Resource 1 is in need of a Sr. Data Engineer for a full-time/ permanent position with our client in Naperville, IL. Candidate must be local to Illinois because of future hybrid onsite in Naperville expected. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus.
This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual will work within cross-functional Agile teams, collaborating with product owners, business analysts and other engineers to design and deliver data solutions that power business insights and AI products.
Responsibilities:
• Design and develop scalable data pipelines for ingestion, transformation and integration using AWS services.
• Pull data from PostgreSQL and SQL Server to migrate to AWS.
• Create and modify jobs in AWS and modify logic in SQL Server.
• Create SQL queries, stored procedures and functions in PostgreSQL and RedShift.
• Provide input on data modeling and schema design as needed.
• Manage infrastructure through infrastructure-as-code templates (Serverless Framework), supporting new data products and services in AWS.
• Support inbound/ outbound data flows, including APIs, S3 replication and secured data.
• Assist with data visualization/ reporting as needed.
• Follow an Agile development methodology, with regular workshops and standup meetings, working in two-week sprints.
Qualifications:
• 5+ years of data engineering experience.
• Experience with AWS and its associated array of offerings (Glue, Redshift, Athena, S3, Lambda, Spectrum).
• Strong experience with SQL, Python and PySpark.
• A background in supply chain, logistics or distribution would be a plus.
• Experience with Power BI is a plus.
