Sr Data Engineer - 15 + years and locals

San Francisco 20 days agoFull-time External
Negotiable
Dice is the leading career destination for tech experts at every stage of their careers. Our client, NMK Global Inc., is seeking the following. Apply via Dice today! Hi Hope you doing good.! Position : Sr Data Engineer. Hybris :Local to bay area 1 day onsite a must Strong Python and Pyspark Good with Data Structures and algorithms 15+yrs experience required Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platform s services. Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services. Qualifications Experience building and optimizing data pipelines in a distributed environment Experience supporting and working with cross-functional teams.. Proficiency working in Linux environment working knowledge of SQL, Python, and PySpark Git/Bitbucket, Jenkins/CodeBuild, CodePipeline