As a Data Engineer, you will play a key role in developing and enhancing our cloud data platform using Microsoft Azure. Your work will involve designing data pipelines, processing large volumes of data, and working with tools like Azure Databricks to turn raw data into valuable insights.
Responsibilities:
• Design, develop, and maintain scalable data pipelines using Azure Databricks, Azure Data Factory, and other cloud tools.
• Automate data ingestion, transformation, and storage processes to ensure reliable and efficient data flow.
• Collaborate with data analysts to prepare, cleanse, and model data for reports and dashboards in Power BI.
• Perform proof of concept and testing for new cloud data solutions.
• Document data architecture, workflows, and operational procedures for ongoing support and troubleshooting.
• Engage with external vendors for platform enhancements and upgrades.
Must-Have Skills and Experience:
• Bachelor’s degree in Computer Science, IT, Data Science, or related field.
• At least 3 years of experience working on data platforms.
• Hands-on experience with Azure Databricks, SQL, Python, Spark, and Azure Data Factory.
• Certification in Azure Data platform or Databricks is a plus.
• Responsible, proactive, and detail-oriented.
