Senior Data Engineer – Databricks

Abu Dhabi Tax Free2 days agoFull-time External
Negotiable
Job role:-Senior Data Engineer ? Databricks Job Location:- Abu Dhabi/Pune/Gurgaon/Bhopal/Chennai/Mumbai Experience:-5+ Years Roles & Responsibilities:- • Design, build, and optimize scalable data pipelines using Databricks (Spark, Delta Lake) • Develop and maintain ETL/ELT workflows for batch and streaming data • Work with structured and semi-structured data from multiple sources • Optimize Spark jobs for performance, cost, and reliability • Implement data quality, validation, and monitoring frameworks • Collaborate with data scientists, analysts, and stakeholders to deliver analytics-ready datasets • Manage data models in data lakes and lakehouse architectures • Ensure data security, governance, and compliance best practices Skills & Requirements:- • 5+ years of experience as a Data Engineer • Strong hands-on experience with Databricks & Apache Spark • Proficiency in Python and/or Scala, SQL • Experience with Delta Lake, Lakehouse architecture • Strong knowledge of ETL/ELT, data modeling, and performance tuning • Experience with cloud platforms (AWS / Azure / GCP) • Familiarity with streaming frameworks (Kafka, Structured Streaming) • Understanding of data governance, security, and access controls • Excellent problem-solving and communication skills