We are seeking a Databricks Engineer with over 5 years of experience in data engineering. The ideal candidate will have strong hands-on expertise in Azure Databricks, PySpark, Python, and SQL for large-scale data processing.
Key responsibilities and qualifications include:
• Proven experience in building end-to-end ETL/ELT pipelines on Azure, capable of handling structured and semi-structured data.
• Strong knowledge of Databricks Delta Lake, including Delta Live Tables (DLT) and streaming pipelines (preferred).
• Solid understanding of data modeling concepts, including Slowly Changing Dimensions (SCD) Type 1 & Type 2 implementations.
• Good working knowledge of Azure Data Factory (ADF) for orchestration and pipeline management.
• Experience with Medallion Architecture (Bronze, Silver, Gold layers) and data quality best practices.
• Exposure to AI/ML-driven use cases or analytics workloads is a strong plus; knowledge or experience with Snowflake or migration projects is also desirable.
Location: Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates
Work Conditions: Hybrid, Full-time
