5+ years of experience in data engineering with strong hands-on expertise in Azure Databricks, PySpark, Python, and SQL for large-scale data processing
Proven experience building end-to-end ETL/ELT pipelines on Azure, handling structured and semi-structured data
Strong knowledge of Databricks Delta Lake, including Delta Live Tables (DLT) and streaming pipelines (good to have)
Solid understanding of data modeling concepts, including SCD Type 1 & Type 2 implementations
Good working knowledge of Azure Data Factory (ADF) for orchestration and pipeline management
Experience working with Medallion Architecture (Bronze, Silver, Gold layers) and data quality best practices
Exposure to AI/ML-driven use cases or analytics workloads is a strong plus
also, knowledge or expereince on snowflake or migration projects
