Senior Data Engineer

Dubai Tax Free2 months agoFull-time External
135.6k - 232.5k / yr
Key Responsibilities • Ingestion&Pipelines: Architect batchstream pipelines (Airflow Kafka dbt) for diverse structured and unstructured marked data. Provide reusable SDKs in Python and Go for internal data producers. • Storage&Modeling: Implement and tune S3 columnoriented and timeseries data storage for petabytescale analytics; own partitioning compression TTL versioning and cost optimisation. • Reliability & Observability : Embed monitoring alerting SLAs SLOs and CI/CD; champion automated testing data quality dashboards and incident runbooks. • Collaboration: Partner with Data Science QuantResearch Backend and DevOps to translate requirements into platform capabilities and evangelise best practices. Qualifications : • 6 years of experience building and maintaining production-grade data systems with proven expertise in architecting and launching data lakes from scratch. • Expert-level Python development skills (Go and C nice to have). • Hands-on experience with modern orchestration tools (Airflow) and streaming platforms (Kafka). • Advanced SQL skills including complex aggregations window functions query optimisation and indexing. • Experience designing high-throughput APIs (REST/gRPC) and data access libraries. • Solid fundamentals in Linux containerization (Docker) and cloud object storage solutions (AWS S3 GCS). • Strong knowledge of handling diverse data formats including structured and unstructured data with experience optimising storage strategies such as partitioning compression and cost management. • English at C1 level - confident communication documentation and collaboration within an international team. Additional Information : What we offer : • Working in a modern international technology company without bureaucracy legacy systems or technical debt. • Excellent opportunities for professional growth and self-realization. • We work remotely from anywhere in the world with a flexible schedule. • We offer compensation for health insurance sports activities and professional training. Remote Work : Yes Employment Type : Full-time