Data Engineer - Python | Databricks | Pyspark

London 5 months ago Remote Full-time External
Negotiable
Job Description Data Engineer – Python | Databricks | PySpark Company: Fortune 500 Financial Services firm Location: Hybrid - London Type: Permanent Salary: £90k + 20% bonus + Exceptional Benefits Exclusively via DATAHEAD Are you a detail-oriented Python Developer who thrives in complex data environments? Do you have hands-on experience with Databricks , PySpark , and cloud-native data engineering? We’re hiring a Data Engineer on behalf of a Fortune 500 firm undergoing a major data and analytics transformation. You’ll join a global Advanced Analytics function working at the cutting edge of data science, engineering, and AI. Why this role? You’ll join a cross-functional team that includes data scientists, actuaries, software engineers, and AI specialists - all working together to build intelligent data platforms that power business-critical decisions across the organisation. This is a cloud-first, engineering-led environment where you’ll play a key role in developing high-quality, scalable data products. What You’ll Do: • Build and maintain scalable Python applications using Databricks and PySpark • Design and optimise robust data pipelines and processing frameworks • Write clean, modular, and testable code aligned with SOLID principles • Contribute to CI/CD pipelines , automated testing frameworks, and deployment tools • Collaborate with stakeholders across data science, analytics, and engineering • Build and expose RESTful APIs for secure data integration across platforms • Help shape the data architecture that underpins machine learning and AI models What You’ll Bring: • Proven experience developing in Python for data-intensive applications • Hands-on expertise with Databricks and PySpark • Strong grasp of cloud data platforms and modern engineering practices • Familiarity with CI/CD, version control (e.G. Git), and automated testing • Ability to work effectively in cross-border, cross-functional teams • A proactive, delivery-driven mindset with strong attention to detail What’s in It for You: • Excellent salary + performance bonus • Private medical and dental cover, enhanced pension, life insurance, income protection • Flexible working options, including holiday buy/sell and season ticket loans • Training budget and career development pathways in a forward-thinking, data-driven organisation • Exposure to global projects in a high-impact function This opportunity is with a Fortune 500 company known for its long-term thinking, innovation, and technical excellence. With operations spanning over 20 countries, the firm is investing heavily in data and analytics to shape its future – and this role is crucial to that mission.