Senior Data Engineer | Commodities & Energy Trading | ClickHouse-Centric Data Platform | Next-Gen Lakehouse | Python, SQL | Up to £89K + Bonus + Benefits
A Senior Data Engineer is required for a leading global Energy & Commodities trading house — one of the world’s largest and most diverse general trading companies. Their trading ecosystem spans multiple commodities and markets, creating high-volume, high-velocity data challenges ideally suited to ClickHouse and modern data engineering.
Role Overview — ClickHouse at the Core
As a Senior Data Engineer, you will play a pivotal role in building and scaling a ClickHouse-driven analytical data platform. You’ll be a senior member of the Core Engineering team, shaping the architecture and implementing high-performance data solutions used directly by trading, risk, analytics and operational teams.
This is a hands-on position where you’ll guide a small team of engineers while designing and developing a next-generation lakehouse architecture. ClickHouse will form the backbone of the system, supporting ultra-fast analytics, market-data ingestion, tick-data storage, and real-time insights for traders and quantitative teams.
You will also work with complementary technologies such as Databricks, Snowflake, Azure Synapse/Fabric, and PySpark — but the focus is on extracting the full performance and scalability of ClickHouse within an enterprise-grade data ecosystem.
What You’ll Do
• Design, build, and optimise high-performance ClickHouse clusters for large-scale analytical workloads across commodities and energy trading.
• Develop ingestion frameworks for market data, pricing data, tick data, and trade/position datasets, leveraging ClickHouse’s columnar storage and real-time querying.
• Architect and maintain a modern lakehouse platform integrating ClickHouse with Databricks, Snowflake, and Azure-based services.
• Define and enforce best practices for data modelling, partitioning, compression, and query optimisation tailored for ClickHouse.
• Build scalable Python-based ETL/ELT pipelines and data services that deliver robust, low-latency data to trading, risk, and analytics teams.
• Integrate ClickHouse with BI tools such as Power BI and Tableau, enabling ultra-fast dashboarding and near real-time reporting.
• Collaborate closely with the Head of Core Engineering to shape the long-term data strategy and engineering roadmap.
Key Skills & Experience
• Strong commercial experience with ClickHouse (schema design, cluster configuration, performance tuning, ingestion pipelines).
• Solid understanding of modern data engineering principles and lakehouse architectures.
• Strong Databricks and PySpark experience.
• Proficiency in Python and SQL.
• Experience working with Azure and DevOps/cloud-native tooling.
• Proven background in data orchestration, ETL/ELT pipelines, and data modelling.
• Familiarity with integrating data platforms with BI tools (Power BI, Tableau).
• Experience in commodities, energy, or financial-markets data is highly advantageous.
Role Details
• Salary: Up to £89,000 per annum + Bonus & Benefits
• Location: London (Hybrid — 3 days per week onsite)
If you're looking to join a leading global trading company and take ownership of a ClickHouse-driven, next-generation data platform at the heart of a greenfield engineering initiative, we’d love to hear from you.
Senior Data Engineer | Commodities & Energy Trading | ClickHouse-Centric Data Platform | Next-Gen Lakehouse | Python, SQL | Up to £89K + Bonus + Benefits
