CHEP helps move more goods to more people, in more places than any other organization on earth via our 300 million pallets, crates and containers. We employ 11,000 people and operate in more than 55 countries. Through our pioneering and sustainable share-and-reuse business model, the world’s biggest brands trust us to help them transport their goods more efficiently, safely and with less environmental impact.
What does that mean for you? You’ll join an international organization big enough to take you anywhere, and small enough to get you there sooner. You’ll help change how goods get to market and contribute to global sustainability. You’ll be empowered to bring your authentic self to work and be surrounded by diverse and driven professionals. And you can maximize your work-life balance and flexibility through our Hybrid Work Model.
Job Description
Our ambition is to support the digital transformation of Brambles by laying the foundations for global DataOps, to deliver high performing, cost-effective and reliable data pipelines in our Data & Analytics ecosystem.
You will work on our new Databricks platform which we’re using for data science and machine learning, data engineering and analysis. Like every other enterprise in the world it seems, we’re even building private RAG-LLM architectures. We need your help to manage our platform configs with tools like Terraform, assure high availability, optimise the performance of our pipelines, manage our compute costs, and support our new base of users. You could also be implementing and managing our new data observability capabilities. The work will be wide and varied and we’ll invest in your development and training to take your existing Databricks, and IaC or MLOps, experience deeper and further.
As a DataOps Engineer, you will be a core member of our Databricks team as they develop and implement the user, cluster and unity catalog governance schemes and processes. They’ll implement various CI/CD processes, including helping to get our continuous and automated testing program off the ground.
The role will work very closely with our Cloud Engineering team to ensure a joined-up approach to our environment management. Some of the work may be performed under the direction of the Cloud Engineering team.
This role is focused primarily on Databricks on AWS but also needs to be aware of:
• Interactions between the Databricks environment and MLOps frameworks such as MLFLow.
• Other platforms in the D&A ecosystem such as Thoughtspot, Salesforce & PowerBI.
ACCOUNTABILITIES
• Implement and maintain infrastructure as code (IaC) using Terraform for our Databricks environments and associated systems.
• Manage Databricks credentials and secrets via Terraform and CI/CD processes.
• Collaborate with our Data Science, Cloud Engineering & Data Engineering teams to align the Databricks environment with application requirements.
• Work with Data Scientists & Machine Learning Engineers to ensure optimal performance of data models and pipelines.
• Support in the development and maintenance of robust high availability processes for the platform.
• Conduct regular fire drills and tests to validate the effectiveness of our recovery solutions.
• Collaborate with data security teams to ensure our deployment adheres to Brambles’ security standards.
• Support the implementation of a cluster policy governance framework.
• Support & maintain implementation of a comprehensive application tagging process.
• Manage dependencies and open-source libraries, identifying vulnerabilities, incompatible or out of date versions.
EXPERIENCE
• At least five years’ experience in Data Engineering, IaC or MLOps.
• Experience of Databricks Administration and Terraform. Using Databricks as a DS or DE is useful experience but we’re really looking Databricks Administration experience.
• Understanding of MLOps frameworks and practices.
• Familiarity with cloud-based services and engineering.
TECHNICAL SKILLS
• Databricks.
• Terraform.
• MLFlow.
• CI/CD tools such as Jenkins, Gitlab, or Travis CI.
• Containerisation & orchestration.
• Version control.
• Environment management & virtualization.
• Monitoring & logging.
• API integration.
• Scripting & programming languages such as Python, Bash, or Powershell.
PERSONAL SKILLS
• Strong analytical and problem-solving skills.
• Able to present results to non-engineering audiences.
• Ability to operate at a detailed level when needed while also influencing and build credibility at senior executive levels.
• Excellent communication, relationship building, stakeholder management and influencing abilities.
Preferred Education
Bachelors
Preferred Level of Work Experience
3 - 5 years
We are an Equal Opportunity Employer and we are committed to developing a diverse workforce in which everyone is treated fairly, with respect, and has the opportunity to contribute to business success while realizing his or her potential. This means harnessing the unique skills and experience that each individual brings and we do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state, or local protected class.
Individuals fraudulently misrepresenting themselves as Brambles or CHEP representatives have scheduled interviews and offered fraudulent employment opportunities with the intent to commit identity theft or solicit money. Brambles and CHEP never conduct interviews via online chat or request money as a term of employment. If you have a question as to the legitimacy of an interview or job offer, please contact us at recruitment@brambles.com
