Robert Walters
Lead Databricks Platform Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Job Title: Lead Databricks Platform Engineer (Contract)
Location: Remote (UK-based)
Day Rate: Up to £550 p/d (Outside IR35)
Contract: 6-Month initially
No sponsorship offered - Applicants must have RTW in the UK and their own Ltd company
We're looking for a hands-on Lead Databricks Platform Engineer to join a global software vendor and take ownership of a modern data ecosystem, driving data engineering excellence, platform optimisation, and AI enablement. You'll lead a team of 6+ engineers, set best practices, and ensure the Databricks platform is reliable, scalable, and cost-effective.
Key Responsibilities
- Lead, coach, and mentor 6+ data engineers in modern, AI-enabled practices.
- Own and optimise Databricks (Delta Lake, Unity Catalog, MLflow, Databricks SQL).
- Redesign data pipelines for maximum scalability, performance, and cost efficiency.
- Champion Python engineering best practices (CI/CD, testing, code reviews).
- Drive DataOps and MLOps to ensure strict observability, governance, and seamless lifecycles.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What We're Looking For
- 5+ years in data engineering with 2+ years scaling Databricks environments.
- Deep expertise in Apache Spark, PySpark, Unity Catalog, and MLflow.
- Strong production Python background with robust CI/CD experience.
- Proven track record of optimising Databricks environments for cost and performance.
- Experience leading engineering teams and establishing modern best practices.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
If interested in this Lead Databricks Platform Engineer role please apply with your latest WORD CV.
Desired Skills and Experience
What We're Looking For
- 5+ years in data engineering with 2+ years scaling Databricks environments.
- Deep expertise in Apache Spark, PySpark, Unity Catalog, and MLflow.
- Strong production Python background with robust CI/CD experience.
- Proven track record of optimising Databricks environments for cost and performance.
- Experience leading engineering teams and establishing modern best practices
Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location