iO Associates
Lead Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About the Role
My client is seeking an experienced Lead Data Engineer to drive the design, delivery, and evolution of a modern data platform built on Databricks, Microsoft Fabric, Azure Synapse, and Azure. This is a hands-on technical leadership role where you'll guide a team of Data Engineers, set engineering standards, and deliver scalable, secure, high-performing data solutions.
What You'll Lead
- Lead and mentor a high-performing Data Engineering team.
- Act as the technical SME across Databricks, Fabric, Synapse, and Azure.
- Own solution design, implementation strategy, and technical delivery.
- Build and optimise pipelines using PySpark, Spark SQL, ADF, Synapse Pipelines, or Fabric Pipelines.
- Define engineering best practice, conduct code reviews, and uplift quality.
- Develop secure, performant SQL solutions.
- Manage Azure DevOps Boards, Repos, and CI/CD Pipelines.
- Collaborate with architects, product owners, and stakeholders.
- Drive Agile delivery, sprint planning, and continuous improvement.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What You'll Bring
- Proven leadership of Data Engineering teams.
- Strong commercial experience with Databricks, Microsoft Fabric, or Azure Synapse.
- Deep expertise in PySpark, Spark SQL, and SQL optimisation.
- ETL/ELT pipeline development and orchestration.
- Experience building scalable cloud-based data platforms.
- Hands-on Azure DevOps experience—Boards, Repos, CI/CD.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Nice to Have
- Graph databases (Neo4j).
- Snowflake experience.
- AI-assisted development tools (Claude, GitHub Copilot).
- Azure DevOps Pipelines.
- Broad experience across Databricks, Fabric, and Synapse.
Preferred Certifications
- Microsoft Fabric Analytics Engineer Associate.
- Microsoft Fabric Data Engineer Associate.
- Databricks Professional Certification.
- Snowflake Certification.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location