Venturi
Senior Python / PySpark Data Engineer (Azure Databricks)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Python / PySpark Data Engineer (Azure Databricks)
Remote (UK)
£425/day
Outside IR35
Long-Term Contract
About the Role
We're partnering with a global technology organisation delivering enterprise-scale cloud data platforms for major international clients.
We're looking for an experienced Senior Python / PySpark Data Engineer to join an established Azure Data Engineering team, working on the design, development and optimisation of scalable data solutions within Azure Databricks.
This is a hands-on engineering role suited to someone who enjoys solving complex technical challenges, writing high-quality code and taking ownership of technical delivery.
Key Responsibilities
- Design and develop data solutions using Azure Databricks.
- Build scalable data pipelines with Python and PySpark.
- Develop batch and streaming data processing solutions.
- Analyse complex datasets and build efficient data models.
- Deliver robust, production-ready ETL/ELT pipelines.
- Collaborate with other engineers to deliver high-quality cloud data solutions.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Essential Skills
- Strong commercial experience with Azure Databricks.
- Excellent Python and PySpark skills.
- Strong SQL and core Data Engineering experience.
- Experience building enterprise-scale data pipelines.
- Experience with batch and streaming data processing.
- Understanding of Unity Catalog and core Databricks functionality.
Desirable
- Azure DevOps.
- CI/CD pipelines.
- Infrastructure as Code.
- Experience working within enterprise Azure environments.
What We're Looking For
We're looking for engineers who:
- Have strong technical and problem-solving skills.
- Can work independently with minimal supervision.
- Produce clean, maintainable, production-quality code.
- Enjoy working in highly technical engineering teams.
- Take ownership and pride in delivering high-quality solutions.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Technology Stack
Azure Databricks • Python • PySpark • SQL • Azure Data Lake • Unity Catalog • Databricks Jobs • Batch & Streaming Processing • Git • Azure DevOps
What's on Offer
- £425/day.
- Outside IR35.
- Fully remote within the UK.
- Long-term contract.
- Immediate interview process.
Opportunity to work on large-scale cloud data engineering programmes.
Interested?
If you're an experienced Python / PySpark Data Engineer with strong Azure Databricks experience and you're looking for your next Outside IR35 contract, we'd love to hear from you.
Apply today or send your CV for a confidential discussion. We're reviewing applications as they come in, with interviews taking place on a rolling basis.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location