How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer
(Azure | Databricks | PySpark | SQL)
Contract | Remote | UK Public Sector Project
Overview
We are seeking a Senior Data Engineer to support the delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery teams to implement pipeline builds, data models, and integration patterns aligned to the organisation’s new Target Operating Model for Data.
You will contribute to the development of scalable data flows, optimise ingestion & transformation activities, and ensure solutions meet technical standards, performance expectations, and security controls. This is a hands-on engineering role ideal for someone who enjoys building, shaping, and improving modern data platforms.
Who We're Looking for
A highly capable Data Engineer with hands-on experience building ETL pipelines, implementing Data Lake architectures, and working across Azure platform services. You will need strong problem-solving ability, a solid engineering mindset, and the ability to work collaboratively within a multi-disciplinary team.
If you’re confident writing production-grade code, applying design patterns, and building scalable, high-performing data products, this role offers technical autonomy, ownership, and challenge.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Responsibilities
- Build and maintain ETL pipelines and code in cloud data platforms.
- Support ingestion activity and onboarding of new data sources.
- Work with the Databricks Data Intelligence Platform and develop Data Engineering workloads.
- Construct raw, refined and curated data layers; catalogue assets appropriately.
- Validate solutions against functional and non-functional requirements.
- Deliver datasets, transformations and performance-optimised data products.
- Improve processes, engineering patterns, and reusable tooling.
- Monitor and measure pipeline performance; support incident resolution.
- Ensure documentation meets acceptance standards and is approved centrally.
- Actively engage in Agile ceremonies and governance forums.
Mandatory Responsibilities
- Strong experience with Python, PySpark & SQL for data engineering.
- Hands-on experience with Azure Databricks.
- Strong knowledge of Azure Data Factory & Fabric.
- Experience with Microsoft Purview.
- Familiarity with Event-driven data ingestion (Event Grid / Pub-Sub).
- Understanding of SOLID principles, Async programming, Mediator/Factory patterns.
- Experience delivering unit + integration testing in Databricks.
- Knowledge of Secure ETL design with Entra IMID/SCIM integration.
- Understanding of Azure best practices, APIM, and platform governance.
- Ability to build and serve Power BI models via Databricks data sources.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Required Skills
- Prior experience working within UK Public Sector environments.
Soft Skills
- Strong stakeholder communication and cross-team collaboration.
- Analytical and solution-focused mindset.
- Able to work independently, take ownership and drive progress.
- Commitment to clean, scalable, well-documented engineering.
- Adaptable, proactive, and comfortable working in dynamic delivery environments.
Contract Details
- Contract Type: Freelance / Contract - Outside IR35
- Location: Remote (UK-based candidates preferred)
- Start Date: ASAP
- Clearance: Candidates must be eligible to work with UK Government departments / BPSS.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location