Arthur Recruitment
Data Engineer - Azure, DataBricks, PySpark
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Data Engineer - Azure, DataBricks, PySpark
London | Hybrid
Up to £75,000 + 25% Bonus + Excellent Benefits
A leading London Market insurer is continuing to invest in its enterprise data platform and is looking for a Data Engineer to join a growing Data & Analytics function.
The Opportunity
Join a growing Data & Analytics team within a leading London Market insurer investing heavily in its cloud data platform. Working with modern technologies including Azure, Databricks, SQL and Python, you'll play a key role in designing, building and maintaining scalable data solutions that enable smarter decision making across Underwriting, Finance and Operations.
- Collaborate with engineers, analysts and business stakeholders to develop robust data pipelines, improve data quality and optimise cloud-based data processing.
- Work on enterprise-scale data engineering projects while helping shape the future of a modern Azure and Databricks platform.
- Develop your technical skills and progress your career.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What You'll Be Doing
- Designing and developing cloud-based data pipelines using Azure Data Factory and Databricks.
- Building scalable ETL and ELT solutions to ingest and transform data from multiple business systems.
- Developing data solutions using SQL, Python and PySpark.
- Supporting the deployment of production-ready data pipelines using CI/CD and DevOps best practices.
- Working with business stakeholders to understand data requirements and deliver technical solutions.
- Improving data quality, performance and reliability across the data platform.
- Supporting data modelling, orchestration and cloud data architecture initiatives.
- Troubleshooting production issues and continuously improving engineering standards.
- Collaborating with the wider Data & Analytics team to deliver high-value data products.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
What We're Looking For
- Commercial experience as a Data Engineer.
- Strong SQL development skills.
- Experience with Python and/or PySpark.
- Experience working with Microsoft Azure data technologies.
- Exposure to Databricks or a strong desire to develop expertise in the platform.
- Experience building ETL or ELT data pipelines.
- Knowledge of Azure Data Factory or similar integration tools.
- Understanding of Git, source control and CI/CD practices.
- Experience working within Agile delivery environments.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder engagement skills.
- A proactive mindset with a genuine enthusiasm for learning new technologies.
Sound good?
Apply now!
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location