Fairmont Recruitment Technology
Data Engineering Lead
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Data Engineering Lead
Central London (1 Day per week)
£75,000 - £80,000
Excellent pension
30 Days Holiday
Private Medical
About the role
We are recruiting a Data Engineering Lead to provide senior technical leadership across a large-scale AWS data platform supporting a major organisation.
This role combines hands-on technical expertise with team leadership, platform ownership, and architectural decision-making. You will act as the senior authority on data engineering, helping ensure the platform remains reliable, scalable, and capable of supporting increasingly complex data requirements.
You will work closely with senior data and architecture leaders while mentoring engineers and improving engineering standards across the wider organisation.
Key responsibilities
- Lead the development, operation, and improvement of the AWS data platform
- Oversee the delivery of complex batch and streaming data pipelines
- Make technical decisions around architecture, data models, storage, and engineering tooling
- Improve platform resilience, scalability, performance, and availability
- Set standards across coding, testing, monitoring, documentation, and DataOps
- Mentor and support data engineers at different levels
- Act as the senior escalation point for complex data engineering issues
- Work closely with Architecture, Information Security, and Quality Assurance teams
- Collaborate with external partners on integrations and platform development
- Translate business requirements into practical technical solutions
- Help prioritise engineering work and support the organisation’s wider data strategy
- Ensure suitable operational controls and monitoring are in place
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Technical environment
The platform uses a broad range of AWS services, including:
- Redshift
- S3
- Glue
- Lambda
- Athena
- EC2
- Kinesis Firehose
The engineering environment also makes extensive use of Python, SQL, and Bash, with data arriving through both legacy and modern source systems.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Essential experience
- Strong, recent hands-on AWS data engineering experience
- Advanced SQL skills, including optimisation across very large datasets
- Strong Python development experience
- Experience building batch and streaming data pipelines
- Knowledge of data warehouses, data lakes, and modern data storage patterns
- Experience with distributed processing technologies such as Spark
- Strong understanding of CI/CD, DevOps, and DataOps practices
- Experience setting engineering standards and improving code quality
- Previous technical leadership or mentoring experience
- Strong stakeholder management and communication skills
Desirable experience
- Experience working with exceptionally large datasets
- Exposure to complex operational environments
- Experience integrating legacy systems, fixed-width files, and REST APIs
- Experience working with external technology and delivery partners
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location