TrueNorth®
Lead Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Lead Data Engineer (SC Cleared)
Contract: Inside IR35
Rate: Up to £425 per day
Location: Remote
Clearance: Active SC Clearance required
We're supporting a major government digital transformation programme and are seeking an experienced Lead Data Engineer to provide technical leadership across the design, delivery and governance of enterprise-scale cloud data platforms.
This is an excellent opportunity to lead a team of engineers working on complex, high-volume data solutions within a modern AWS-based data environment.
What You'll Be Doing
- Leading data engineering delivery across multiple workstreams, ensuring high-quality sprint outputs and technical excellence
- Designing complex data pipeline patterns for large and highly complex datasets
- Defining and governing reusable data engineering standards, frameworks and best practices
- Leading the implementation of Change Data Capture (CDC), incremental loading and large-scale data ingestion solutions
- Conducting technical design reviews and code reviews to ensure performance, scalability and maintainability
- Supporting the successful handover of reusable patterns and solutions across delivery teams
- Mentoring and developing Data Engineers within an agile environment
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Essential Skills
- Extensive experience leading Data Engineering teams and projects
- Expertise in large-scale data pipeline design and architecture
- Strong experience with Change Data Capture (CDC) and incremental data loading
- Data engineering pattern development and governance
- Technical leadership, mentoring and code review experience
- Strong cloud data platform experience within AWS environments
- Infrastructure as Code using Terraform
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Technical Environment
- AWS Glue
- Amazon S3
- MWAA (Managed Workflows for Apache Airflow)
- Apache Iceberg
- Python
- PySpark
- Terraform
Requirements
- Active SC Clearance is essential
- Proven experience delivering complex cloud data solutions within enterprise-scale environments
- Strong stakeholder engagement and technical leadership capabilities
- Ability to guide engineering standards and best practices across a delivery team
This fully remote contract offers the opportunity to play a key role in the delivery of a large-scale public sector data transformation programme, leading the design and implementation of modern cloud-native data solutions.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location