twentyAI
Senior Data Engineer - TWE45927
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer
Contract: 12-Month Contract (Outside IR35)
Location: London (Hybrid)
Overview
We are supporting a leading private equity firm in the build of a greenfield data warehouse and portfolio monitoring platform. This is a key contract opportunity for an experienced Data Engineer to lead the design, architecture, and implementation of a modern cloud-based data platform using Databricks on Azure.
The successful consultant will be responsible for establishing the core data infrastructure, building scalable ingestion frameworks, implementing reconciliation controls across multiple data sources, and ensuring robust governance and quality assurance processes are embedded from day one.
What you'll do:
- Design and build a new Databricks environment on Azure from the ground up.
- Define the architecture and technical standards for the data warehouse and portfolio monitoring platform.
- Design and implement data ingestion pipelines from:
- Aztec (SFTP / file-based integrations)
- Canoe (API-based integrations)
- Build and maintain scalable ETL/ELT processes using Python and SQL.
- Develop an automated reconciliation framework comparing Aztec and Canoe data sources.
- Implement data quality controls, validation checks, and exception management processes.
- Establish formal QA, testing, and approval gates across the data lifecycle.
- Work closely with business stakeholders, operations teams, and third-party vendors to gather requirements and deliver solutions.
- Produce technical documentation and support knowledge transfer activities.
- Ensure the platform is secure, scalable, auditable, and production-ready.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What we're looking for:
Get help with your application
Your very own career expert that helps elevate your application to the next level.
- 5+ years' experience in Data Engineering or Data Platform Engineering roles.
- Strong commercial experience with Databricks and Azure.
- Advanced Python development skills.
- Strong SQL and data modelling experience.
- Proven experience building cloud-based data warehouses and data platforms.
- Experience designing and implementing ETL/ELT pipelines.
- Experience integrating data from APIs and file-based/SFTP sources.
- Strong understanding of data quality, governance, and testing frameworks.
- Experience delivering greenfield data platform implementations.
- Ability to work independently and engage effectively with technical and business stakeholders.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location