Compare the Market
Principal Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Principal Data Engineer
Function: Data / Technology
Location: London / Peterborough
Curious about what’s next?
So are we. Join Compare the Market and help to make financial decision making a breeze for millions.
At Compare the Market, we’re a purpose-driven business powered by tech and AI. We’re building high-performing, results-driven teams with the skills, mindset, and ambition to deliver outcomes at pace. Every role here plays a part in driving our mission forward, and we create an environment where you can bring your authentic self, grow a truly characterful career, and see the direct impact of your work on the lives of our customers.
We’ve carved a meerkat-shaped niche and we’re looking for ambitious, curious thinkers who thrive in a fast-moving, high-impact environment. If you love accountability, embrace challenge, and want to make a real difference, you’ll fit right in.
What you’ll be doing:
- Own the Data Platform architecture and strategy, defining the long-term target state and setting clear standards and guardrails to ensure scalability, resilience, and cost efficiency.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
-
Set the engineering bar by establishing best practices across data ingestion, streaming, transformation, modelling, CI/CD, orchestration, testing, observability, and governance.
-
Act as the senior technical authority across data engineering, influencing architecture decisions and leading the Data Engineering Community of Practice to raise capability across the organisation.
-
Champion “data as a product”, ensuring datasets and platform services are reliable, discoverable, reusable, and governed with clear ownership and service expectations.
-
Drive strategic technical direction while remaining hands-on where it matters—reviewing designs, validating patterns, and guiding complex problem-solving without becoming a delivery bottleneck.
What we’re looking for:
-
Extensive experience in Data Engineering within modern, cloud-based data platforms.
-
Deep expertise in streaming-first architectures, with strong knowledge of batch processing approaches.
-
Strong experience across AWS data ecosystems, Databricks, dbt, CI/CD practices, and orchestration frameworks.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
-
Proven track record of defining and implementing large-scale platform architecture and engineering standards.
-
Strong understanding of data modelling, ingestion patterns, performance optimisation, observability, governance, and security.
-
Experience influencing senior engineers and stakeholders across multiple teams without formal authority.
-
Experience leading engineering communities of practice and raising technical standards at organisational scale.
-
Ability to operate independently in complex, high-impact environments.
Why Compare the Market?
We’re a business built for pace and performance. Here, you’ll be encouraged to think differently, act boldly, and deliver brilliantly in a culture that values results and rewards progress.
We believe diverse teams make better decisions, and we’re committed to creating an inclusive workplace where everyone feels empowered to grow, contribute, and thrive.
If you’re ready to stretch yourself, raise the bar, and grow with a team that’s serious about performance, innovation, and purpose, we’d love to hear from you
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location