Bourne Search Ltd
Senior Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Principal Data Engineer | Financial Exchange | London, 3 days on site
A London exchange is building a trading data platform from scratch, in house, on open source. Spark, Polaris, Ranger, Airflow, Kafka, MinIO. This is the person who designs it, builds it and owns it.
Why now
The analytics function is running on legacy warehouses that were never built for the volume or the velocity of trading data. The decision has been taken to consolidate them into a single lakehouse handling streaming and batch together, and to build it in house rather than buy it. From a trading perspective, this is genuinely greenfield. You are joining while the architecture is still an open question, not after it has been decided.
Your first year
- Design the lakehouse and set the patterns everything else follows
- Build streaming and batch ingestion on one platform, not two
- Migrate the legacy warehouses off and decommission them
- Stand up governance, cataloguing and access control with Polaris and Ranger
- Make the platform self-service so the analytics team stops queuing behind engineering
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Who you would work with
You report into UK technology at VP grade, with the CTO directly involved in how the platform is shaped. A Senior Data Engineer is being hired alongside this role, so you are building the team, not inheriting one.
What we actually need
- Strong SQL and Python. These are the working languages of the platform.
- You have built and scaled a data platform at terabyte scale and dealt with the performance problems that come with it
- Real experience of on-prem or hybrid infrastructure. If everything you have run has been managed cloud services, the way these components fit together here will be unfamiliar.
- Distributed systems across both streaming and batch
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Useful, not essential
- Financial markets background, any asset class.
- Java or another JVM language
- Hadoop, S3-compatible object storage, open table formats
- Kafka certification
Nobody has all of this. If you have the first list, apply.
Process
Three stages: an introductory call, a technical discussion built around real scenarios rather than a timed coding test, and a conversation with the CTO. We are moving quickly and want this filled before year end.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location