CMC Markets
Senior Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer – Market Data
We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics, and real-time applications.
Key Responsibilities
- Build scalable ETL/ELT pipelines for batch and streaming market data.
- Develop production-grade Python and SQL solutions.
- Ingest, normalize and validate market data, including trades, ticks, Level 1 & 2 quotes, order books, reference data, and corporate actions.
- Implement automated data quality, reconciliation, and monitoring frameworks.
- Optimize data storage using Parquet, Arrow, and modern data lake technologies.
- Partner with quantitative researchers, traders, and engineering teams to deliver trusted datasets.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Essential Skills
- Strong Python and SQL.
- Experience building scalable, production data pipelines.
- Expertise with Parquet and modern data storage formats.
- Deep understanding of high-frequency market data, including tick data, order books, and market data normalization.
- Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate, and out-of-order events.
- Experience with distributed processing (Spark, Polars, Dask, Ray, or similar).
- Experience with Kafka or similar streaming technologies.
- Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+, or similar.
- Docker, Linux, Git, and CI/CD experience.
Highly Desirable
- Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+, or similar.
- Order book reconstruction.
- Tick-to-bar aggregation.
- Airflow, Dagster, Prefect, or MLflow.
- Experience supporting quantitative research or trading systems.
- Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs).
Get help with your application
Your very own career expert that helps elevate your application to the next level.
What We're Looking For
The successful candidate will have a strong background in market data engineering with proven experience building reliable, scalable data platforms.
Our non-negotiable requirements are:
- Expert Python.
- Strong SQL.
- Scalable data pipeline development.
- Apache Parquet.
- Market data normalization.
- Automated data quality controls.
- Deep tick and market data expertise.
Experience in MLOps is advantageous but not essential. We welcome candidates with strong experience in either market data engineering or MLOps, provided they have the skills to build and operate production-grade data platforms.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location