Cognitive Group | Part of the Focus Cloud Group
Data Ingestion Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Location: Hybrid London Type: Contract Duration: 6 months+ extension
We’re looking for a Data Ingestion Engineer with experience working in the robotics industry. You will work with the Data team to improve the reliability, efficiency, and throughput of the pipelines that move real-world driving data through the client.
Key Responsibilities:
- Debug and fix failing or blocked ingestion pipelines.
- Investigate issues caused by corrupt, malformed, or unexpected data.
- Help make our pipelines more resilient so individual bad data segments do not block wider workflows.
- Improve how we handle varied data formats from partners, suppliers, and third-party sources.
- Support orchestration across multi-step ingestion workflows, including dependencies, retries, and queue management.
- Optimise Spark jobs and data processing pipelines for throughput and compute efficiency.
- Reduce operational toil around failed jobs, stalled pipelines, and manual interventions.
- Work on high-volume batch processing systems where throughput, reliability, and cost all matter.
- Help prioritise and unblock important datasets for downstream annotation, data science, and model training teams.
- Partner with permanent engineers to keep critical ingestion work moving while longer-term platform improvements are developed.
- Contribute pragmatic improvements that make the system easier to operate, scale, and trust.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Essential
- Strong production experience with Apache Spark.
- Strong Python engineering experience.
- Experience building, debugging, or operating large-scale data ingestion, ETL, or data processing pipelines.
- Experience with distributed data processing systems.
- Ability to optimise jobs for throughput, compute efficiency, and reliability.
- Experience debugging production pipeline failures.
- Experience working in the robotics sector
Get help with your application
Your very own career expert that helps elevate your application to the next level.
If you're looking for a new opportunity and would be interested please apply.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location