Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Data Engineer
Data Scientist - Advanced Analytics
🌟 About the Role
As a Data Engineer, you will be responsible for designing and building integration pipelines that connect CDS source systems to an advanced AI platform. You will create reliable ingestion frameworks, manage data onboarding initiatives, and ensure that critical enterprise data is available for downstream AI and analytics workloads.
Working alongside Knowledge Engineers, platform teams, and stakeholders, you will help establish a scalable, event-driven architecture capable of supporting a rapidly expanding data ecosystem.
🚀 Key Responsibilities
- Build and maintain source-system integrations using modern event-driven architectures
- Develop ingestion pipelines using:
- Webhooks
- API Gateway
- AWS Lambda
- EventBridge
- SQS
- Design and implement watermark and state-tracking mechanisms using DynamoDB
- Perform reconciliation processes to identify and resolve webhook delivery gaps without increasing load on source systems
- Integrate data from new CDS source systems including platforms such as Confluence, Jira, and other enterprise applications
- Support data migration and historical backfill activities for new data sources
- Collaborate with Knowledge Engineers to ensure data quality, consistency, and usability
- Monitor and optimize integration pipelines for performance, reliability, and scalability
- Troubleshoot ingestion and integration issues across multiple systems and environments
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
🎯 Essential Skills & Experience
- Strong experience building integrations against source-system APIs, including:
- REST APIs
- Webhooks
- Event streams
- Hands-on experience developing event-driven ingestion architectures
- Expertise with:
- AWS API Gateway
- AWS Lambda
- Amazon EventBridge
- Amazon SQS
- DynamoDB
- Experience implementing state management, watermark tracking, and reconciliation processes
- Strong Python development skills for integration and pipeline engineering
- Experience with data migration tools and approaches, including AWS DMS
- Understanding of scalable cloud-native data architectures
- Experience onboarding and integrating multiple enterprise data sources
- Strong analytical, troubleshooting, and problem-solving skills
Get help with your application
Your very own career expert that helps elevate your application to the next level.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location