RJC Group
Senior Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer ~ £700pd (Inside IR35) ~ Python
We are looking for a Senior Data Engineer with strong technical experience in Python, Databricks, SQL and PySpark alongside strong overall data engineering experience, this is an exciting opportunity to join the technology team of a global leader in the energy and commodities trading sector!
Key Responsibilities:
- Design, develop and maintain scalable, high-performance data pipelines using Databricks on AWS
- Build and optimise Delta Lake architectures to ensure reliable, secure and efficient data storage for trading and analytics
- Develop and enhance the Front Office data platform, enabling traders and business users to access high-quality data for reporting, analytics and decision-making
- Work closely with Data Scientists, Quantitative Analysts and Machine Learning Engineers to prepare data for AI and machine learning models
- Implement and maintain CI/CD processes, automated testing and monitoring to improve the reliability and quality of data engineering solutions
- Support MLOps processes including model deployment, lifecycle management and monitoring using MLflow
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills:
- 8+ years' experience delivering enterprise-scale data engineering solutions
- Expert-level knowledge in: Apache Spark, PySpark, and Databricks—including experience with Delta Lake, Unity Catalog, MLflow, and Databricks Workflows.
- Advanced Python and SQL development skills
- Strong experience with AWS cloud services (S3, Lambda, Glue, API Gateway, IAM, EC2, EKS)
- Integration of AWS-native components with Databricks
- Strong understanding of CI/CD, DevOps and Infrastructure as Code
- Experience implementing robust DevOps practices for data engineering
- Experience in commodity trading markets is beneficial!
Get help with your application
Your very own career expert that helps elevate your application to the next level.
The Role:
- Senior Data Engineer
- Hybrid (3 days in office, 2 from home)
- Location: London
- Salary: £700pd (Inside IR35)
If you think you'd be a good fit, don't hesitate to apply with your latest CV attached for immediate consideration!
Contact: Ella.Lyons@rjcgroup.co.uk
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location