Certain Advantage
Senior Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer – Databricks & DLT (Delta Live Tables)
Central London - 3 days onsite per week (no flex on this)
Certain Advantage are recruiting on behalf of our trading client for a Senior Data Engineer with strong analytical capabilities and hands-on experience in building scalable data solutions using a programming languages like Python or Scala as well as experience in Databricks and Delta Live Tables - This experience is essential.
Suitable candidates will have expertise in Databricks, streaming architectures, data ingestion frameworks, and dashboarding, along with experience working with SAP data sources. You will be responsible for designing and implementing scalable data pipelines and enabling real-time and batch analytics across the organization.
Your Responsibilities:
- Design and implement scalable data pipelines using Databricks and Delta Live Tables (DLT).
- Develop and manage streaming data solutions for real-time analytics and decision-making.
- Ingest data from various sources—including SAP systems using Qlik Replicate and ADF to ingest data from various sources ensuring data quality and consistency.
- Perform data modelling and optimize data structures for analytics and reporting.
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
- Monitor, troubleshoot, and enhance data workflows for performance and reliability.
- Maintain technical documentation and contribute to data engineering best practices.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills & Qualifications:
- Strong experience with Databricks- DLT, Delta Lake concepts, UC governance.
- Solid understanding of streaming technologies (e.g., Spark Structured Streaming, Autoloader).
- Programming skills in Python, SQL, or Scala.
- Proficiency in data modelling, ETL/ELT processes, and data architecture.
- Experience in MS Copilot, AI Foundry, Databricks (MosiacAI, MLflow, Agentbricks, Genie)
- Strong analytical background with problem-solving skills.
- Performance tuning concepts like watermarking, late data handling, parallelism & checkpointing.
- Hands-on expertise in ADF, and Qlik Replicate for data ingestion and replication.
- Experience working in Azure cloud environments.
- Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Does this sound like your next career move? Apply today!
Working with Certain Advantage
We go the extra mile to find the best people for the job. If you’re hunting for a role where you can make an impact and grow your career, we’ll work with you to find it.
We work with businesses across the UK to find the best people in IT, Engineering, Automotive, and Defence & Aerospace.
If this job isn’t for you, head to certainadvantage.co.uk and register for job alerts and career guidance tips.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location