Primus Connect
Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Databricks Data Engineer
Contract Opportunity | Data & AI Consultancy | Databricks
Contract: Outside IR3
Rate: £450–£550 per day
Location: Fully Remote – UK
Start: ASAP
Focus: Databricks / Data Engineering
The Opportunity
Primus Connect is working with a growing Data & AI Consultancy that is delivering modern data platforms and Databricks solutions for a range of enterprise clients. They are expanding their engineering capability and are looking for a Mid-Level Data Engineer with strong commercial Databricks and Spark experience to join an active delivery team. This is a hands-on engineering position where you will take ownership of data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and wider delivery teams.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Key Responsibilities
- Design, build and maintain ETL/ELT data pipelines using Databricks, PySpark, and Spark SQL
- Develop and optimize Delta Lake tables using Bronze, Silver, and Gold medallion architecture
- Ingest data from a variety of source systems into Databricks
- Write clean, maintainable, and well-tested Python/data engineering code
- Implement data quality checks, validation, and monitoring
- Participate in code reviews and collaborative development
- Contribute to CI/CD pipelines for data engineering workloads
- Work with senior engineers to deliver scalable data platform solutions
- Collaborate with technical, analytics, and business stakeholders
- Participate in Agile ceremonies and delivery activities
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Essential Experience
- Commercial experience building data pipelines using Databricks
- Strong PySpark and Spark SQL skills
- Solid Python experience within data engineering
- Practical experience with Delta Lake
- Understanding of medallion architecture and modern data platform principles
- Experience working with Azure, AWS, or GCP
- Good understanding of Git and collaborative development practices
- Experience working within Agile delivery environments
- Strong communication skills and the ability to work effectively in a remote team
Desirable Experience
- Databricks certification
- Unity Catalog
- Databricks Asset Bundles
- Terraform / Infrastructure as Code
- Databricks Workflows
- Airflow
- Spark Structured Streaming
- Kafka or Azure Event Hubs
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location