How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About ISx4
ISx4 is a dynamic and innovative team, we harness the power of artificial intelligence and cloud computing to drive real-world impact. We work at the forefront of Analytics and AI technology, leveraging leading cloud platforms to build scalable, intelligent solutions. We provide Insight through Strategy, Solutions, Services & Support (Sx4). Our industry experience helps derive competitive advantage for our clients, taking them on the journey from Hindsight, through Insight to Foresight.
Job Role
We are looking for a Databricks Data Engineer to design, build and operate scalable data pipelines and data platform capabilities within a modern lakehouse architecture. You will work in a collaborative agile engineering team delivering production-grade data solutions using Databricks, Spark, Python and SQL in a cloud environment. The role focuses on developing robust data pipelines, ensuring high data quality and enabling analytics and data product delivery for enterprise clients.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Key Responsibilities
- Design and implement ELT/ETL pipelines using PySpark and Databricks
- Build scalable batch and streaming data pipelines using Spark and Kafka
- Develop optimised SQL and Python pipelines for data transformation and integration
- Integrate external data sources using REST APIs and data ingestion frameworks
- Optimise Spark jobs and cluster performance for reliability and cost efficiency
- Implement data quality checks, validation and monitoring
- Apply CI/CD practices and version control for pipeline deployment
- Work closely with solution architects, DevOps engineers and business analysts to deliver data products
- Produce technical documentation, architecture diagrams and operational runbooks
Key Requirements
Get help with your application
Your very own career expert that helps elevate your application to the next level.
- 3+ years experience building production data pipelines
- Strong Python and Microsoft SQL Server development skills
- Hands-on experience with Databricks, Spark and PySpark
- Experience with Delta Lake, Unity Catalog and Databricks
- Working experience with data pipeline design, testing and deployment
- Familiarity with test-driven development, CI/CD practices and Git-based development
- Strong collaboration and communication skills
- Working knowledge of Hadoop REST APIs and Kafka experience
Nice to Have
- Cloud experience with AWS, Azure or GCP
- Certifications in Databricks, AWS or data engineering
- Infrastructure as Code (Terraform)
- Orchestration: Airflow or AWS Glue
- Streaming technologies including Structured Streaming
- Observability tooling for data pipelines
- Experience working with regulated industries such as banking or financial services
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills