Insight International (UK) Ltd
Data Engineer (Databricks Specialist)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Role: Data Engineer (Databricks Specialist)
Location: Dublin (2-3 days/week On-Site)
Job Type: Contract
Role Purpose:
Build scalable data pipelines and ensure curated, high-quality cyber data is available for analytics.
Key Responsibilities
- Build ingestion pipelines (logs, network data, security tools)
- Develop ETL/ELT pipelines using Databricks & Spark
- Implement Delta Lake (Bronze–Silver–Gold layers)
- Optimise performance and cost (partitioning, caching)
- Ensure data quality, lineage, and reliability
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills
- Strong PySpark / Spark SQL
- Databricks ecosystem (Delta Lake, Jobs, Workflows)
- Experience with streaming (Kafka / Event Hub)
- Cloud expertise (AWS preferred – S3, IAM, Glue)
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Key Deliverables
- Data ingestion pipelines
- Curated cyber datasets
- Optimised lakehouse architecture
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location