Venturi
Data Engineer – Enterprise Data Hub (EDH) / Cloudera
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Data Engineer – Enterprise Data Hub (EDH) / Cloudera
Role: Data Engineer – EDH / Cloudera
Location: UK
Contract: 12 month contract
Clearance: SC Clearance required / SC eligible
We are looking for experienced Data Engineers to join a large-scale UK Government data programme, working within an established Enterprise Data Hub (EDH) environment.
This is a specialist requirement and previous hands-on Enterprise Data Hub (EDH) experience is mandatory.
The successful Data Engineer will work across data ingestion and loading services, building, maintaining and supporting data feeds into a large-scale Cloudera/Hadoop data platform.
Responsibilities
- Build and maintain data ingestion pipelines and data feeds into an Enterprise Data Hub
- Develop and support Data Loading Service (DLS) pipelines
- Perform data validation, cleansing, structure and format checking
- Develop ETL and transformation processes using technologies including Hive, Pig and Spark
- Use ingestion technologies including Apache NiFi, Sqoop and Flume
- Monitor production data feeds and troubleshoot pipeline failures
- Maintain data quality, completeness and accuracy
- Work with sensitive and highly governed datasets
- Support secure data processing, tokenisation and entity-protection controls
- Work within an Agile delivery environment
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Experience
- Previous Enterprise Data Hub (EDH) experience – essential
- Strong commercial Data Engineering experience
- Strong Cloudera / Hadoop experience
- Experience developing large-scale data ingestion and data feed pipelines
- Experience with technologies including:
- Hadoop / HDFS
- Cloudera CDH
- Hive
- Pig
- Sqoop
- Apache NiFi
- Flume
- Spark / Spark Streaming
- Experience with HBase and/or Cassandra
- Python, Scala and/or Java experience
- Strong understanding of data validation, cleansing and data quality
- Experience working with sensitive or highly governed data
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Experience with Data Loading Services (DLS), Protegrity, tokenisation, Kerberos or Entity Protection Controls would be particularly advantageous.
Security Clearance
Due to the nature of the programme, candidates must either hold SC Clearance or be eligible and willing to undergo SC vetting.
If you have previous Enterprise Data Hub (EDH) experience and would like to discuss the opportunity, please apply with your latest CV.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location