Venturi
Senior Data Engineer – Entity Resolution
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer – Entity Resolution
£550–£650 per day | Inside IR35 | London | Hybrid, 2 days onsite per week
We are looking for a Senior Data Engineer specialising in Entity Resolution and Data Matching to support a major UK Government programme.
This is a senior, hands-on role focused on designing and delivering complex data-matching solutions across large and sensitive datasets. You will work with modern data engineering technologies including Python, PySpark, Apache Spark, AWS and Databricks, while applying advanced matching techniques to improve the accuracy, quality and usability of data.
You’ll be working on complex problems involving record linkage, identity matching, deduplication and probabilistic matching, so we’re looking for someone who combines strong Data Engineering capability with genuine Entity Resolution expertise.
Key experience
- Strong commercial experience in Entity Resolution, Data Matching or Record Linkage
- Experience designing deterministic, probabilistic and fuzzy matching solutions
- Strong understanding of matching rules, blocking strategies, thresholds and confidence scoring
- Experience analysing and reducing false positives and false negatives
- Advanced Python, PySpark and SQL
- Strong hands-on experience with Apache Spark
- Experience working with large-scale data platforms using AWS EMR and/or Databricks
- AWS experience across technologies such as S3, Glue and Athena
- Strong Data Quality experience including profiling, cleansing, standardisation and deduplication
- Experience working with complex, incomplete or inconsistent datasets
- Good understanding of Data Governance, lineage, metadata, auditability and privacy
- Experience providing technical leadership, assurance and peer review
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Highly desirable
- Splink experience
- Quantexa or another Entity Resolution platform
- Experience developing reusable probabilistic matching frameworks
- UK Government or Central Government experience
- Previous Home Office, HMRC, DWP, ONS, NHS or similar public-sector experience
- Experience working with population or administrative datasets
- Experience matching personal identifiers such as National Insurance Numbers
- Strong knowledge of Data Quality frameworks and governance controls
- Experience working with sensitive personal data in highly regulated environments
Get help with your application
Your very own career expert that helps elevate your application to the next level.
The role
You will help define and implement robust matching methodologies, develop scalable data-processing solutions and provide technical assurance around how records and entities are linked. You should be comfortable explaining why records have been matched, how match confidence has been calculated and how the solution has been validated. This is not simply an ETL/Data Engineering role. Strong Entity Resolution or Data Matching experience is essential.
Location
London
Working pattern
Hybrid, approximately 2 days onsite per week
Rate
£550 per day
IR35
Inside IR35
If you have strong Data Engineering + Entity Resolution / Record Linkage experience and are interested in a major UK Government programme, please apply with your latest CV.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location