PwC UK
Data Scientist - AI Evaluation & Benchmarking Manager
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About The Role
You’ll join our AI Research team as a Data Scientist - AI Evaluation & Benchmarking Manager, helping to shape and evolve the model benchmarking and experimentation capabilities that underpin AI delivery across PwC and our clients. You’ll work within a highly collaborative applied research environment that values curiosity, technical rigour, and practical problem solving. In this role, you'll develop frameworks and experimentation workflows used to evaluate emerging AI models, driving evidence-based decisions for client engagements. We’re looking for someone who enjoys technical ownership, thrives in fast-moving environments, and is motivated by building scalable, secure AI research infrastructure.
What Your Days Will Look Like
You’ll play a key role in building and evolving our AI benchmarking and experimentation platforms, enabling robust and repeatable model evaluation. Your work will directly influence AI model selection and technical strategy across PwC projects and client engagements.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
- Design and run end-to-end benchmarking workflows, from understanding client use cases, designing and running benchmarking strategies, and generating business-ready insights
- Build scalable evaluation frameworks, metrics, and pipelines, combining hands-on engineering with continuous review of academic literature to ensure our evaluation strategies reflect leading research and best practice.
- Develop, maintain, and improve experimentation infrastructure, ensuring robustness and production-grade engineering.
- Produce clear, client-ready insights and support technical demos and deep dive sessions.
This Role Is For You If
- You have strong hands-on experience in Data Science concepts, or LLM experimentation using structured evaluation frameworks.
- You are highly proficient in Python, including asynchronous programming, multithreading, and writing maintainable code.
- You have experience deploying ML workloads to cloud platforms (Azure, AWS, or GCP), with familiarity in CI/CD and containerization (Docker/Podman).
- You have applied knowledge of statistics and experimental design and can translate findings into actionable recommendations. You are comfortable managing fast-moving workstreams and operating autonomously.
- You demonstrate emerging leadership behaviors - taking initiative, influencing technical direction, communicating clearly, and supporting the development of others.
- You are motivated by ownership and excited by the opportunity to shape AI research platforms that directly impact client engagements.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
What You’ll Receive From Us
No matter where you may be in your career or personal life, our benefits are designed to add value and support, recognizing and rewarding you fairly for your contributions.
We offer a range of benefits including empowered flexibility and a working week split between office, home, and client site; private medical cover and 24/7 access to a qualified virtual GP; six volunteering days a year and much more.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location