Few&Far
Senior Applied AI scientist
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
🚨 Senior Applied AI Scientist | Contract
I’m currently working on an exciting contract opportunity for a Senior Applied AI Scientist to join a growing AI business, working on taking AI applications from proof of concept through to production.
💰 Up to £700 a day- Ideally around the £600-£650 mark though! 📄 Outside IR35 📅 6-month contract 🌍 Fully remote ⚡ ASAP start 🎯 2-stage interview process
The key requirement for this role is strong experience in AI evaluations and setting up evaluation frameworks. You’ll be responsible for establishing how AI systems are measured, tested and improved, ensuring there is clear evidence behind the quality and reliability of the applications being built.
What you’ll be doing:
- Designing and building evaluation frameworks for LLM and RAG-based applications
- Defining metrics, benchmarks and acceptance criteria to determine whether an AI application is ready for production
- Building golden datasets and ground-truth benchmarks, working with subject matter experts to establish what good looks like
- Evaluating areas including retrieval precision, recall, groundedness, faithfulness and end-to-end answer quality
- Developing regression testing to ensure quality remains consistent as models, prompts and data evolve
- Working with LLM-as-a-judge methodologies, calibrated against human judgement
- Using evaluation results and production feedback to identify failure modes and continuously improve AI systems
- Taking AI applications from PoC through to production, establishing the evaluation gates and evidence required for release
- Working closely with engineers and AI specialists across LLMs, RAG, retrieval and knowledge graphs
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What we’re looking for:
Someone with a strong hands-on background in Applied AI / ML, particularly around evaluating and improving LLM-based systems. You should have experience with:
- LLMs and RAG
- AI/LLM evaluation methodologies
- Building evaluation frameworks from scratch
- Golden datasets and benchmark creation
- LLM-as-a-judge / human evaluation
- Retrieval evaluation and optimisation
- Productionising LLM applications
- Python and modern AI engineering practices
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Experience with tools such as Ragas, DeepEval, LangSmith or promptfoo would be highly beneficial.
This is a great opportunity for someone who enjoys being responsible for proving whether AI actually works, rather than simply building the models themselves.
If you have strong experience across LLM evaluations, RAG and evaluation frameworks and are available for an ASAP start, please apply below!
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location