Oliver Bernard
AI Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
AI Engineer - Remote (UK) - Early Stage EdTech - £75-85k + equity
Remote within the UK, with occasional in-person meetups in London
I'm working with an early-stage, VC-backed startup building an AI-powered assessment platform, to find an AI Engineer to join their small, fully remote team.
About the Role
You'll build and improve the systems powering AI-assisted marking, feedback, and assessment. This means delivering assessment workflows for customers end-to-end — from requirements through implementation, evaluation, production release, and ongoing improvement — while also contributing to a shared assessment engine that turns recurring patterns into reusable, configurable capabilities.
This is a hands-on role: production Python, large language models, and other AI systems. You'll investigate failures, evaluate non-deterministic workflows, and make practical trade-offs between quality, latency, and cost.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What You'll Do
- Deliver AI-assisted assessment workflows from requirements through production and ongoing improvement
- Translate marking guidance into rubrics, schemas, prompts, and LLM programs
- Build and maintain production Python code for assessment workflows and shared AI components
- Design evaluation methods using representative datasets, regression tests, and statistical analysis
- Investigate failed or contested assessments and improve workflows accordingly
- Build human-review and feedback-driven optimisation workflows
- Extend multimodal assessment capabilities across documents, images, and video
Core Requirements
- Experience building and improving LLM- or ML-based systems in production
- Strong Python engineering skills in production codebases
- Experience designing evaluations or regression tests for non-deterministic systems, with real statistical grounding
- Ability to investigate failures systematically and make sound engineering trade-offs
- At least 3 years of relevant AI/ML engineering experience, or a relevant postgraduate degree plus applied experience
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Nice to Have
- Experience with prompt/program optimisation frameworks (DSPy, GEPA, AdalFlow) or continuous evaluation workflows
- Experience with multimodal or document-processing systems
- Experience with LLM tracing/eval tools (Langfuse, MLflow, W&B, LangSmith)
- Experience with assessment technology or EdTech
- Cloud deployment experience (AWS, Azure, GCP)
You must be based in the UK and have the full right to work without sponsorship to be considered.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location