Lorien
Quality Assurance Tester
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
AI QA Tester
We are currently recruiting for an AI QA Tester with strong automation testing and AI Project experience to join one of our Insurance clients on a 6-month contract.
Inside IR35, Remote Working
Experience required:
- Strong QA engineering background with hands-on test automation, not manual scripting alone.
- Automation coding ability in Python, C# and/or JavaScript/TypeScript.
- API testing experience, including contract testing, authentication, negative testing, and mocked dependencies.
- Demonstrable experience testing AI, machine learning, or LLM-based systems, or a clear grasp of how to assure non-deterministic output using evaluation metrics and statistical thresholds.
- Understanding of RAG architectures and where they fail - retrieval misses, stale indexes, chunk boundary loss, hallucination, ungrounded citations.
- Awareness of LLM security risks (for example, the OWASP Top 10 for LLM applications) and practical adversarial testing technique.
- CI/CD integration of automated test suites (GitHub Actions or Azure DevOps).
- Test data management, including handling of personal data safely in test environments.
- Confidence challenging engineers and stakeholders on release readiness.
- Experience with Azure AI Foundry evaluations, Azure AI Content Safety testing, or PyRIT / other red-teaming tooling.
- Performance and load testing tools (k6, JMeter, Azure Load Testing).
- Azure Monitor / Application Insights and KQL for investigating failures from telemetry.
- Accessibility and conversational UX testing experience.
- Familiarity with UK GDPR, DPIA processes, or regulated-sector assurance evidence.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
If this role is of interest and you would like to know more, please apply now!
Get help with your application
Your very own career expert that helps elevate your application to the next level.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location