Codvo.ai
(UK)Principal Engineer - Test
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Job Title: Principal Engineer, Test – AI Core Services Development
Location: Cambridge, UK
Company Overview
At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day.
We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results.
Role Requirement
We are looking for detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services. You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities. This role demands deep technical skill and a passion for delivering robust, secure, and ethical AI services at scale.
You’ll be a part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools - with a builder mindset - rapid prototyping and continuous improvement with agility of a start-up
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Key Responsibilities
- Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure.
- Design and implement automated test suites for APIs, service components, and AI pipelines.
- Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses.
- Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks.
- Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes.
- Participate in threat modelling and security validation of exposed APIs and AI services.
- Provide feedback early in the lifecycle to reduce defects and improve design.
- Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation.
AI & Cloud Expertise
- Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.
- Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection.
- Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations.
- Defining Performance Metrics for AI services and testing for the same.
- Awareness of AI safety, bias detection, and explainability techniques.
- Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).
- Strong belief in ethical AI practices, transparency, and end-user trust.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Core Skills and Qualifications
- 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and.NET technologies.
- Proficient in designing automated testing frameworks.
- Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments.
- Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10).
- Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions.
- Experience working in Agile teams and collaborating across global R&D locations.
- Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills