Rodeo
Get started

Sundayy

Quality Engineer - AI

England
Posted about 16 hours ago
Sign up to applySee more jobs like this

How your CV stacks up

1Upload CV
2Analyse CV
3Improve CV

Upload your CV to see how well it fits this job role

?%

About The Company

Fourth is a leading global technology company dedicated to transforming the way organizations deliver services through innovative solutions and cutting-edge technology. Committed to excellence and continuous improvement, Fourth specializes in providing comprehensive software and platform solutions that enhance operational efficiency, customer experience, and strategic growth. With a focus on fostering a dynamic and inclusive work environment, Fourth prides itself on its forward-thinking approach, leveraging the latest advancements in artificial intelligence and automation to stay ahead in the industry. The company values integrity, collaboration, and a passion for technological innovation, making it a preferred employer for professionals seeking to make a meaningful impact in the tech space.

About The Role

This is an exciting opportunity to define how a global technology company assures quality in the age of AI. Fourth is seeking an exceptional, strategically minded Principal AI Quality Engineer to drive our AI-driven global QA strategy from the front. Reporting to the Global Head of Service Delivery within Technology, you will be the most senior quality voice in the organization, shaping how quality is engineered across Fourth’s systems in an era of AI-assisted and agentic AI development. You will set the vision, standards, and frameworks that build quality, reliability, and trust into everything we ship, aligning the QA strategy directly with the company’s technical vision, roadmap, and business strategy. If you want to leave a lasting mark on how software quality and AI come together at scale, this is the role to do it.

Qualifications

  • Proven experience in defining and implementing QA strategies at an organizational or enterprise level.
  • Strong understanding of testing challenges associated with non-deterministic, ML/LLM-based, and agentic systems.
  • Experience establishing test automation best practices across multiple teams.
  • Hands-on experience with AI-assisted development tools, such as GitHub Copilot or similar.
  • Proficiency in programming languages such as C# or Java.
  • Experience with web and API testing frameworks, including UI automation tools like Playwright or comparable frameworks.
  • Knowledge of performance, security, and non-functional testing methodologies.
  • Familiarity with MLOps or LLMOps practices, monitoring, and observing AI system behavior in production environments.
  • Understanding of prompt design and evaluation techniques for AI-enabled features.
  • Experience with CI/CD tools such as Jenkins, Azure DevOps, or Octopus Deploy.
  • Knowledge of observability tools like Prometheus, Grafana, or Sumo Logic.
  • Excellent stakeholder management and communication skills, with fluency in English (written and spoken).

Reasons to use Rodeo

I’m in my final year doing Economics and I don’t know whether to apply for grad schemes now or do a masters first. What do you think?

Honest answer — it depends on where you want to end up. A lot of top grad schemes (Big 4, civil service, banking) don’t need a masters. Let’s look at the ones you’d be competitive for now, and we can decide if a masters actually adds anything.

Also worth knowing: most autumn 2026 applications are open now. Timing matters more than you think.

Start with a chat, not a search bar

Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.

P

Graduate Consultant — 2026 Scheme

PwC·London, UK
£35,000/yr

Why you're a good match

Strong

Your economics background and your summer at a regional bank line up with what PwC looks for on the consulting scheme. Applications close in four weeks.

See breakdown
Save jobNot relevant
View details

It searches the market for you

Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.

Why you're a good match

You’ve got the grades and the economics background, and your bank internship is exactly the experience this scheme looks for. Apply soon — deadlines close within the month.

See breakdown
Strong

Experience fit

Your summer at the bank plus your econometrics coursework map directly to the day-one responsibilities on this scheme — client modelling, market briefings, and deal support.

See breakdown
Strong

Only hits

No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.

Responsibilities

  • Define, own, and continuously evolve Fourth’s AI-driven global QA strategy and roadmap, aligned with product and technology objectives.
  • Establish QA tools, frameworks, standards, and best practices across the global engineering organization.
  • Drive the unification and ongoing improvement of testing processes and practices, collaborating closely with Software Engineering Managers and Product Managers.
  • Act as the primary escalation point for complex testing and quality challenges across engineering teams worldwide.
  • Champion modern testing technologies, frameworks, and tools, including the responsible integration of AI-powered solutions.
  • Define and monitor quality KPIs and quality gates to assess product quality and delivery effectiveness.
  • Manage the Engineering Defect Management process and organization-wide defect prevention strategies.
  • Lead the QA approach for AI development, covering AI-assisted and agentic AI systems, including evaluation, validation, and governance frameworks.
  • Establish standards for validating AI-generated code, ensuring compliance with quality, security, and maintainability requirements.
  • Partner with leadership across Engineering, Product, and Service Delivery to embed AI fluency and modern quality practices organization-wide.
  • Mentor and uplift QA capabilities globally, fostering a culture of continuous learning and innovation in quality assurance.

Get help with your application

Your very own career expert that helps elevate your application to the next level.

Get help applying for this job

Benefits

  • 25 days of paid leave, with options to increase up to 30 days based on tenure, plus bank holidays and your birthday off.
  • Flexible working hours and hybrid work arrangements to promote work-life balance.
  • Wellness activities and discounts on gym memberships.
  • Company-provided laptop and essential equipment.
  • Tools and support for healthcare expense claims.
  • Support for professional certifications and ongoing development.
  • Annual company meet-ups to foster team bonding and collaboration.
  • Enhanced parental leave schemes to support families.
  • Cycle-to-work schemes and season ticket loans for commuting convenience.
  • Comprehensive pension plans and life insurance options.
  • On-demand pay tools enabling early access to salary before month-end.

Equal Opportunity

Fourth is an Equal Opportunity Employer. All qualified applicants will receive consideration without discrimination based on sex, gender identity, gender expression, sexual orientation, marital status, race, color, age, national origin, military status, religion, disability, or any other legally protected characteristic. We are committed to fostering an inclusive environment where diversity is celebrated and everyone has the opportunity to succeed.

Trusted by 25,000+ job seekers

“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”

Jessica, London

Get help applying for this job

Skills

AI Quality Assurance
ML/LLM Testing
Test Automation
C#
Java
Playwright
API Testing
MLOps
LLMOps
Prompt Design
CI/CD
Observability Tools
Stakeholder Management
Defect Management
Agentic AI Systems
Quality KPIs

Location

England, United Kingdom

Sign up to applySee more jobs like this