Fourth
Principal AI Quality Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Our Story
In July 2019, Fourth joined forces with HotSchedules to become the global leader in end-to-end restaurant and hospitality management technology solutions. Together, the merged company now represents the world’s largest and only provider of end-to-end restaurant and hospitality management solutions for customers across the globe and of all sizes, from a single location or franchisee restaurant to a global restaurant or hotel chain. The combined company’s complete software-as-service (SaaS) solution suite including scheduling, time & attendance, applicant tracking, training, inventory management / procurement, HR / benefits and payroll services now serves customers in 120,000 locations worldwide and is supported by a dedicated, unified team across offices in the US, UK, Bulgaria, China, Australia, and UAE.
Interested in joining our smart, fun, and talented team?
Position Overview
This is an exciting opportunity to define how a global technology company assures quality in the age of AI. Fourth is seeking an exceptional, strategically minded Principal AI Quality Engineer to drive our AI-driven global QA strategy from the front. Reporting to the Global Head of Service Delivery within Technology, you will be the most senior quality voice in the organisation, shaping how quality is engineered across Fourth’s systems in an era of AI-assisted and agentic AI development. You will set the vision, standards, and frameworks that build quality, reliability, and trust into everything we ship, aligning the QA strategy directly with the company’s technical vision, roadmap, and business strategy. If you want to leave a lasting mark on how software quality and AI come together at scale, this is the role to do it.
Primary Responsibilities
- Define, own, and continuously evolve Fourth’s AI-driven global QA strategy and roadmap, aligned with the Product and Technology roadmaps, to shape the strategic testing needs of the business.
- Establish the QA tools, frameworks, standards, and ways of working across our global engineering organisation to achieve our technology goals.
- Drive the unification and continuous improvement of testing processes and practices across delivery teams, partnering directly with Software Engineering Managers and Product Managers.
- Act as the principal point of escalation for complex testing and quality challenges across global Engineering teams, marshalling subject matter expertise to resolve them.
- Champion modern testing technologies, frameworks, and tools across Engineering, including the responsible adoption of AI.
- Define and own the quality KPIs and quality gates that measure product quality and the effectiveness of AI-assisted delivery.
- Own the Engineering Defect Management process and the organisation-wide approach to defect prevention.
- Lead Fourth’s QA approach for AI development end to end, covering both AI-assisted development (such as AI code generation and developer copilots) and agentic AI development (autonomous and semi-autonomous systems).
- Establish quality, evaluation, and governance frameworks for non-deterministic and AI-driven systems, including test and evaluation strategies for LLM-based and agentic features.
- Set enterprise standards for validating AI-generated code, ensuring it meets Fourth’s quality, security, and maintainability requirements.
- Partner with Engineering, Product, and Service Delivery leadership to embed AI fluency and modern quality practice across the organisation, mentoring and uplifting QA capability globally.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Key Skills and Competencies
- Strong understanding of the testing and quality challenges of non-deterministic, ML/LLM-based, and agentic systems, including evaluation, guardrails, and the regression of model-driven behaviour.
- Proven experience defining and implementing QA strategy at an organisational or enterprise scale.
- Experience establishing test automation best practice, both functional and non-functional, across multiple teams.
- Demonstrable experience shaping or leading a QA approach for AI-assisted and/or agentic AI development.
- Track record of defining and analysing quality KPIs and quality gates.
- Ability to influence and provide technical leadership and mentoring across senior engineering and product stakeholders.
- Experience creating and owning technical strategy and process documentation.
- Strong experience with Agile software delivery at scale.
- Excellent communication and stakeholder-management skills, with fluent English (written and spoken).
Preferred Experience and/or Qualifications
- Familiarity with MLOps or LLMOps practices, and with monitoring and observing the behaviour of AI systems in production.
- Exposure to prompt design and prompt/response evaluation techniques for AI-enabled features.
- Strong programming proficiency in C# or Java.
- Expertise in web and API testing, including hands-on UI automation with modern tools such as Playwright (or comparable frameworks).
- Proven ability to design and implement robust, scalable QA test strategies and automation frameworks.
- Hands-on experience with performance, security and non-functional testing.
- Practical experience using AI-assisted development tools (such as GitHub Copilot or similar), with a clear understanding of how to assure the quality, security, and maintainability of AI-generated code.
- A practical understanding of how AI is reshaping software delivery and the new quality risks it introduces, with the drive to keep Fourth’s testing practices at the leading edge.
- Experience with CI/CD tooling, e.g. Jenkins, Azure DevOps, and Octopus Deploy.
- Experience with observability tooling such as Prometheus, Grafana, and Sumo Logic.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Benefits
- 🏖 Holidays. We all need to rest so you get 25 basic holidays with the option to grow up to 30 with service + your birthday off + bank holidays!
- ⌚️ Flexible working! Use our flexible working hours and hybrid working environments to manage it.
- 🧘♀️ Wellness activities and a lot of pampering included. On top of that, you can add gym subscription discounts.
- 💻 Laptop and equipment.
- 🏥 Healthcare expense claim tools!
- 📔 Like in life, at work we also want you to grow with certifications.
- 🎉 Annual meet ups!
- 👥 Enhanced parenting scheme!
- 🚲 Cycle to work scheme and season ticket loan provided.
- 🏦 Pension and life insurance? Several, for you to choose what looks convenient.
- 💷 On demand pay tools for you to be able to access salary even before the end of the month!
All personal data provided by you in your application will be processed by Fourth LTD solely for our recruitment purposes. More information on Fourth LTD's privacy policy for job candidates is available here and by applying you confirm that you have read it.
Fourth is an Equal Opportunity Employer
All qualified applicants will receive consideration without discrimination because of sex, gender identity, gender expression, sexual orientation, marital status, race, colour, age, national origin, military status, religion, or disability or any other legally protected status.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills