PRACYVA
AI Automation Tester
Manchester
Posted about 17 hours ago
Get notified of more jobs like this · No spam, ever
How your CV stacks up
1Upload CV
2Analyse CV
3Improve CV
Upload your CV to see how well it fits this job role
?%
Role Purpose
Lead automation-first quality engineering across digital services, APIs and AI-enabled products. The role will build scalable test frameworks, embed continuous testing in delivery pipelines and establish robust quality approaches for Generative AI and agent-based solutions.
Key Responsibilities
- Design, develop and maintain reusable UI automation frameworks using Playwright, Cypress or Selenium.
- Build API and service-level automation using RestAssured or equivalent frameworks, supported by Postman or Bruno for exploratory and regression testing.
- Define risk-based test strategies covering functional, integration, regression, end-to-end and production-readiness testing.
- Embed automated tests, quality gates and reporting into CI/CD pipelines to enable reliable and frequent releases.
- Work within cross-functional feature teams to shift quality left, influence solution design and improve testability from the outset.
- Create maintainable test data, service mocks and validation approaches for APIs, microservices and distributed integrations.
- Design testing approaches for AI and Generative AI applications, including prompt/response validation, grounding, safety, consistency and non-deterministic outputs.
- Validate AI Agents and agent workflows, including tool calling, orchestration, memory, failure handling and multi-step task completion.
- Use quality metrics, defects, logs and observability signals to identify risks, improve coverage and support incident investigation.
- Mentor engineers, review automation code and contribute standards, reusable accelerators and Quality Engineering communities of practice.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Mandatory Skills and Experience
Capability
- Required experience
- UI automation
- Strong hands-on automation using Playwright, Cypress or Selenium, including framework design, maintainability and parallel execution.
- API automation
- RestAssured or an equivalent code-based API framework; practical use of Postman or Bruno for REST API validation.
- Programming
- Strong Java, JavaScript, TypeScript or Python skills and the ability to write clean, reusable automation code.
- Quality engineering
- Functional, integration, regression and end-to-end testing, with risk-based planning and shift-left practices.
- CI/CD
- Experience integrating automated tests, quality gates and results into Jenkins, Harness, GitHub Actions or equivalent pipelines.
- AI testing
- Hands-on experience testing AI or Generative AI applications, including evaluation of variable outputs and response quality.
- AI Agents
- Experience or strong knowledge of testing agent workflows, tool invocation, orchestration, memory and error handling.
- Collaboration
- Ability to work with Product, Engineering, DevOps and Architecture teams and communicate quality risks clearly.
- UI automation
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Other Experience
- BDD with Cucumber and Gherkin, plus contract testing and service virtualisation.
- RAG or LLM application testing, including retrieval relevance, hallucination, grounding and guardrail evaluation.
- Performance testing with k6 or JMeter and accessibility or security testing awareness.
- Docker, Kubernetes, GCP, Dynatrace and modern observability practices.
- Experience delivering customer-facing software in financial services or another regulated environment.
What Success Looks Like
- Automation provides fast, reliable feedback across UI, API and integration layers.
- Quality controls are embedded throughout delivery rather than applied only at the end.
- AI and agent-based products are assessed with repeatable evidence covering functionality, reliability, safety and customer outcomes.
Trusted by 25,000+ job seekers
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London