Test Yantra
AI Automation Test Engineer
Sheffield
Posted about 15 hours ago
How your CV stacks up
1Upload CV
2Analyse CV
3Improve CV
Upload your CV to see how well it fits this job role
?%
Required Skills & Experience
Core Technical Skills
- 5+ years of experience in Quality Engineering and Test Automation.
- Strong programming experience in Python and automation frameworks such as PyTest.
- Hands-on experience with API testing tools and frameworks (Postman, Rest Assured, Swagger/OpenAPI).
- Strong understanding of IAM concepts, Identity Governance, Authentication, Authorization, and Access Management.
- Experience with cloud platforms, preferably Google Cloud Platform (GCP).
- Experience testing event-driven architectures and messaging systems such as Google Pub/Sub.
- Strong understanding of CI/CD pipelines using Jenkins or equivalent tools.
- Experience with defect and test management tools such as JIRA and Zephyr.
- Knowledge of graph databases, preferably Neo4j.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
AI Testing Skills
- Experience validating AI/ML or Generative AI applications in enterprise environments.
- Understanding of Large Language Models (LLMs), prompt engineering, and AI quality evaluation techniques.
- Experience with AI-assisted testing tools and intelligent test automation frameworks.
- Familiarity with AI model lifecycle, training data validation, model performance evaluation, and drift monitoring.
- Exposure to Vertex AI, OpenAI, Azure AI, or similar AI platforms is preferred.
- Understanding of responsible AI practices, bias testing, explainability, and AI governance frameworks.
Preferred Qualifications
- Experience in Cloud Security, IAM, Identity Governance, or Zero Trust Security environments.
- Exposure to SailPoint, Okta, ForgeRock, Ping Identity, Entra ID (Azure AD), or similar IAM platforms.
- Knowledge of DevSecOps and Security Testing principles.
- Relevant certifications in GCP, Security, Automation Testing, AI/ML, or Cloud Technologies.
- Experience working within Agile/Scrum environments.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Key Competencies
- Quality-first and automation-first mindset
- Strong analytical and problem-solving skills
- Excellent stakeholder communication
- Ability to work in cross-functional cloud and AI teams
- Strong ownership and accountability
- Continuous learning mindset with interest in emerging AI technologies and cloud security practices
Trusted by 25,000+ job seekers
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Quality Engineering
Test Automation
Python
API Testing
IAM Concepts
Cloud Platforms
Event-Driven Architectures
CI/CD Pipelines
Defect Management
Graph Databases
AI Testing
Large Language Models
AI-Assisted Testing
Cloud Security
Agile
DevSecOps