IG Group
Graduate Conversational AI QA
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Graduate Conversational AI QA
So, who are we? IG Group is a FTSE 100 fintech operating across five continents, serving over 1.4m customers and handling billions of dollars in transactions – built on scale, trust, and proof. We didn't pivot to innovation; it's how we've always operated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scope that's rare in established businesses.
The bar is high – bring a curious and forward-thinking mindset and we'll give you the platform to define what comes next.
Join us at IG – the future gets built here.
About the Team
This role sits within our Conversational AI team, which builds and runs the AI assistant our clients talk to. Quality is what gives the business confidence those standards are being met in every conversation the assistant has, and that we are doing right by our clients and our regulators.
Your Role within the Team:
Our Conversational AI team is building a dedicated quality capability for the bot - new framework, new standards, and AI-assisted tooling - and you will join as we do it. This is a graduate role, and a rare chance to join an AI capability while it is still being shaped rather than after the decisions have all been made. Your core job is to assess real conversations between clients and our AI assistant, judge them fairly and accurately against our quality and conduct standards, and turn what you find into insight the team and our CX colleagues can act on.
Conversational AI lets us answer far more client queries, faster and around the clock, than human agents alone ever could. But an AI assistant can be wrong with complete confidence, and at scale a single flaw in its knowledge, logic, or guardrails can repeat across thousands of conversations before anyone notices. In a regulated business, that is a conduct risk, not just a service one. QA is how we make sure the bot's answers are accurate, compliant, and genuinely helpful, that it knows when to hand a client over to a human, and that it keeps getting better as our client base grows.
You will not just be checking the bot's work. As you build your expertise, you will have the opportunity to get involved in the wider AI projects that make it better - from testing new features and models to helping design how we measure AI quality in the first place. No prior experience in QA or financial services is needed: we will give you full training and support. What we are looking for is curiosity, sharp judgement, and a genuine interest in how AI behaves in the real world.
What You'll Do
Quality evaluations of AI assistant conversations
- Review client conversations with our AI assistant across chat and other digital channels, scoring them fairly and consistently against a bot-specific evaluation framework.
- Assess the things that matter most: whether the bot understood what the client was actually asking, whether its answer was accurate and grounded in approved content, whether it resolved the query or routed it appropriately, the clarity and tone of its responses, and - critically - whether the conversation met our conduct and regulatory standards.
- Scrutimise handoffs to human agents: whether the bot escalated when it should have, avoided escalating when it did not need to, and passed the client over with enough context that they did not have to start again.
- Use sampling, AI-assisted scoring, and conversation analytics to focus your review where it adds the most value, applying our quality standards consistently and in line with how human interactions are assessed.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Regulation and Consumer Duty at the centre
- Treat bot QA as what it is: a core line of defence for regulatory compliance, not a box-ticking exercise. The same standards apply whether a client is served by a person or a machine.
- Identify conduct risk in bot responses - anything that strays into investment advice or a personal recommendation, unbalanced representation of risk and reward, inaccurate or invented information about products, fees, or margin, market abuse indicators, and mishandling of personal data or DSAR requests - and flag it correctly.
- Pay particular attention to Consumer Duty obligations, especially whether the bot recognises expressions of dissatisfaction as complaints, picks up signs of client vulnerability, and routes those clients to a human with appropriate care.
Testing, investigation and root cause
- Carry out root cause analysis on failed conversations, DSATs, and other negative outcomes, working out whether the problem sits in intent recognition, the knowledge base, conversation design, the model's behaviour, or the handoff process.
- Look for patterns across conversation types, intents, and topics rather than treating every failure as a one-off, and surface them clearly.
- Help design and run test scenarios - including edge cases and adversarial prompts - to probe how the bot behaves before and after changes, and check that fixes work without breaking something else.
Feedback that drives improvement
- Share clear, evidence-based findings that the rest of the Conversational AI team and our product and knowledge colleagues can actually use - with example transcripts, the standard that was missed, and what good would have looked like.
- Learn to stand behind your assessments. Not everyone will agree that a response was a failure, and you will build the confidence to make your case with evidence - and the judgement to concede when the evidence points the other way.
- Connect what you see in evaluations to the bigger picture, feeding insight into content updates, conversation design, guardrails, and release decisions so that the bot's quality improves over time, not just gets measured.
Getting involved in wider AI projects
- Get hands-on with AI improvement work beyond day-to-day QA - for example testing new bot features, knowledge content, or model updates before they reach clients.
- Contribute to how we measure AI quality: helping build evaluation datasets, refine scoring criteria, and explore how automated evaluation can work alongside human review.
- Work closely with colleagues across the Conversational AI team and with product, data, and compliance, seeing first-hand how a regulated business builds and governs AI - experience that opens doors across the business.
What You'll Need
Essential
- A degree in any discipline. We are as interested in graduates from psychology, linguistics, law, or philosophy as from computer science, maths, or economics.
- A genuine interest in AI and how it behaves in the real world - you are the kind of person who has poked at a chatbot to see where it breaks and wondered why.
- Excellent written English with a strong grasp of spelling, punctuation and grammar (SPAG). You will be judging the clarity, accuracy, and tone of the bot's written responses, so your own writing needs to be sound.
- A genuinely customer-centric mindset: you can tell the difference between a conversation that technically answered the question and one that actually served the client well.
- Strong analytical and problem-solving skills, with the curiosity to dig into why the bot responded the way it did rather than simply recording that it got it wrong.
- Attention to detail and consistency. The credibility of QA rests on evaluations being fair, accurate, and defensible.
- The confidence to share honest, constructive views - or the drive to build that confidence quickly with support.
- An interest in financial services and why regulation matters. You do not need prior knowledge of Consumer Duty or conduct rules - we will teach you - but you should want to understand why they exist.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Desirable
- An internship, placement, or part-time role in customer service, compliance, data, or a regulated environment such as financial services.
- Hands-on experience with AI or large language model (LLM) tools, for example through a dissertation, university project, hackathon, or personal project.
- A second language. While not a requirement, the ability to evaluate bot conversations in languages other than English would be a real asset given our global client base.
- Some exposure to data analysis or basic coding (Excel, SQL, or Python) - useful for spotting patterns across large volumes of conversations, but not essential.
- An understanding of research methods, experiment design, or how to measure quality or accuracy in a structured way.
Your First Few Months
You cannot fairly judge work you have never done yourself, so you will start by going through our CX agent training. You will learn our products, systems, and processes from the agent's seat and get a real feel for what a good client interaction looks like in practice. You will then spend time across the Conversational AI team to understand how the bot is built, what it is and is not allowed to do, and how changes to it are made. Throughout, you will have a dedicated mentor in the team and structured training on financial services regulation and Consumer Duty. From there, you will ramp into the role itself:
- First, getting to know our bot evaluation framework and tooling inside out, and completing evaluations under guidance until you are scoring fairly and consistently.
- Then, carrying out root cause analysis on failed conversations independently, contributing to test scenarios, and presenting your findings to the wider team and our CX colleagues.
- In time, taking on a role in wider AI projects, spotting the patterns and conduct risks others miss, and helping shape how the bot is improved and what gets tested next.
What's in It for You
- A front-row seat in conversational AI at a FTSE 100 FinTech, with real responsibility from the start.
- Structured training in QA, financial services regulation, and AI evaluation, plus a dedicated mentor.
- Exposure to wider AI projects and cross-functional teams, and a foundation to grow into QA, AI quality, conversation design, or product roles as your interests develop.
The perks: It really is more than a job. We think
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London