Ctrl AI
Product Assistant (ADR)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Location: UK (remote with client and team travel, ideally London or Manchester)
Reports to: Product Manager
Working alongside: Product Managers and Development Team
Mission
Help Ctrl AI ship a trustworthy, high-quality product across the ADR sector. You'll sit at the heart of the product team, bringing your dispute-resolution expertise to help configure AI assessments, then evaluating and stress-testing the outputs the platform produces, and acting as a quality gate before anything reaches clients in sensitive, high-stakes dispute-resolution markets. Your work directly underpins the platform's core promise: evidence-grounded, auditable outputs that practitioners can rely on.
The Role
This is a hands-on quality and analysis role, built on dispute-resolution expertise gained in an ADR, arbitration or ombudsman scheme. Your value comes from combining that dispute-resolution judgement with a rigorous, detail-oriented approach: judging whether platform outputs are accurate, complete, and defensible, and giving clear, structured feedback to the people building it. You'll support Product Managers and the Development Team to design and refine the AI configuration behind each client's case assessments.
Ctrl AI operates in markets where data is often sensitive, messy, and inconsistently structured, and where a wrong or unsupported output carries real consequences. Much of your work will involve reviewing test cases the way a practitioner would, comparing platform outputs against what a sound assessment should look like, and showing the team where the product performs well and where it needs attention.
Your focus areas:
- Designing AI configuration — using your understanding of how cases are assessed to configure and refine the AI assessments that power each sector solution.
- Case and output review — reviewing platform outputs against the standards a competent practitioner would apply, assessing quality and defensibility, spotting weaknesses, and building a clear picture of how the platform behaves across different case types.
- Feedback and product support — translating findings into clear, actionable feedback for the Development Team, and helping prioritise, implement and verify improvements.
- Working with clients and stakeholders — collaborating with internal teams, clients and sector stakeholders to gather input, organise sessions, and make sure their perspectives shape how outputs are evaluated and improved.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Core Responsibilities
- Design and configure the AI assessments, shaping how case assessments work for different clients, what a good output looks like, and how the configuration is refined as requirements evolve.
- Evaluate and test the platform's data and outputs, running test cases against expected outputs, refining the underlying AI configuration so assessments perform reliably, and documenting results clearly and repeatably as structured quality assurance before release.
- Identify where outputs are wrong, inconsistent, or indefensible, and use your sector knowledge to help the team understand why, distinguishing assessment failures from acceptable variation.
- Provide clear, constructive feedback to product, technical, and stakeholder audiences, and validate that fixes resolve the issues raised.
- Support Product Managers day-to-day across competing priorities, bringing domain insight to assessment design, reviewing outputs, and helping keep quality standards consistent.
- Work alongside clients, sector stakeholders, and internal teams to gather input on requirements, capturing clear outcomes and building constructive relationships across the business.
- Work with sensitive data responsibly, applying good judgement and care in line with the platform's evidence-grounded, auditable approach.
What You Bring
- Domain expertise in dispute resolution, with direct experience of an ADR, arbitration or ombudsman scheme strongly preferred.
- An analytical, detail-oriented mindset: comfortable looking closely at data and outputs, spotting patterns and anomalies, and forming clear judgements about quality.
- Strong organisational skills and the discipline to configure assessments thoughtfully, test methodically, document findings clearly, and follow issues through to resolution.
- Clear written and verbal communication; able to give precise, useful feedback to both product and technical colleagues, and comfortable working with clients and stakeholders and helping run sessions.
- Self-starter, comfortable juggling priorities across several workstreams and working directly with a fast-moving product team.
- An interest in legal technology and how AI is changing ADR and ombudsman dispute resolution — and the curiosity to translate your sector knowledge into how the platform's assessments are designed and configured.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Development Opportunities
This is a role with real room to grow. You'll take your existing expertise and learn to express it through AI, gaining hands-on exposure to product management, AI assessment design, and quality assurance in a fast-moving legal-tech business, working closely with experienced Product Managers and developers. We actively support learning on the job, and you'll be encouraged to deepen your data and analytical skills so you can turn your domain knowledge into ever more effective configuration over time.
Why Ctrl AI
Ctrl AI is redefining dispute resolution through intelligent automation, backed by leading investors and partnered with major technology and regulatory stakeholders. You'll join a product team at an inflection point, in a role where your professional judgement about what makes an assessment sound directly shapes how much clients can trust what the platform produces — work that is genuinely central to the company's mission, and a rare chance to put deep ADR and ombudsman expertise at the heart of how the AI itself is built.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills