Harnham
Technical CRO Consultant (AI-Focused Testing)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Technical CRO Consultant, AI Product Experimentation
London, Outside IR35, £400-440/day
This is an opportunity to help shape the rollout of AI-native products at scale. The business is investing heavily in conversational AI, recommendation engines, decisioning tools and agentic AI experiences, and needs a hands-on CRO specialist who can ensure these products deliver measurable commercial impact through robust experimentation and optimisation.
The Company
They are a large, customer-focused organisation undergoing significant digital and AI transformation. Their established experimentation function has strong foundations in traditional testing and optimisation. As AI-powered experiences become a growing part of the customer journey, they are looking to add specialist expertise to bridge the gap between CRO and AI product delivery. This project is expected to evolve as new AI workstreams are uncovered across the organisation.
The Role and Deliverables
- Lead experimentation and conversion optimisation activities across AI-powered digital products and customer experiences.
- Design, implement and evaluate tests for conversational AI, recommendation engines, decisioning tools and other AI-native products.
- Work closely with product, engineering and AI teams to ensure accurate instrumentation, tracking and measurement of performance.
- Use feature flagging and experimentation platforms to understand which experiences, features and AI models are driving commercial outcomes.
- Debug and validate experiment implementations, ensuring data quality and reliable reporting.
- Champion a conversion-focused mindset by challenging assumptions and evaluating the commercial impact of AI product decisions.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Your Skills & Experience
- Strong hands-on experience in Conversion Rate Optimisation (CRO) and digital experimentation.
- Experience testing, optimising or launching AI-powered products, including chatbots, conversational interfaces or LLM-based experiences.
- Practical knowledge of feature flagging platforms tools such as Launch Darkly or Statsig.
- Experience with platforms such as Optimizely, VWO, Adobe Target or similar technologies.
- Comfortable working alongside engineers and technical stakeholders, with the ability to translate business objectives into testable hypotheses.
- Strong understanding of instrumentation, analytics, debugging and experiment measurement.
- Commercially focused, with the ability to connect experimentation outcomes to conversion and business performance.
- Genuine interest in AI technologies and how they influence customer behaviour and digital experiences.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
How to Apply
If you have a blend of CRO expertise and hands-on experience working with AI-powered digital products, please apply with your latest CV.
Desired Skills and Experience
CRO, Conversion Rate Optimisation, AI, LLM, ML, Machine learning, Agent skills, Freelance, Contractor, A/B testing
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills