How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Analyst I
An exciting opportunity is available for a Senior Data Analyst to drive analytics and evaluation for enterprise-scale search and AI-powered retrieval systems. This role focuses on measuring search performance, developing experimentation frameworks, and delivering actionable insights that improve ranking quality, relevance, and user experience across advanced data products.
Working closely with data scientists, engineers, and product teams, you'll play a key role in shaping search evaluation strategies, optimizing AI-driven experiences, and enabling data-informed decision-making.
Key Responsibilities
- Lead analysis of search and retrieval system performance, including ranking quality and relevance.
- Define, standardize, and monitor search evaluation metrics such as NDCG, MAP, precision, recall, and CTR.
- Analyze user behaviour, query patterns, and content performance to identify optimization opportunities.
- Conduct in-depth analysis of ranking performance, query intent, and retrieval gaps.
- Support evaluation of AI-powered and retrieval-based applications.
- Design and lead A/B testing frameworks, ensuring statistical accuracy and meaningful experimentation.
- Partner with Product, Engineering, and Data Science teams to define success metrics and experiment strategies.
- Build scalable analytics workflows and reusable reporting templates.
- Develop dashboards and visualizations that track search performance and user engagement.
- Deliver clear, data-driven insights to both technical and non-technical stakeholders.
- Work with large-scale datasets using modern data platforms while maintaining high standards for data quality and measurement consistency.
- Collaborate with engineering teams to improve data collection, logging, and observability.
- Act as a trusted analytics partner across cross-functional teams and contribute to the continuous improvement of search evaluation practices.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
- Master's degree or PhD in Data Analytics, Statistics, Computer Science, or a related field (or equivalent practical experience).
- Significant experience in data analytics, business intelligence, or similar analytical roles.
- Strong proficiency in SQL and Python for large-scale data analysis.
- Advanced experience with business intelligence and data visualization tools such as Tableau, Power BI, Looker, or similar.
- Experience working with Databricks, Spark, or comparable large-scale data platforms.
- Strong understanding of experimental design, A/B testing, and statistical analysis.
- Experience measuring search and retrieval performance using metrics such as NDCG, recall, precision, and ranking metrics.
- Ability to translate complex analytical findings into clear business recommendations.
- Excellent communication and stakeholder management skills.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Preferred Experience
- Experience with search, ranking, recommendation, or information retrieval systems.
- Knowledge of indexing, ranking algorithms, and query understanding.
- Experience working with clickstream data and user behaviour analytics.
- Exposure to machine learning evaluation frameworks.
- Familiarity with Retrieval-Augmented Generation (RAG) systems and Generative AI applications.
Benefits
- Flexible and hybrid working options.
- Generous annual leave with the option to purchase additional leave.
- Private healthcare and wellbeing support.
- Pension scheme and life assurance.
- Share incentive programmes.
- Family-friendly leave policies.
- Professional development and study support.
- Volunteer leave and charity initiatives.
- Employee wellbeing programmes and additional lifestyle benefits.
This is an excellent opportunity for an experienced data professional looking to influence the performance of cutting-edge search and AI technologies while working on complex, high-impact analytical challenges within a collaborative, innovation-driven environment.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location