How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Analyst
Senior Data Analyst I
About the Role
An exciting opportunity is available for a Senior Data Analyst to drive analytics and evaluation for enterprise-scale search and AI-powered retrieval systems. This role focuses on measuring search performance, developing experimentation frameworks, and delivering actionable insights to improve Ranking Quality, relevance, and user experience across advanced data products.
Working closely with data scientists, engineers, and product teams, you’ll play a key role in shaping search evaluation strategies, optimizing AI-driven experiences, and enabling data-informed decision-making.
Key Responsibilities
- Lead analysis of search and retrieval system performance, including ranking quality and relevance
- Define, standardize, and monitor search evaluation metrics such as:
- NDCG
- MAP
- Precision and recall
- CTR
- Analyze user behaviour, query patterns, and content performance to identify optimization opportunities
- Conduct in-depth analysis of:
- Ranking performance
- Query intent
- Retrieval gaps
- Support evaluation of AI-powered and retrieval-based applications
- Design and implement A/B testing frameworks, ensuring statistical accuracy and meaningful experimentation
- Partner with Product, Engineering, and Data Science teams to:
- Define success metrics
- Develop experiment strategies
- Build scalable analytics workflows and reusable reporting templates
- Develop dashboards and visualizations tracking:
- Search performance
- User engagement
- Deliver clear, data-driven insights to both technical and non-technical stakeholders
- Work with large-scale datasets using modern data platforms while maintaining:
- High data quality standards
- Measurement consistency
- Collaborate with engineering teams to improve:
- Data collection
- Logging
- Observability
- Act as a trusted analytics partner across cross-functional teams and contribute to the continuous improvement of search evaluation practices
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
Mandatory
- Master’s degree or PhD in:
- Data Analytics
- Statistics
- Computer Science
- Or related field (or equivalent practical experience)
- Significant experience in:
- Data analytics
- Business intelligence
- Similar analytical roles
- Proficient in:
- SQL (for large-scale data analysis)
- Python
- Advanced experience with:
- Business intelligence tools
- Data visualization solutions such as:
- Tableau
- Power BI
- Looker
- Similar platforms
- Experience working with:
- Databricks
- Spark
- Comparable large-scale data platforms
- Strong understanding of:
- Experimental design
- A/B testing
- Statistical analysis
- Experience measuring:
- Search and retrieval performance
- Metrics including:
- NDCG
- Recall
- Precision
- Ranking metrics
- Ability to translate complex analytical findings into clear business recommendations
- Excellent:
- Communication skills
- Stakeholder management skills
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Preferred
- Experience with:
- Search
- Ranking and recommendation systems
- Information retrieval systems
- Knowledge of:
- Indexing
- Ranking algorithms
- Query understanding
- Experience working with:
- Clickstream data
- User behaviour analytics
- Exposure to:
- Machine learning evaluation frameworks
- Familiarity with:
- Retrieval-Augmented Generation (RAG) systems
- Generative AI applications
Benefits
- Flexible and hybrid working options
- Generous annual leave with the option to purchase additional leave
- Private healthcare and wellbeing support
- Pension scheme and life assurance
- Share incentive programmes
- Family-friendly leave policies
- Professional development and study support
- Volunteer leave and charity initiatives
- Enriching employee wellbeing programmes
- Additional lifestyle benefits
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location