Crossing Hurdles
AI Response Evaluator | $20/hr Remote
United Kingdom
$15 – $20/hr
Posted about 18 hours ago
Get notified of more jobs like this · No spam, ever
How your CV stacks up
1Upload CV
2Analyse CV
3Improve CV
Upload your CV to see how well it fits this job role
?%
Position: LLM - AI Quality Analyst (Personalization) - English
Type: Short-Term Contractor Assignment (4 months)
Compensation: $15 - $20 per hour
Location: Remote
Commitment: Up to 40 hours per week with PST overlap
Role Responsibilities
- Design and evaluate multi-turn prompts using personal context and experiences.
- Assess AI responses for personalization, grounding, integration, and helpfulness.
- Compare model responses side-by-side and evaluate their overall quality.
- Identify inaccurate personalization, unsupported inferences, and other response issues.
- Provide clear written rationales and detailed feedback on model performance.
- Review the use of relevant information in responses and follow project data-handling procedures.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
- Strong English proficiency, including reading and writing.
- Strong analytical thinking and attention to detail.
- Ability to evaluate nuanced and ambiguous AI responses.
- Ability to create and assess multi-turn conversational prompts.
- Strong written communication skills and ability to provide structured feedback.
- Ability to work independently in a remote environment.
- Reliable computer and internet connection.
- Willingness to use a personal Google account and required data sources for the evaluation process.
- Full-time availability in the local time zone for applicable locations.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Application Process
- Apply via the assessment link.
- Check your email for next steps and further assessment instructions.
Trusted by 25,000+ job seekers
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
English Proficiency
Analytical Thinking
Attention To Detail
Prompt Engineering
AI Evaluation
Written Communication
Structured Feedback
Data Handling
Location