Crossing Hurdles
Data Annotator (English) | $11.5/hr Remote
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Position: LLM AI Quality Analyst (Personalization) English
Type: Short-Term Contract
Location: Remote
Commitment: 30 40 hours/week
Compensation: $11.5/hr
Engagement Length: 1 month
Start Date: Immediate
Role Responsibilities
Design multi-turn conversational prompts based on personal context Evaluate personalized AI responses for relevance, grounding, and helpfulness Assess correct and incorrect use of personal data in model outputs Perform side-by-side (SxS) evaluation and ranking of AI responses Identify grounding errors, poor inferences, and forced personalization Write clear, structured rationales referencing specific conversation turns Extract and verify model debug information and data source usage Maintain strict data hygiene by deleting evaluation conversations
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
English fluency (reading and writing) Strong experience in data annotation, AI quality evaluation, content moderation, or related roles Strong analytical thinking and attention to detail Ability to evaluate nuanced and ambiguous AI responses Comfortable using a primary personal Google account with enabled data sources BS/BA degree or equivalent experience in a relevant analytical field Strong written communication and structured feedback skills Self-motivated and able to work independently in a remote setting
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Application Process
Fill out the application form Complete the ICF Assessment
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location