Mercor
Generalist Expert - Data Evaluation
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Experienced Generalist
Type: Contract
Compensation: $45–$60/hour
Location: Remote
Commitment: 10–25 hours/week
Role Responsibilities
- Create and evaluate base prompts across a range of generalist topics.
- Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning.
- Develop prompt-response iterations using variations in length, style, and system prompts.
- Contribute to benchmarking efforts by identifying failure points in model responses.
- Create rubrics to evaluate the prompts and apply consistent quality standards across diverse content types.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Qualifications
Must-Have
- 2+ years of experience in research, education, writing, editing, or adjacent analytical fields.
- Proven ability to communicate complex topics clearly and concisely.
- Strong attention to detail and critical thinking skills.
- Comfort working independently with evolving task guidelines.
Preferred
- Familiarity with LLMs or AI-assisted writing tools.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to get started.
- Complete the Domain Expert interview.
- We aim to follow up within a few business days.
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location