Synthires
Data Labeling Expert (Remote | $14–$36/hr)
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior AI Trainer
Position
Contractor
Compensation
$14–$36/hour
Location
Remote
About the Opportunity
micro1 is seeking Senior AI Trainers to support a customer-driven project focused on improving the quality, reliability, and performance of AI systems through expert-level training and evaluation.
In this role, selected contributors will use their generalist expertise and hands-on familiarity with AI products to evaluate model performance, develop and test prompts, annotate outputs, and provide structured feedback. Your work will help shape how next-generation AI systems learn, reason, and respond across a wide range of real-world scenarios.
Responsibilities
- Evaluate the performance of AI chat and search tools under standardized and repeatable conditions.
- Apply detailed grading guidelines to accurately evaluate, rank, and annotate AI-generated responses.
- Provide structured feedback designed to identify weaknesses and improve model performance.
- Write, refine, and stress-test prompts to assess model capabilities across diverse scenarios, edge cases, and user intents.
- Verify consistency and accuracy across evaluations and correct discrepancies between ratings and established rubrics.
- Use AI training platforms and evaluation tools to record findings and submit evaluation datasets according to project standards.
- Collaborate with project trainers and other contributors to resolve ambiguities and improve evaluation guidelines.
- Participate in ongoing quality reviews and incorporate feedback to maintain rigorous training and annotation standards.
- Maintain accuracy and consistency across assigned evaluation tasks and project milestones.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Qualifications
- Exceptional attention to detail and accuracy when reviewing and evaluating AI-generated content.
- Strong written and verbal communication skills for collaboration, reporting, and project updates.
- Strong time-management and self-organization skills for independent remote work.
- Analytical and problem-solving mindset with a proactive approach to resolving evaluation challenges.
- Ability to follow detailed evaluation guidelines and apply grading criteria consistently.
- Comfort working with AI-generated content and structured evaluation workflows.
Preferred Qualifications
- Experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects.
- Familiarity with AI products, prompt engineering, and common model behaviors and limitations.
- Experience writing evaluation rubrics or grading model outputs.
- Experience reviewing AI responses for accuracy, helpfulness, and safety.
- Background in AI training, machine learning data preparation, or LLM-focused projects.
- Experience using AI annotation, evaluation, or training platforms.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Key Areas of Expertise
- AI Model Evaluation
- AI Training
- LLM Evaluation
- AI Chat & Search Evaluation
- Prompt Engineering
- Prompt Testing
- Data Labeling
- Data Annotation
- RLHF
- Evaluation Rubrics
- Model Response Grading
- AI Quality Assurance
- Model Behavior Analysis
- AI Safety Evaluation
- Structured Feedback
- Quality Control
- Attention to Detail
- Remote Project Management
Compensation & Engagement
- Compensation: $14–$36/hour
- Engagement Type: Contractor
- Work Arrangement: Fully remote
- Location Eligibility: Northern America and Europe
- Project Type: Customer-driven AI training and evaluation
- Work Focus: AI model evaluation, prompt development, annotation, quality review, and structured feedback
- Openings: Approximately 50 positions
Application Process
- Submit your application with your resume and relevant experience.
- Demonstrate your ability to evaluate AI-generated content accurately and consistently.
- Complete any required AI evaluation, annotation, or domain-specific assessment.
- Complete onboarding and training on the applicable evaluation guidelines and tools.
- Begin contributing to AI training, evaluation, and quality-assurance workflows.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location