Crossing Hurdles
Generalist (Finnish) | $15/hr Remote
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Generalist (Finnish) | $15/hr Remote
LLM – AI Quality Analyst (Personalization) – Finnish
Position: LLM – AI Quality Analyst (Personalization) Type: Short-Term Contract (1 month) Compensation: $11–$15 per hour Location: Remote Commitment: Part-time availability required (30-40 hours/week with 4 hours overlap with PST)
About the Role
Evaluate a personalization feature for Gemini, assessing how effectively the AI leverages past conversations and user data to generate relevant, tailored responses.
Responsibilities
- Design and execute multi-turn conversational prompts requiring AI to utilise personal information and past experiences
- Assess model effectiveness in incorporating Gmail, Google Search, and YouTube activity for response generation
- Evaluate responses based on:
- Intent and general personalisation quality
- Grounding issues (e.g., flawed inferences or hallucinations)
- Integration of personal data in responses without overnarration
- Conduct side-by-side evaluations and stack-rank responses for:
- Helpfulness
- Naturalness
- Usability
- Provide clear, reasoned critiques referencing specific conversational turns
- Debug and verify data summaries and sources
- Maintain data hygiene by securely deleting post-evaluation conversations
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
- Proven experience in:
- Data annotation
- AI quality evaluation
- Content moderation, or related roles
- Strong Finnish proficiency (reading and writing)
- Degree (or equivalent experience) in fields such as:
- Policy
- Law
- Ethics
- Linguistics
- Journalism
- Computer Science
- Willingness to use a primary Google account with enabled personal data sources for evaluation
- Critical analytical thinking and attention to detail
- Prompt engineering and personalization experience
- Ability to assess and provide structured feedback on:
- Nuanced AI responses
- Ambiguous conversational submissions
- High-level written communication and collaboration skills
- Independent remote-work capabilities
- Reliable desktop/laptop with stable internet connection
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Application Process
- Apply via Easy Apply
- Check email for Google form application link
- Complete the form and submission tasks
- Finish ICF compliance
- Pass the assessment stage
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location