Crossing Hurdles
Data Annotator (Greek) | $15/hr Remote
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
LLM – AI Quality Analyst (Personalization) – Greek
Position: LLM – AI Quality Analyst (Personalization) – Greek
Type: Short-Term Contract (1 month)
Compensation: $11–$15 per hour
Location: Remote
Commitment: Part-time availability required (30–40 hours/week with 4 hours overlap with PST)
About the Role
Evaluate a personalization feature for Gemini, a Google AI model, by assessing how well it integrates and uses user-specific data (e.g., past conversations, Gmail, Google Search, and YouTube activity) to generate contextually relevant and helpful responses.
Responsibilities
- Design and execute multi-turn conversational prompts to test the AI’s ability to utilize personal information and experiences effectively.
- Assess the model’s intent alignment and personalization accuracy, ensuring responses are relevant and grounded in user context.
- Evaluate potential flaws, including:
- Faulty inferences
- Hallucinations (fake or misleading information)
- Grounding issues (where responses diverge from available data)
- Check if personal data is incorporated naturally into responses without overuse (overnarration).
- Perform side-by-side evaluations and stack-rank responses based on:
- Helpfulness
- Naturalness
- Usability
- Provide clear, structured rationales referencing key conversation turns for feedback.
- Extract and verify debug information to confirm correct use of data summaries and sources.
- Maintain data hygiene by securely deleting evaluation conversations post-use.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
- Experience in data annotation, AI quality evaluation, content moderation, or related fields.
- Native-level Greek proficiency (reading/writing required).
- Degree or equivalent experience in a relevant field, such as:
- Policy
- Law
- Ethics
- Linguistics
- Journalism
- Computer Science
- Willingness to use a personal Google account with enabled data sources (Gmail, Search, YouTube) for testing.
- Strong analytical skills and attention to detail.
- Experience with creative prompt engineering and understanding of personalization concepts.
- Ability to evaluate nuanced and ambiguous AI responses.
- Skills to provide structured feedback and clear written explanations.
- Excellent written communication and collaboration.
- Ability to work independently in a remote setting.
- Reliable desktop/laptop with a stable internet connection.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Application Process
- Fill out the application form.
- Complete the ICF (Intellectual Contributor Form).
- Complete the assessment.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location