Jobs Ai
AI Quality Analyst - Personalization (Remote)
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Role: AI Quality Analyst - Personalization (Remote)
Location: Remote (Work from Anywhere)
Job Type: Full-Time
Payout: Competitive, based on experience
Role Overview:
We are hiring for one of our clients, seeking an AI Quality Analyst (Personalization) - Hindi to evaluate a new personalization feature for an advanced AI model, assessing how well it uses personal data to generate relevant responses.
You will analyze the model’s ability to integrate information from past conversations, email, search, and video activity to deliver accurate and contextually appropriate outputs.
Key Responsibilities:
- Design and refine multi-turn prompts based on personal experiences to test the AI model’s personalization capabilities.
- Evaluate the quality of AI-generated responses across dimensions such as grounding, integration, and helpfulness.
- Identify instances of incorrect personalization, flawed inferences, or forced connections in model outputs.
- Compare side-by-side model responses to detect subtle differences and assess consistency.
- Provide detailed feedback on the model’s ability to align with user-specific context and intent.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills & Qualifications:
- Proficiency in Hindi with a high degree of competency in reading and writing.
- Experience in analytical evaluation of AI-generated content, particularly in personalization contexts.
- Ability to design creative and contextually relevant prompts for testing AI models.
- Strong attention to detail to assess nuanced and ambiguous AI responses.
- Willingness to use a personal Google account with enabled data sources for genuine evaluation.
- Familiarity with concepts related to AI personalization, grounding, and user intent alignment.
- Experience in multi-turn conversation analysis and response evaluation.
- Comfort with data privacy considerations when handling personal user information.
- Ability to work full-time with flexibility to support a global, 24-hour operations team.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
More About the Opportunity:
This role offers the chance to contribute to the development of a cutting-edge AI system used by leading enterprises, ensuring it delivers measurable impact through reliable personalization.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Required Skills:
AI evaluation, prompt engineering, Hindi language proficiency, quality analysis, personalization testing, AI response assessment, data analysis, multilingual evaluation, AI model testing, context understanding, attention to detail
Subtitles:
- AI Quality Analyst (Hindi) (Remote)
- AI Test Analyst - Personalization (Remote)
- Multilingual AI Evaluator (Remote)
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location