Xperteez Technology
AI Agent Power User, Remote - Contract
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
AI Agent Power User
Role Type: Contract
Location: Remote (US, CA, UK, IE, AU, NZ)
In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Run complex, multi-step business scenarios using AI assistants such as ChatGPT and Claude, reflecting genuine professional workflows.
- Document each step, highlighting where AI performance aligns with or diverges from realistic business needs.
- Evaluate and score AI-generated outputs using specified rubrics and criteria, focusing on quality, completeness, and relevance.
- Draft clear, constructive, and actionable feedback based on rubric findings to inform AI research and product teams.
- Identify recurring patterns in AI behavior—strengths, weaknesses, and opportunities for process improvement.
- Connect AI tools to frequently used workplace platforms (e.g., Google Drive, Gmail, Slack, Notion) to mirror authentic use cases.
- Maintain meticulous written records and communicate findings in professional English, ensuring transparency and reproducibility.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Preferred Qualifications
Get help with your application
Your very own career expert that helps elevate your application to the next level.
- 5+ years of professional experience in any business function, utilizing technology to solve operational challenges.
- Completed Bachelor’s degree or higher in any discipline.
- Consistent, hands-on daily use of ChatGPT and/or Claude for actual work, not just experimentation.
- Experience grading, applying, or creating evaluation rubrics, QA scorecards, or content review guidelines (academic, QA, hiring, or annotation experience strongly valued).
- General comfort integrating AI tools with business software and productivity platforms.
- Demonstrated excellence in written English, with a focus on clear, actionable documentation and feedback.
- Authorized for contract work and based in the US, Canada, UK, Ireland, Australia, or New Zealand (US strongly preferred).
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location