Jobs Ai
Software Quality Engineer (Remote)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Role: Software Quality Engineer (Remote)
Location: Remote (Work from Anywhere)
Job Type: Full-Time
Payout: Competitive, based on experience
Role Overview:
We are hiring for one of our clients, seeking a Agentic Coding Annotator - Online / Offline Tasks to work on a full-time basis. This role involves working with realistic coding tasks in an agentic coding harness, reviewing model trajectories, verifying solutions, and producing high-quality annotations. Candidates are expected to read and debug code, validate behavior, follow detailed process rules, and make consistent judgment calls across model runs.
Key Responsibilities:
- Execute realistic coding tasks within the assigned agentic coding harness while maintaining model blindness and session independence
- Follow task instructions, milestones, planned interactions, and evaluation guardrails consistently across runs
- Verify model outputs by reading code, running commands, checking logs, and inspecting generated artifacts
- Design multi-step, realistic coding tasks including user intent and milestone structure for offline evaluations
- Write clear, specific, evidence-based rationales for trajectory rankings and assessments
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills & Qualifications:
- Proficiency in Python, JavaScript, Java, C++, or SQL for code analysis and debugging
- Experience working with realistic software tasks beyond toy problems or shallow code-review exercises
- Ability to design task-specific rubrics and binary evaluation criteria for model outputs
- Strong attention to detail to ensure high-quality annotations and consistent grading
- Comfort with debugging, test validation, and manual verification of software behavior
Get help with your application
Your very own career expert that helps elevate your application to the next level.
More About the Opportunity:
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement and deployment of powerful AI systems. The work directly supports the development of agentic coding models used for mission-critical applications.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location