Hire Feed
Software Engineer – AI Evaluation (Remote)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Role: Software Engineer – AI Evaluation (Remote)
Location: Remote (Work from Anywhere)
Job Type: Part-Time
Payout: Competitive, based on experience
Role Overview:
We are hiring for one of our clients, seeking a Senior Software Engineer – LLM Evaluation (US/Canada/WEU based) to work on a part-time basis. You will create cutting-edge datasets for training, benchmarking, and advancing large language models while collaborating closely with researchers. This includes curating code examples, refining AI-generated code, and designing verification mechanisms for software engineering tasks.
Key Responsibilities:
- Curate code examples, provide precise solutions, and make corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
- Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
- Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry benchmarks.
- Build verification agents to assess code quality and identify error patterns.
- Hypothesize on software engineering lifecycle steps and evaluate model capabilities against them.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills & Qualifications:
- Several years of software engineering experience (3 years or more).
- Strong expertise in building full-stack applications and deploying scalable, production-grade software.
- Deep understanding of software engineering principles including prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, and operational maintenance.
- Proficiency in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
- Experience designing verification mechanisms for automated solution validation.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
More About the Opportunity:
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet | IT Services and IT Consulting | Data Infrastructure and Analytics | Research Services industry, contributing to the advancement of frontier AI systems. The position supports customers in accelerating research and transforming AI proofs of concept into proprietary intelligence.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location