DataAnnotation
Senior Software Engineer (Agentic Coding RL Environments)
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About Surge AI
Surge AI partners with the world's leading AI labs to build the benchmarks and RL environments that train and evaluate frontier models. Most benchmarks cut corners because expert humans are expensive. Our model is the opposite: we pay experts enough that we don't have to.
Position
Senior Software Engineer (Agentic Coding RL Environments)
Type
Contract
Compensation
$100–150+/hour ($200–300k+/year). Rates scale with your experience, and many go past the top of that range.
Location
Fully remote, any time zone
Role Responsibilities
- Build coding RL environments and benchmarks that test how agents perform on realistic software engineering tasks
- Design tasks based on real engineering work
- Review and red-team model output to surface meaningful failures
- Write the tests, rubrics, and success criteria that separate good work from slop
- Give structured feedback that improves future models
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Qualifications (Must-Have)
- Professional software engineering experience shipping real, scaled production systems
- Expertise in at least one common tech stack (TypeScript, Python, Ruby, PHP, Java, Rust, Go, or C++)
- Strong judgment about what "good code" and a "meaningful model failure" look like
- Comfort working independently, and giving direct, code-review-style feedback
- Availability for a meaningful commitment (most contributors work 20 to 40+ hours per week)
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Note
You do not need prior AI or ML experience. Strong engineering judgment and attention to detail matter most.
What Makes This Different
- No managers, 1:1s, OKR ceremonies, or Jira backlog grooming
- You choose when and where you work
- You are judged on the quality of what you produce, not speed
Application Process
- Coding capability screen (replaces a multi-round interview loop)
- ID verification
- Background check
- Paid first real task. Do well, and you're on the team.
Questions?
Email swe@surgehq.ai
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills