Synthires
Software Engineer (Remote | $90–$140/hr)
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Software Engineer
Position: Software Engineer
Type: Contractor
Compensation: $90–$140/hour
Location: Remote
About the Opportunity
micro1 is engaging experienced Software Engineers to contribute to a project focused on evaluating advanced AI system outputs. You will apply your software engineering expertise to assess AI-generated technical content and help train next-generation AI systems through high-quality, real-world evaluation.
This engagement focuses on critical analysis and content evaluation rather than software development or feature delivery. You will review technical responses such as documentation, error messages, code comments, architectural explanations, and instructions, assessing whether they are accurate, clearly communicated, audience-appropriate, and genuinely useful.
Responsibilities
- Evaluate and compare AI-generated responses to technical prompts for correctness, clarity, tone, and usefulness.
- Assign analytical quality scores and provide detailed written rationales supporting each assessment.
- Identify technically accurate responses that are poorly communicated or insufficiently useful.
- Detect responses that appear fluent but contain factual inaccuracies or misleading information.
- Review technical content for subtle errors, inconsistencies, ambiguities, and omissions.
- Assess whether technical explanations and instructions are appropriate for their intended audience.
- Document observations and evaluation findings with precision and consistency.
- Collaborate asynchronously with project managers and reviewers to maintain alignment on evaluation standards.
- Work independently to complete assigned requirements and deliverables within established timelines.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Qualifications
- Native-level English fluency and exceptional written communication skills.
- Professional experience as a Software Engineer using a modern technology stack.
- Experience authoring or reviewing technical documentation, design documents, API references, or technical specifications.
- Experience conducting code reviews, design reviews, or providing feedback on technical writing.
- Strong ability to evaluate technical communication for accuracy, clarity, audience appropriateness, and instructional value.
- Excellent analytical and critical-thinking skills.
- Meticulous attention to detail when reviewing technical content.
- Strong editing and written communication abilities.
- Ability to work independently and consistently in a remote environment.
Preferred Qualifications
- Experience evaluating technical documentation or developer-facing content at scale.
- Strong understanding of software architecture and engineering concepts.
- Experience reviewing API documentation, implementation guidance, or technical instructions.
- Familiarity with AI model evaluation, annotation, or RLHF projects.
- Experience identifying subtle technical inaccuracies in otherwise well-written content.
- Strong ability to distinguish technical correctness from effective communication.
- Experience working asynchronously with distributed technical or review teams.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Compensation
- $90–$140 per hour
- Contractor engagement
- Fully remote
- Work focused on AI-generated technical content evaluation and analysis
Eligibility
- Candidates should have professional Software Engineering experience with a modern technology stack.
- Strong written English and technical communication skills are essential.
- Prior AI evaluation or annotation experience is not required.
Application Process
- Submit your application highlighting your Software Engineering experience.
- Detail your experience with technical documentation, code review, design review, or technical writing.
- Demonstrate your ability to critically evaluate technical content for correctness, clarity, and usefulness.
- Selected candidates will be considered for the AI evaluation project based on their technical expertise and communication skills.
- Complete assigned evaluation work independently while following established project standards and deadlines.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location