Crossing Hurdles
Software Engineer - Python | Remote
United Kingdom
$19 – $20/hr
Posted 8 days ago
How your CV stacks up
1Upload CV
2Analyse CV
3Improve CV
Upload your CV to see how well it fits this job role
?%
Position: Senior Software Engineer – Python (LLM Evaluation & Repository Validation)
Type: Contractor Assignment (3 months)
Compensation: $19-$20/hr
Location: Remote
Commitment: 40 hrs/week with some overlap with PST
Role Responsibilities
- Evaluate and analyze GitHub issues across widely used open-source repositories.
- Set up and configure development environments for repositories, including Docker setup.
- Modify and run codebases locally to evaluate LLM performance in debugging and bug-fixing scenarios.
- Evaluate unit test coverage and assess the quality of existing tests.
- Work with real-world Python repositories to identify engineering tasks suitable for LLM evaluation.
- Collaborate with researchers to expand datasets used for training and evaluating AI models.
- Identify repositories and issues that present challenging real-world scenarios for LLMs.
- Support the creation of realistic software engineering tasks based on repository histories.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
- Strong experience in software development.
- Strong experience with Python programming.
- Proficiency in Git, Docker, and development environment setup.
- Experience working with well-maintained public GitHub repositories.
- Ability to understand, modify, and test complex codebases.
- Strong analytical thinking and problem-solving skills.
- Excellent written English and ability to document findings clearly.
- Ability to work independently in a remote environment.
- Desktop or laptop with a stable internet connection.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Preferred Qualifications
- Experience contributing to open-source projects.
- Exposure to LLM evaluation, AI research, or machine learning projects.
- Experience with developer tools, automation agents, or CI/CD pipelines.
Application Process
- Application Form
- ICF + Profile Review
- Assessment
- Submit
Trusted by 25,000+ job seekers
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Python
Git
Docker
Software Development
Analytical Thinking
Problem-Solving
Unit Testing
AI Research
Machine Learning
Open-Source Projects
Development Environment Setup
Code Modification
Documentation
Collaboration
Automation Agents
CI/CD Pipelines
Location