IC Resources
Senior Software Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
A well-funded AI engineering organisation is hiring a Senior Software Engineer to deploy, extend, and optimise a leading open-source LLM inference engine, across two core programmes: a scaling inference initiative and a high-assurance/regulated-environment initiative.
What You’ll Do
- Deploy, instrument, and monitor open-weight models served via the inference engine
- Build new engine features to support novel hardware architectures
- Extend the engine for accuracy, explainability, and accountability in regulated settings
- Contribute upstream to the relevant open-source community
- Optimise inference performance (latency, throughput, hardware utilisation)
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What They’re Looking For
- Senior-level Python + low-level programming (C/C++, Rust, CUDA)
- Direct contributions to a major inference/serving engine or similar ML infra project (e.g. PyTorch, Ray)
- Strong grasp of LLM inference internals (KV caching, batching, quantisation)
- Experience upstreaming to active OSS communities
- Hardware accelerator optimisation experience (GPU/TPU/etc.)
- Genuine enthusiasm for AI-assisted development (LLMs/agents as core tools)
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Nice to have: regulated-environment experience, AI safety involvement, MLOps/CI/CD depth.
If you think this role would be a good fit for you, please reach out to Charles Duran.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location