Ocho
Senior AI Software Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior AI Software Engineer
At-a-Glance
- Senior backend role building the core of an AI operating system
- Java, Go and Python across LLM integration, agent orchestration and retrieval infrastructure
- AWS, Neo4j, distributed systems at real scale
- Platform already live and in daily operational use with major customers
- Share options and an engineering culture built around AI tooling
About the Company
My client is a UK technology company building an AI operating and orchestration layer that puts intelligent systems to work inside large, complex organisations where accuracy and accountability really matter. The platform is already live and in daily operational use with major customers. The engineering group is small, senior and unusually fast moving, with AI tooling built into how the team genuinely works rather than bolted on afterwards.
The Role
This is core platform engineering rather than model research. You will build the services that make AI usable at scale: orchestration layers, retrieval infrastructure, evaluation pipelines and the plumbing that keeps it all reliable in constrained environments. The codebase is modern, the team is senior, and there is very little between deciding something and shipping it. It suits an engineer who wants to build AI infrastructure properly rather than assemble it from tutorials.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Key Responsibilities
- Design and build core backend services underpinning the AI platform
- Build and maintain LLM integration and agent orchestration layers
- Develop retrieval infrastructure across graph and vector stores
- Own performance, reliability and observability of the services you build
- Deploy and operate services on AWS
- Build automated evaluation into the delivery pipeline
- Review code and raise the technical bar across the team
- Mentor mid-level engineers as the team grows
What You'll Need
Essential:
- 5+ years building production backend systems
- Strong in Java or Go, plus working Python
- Hands-on experience integrating large language models into production software
- Solid cloud experience, ideally AWS
- Comfortable with distributed systems and microservice architectures
- Eligible for UK security clearance
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Desirable / Nice to Have:
- Neo4j or another graph database in production
- Experience with agent frameworks or LLM evaluation tooling
Why Apply?
- Build AI infrastructure that is genuinely in operational use
- Modern stack with no meaningful legacy drag
- Share options as part of the package
- AI development tooling expected and actively encouraged
- Flexible working pattern
- Senior team where technical arguments are decided on merit
- Strong progression as the platform and customer base expand
Next Steps
Send your CV to Brendan McCrory at brendan.mccrory@example.com, or connect with me on LinkedIn if you would prefer an informal chat before anything goes anywhere.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills