Rodeo
Get started

Jobgether

Senior Backend Engineer: Machine Learning Infrastructure

United Kingdom
$80k – $120k/yr
Posted about 7 hours ago
Sign up to applySee more jobs like this
Get notified of more jobs like this · No spam, ever

How your CV stacks up

1Upload CV
2Analyse CV
3Improve CV

Upload your CV to see how well it fits this job role

?%

Senior Backend Engineer: Machine Learning Infrastructure

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Backend Engineer: Machine Learning Infrastructure based in United Kingdom.

As a Senior Backend Engineer, you’ll help build the infrastructure that enables machine learning teams to develop, deploy, and operate models reliably at scale.

You’ll own critical backend services, data pipelines, and platform capabilities supporting workloads ranging from traditional machine learning to LLMs.

The role combines distributed systems engineering, cloud infrastructure, API development, observability, and platform design.

You’ll work closely with ML and product teams to understand their needs and turn them into reusable, self-service infrastructure.

You’ll have significant autonomy to make technical decisions, evaluate trade-offs, and take solutions from design through continuous improvement.

The environment is remote-first, collaborative, and strongly oriented toward ownership, thoughtful engineering, and modern AI-assisted development.

This is an opportunity to have a direct impact on how teams build and operate machine learning products at scale.

Accountabilities

  • Design, build, deploy, and operate high-load distributed backend services and APIs that support machine learning infrastructure.
  • Take end-to-end ownership of core ML services and associated data pipelines, from system design and implementation through deployment, observability, maintenance, and continuous improvement.
  • Build reliable, scalable, and reusable infrastructure components that make machine learning workloads easier for product and ML teams to run and operate.
  • Partner closely with ML and product engineers to understand their requirements and translate them into effective platform capabilities and services.
  • Make and communicate technical decisions by evaluating architectural options, trade-offs, scalability, reliability, and operational requirements.
  • Maintain a high standard for service reliability, performance, observability, and maintainability.
  • Proactively identify technical and operational problems and take ownership of resolving them rather than allowing issues to remain unaddressed.
  • Use modern AI-assisted development tools thoughtfully while maintaining strong ownership of system design, engineering decisions, and code quality.
  • Contribute to a collaborative engineering culture by sharing knowledge, supporting teammates, and helping others solve technical challenges.

Reasons to use Rodeo

I’m in my final year doing Economics and I don’t know whether to apply for grad schemes now or do a masters first. What do you think?

Honest answer — it depends on where you want to end up. A lot of top grad schemes (Big 4, civil service, banking) don’t need a masters. Let’s look at the ones you’d be competitive for now, and we can decide if a masters actually adds anything.

Also worth knowing: most autumn 2026 applications are open now. Timing matters more than you think.

Start with a chat, not a search bar

Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.

P

Graduate Consultant — 2026 Scheme

PwC·London, UK
£35,000/yr

Why you're a good match

Strong

Your economics background and your summer at a regional bank line up with what PwC looks for on the consulting scheme. Applications close in four weeks.

See breakdown
Save jobNot relevant
View details

It searches the market for you

Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.

Why you're a good match

You’ve got the grades and the economics background, and your bank internship is exactly the experience this scheme looks for. Apply soon — deadlines close within the month.

See breakdown
Strong

Experience fit

Your summer at the bank plus your econometrics coursework map directly to the day-one responsibilities on this scheme — client modelling, market briefings, and deal support.

See breakdown
Strong

Only hits

No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.

Requirements

  • 5+ years of professional experience in backend engineering, platform engineering, or a closely related discipline.
  • Extensive professional experience with Python, the primary programming language used in the environment.
  • Hands-on experience developing and operating software on a public cloud platform such as AWS, GCP, or Azure, or working with self-managed Kubernetes; experience with AWS is particularly relevant.
  • Strong experience designing and building distributed, high-load services and APIs.
  • Solid understanding of data structures, algorithms, and the trade-offs involved in selecting and implementing them.
  • Strong system-design mindset, with the ability to design solutions before implementation and understand the architectural implications of technical decisions.
  • Experience working effectively with modern AI-assisted coding and development tools, combined with the judgment to understand their appropriate use and limitations.
  • High level of ownership, initiative, and accountability, with a proactive approach to identifying and solving problems.
  • Strong communication and collaboration skills, with a friendly and supportive approach to working with teammates and cross-functional partners.
  • Experience with Rust, C, C++, or Go is a strong advantage.
  • Previous experience developing or contributing to ML platforms or machine learning infrastructure is highly valued.
  • Experience setting up and operating vector databases such as Qdrant, Milvus, Weaviate, OpenSearch, or pgvector is a plus.
  • Experience with model serving or inference infrastructure, including LLM workloads, is advantageous.
  • Experience with Infrastructure as Code tools such as Terraform is a plus.

Get help with your application

Your very own career expert that helps elevate your application to the next level.

Get help applying for this job

Benefits

  • Fully remote working environment, allowing you to choose where you live.
  • Unlimited vacation time, with employees strongly encouraged to take at least three weeks of vacation each year.
  • Home-office stipend to help you create a productive and comfortable remote workspace.
  • Apple laptop provided for new employees.
  • Annual training and professional development budget.
  • Maternity and paternity leave for eligible employees.
  • Competitive base salary of $80,000–$120,000 USD, depending on knowledge, skills, experience, and interview results.
  • Stock options offered in addition to the base salary.
  • Regular team offsites providing opportunities for collaboration and connection.
  • Opportunity to work with experienced colleagues and contribute to meaningful, technically challenging projects.
Trusted by 25,000+ job seekers

“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”

Jessica, London

Get help applying for this job

Location

United Kingdom

Sign up to applySee more jobs like this