Rodeo
Get started

Arm

Machine Learning Framework/Runtime Software Engineer

Cambridge
£73.5k – £99.5k/yr
Posted 1 day ago
Sign up to applySee more jobs like this
Get notified of more jobs like this · No spam, ever

How your CV stacks up

1Upload CV
2Analyse CV
3Improve CV

Upload your CV to see how well it fits this job role

?%

Specific Skills And Experience Required

We’re looking for strong C++ software development experience, ideally gained while building machine learning inference engines, runtime systems, or backend integration frameworks. Experience working with a machine learning inference framework such as LiteRT, TensorFlow Lite, ONNX Runtime, or a similar technology is also important.

A good understanding of how AI models execute in practice is essential, including graph processing, operator execution, memory management, and backend integration. This role involves analysing, investigating, diagnosing, and resolving complex functional or performance issues across frameworks, runtimes, compilers, drivers, and hardware abstraction layers.

The work brings together engineers across runtime, compiler, driver, and hardware teams to design, develop, integrate, test, and optimise solutions within a large, modular codebase. Strong analytical and problem-solving skills, combined with an interest in machine learning systems, AI acceleration, and performance optimisation, will support success in the role.

Beneficial but Not Required

Experience across every area below is not expected. Relevant knowledge or experience could include:

  • Developing delegates, execution providers, plugins, or other backend integration mechanisms
  • GPU programming or machine learning acceleration technologies such as Vulkan, OpenCL, TOSA, or compute kernels
  • Designing or implementing Ahead-of-Time or Just-in-Time compilation flows for AI workloads
  • Transforming graphs or working with operator partitioning, scheduling, memory planning, or model optimisation
  • Validating, benchmarking, profiling, or analysing AI model performance
  • Developing compiler technologies, intermediate representations, or hardware abstraction layers
  • Building automated tests and CI/CD workflows for large-scale software projects
  • Applying AI-assisted development tools responsibly to improve engineering productivity and software quality

What You Will Learn and Develop

Reasons to use Rodeo

I’m in my final year doing Economics and I don’t know whether to apply for grad schemes now or do a masters first. What do you think?

Honest answer — it depends on where you want to end up. A lot of top grad schemes (Big 4, civil service, banking) don’t need a masters. Let’s look at the ones you’d be competitive for now, and we can decide if a masters actually adds anything.

Also worth knowing: most autumn 2026 applications are open now. Timing matters more than you think.

Start with a chat, not a search bar

Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.

P

Graduate Consultant — 2026 Scheme

PwC·London, UK
£35,000/yr

Why you're a good match

Strong

Your economics background and your summer at a regional bank line up with what PwC looks for on the consulting scheme. Applications close in four weeks.

See breakdown
Save jobNot relevant
View details

It searches the market for you

Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.

Why you're a good match

You’ve got the grades and the economics background, and your bank internship is exactly the experience this scheme looks for. Apply soon — deadlines close within the month.

See breakdown
Strong

Experience fit

Your summer at the bank plus your econometrics coursework map directly to the day-one responsibilities on this scheme — client modelling, market briefings, and deal support.

See breakdown
Strong

Only hits

No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.

Interested in exploring how machine learning models move from high-level frameworks through the software stack to hardware acceleration?

This role provides opportunities to deepen expertise in machine learning runtime development and hardware-accelerated AI execution. The work spans the end-to-end AI software stack, from framework-level model execution and backend delegation through compiler flows to NGP acceleration.

Working collaboratively across Arm provides exposure to inference engines and runtimes, accelerator integration, operator partitioning and fallback mechanisms, AOT and JIT compilation, model validation and benchmarking, performance optimisation, and automated validation workflows.

There are also opportunities to build a broader understanding of how machine learning frameworks, software, compilers, and hardware come together to deliver efficient AI experiences on Arm technology.

Working at Arm

At Arm, we want our people to learn, contribute, and grow while working on technologies shaping the future of AI and computing. The role offers opportunities for professional development, collaboration with colleagues across our global engineering community, and exposure to challenging technical problems with real-world impact.

Arm provides a comprehensive range of employee benefits and support designed to help our people thrive at work and beyond. Benefits vary by location and can include support for health and wellbeing, financial wellbeing, time away from work, and professional development.

We want our recruitment process to be accessible and inclusive. Reasonable accommodations are available throughout the recruitment process, and we encourage candidates who require support to let us know so that appropriate adjustments can be considered.

If Skilled Worker sponsorship is required, Arm will meet costs associated with sponsorship for the employer only. Fees associated with the individual’s application, such as the visa application fee and Immigration Health Surcharge, will be the responsibility of the successful candidate.

Get help with your application

Your very own career expert that helps elevate your application to the next level.

Get help applying for this job

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Salary Range: £73,500 - £99,500 per year

Trusted by 25,000+ job seekers

“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”

Jessica, London

Get help applying for this job

Skills

C++
Machine Learning Inference Engines
LiteRT
TensorFlow Lite
ONNX Runtime
Graph Processing
Memory Management
GPU Programming
Vulkan
OpenCL
TOSA
AOT Compilation
JIT Compilation
CI/CD
Performance Optimisation
Hardware Abstraction Layers

Location

Cambridge, England, United Kingdom

Sign up to applySee more jobs like this