Luma
Research Scientist / Engineer – Training Infrastructure
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Job Title
You'll build the distributed systems that train Luma's large-scale multimodal models across thousands of GPUs, so researchers can focus on innovation on top of reliable, efficient, scalable infrastructure.
This is hard PyTorch, CUDA, and distributed-systems work — advanced parallelism, training stability, and utilization across massive clusters. It fits an engineer who's solved real problems training foundation models at scale. If you haven't worked at the level of FSDP and multi-node training, this is the wrong depth.
What You'll Own
- Design, implement, and optimize efficient distributed training systems for models across thousands of GPUs.
- Research and implement advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel).
- Build monitoring, visualization, and debugging tools for large-scale training runs.
- Optimize training stability, convergence, and resource utilization across massive clusters.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
First 90 Days
One way the first 90 could unfold.
- Days 1–30 — Immerse & Diagnose: Learn the current training stack and where stability and utilization hurt at scale.
- Days 30–60 — Ship & Validate: Land a parallelization or stability improvement that measurably helps a real training run.
- Days 60–90 — Scale & Systemize: Build the monitoring and tooling that keeps large runs reliable and efficient.
What You Bring
- Extensive distributed PyTorch training and parallelism in foundation-model training.
- Deep understanding of GPU clusters, networking, and storage systems.
- Familiarity with communication libraries (NCCL, MPI) and distributed-system optimization.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Nice to Have
- Strong Linux systems administration and scripting.
- Experience managing training runs across 100+ GPUs.
- Experience with containerization, orchestration, and cloud infrastructure.
About Luma
Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.
Compensation Range
$195K - $395K
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location