Who We Are Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world’s most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver™, to support a wide range of applications, from robotaxis and commercial fleets to personally owned vehicles. With technology proven over years of self-driving deployments, Nuro gives the automakers and mobility platforms a clear path to AVs at commercial scale—empowering a safer, richer, and more connected future.About the Role We are seeking a highly experienced Staff Software Engineer to join our ML Infrastructure team, focusing on optimizing training runtime efficiency and input pipelines for model training, evaluation, and distillation workloads. In this role you will enable models to train faster and more efficiently – accelerating our self-driving roadmap of commercial and personal mobility.About the Work In this role you will contribute to the overall ML Infrastructure strategy, particularly in areas related to runtime efficiency and goodput. Specifically, your areas of responsibility will include:<ul><li>Collaborate with ML practitioners and other infrastructure teams to understand their needs and integrate optimized input pipelines seamlessly into their workflows.</li><li>Detect, diagnose, and resolve performance bottlenecks across training, eval, and model distillation workflows.</li><li>Optimize training performance, resource utilization, and ensure consistent, reproducible model training outcomes.</li><li>Optimize input data pipelines to increase runtime goodput, ensuring accelerators maximize their "time on task" and minimize idle cycles.</li><li>Champion best practices for robust, reproducible, and debuggable ML experimentation.</li></ul>About You <ul><li>B.S./M.S./Ph.D. in Computer Science, Electrical Engineering, or related technical field (or equivalent experience).</li><li>4+ years of professional experience in ML infrastructure, distributed training, or ML systems engineering, scaling models on multi-node, multi-accelerator clusters.</li><li>Understanding of training, evaluation, and distillation workflows for billion-parameter models</li><li>Expert-level knowledge in distributed systems and (remote) Python</li><li>Strong skills in profiling, debugging, and optimizing quantized workloads.</li><li>Experience with ML compilers and strategies to reduce startup overhead</li><li>Familiarity with model distillation and efficient inference workflows.</li></ul>Bonus Points <ul><li>Previous contributions to open source ML infra projects or research publications in ML systems.</li><li>Hands-on experience with Foundation Model infrastructure </li><li>Highly proficient in C++, distributed systems, ML framework internals (e.g., NCCL, Horovod, DeepSpeed, Ray)</li></ul>At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $235,030 and $352,290 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics. #li-dnp

We believe that great technology should benefit everyone. The team at Nuro is accelerating a future where robots make life easier and help us connect to the people and things we love. Together, we're pushing the boundaries of robotics to improve human life.
Dave Ferguson and Jiajun Zhu have devoted their careers to robotics and machine learning, most recently as Principal Engineers at Google's self-driving car project (now Waymo). They founded Nuro in 2016 to harness the power of robotics and artificial intelligence to solve new challenges at a global scale.
Our vehicle is a fully autonomous, on-road vehicle designed to transport goods quickly, safely, and affordably.
With no driver or passengers to worry about, our vehicle has been engineered from the ground up to keep what's outside even safer than what's inside.
Efficient, electric, and fully autonomous, it delivers life's needs at a price anyone can afford.

Senior/Staff Machine Learning Engineer, Training Runtime Performance 

Who We Are&nbsp;Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world’s most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver™, to support a wide range of applications, from robotaxis and commercial fleets to personally owned vehicles. With technology proven over years of self-driving deployments, Nuro gives the automakers and mobility platforms a clear path to AVs at commercial scale—empowering a safer, richer, and more connected future.About the Role We are seeking a highly experienced Staff Software Engineer to join our ML Infrastructure team, focusing on optimizing training runtime efficiency and input pipelines for model training, evaluation, and distillation workloads. In this role you will enable models to train faster and more efficiently – accelerating our self-driving roadmap of commercial and personal mobility.About the Work In this role you will contribute to the overall ML Infrastructure strategy, particularly in areas related to runtime efficiency and goodput. Specifically, your areas of responsibility will include:<ul><li>Collaborate with ML practitioners and other infrastructure teams to understand their needs and integrate optimized input pipelines seamlessly into their workflows.</li><li>Detect, diagnose, and resolve performance bottlenecks across training, eval, and model distillation workflows.</li><li>Optimize training performance, resource utilization, and ensure consistent, reproducible model training outcomes.</li><li>Optimize input data pipelines to increase runtime goodput, ensuring accelerators maximize their "time on task" and minimize idle cycles.</li><li>Champion best practices for robust, reproducible, and debuggable ML experimentation.</li></ul>About You <ul><li>B.S./M.S./Ph.D. in Computer Science, Electrical Engineering, or related technical field (or equivalent experience).</li><li>4+ years of professional experience in ML infrastructure, distributed training, or ML systems engineering, scaling models on multi-node, multi-accelerator clusters.</li><li>Understanding of training, evaluation, and distillation workflows for billion-parameter models</li><li>Expert-level knowledge in distributed systems and (remote) Python</li><li>Strong skills in profiling, debugging, and optimizing quantized workloads.</li><li>Experience with ML compilers and strategies to reduce startup overhead</li><li>Familiarity with model distillation and efficient inference workflows.</li></ul>Bonus Points <ul><li>Previous contributions to open source ML infra projects or research publications in ML systems.</li><li>Hands-on experience with Foundation Model infrastructure&nbsp;</li><li>Highly proficient in C++, distributed systems, ML framework internals (e.g., NCCL, Horovod, DeepSpeed, Ray)</li></ul>At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $235,030 and $352,290 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics. #li-dnp

Senior/Staff Machine Learning Engineer, Training Runtime Performance

About the Job

About the Company

Nuro

Similar Jobs

Staff Machine Learning Engineer

Staff Machine Learning Engineer

Senior/Staff ML Engineer, AI-Assisted Efficiency Optimization

Senior/Staff ML Engineer, AI-Assisted Efficiency Optimization

Senior/Staff ML Performance Engineer, Low-Precision Training & Model Quantization

Senior/Staff ML Performance Engineer, Low-Precision Training & Model Quantization

Senior Machine Learning Engineer

Senior Machine Learning Engineer

Staff ML Platform Engineer

Staff ML Platform Engineer

Senior/Staff Software Engineer, Machine Learning Infrastructure

Senior/Staff Software Engineer, Machine Learning Infrastructure

Software Engineer, Machine Learning Infrastructure

Software Engineer, Machine Learning Infrastructure

Senior Software Engineer, Machine Learning

Senior Software Engineer, Machine Learning

Machine Learning Engineer

Machine Learning Engineer

Senior Machine Learning Developer

Senior Machine Learning Developer