{"schemaVersion":"jobsearcher.job.v1","id":"04be48ec8213b18208e5cac7","url":"https://jobsearcher.com/jobs/04be48ec8213b18208e5cac7","canonicalUrl":"https://jobsearcher.com/jobs/04be48ec8213b18208e5cac7","title":"Machine Learning Engineer, ML Runtime & Optimization","description":"Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai's leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural \"XB100\" 2023 list of the world's top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in Nov. 2024.ResponsibilityThe ML Infrastructure team at Pony.ai provides a set of tools to support and automate the lifecycle of the AI workflow, including model development, evaluation, optimization, deployment, and monitoring.As a Machine Learning Engineer in ML Runtime & Optimization, you will be developing technologies to accelerate the training and inferences of the AI models in autonomous driving systems.This includes:Identifying key applications for current and future autonomous driving problems and performing in-depth analysis and optimization to ensure the best possible performance on current and next-generation compute architecturesCollaborating closely with diverse groups in Pony.ai including both hardware and software to optimize and craft core parallel algorithms as well as to influence the next-generation compute platform architecture design and software infrastructureApply model optimization and efficient deep learning techniques to models and optimized ML operator librariesWork across the entire ML framework/compiler stack (e.g.Torch, CUDA and TensorRT), and system-efficient deep learning modelsRequirementsBS/MS or Ph.D in computer science, electrical engineering or a related disciplineStrong programming skills in C/C++ or PythonExperience on model optimization, quantization or other efficient deep learning techniquesGood understanding of hardware performance, regarding CPU or GPU execution model, threads, registers, cache, cost/performance trade-off, etcExperience with profiling, benchmarking and validating performance for complex computing architecturesExperience in optimizing the utilization of compute resources, identifying and resolving compute and data flow bottlenecksStrong communication skills and ability to work cross-functionally between software and hardware teamsPreferred Qualifications:One or more of the following fields are preferredExperience with parallel programming, ideally CUDA, OpenCL or OpenACCExperience in computer vision, machine learning and deep learningStrong knowledge of software design, programming techniques and algorithmsGood knowledge of common deep learning frameworks and librariesDeep knowledge on system performance, GPU optimization or ML compilerCompensation And BenefitsBase Salary Range: $140,000 - $250,000 AnnuallyCompensation may vary outside of this range depending on many factors, including the candidate's qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.Also, we provide the following benefits to the eligible employees:Health Care Plan (Medical, Dental & Vision)Retirement Plan (Traditional and Roth 401k)Life Insurance (Basic, Voluntary & AD&D)Paid Time Off (Vacation & Public Holidays)Family Leave (Maternity, Paternity)Short Term & Long Term DisabilityFree Food & Snacks","company":"Ponyai","rawCompany":"ponyai","city":"Fremont","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-07T11:37:09.714Z","occupations":[{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541715","title":"Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)","slug":"research-and-development-in-the-physical-engineering-and-life-sciences-except-nanotechnology-and-biotechnology"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Machine Learning Engineer, ML Runtime & Optimization","description":"Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai's leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural \"XB100\" 2023 list of the world's top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in Nov. 2024.ResponsibilityThe ML Infrastructure team at Pony.ai provides a set of tools to support and automate the lifecycle of the AI workflow, including model development, evaluation, optimization, deployment, and monitoring.As a Machine Learning Engineer in ML Runtime & Optimization, you will be developing technologies to accelerate the training and inferences of the AI models in autonomous driving systems.This includes:Identifying key applications for current and future autonomous driving problems and performing in-depth analysis and optimization to ensure the best possible performance on current and next-generation compute architecturesCollaborating closely with diverse groups in Pony.ai including both hardware and software to optimize and craft core parallel algorithms as well as to influence the next-generation compute platform architecture design and software infrastructureApply model optimization and efficient deep learning techniques to models and optimized ML operator librariesWork across the entire ML framework/compiler stack (e.g.Torch, CUDA and TensorRT), and system-efficient deep learning modelsRequirementsBS/MS or Ph.D in computer science, electrical engineering or a related disciplineStrong programming skills in C/C++ or PythonExperience on model optimization, quantization or other efficient deep learning techniquesGood understanding of hardware performance, regarding CPU or GPU execution model, threads, registers, cache, cost/performance trade-off, etcExperience with profiling, benchmarking and validating performance for complex computing architecturesExperience in optimizing the utilization of compute resources, identifying and resolving compute and data flow bottlenecksStrong communication skills and ability to work cross-functionally between software and hardware teamsPreferred Qualifications:One or more of the following fields are preferredExperience with parallel programming, ideally CUDA, OpenCL or OpenACCExperience in computer vision, machine learning and deep learningStrong knowledge of software design, programming techniques and algorithmsGood knowledge of common deep learning frameworks and librariesDeep knowledge on system performance, GPU optimization or ML compilerCompensation And BenefitsBase Salary Range: $140,000 - $250,000 AnnuallyCompensation may vary outside of this range depending on many factors, including the candidate's qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.Also, we provide the following benefits to the eligible employees:Health Care Plan (Medical, Dental & Vision)Retirement Plan (Traditional and Roth 401k)Life Insurance (Basic, Voluntary & AD&D)Paid Time Off (Vacation & Public Holidays)Family Leave (Maternity, Paternity)Short Term & Long Term DisabilityFree Food & Snacks","datePosted":"2026-10-07T11:37:09.714Z","dateModified":"2026-10-07T11:37:09.714Z","hiringOrganization":{"@type":"Organization","name":"Ponyai","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Fremont","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"04be48ec8213b18208e5cac7"},"url":"https://jobsearcher.com/jobs/04be48ec8213b18208e5cac7"}}