{"schemaVersion":"jobsearcher.job.v1","id":"453f389fe1a489a7a840dcd8","url":"https://jobsearcher.com/jobs/453f389fe1a489a7a840dcd8","canonicalUrl":"https://jobsearcher.com/jobs/453f389fe1a489a7a840dcd8","title":"Software Engineer - Model Training","description":"ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.\r\nTHE ROLE As a Senior Software Engineer – Model Training at Baseten, you'll be at the forefront of building the infrastructure that powers large-scale training and fine-tuning of foundation models. You'll design and implement distributed training systems, optimize GPU utilization, and create scalable pipelines that enable Baseten and our customers to adapt models efficiently and reliably. This role is highly technical and hands-on: you'll own key components of our training stack, collaborate with product and infra teams to surface customer needs, and push forward the state of the art in scalable training infrastructure.\r\nEXAMPLE WORK Training open-source models that outperform GPT-5 for a leading digital insurer\r\nSpecialized, continually learning models as the future of AI\r\nTraining docs overview\r\nResearch we've done\r\nRESPONSIBILITIES Design, build, and maintain distributed training infrastructure for large-scale foundation models\r\nImplement scalable pipelines for fine-tuning and training across heterogeneous GPU/accelerator clusters\r\nOptimize training performance through techniques like FSDP, DDP, ZeRO, and mixed precision training\r\nContribute to frameworks and tooling that make training workflows efficient, reproducible, and developer-friendly\r\nCollaborate with cross-functional teams (Product, Forward Deployed Engineering, Inference Infra) to ensure training systems meet real-world requirements\r\nResearch and apply emerging techniques in training efficiency and model adaptation, and productionize them in the Baseten platform\r\nParticipate in code reviews, system design discussions, and technical deep dives to maintain a high engineering bar\r\nREQUIREMENTS Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience\r\n5+ years of experience in ML infrastructure, distributed systems, or ML platform engineering, including 2+ years in a tech lead or manager role\r\nStrong expertise in distributed training frameworks and orchestration (FSDP, DDP, ZeRO, Ray, Kubernetes, Slurm, or similar)\r\nHands-on experience building or scaling training infrastructure for LLMs or other foundation models\r\nDeep understanding of GPU/accelerator hardware utilization, mixed precision training, and scaling efficiency\r\nProven ability to lead and mentor technical teams while delivering complex infrastructure projects\r\nExcellent communication skills, with the ability to bridge technical depth and business needs\r\nNICE TO HAVE Experience building APIs, SDKs, or developer tools for ML workflows\r\nFamiliarity with cluster management and scheduling (Kubernetes, Ray, Slurm, etc.)\r\nKnowledge of parameter-efficient fine-tuning methods (LoRA, QLoRA) and evaluation pipelines\r\nContributions to open-source distributed training or ML infra projects\r\nExperience with cloud environments (AWS, GCP, Azure) and container orchestration\r\nBENEFITS Competitive compensation, including meaningful equity.\r\n100% coverage of medical, dental, and vision insurance for employee and dependents\r\nGenerous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)\r\nPaid parental leave\r\nCompany-facilitated 401(k)\r\nExposure to a variety of ML startups, offering unparalleled learning and networking opportunities.\r\nApply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.\r\nAt Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.\r\nJ-18808-Ljbffr","company":"Baseten","rawCompany":"baseten","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-04-11T05:06:15.993Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineer - Model Training","description":"ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.\r\nTHE ROLE As a Senior Software Engineer – Model Training at Baseten, you'll be at the forefront of building the infrastructure that powers large-scale training and fine-tuning of foundation models. You'll design and implement distributed training systems, optimize GPU utilization, and create scalable pipelines that enable Baseten and our customers to adapt models efficiently and reliably. This role is highly technical and hands-on: you'll own key components of our training stack, collaborate with product and infra teams to surface customer needs, and push forward the state of the art in scalable training infrastructure.\r\nEXAMPLE WORK Training open-source models that outperform GPT-5 for a leading digital insurer\r\nSpecialized, continually learning models as the future of AI\r\nTraining docs overview\r\nResearch we've done\r\nRESPONSIBILITIES Design, build, and maintain distributed training infrastructure for large-scale foundation models\r\nImplement scalable pipelines for fine-tuning and training across heterogeneous GPU/accelerator clusters\r\nOptimize training performance through techniques like FSDP, DDP, ZeRO, and mixed precision training\r\nContribute to frameworks and tooling that make training workflows efficient, reproducible, and developer-friendly\r\nCollaborate with cross-functional teams (Product, Forward Deployed Engineering, Inference Infra) to ensure training systems meet real-world requirements\r\nResearch and apply emerging techniques in training efficiency and model adaptation, and productionize them in the Baseten platform\r\nParticipate in code reviews, system design discussions, and technical deep dives to maintain a high engineering bar\r\nREQUIREMENTS Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience\r\n5+ years of experience in ML infrastructure, distributed systems, or ML platform engineering, including 2+ years in a tech lead or manager role\r\nStrong expertise in distributed training frameworks and orchestration (FSDP, DDP, ZeRO, Ray, Kubernetes, Slurm, or similar)\r\nHands-on experience building or scaling training infrastructure for LLMs or other foundation models\r\nDeep understanding of GPU/accelerator hardware utilization, mixed precision training, and scaling efficiency\r\nProven ability to lead and mentor technical teams while delivering complex infrastructure projects\r\nExcellent communication skills, with the ability to bridge technical depth and business needs\r\nNICE TO HAVE Experience building APIs, SDKs, or developer tools for ML workflows\r\nFamiliarity with cluster management and scheduling (Kubernetes, Ray, Slurm, etc.)\r\nKnowledge of parameter-efficient fine-tuning methods (LoRA, QLoRA) and evaluation pipelines\r\nContributions to open-source distributed training or ML infra projects\r\nExperience with cloud environments (AWS, GCP, Azure) and container orchestration\r\nBENEFITS Competitive compensation, including meaningful equity.\r\n100% coverage of medical, dental, and vision insurance for employee and dependents\r\nGenerous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)\r\nPaid parental leave\r\nCompany-facilitated 401(k)\r\nExposure to a variety of ML startups, offering unparalleled learning and networking opportunities.\r\nApply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.\r\nAt Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.\r\nJ-18808-Ljbffr","datePosted":"2026-04-11T05:06:15.993Z","dateModified":"2026-04-11T05:06:15.993Z","hiringOrganization":{"@type":"Organization","name":"Baseten","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"453f389fe1a489a7a840dcd8"},"url":"https://jobsearcher.com/jobs/453f389fe1a489a7a840dcd8"}}