{"schemaVersion":"jobsearcher.job.v1","id":"e8022cbed0a8ba6221b072eb","url":"https://jobsearcher.com/jobs/e8022cbed0a8ba6221b072eb","canonicalUrl":"https://jobsearcher.com/jobs/e8022cbed0a8ba6221b072eb","title":"Senior Technical Program Manager, Machine Learning Infrastructure","description":"Overview\nAs Technical Program Manager for Machine Learning Infrastructure, you will oversee the portfolio spanning inference, serving, and endpoints to scale Cohere’s AI infrastructure for a growing user base. You’ll coordinate cross-functionally with Modeling and customer-facing teams, identify pain points, and implement processes that boost development velocity while meeting user needs. You’ll foster a culture of continuous improvement, drive prioritized delivery, and partner with senior leaders to solve strategic problems that impact the company. This role offers exposure to cutting-edge AI tech and a dynamic, fast-paced environment with meaningful impact.\n\nCompensation / Benefitsweekly lunch stipendhealth and dental benefitsRRSP matching, 401K, Pension6 weeks of paid vacationparential leave top-up (up to 6 months)home office stipend\nResponsibilitiesManage the ML infrastructure program portfolio (inference, serving, efficiency, endpoints) to scale for internal and external usersLead end-to-end program coordination with cross-functional partners (Modeling, customer-facing teams)Identify bottlenecks and establish processes that enable development while serving user needsPromote continuous improvement and incident management practices with timely root-cause analysis and fixesPrioritize overlapping projects to align with top company prioritiesCollaborate with stakeholders to set timelines, deliverables, budgets, and scopeDeliver clear updates to engineering, leadership, and non-technical audiencesAct as a tactical and strategic partner to senior program leads, addressing both execution and high-level strategy\nKey requirements5+ years of Technical Program Management experience in Machine Learning Infrastructure (inference, serving, efficiency, endpoints)Deep technical knowledge of ML infrastructure design and engineering best practicesComfort in fast-paced, low-structure environments and willingness to do hands-on work if neededExperience advocating for infrastructure and modeling teams to build scalable, high-performance ML systemspragmatic and execution-orientedorganized and cross-functional collaborationadaptable in fast-changing environmentsML infrastructure design and implementationmodel inference and servingsystem efficiency improvements","company":"Cohere","rawCompany":"cohere","city":"White Plains","state":"NY","isRemote":false,"isActive":true,"createdAt":"2026-09-15T05:05:55.865Z","occupations":[{"code":"15-1299.09","title":"Information Technology Project Managers","slug":"information-technology-project-managers"},{"code":"11-3021.00","title":"Computer and Information Systems Managers","slug":"computer-and-information-systems-managers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Technical Program Manager, Machine Learning Infrastructure","description":"Overview\nAs Technical Program Manager for Machine Learning Infrastructure, you will oversee the portfolio spanning inference, serving, and endpoints to scale Cohere’s AI infrastructure for a growing user base. You’ll coordinate cross-functionally with Modeling and customer-facing teams, identify pain points, and implement processes that boost development velocity while meeting user needs. You’ll foster a culture of continuous improvement, drive prioritized delivery, and partner with senior leaders to solve strategic problems that impact the company. This role offers exposure to cutting-edge AI tech and a dynamic, fast-paced environment with meaningful impact.\n\nCompensation / Benefitsweekly lunch stipendhealth and dental benefitsRRSP matching, 401K, Pension6 weeks of paid vacationparential leave top-up (up to 6 months)home office stipend\nResponsibilitiesManage the ML infrastructure program portfolio (inference, serving, efficiency, endpoints) to scale for internal and external usersLead end-to-end program coordination with cross-functional partners (Modeling, customer-facing teams)Identify bottlenecks and establish processes that enable development while serving user needsPromote continuous improvement and incident management practices with timely root-cause analysis and fixesPrioritize overlapping projects to align with top company prioritiesCollaborate with stakeholders to set timelines, deliverables, budgets, and scopeDeliver clear updates to engineering, leadership, and non-technical audiencesAct as a tactical and strategic partner to senior program leads, addressing both execution and high-level strategy\nKey requirements5+ years of Technical Program Management experience in Machine Learning Infrastructure (inference, serving, efficiency, endpoints)Deep technical knowledge of ML infrastructure design and engineering best practicesComfort in fast-paced, low-structure environments and willingness to do hands-on work if neededExperience advocating for infrastructure and modeling teams to build scalable, high-performance ML systemspragmatic and execution-orientedorganized and cross-functional collaborationadaptable in fast-changing environmentsML infrastructure design and implementationmodel inference and servingsystem efficiency improvements","datePosted":"2026-09-15T05:05:55.865Z","dateModified":"2026-09-15T05:05:55.865Z","hiringOrganization":{"@type":"Organization","name":"Cohere","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"White Plains","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"e8022cbed0a8ba6221b072eb"},"url":"https://jobsearcher.com/jobs/e8022cbed0a8ba6221b072eb"}}