{"schemaVersion":"jobsearcher.job.v1","id":"deb253e71ff781cc71f3cfa9","url":"https://jobsearcher.com/jobs/deb253e71ff781cc71f3cfa9","canonicalUrl":"https://jobsearcher.com/jobs/deb253e71ff781cc71f3cfa9","title":"Senior Staff Software Engineer, ML Performance, GPU","description":"OverviewIn this role you work on optimizing GPU performance for Gemini models and LLMs at scale. You will collaborate with DeepMind and XLA to push toward state-of-the-art efficiency, including custom kernels and compiler optimizations. You'll run architecture-level simulations, perform roofline analyses, and build tooling to track performance across Google's fleets. You will impact how models train and serve on AI accelerators, shaping scalable, high-performance ML infrastructure.ResponsibilitiesIdentify performance opportunities and drive XLA:GPU/Triton optimizations toward peak efficiencyCollaborate with DeepMind on onboarding new LLMs and optimizing deployment and training on GPUs at very large scalePerform architecture-level GPU simulations and roofline analyses to guide internal teamsAnalyze performance metrics to identify bottlenecks and implement scalable solutions fleet-widePartner with tooling and fleet metrics teams to build observability and extract workload metricsDevelop and promote compiler and kernel-level optimizations (sharding, quantization, custom kernels)Key requirementsBachelor's degree or equivalent practical experience8 years of software development experience7 years leading technical project strategy, ML design, and end-to-end ML optimizationExperience with modern GPU architectures, memory hierarchies, and performance bottlenecksExperience with low-level GPU programming (CUDA, Triton, CUTLASS, etc.) and performance engineeringExperience with modern LLMs and deployment on AI acceleratorsleadership and cross-functional collaborationproblem-solving mindset with a bias for resultseffective communication of complex technical conceptsCUDATritonCUTLASS","company":"Google","rawCompany":"google","city":"Dallas","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-10-26T13:11:46.068Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Staff Software Engineer, ML Performance, GPU","description":"OverviewIn this role you work on optimizing GPU performance for Gemini models and LLMs at scale. You will collaborate with DeepMind and XLA to push toward state-of-the-art efficiency, including custom kernels and compiler optimizations. You'll run architecture-level simulations, perform roofline analyses, and build tooling to track performance across Google's fleets. You will impact how models train and serve on AI accelerators, shaping scalable, high-performance ML infrastructure.ResponsibilitiesIdentify performance opportunities and drive XLA:GPU/Triton optimizations toward peak efficiencyCollaborate with DeepMind on onboarding new LLMs and optimizing deployment and training on GPUs at very large scalePerform architecture-level GPU simulations and roofline analyses to guide internal teamsAnalyze performance metrics to identify bottlenecks and implement scalable solutions fleet-widePartner with tooling and fleet metrics teams to build observability and extract workload metricsDevelop and promote compiler and kernel-level optimizations (sharding, quantization, custom kernels)Key requirementsBachelor's degree or equivalent practical experience8 years of software development experience7 years leading technical project strategy, ML design, and end-to-end ML optimizationExperience with modern GPU architectures, memory hierarchies, and performance bottlenecksExperience with low-level GPU programming (CUDA, Triton, CUTLASS, etc.) and performance engineeringExperience with modern LLMs and deployment on AI acceleratorsleadership and cross-functional collaborationproblem-solving mindset with a bias for resultseffective communication of complex technical conceptsCUDATritonCUTLASS","datePosted":"2026-10-26T13:11:46.068Z","dateModified":"2026-10-26T13:11:46.068Z","hiringOrganization":{"@type":"Organization","name":"Google","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dallas","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"deb253e71ff781cc71f3cfa9"},"url":"https://jobsearcher.com/jobs/deb253e71ff781cc71f3cfa9"}}