{"schemaVersion":"jobsearcher.job.v1","id":"cab95fc445c8c55c89deeb85","url":"https://jobsearcher.com/jobs/cab95fc445c8c55c89deeb85","canonicalUrl":"https://jobsearcher.com/jobs/cab95fc445c8c55c89deeb85","title":"Senior Software Engineer, Google Distributed Cloud AI","description":"Overview\nIn this role you lead the design, development, and optimization of LLM inference serving components within Google Distributed Cloud. You’ll drive cross-platform integration with billing, logging, observability, security, and quota management, while enabling advanced techniques like disaggregated serving, speculative decoding, and model sharding across distributed hardware. You collaborate with teams on LLM frameworks, orchestration, networking, and hardware acceleration to deliver a high-performance serving platform. You will shape scalable, reliable infrastructure that powers AI solutions across hybrid and edge deployments.\n\nCompensation / Benefitsbonus targetequitybenefits\nResponsibilitiesLead technical design and development of LLM inference serving componentsOptimize data loading, dynamic request routing, and load balancingDrive horizontal integration with core platform services (billing, logging, observability, security, quota management)Implement and enhance serving capabilities for disaggregated serving, quantization, and model shardingCollaborate with teams on Kubernetes/GKE, networking, and hardware acceleration to build a cohesive platform\nKey requirementsBachelor's degree or equivalent practical experience5 years of software development experience in one or more programming languages3 years of experience testing, maintaining, or launching software products and 1 year in software design/architecture3 years of experience with large-scale infrastructure, distributed systems, or compute/storage hardware architectureExperience programming in Go for software development, including AI/ML applicationsleadership potentialcollaboration across cross-functional teamsstrong problem-solving abilitiesGo programmingdistributed systemsKubernetes and GKE","company":"Google","rawCompany":"google","city":"Dallas","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-09-22T03:29:34.584Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Software Engineer, Google Distributed Cloud AI","description":"Overview\nIn this role you lead the design, development, and optimization of LLM inference serving components within Google Distributed Cloud. You’ll drive cross-platform integration with billing, logging, observability, security, and quota management, while enabling advanced techniques like disaggregated serving, speculative decoding, and model sharding across distributed hardware. You collaborate with teams on LLM frameworks, orchestration, networking, and hardware acceleration to deliver a high-performance serving platform. You will shape scalable, reliable infrastructure that powers AI solutions across hybrid and edge deployments.\n\nCompensation / Benefitsbonus targetequitybenefits\nResponsibilitiesLead technical design and development of LLM inference serving componentsOptimize data loading, dynamic request routing, and load balancingDrive horizontal integration with core platform services (billing, logging, observability, security, quota management)Implement and enhance serving capabilities for disaggregated serving, quantization, and model shardingCollaborate with teams on Kubernetes/GKE, networking, and hardware acceleration to build a cohesive platform\nKey requirementsBachelor's degree or equivalent practical experience5 years of software development experience in one or more programming languages3 years of experience testing, maintaining, or launching software products and 1 year in software design/architecture3 years of experience with large-scale infrastructure, distributed systems, or compute/storage hardware architectureExperience programming in Go for software development, including AI/ML applicationsleadership potentialcollaboration across cross-functional teamsstrong problem-solving abilitiesGo programmingdistributed systemsKubernetes and GKE","datePosted":"2026-09-22T03:29:34.584Z","dateModified":"2026-09-22T03:29:34.584Z","hiringOrganization":{"@type":"Organization","name":"Google","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dallas","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"cab95fc445c8c55c89deeb85"},"url":"https://jobsearcher.com/jobs/cab95fc445c8c55c89deeb85"}}