JOBSEARCHER

Machine Learning Hardware Architect, Google Cloud

GoogleSan Jose, CAL6 LeadSeptember 22nd, 2026
Overview: In this role, you will help shape differentiated architectural innovations for Google’s TPU roadmap and drive performance, power, and cost tradeoffs. You will collaborate with Hardware Design, Software, Compiler, ML Model, and Research teams to enable hardware/software co-design and advance ML workloads. You will prototype new hardware features and model performance early to guide production-ready TPU architectures. Join a team pushing the boundaries of AI/ML hardware acceleration and contribute to next-generation TPU systems powering Google-scale applications. Compensation / Benefitsbonus target (15%)equitybenefits
Responsibilities: Identify and evaluate architectural innovations for the TPU roadmapCollaborate with Hardware Design, Software, Compiler, ML Model, and Research teams for co-designCharacterize and benchmark ML workloads; develop performance modelsDesign differentiating features for next-generation TPU architecturesPrototype hardware features (e.g., instruction extensions, memory layouts) using compiler/runtime stacksDevelop transaction-level models for early performance estimation and workload simulationOptimize accelerator design for performance within power and thermal constraints; explore new power technologiesStreamline host-accelerator interactions and data transfer; ensure integration across training and inference modesWork with XLA compiler, Platforms performance, and system design teams to move innovations to production
Key requirements: Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or related field; or equivalent practical experience 5 years of experience in computer architecture, chip architecture, IP architecture, co-design, performance analysis, or hardware designExperience developing software in C++ or PythonCross-functional collaborationStrong problem-solving and analytical thinkingEffective communication of technical conceptsComputer architecture and chip architectureIP architecture and hardware designCo-design and performance analysis