Principal Engineer, Inference Cloud

Overview As Principal Engineer for the Inference Cloud Platform, you translate ambitious scale and reliability goals into a long-term architecture. You will own multi-region topology, failure domains, and system evolution while delivering fast, available inference services. You’ll lead across ML, Product, and Infrastructure teams to solve high-leverage platform problems and drive execution when specs are unclear. Expect to shape platform decisions, production code on critical paths, and strong operational rigor in a rapidly growing setting. ResponsibilitiesDefine and prioritize core platform problems and trade-offs for the Inference Cloud PlatformSet long-term technical direction, topology, and system boundaries for multi-region servicesArchitect reliable, low-latency systems with active-active failover and graceful degradationContribute production code on critical paths and review designs with long-term operational impactLead production issues, drive observability, incident response, and capacity planningInfluence cross-functional teams on API design, deployment strategy, and shared infrastructure decisionsMentor teams to improve technical decision-making and engineering standards Key requirements10+ years of software engineering experienceStrong distributed systems and cloud infrastructure backgroundProven ability to design and operate highly available, latency-sensitive systems at scaleExperience optimizing latency, throughput, and efficiency in high-QPS workloadsProduction-ready coding ability in Go, C++, or PythonExperience with observability practices (metrics/logging/tracing) and SLO/SLA-driven operationsAbility to influence senior engineers and cross-functional partners through credibility and judgmentExperience with ML inference infrastructure, model serving, or GPU-accelerated workloads is a plusstrong technical judgmentexcellent communicationleadership and mentorshipdistributed systems architecture in cloud environmentsnetworking, compute orchestration, container platformsmulti-region production services