JOBSEARCHER

Principal Software Engineer, Storage Infrastructure

MicrosoftSeattle, WAL6 LeadOctober 26th, 2026
Overview: As Principal Software Engineer, Storage Infrastructure at Microsoft, you design and operate storage platforms for foundation-model pre-training, post-training, fine-tuning, and inference. You collaborate with Azure infrastructure and AI platform teams to tackle storage performance, reliability, and scalability for cloud-scale GPU workloads. You will lead architecture reviews, mentor engineers, and set engineering practices for secure, reliable cloud services. This role offers impact across cross-team initiatives and opportunities to deepen expertise in distributed systems. You help shape a high-performance, cost-efficient storage foundation for AI at scale.
Responsibilities:
  • Design, build, and evolve distributed storage systems and file systems for cloud-scale AI workloads
  • Architect and operationalize storage stacks for large Kubernetes clusters, optimizing data access, throughput, latency, and reliability for GPU workloads
  • Design storage and KV caching architectures to improve LLM inference latency, throughput, and cost efficiency
  • Improve durability, availability, performance, and observability through automation and resiliency engineering
  • Analyze cross-layer production issues, identify root causes, and implement durable improvements across storage, compute, networking, and runtime components
  • Partner with infrastructure and ML/LLM platform teams to deliver end-to-end capabilities for foundation-model workflows
  • Lead architecture reviews, mentor engineers, and establish engineering practices for secure, reliable cloud services
Key requirements:
  • Bachelor's Degree in Computer Science or related field AND 6+ years of engineering experience with coding in C/C++/C#/Java/JavaScript/Python OR equivalent experience 5+ years designing or operating distributed systems or storage platforms
  • Experience with production-grade, fault-tolerant services and incident management
  • Experience with storage concepts: durability, replication, consistency, performance, reliability
  • Experience leading technical design reviews or cross-team projects
  • Experience with geo-distributed storage architectures, replication, disaster recovery, or regional failover
  • Experience designing storage platforms for large-scale Kubernetes clusters supporting AI workloads
  • Familiarity with high-performance caching or KV caching for LLM inference
  • Familiarity with GPU-accelerated environments and related tooling (CUDA, Kubernetes device plugins)
  • Experience with anomaly detection, capacity planning, or operational automation using ML/AI techniquesleadership and mentoringcross-team collaborationproblem-solvingC/C++/C#/Java/Python
  • Distributed storage and file systems
Kubernetes