Senior Software Engineer- ML Network Stack, ML Network Stack - Annapurna Labs

Overview In this role you will help shape the network stack for EC2-based AI/ML systems. You’ll work with cross‑functional teams to monitor, benchmark, and improve performance at scale, enabling large clusters for ML and HPC workloads. You’ll build automated delivery and alerting pipelines, turning vast performance data into actionable insights. This is a hands‑on, scale‑driven position at the forefront of AI/ML infrastructure, with a strong focus on reliability and cross‑team collaboration. Compensation / Benefitswork-life balanceflexible working culturementorship and career growthinclusive cultureopportunity to work on large-scale AWS infrastructure ResponsibilitiesMonitor and report on effectiveness and performance of large testing workloads at scaleAutomate software delivery to customers using CI/CD tools, Linux, and AWS productsDevelop Python scripts to spin up large clusters and run ML/HPC benchmarksUse Grafana and Athena to analyze performance data and build dashboards for developers and stakeholdersInvent automatic alerting mechanisms for functional and performance regressionsManage infrastructure across multiple instance types, OS releases, and evolving software stacks Key requirements5+ years of professional software development experience5+ years of experience in design or architecture of complex systems5+ years of full software development life cycle including coding standards, reviews, build, testing, and operations3+ years as a mentor, tech lead, or leading engineering teams3+ years experience in SW/HW co-designmentoring and leadershipcross-functional collaborationproblem solving under scalePython programmingLinux/system programmingCI/CD workflows