JOBSEARCHER

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

ARCHIVED
AmazonSan Jose, CAL6 LeadSeptember 15th, 2026

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Overview: In this role you drive large-scale ML training on AWS Trainium hardware, bridging ML research and high-performance systems. You’ll optimize distributed training across model families, from LLMs to multimodal and RL workloads, partnering with hardware, compiler, and solutions teams. The work combines refining training techniques, profiling end-to-end pipelines, and extending popular frameworks to deliver cost-effective, high-throughput training at scale. This is a hands-on, impact-oriented opportunity to shape ML training on a leading cloud accelerator. Compensation / Benefitshealth insurance (medical, dental, vision)401(k) matchingpaid time offparential leaveRSUs and sign-on paymentscomprehensive benefits package Responsibilitiesdesign, implement, and optimize distributed training for large-scale ML models on Trainiumextend and optimize distributed frameworks (FSDP, torchtitan, Hugging Face) for Neuron ecosystemdevelop and optimize mixed-precision and low-precision training (BF16, FP8)profile, analyze, and tune end-to-end training pipelines on Trainium hardwarecollaborate with hardware, compiler, and runtime teams to influence system designwork with AWS solution architects and customers to deploy training workloads at scale
Key requirements: Bachelor in Computer Science or equivalent 5+ years of professional software development 5+ years in design/architecture of systems 5+ years of full software development life cycle experienceexperience as a mentor, tech lead, or engineering team leadexperience in machine learning, large-scale training with LLMs, and expertise in PyTorchmentoringleadershipcross-functional collaborationPyTorchJaxTensorFlow