{"schemaVersion":"jobsearcher.job.v1","id":"8d246cb56f310effe2d3126e","url":"https://jobsearcher.com/jobs/8d246cb56f310effe2d3126e","canonicalUrl":"https://jobsearcher.com/jobs/8d246cb56f310effe2d3126e","title":"Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference","description":"Overview\nIn this role you will help enable and optimize distributed inference for PyTorch within the Neuron SDK on AWS accelerators (Trainium and Inferentia). You will work across software and hardware teams to push performance for large models, including LLMS, while shaping the Neuron inference stack. You’ll design high-performance kernels, implement optimizations, and collaborate with customers to maximize model efficiency at scale. This is a unique chance to contribute to AI acceleration at the intersection of ML, HPC, and distributed systems.\n\nCompensation / BenefitsHealth insurance (medical, dental, vision)401(k) matchingPaid time offParental leaveRSUsSign-on payments\nResponsibilitiesDesign, develop, and optimize ML models and frameworks for deployment on custom ML acceleratorsLead distributed inference support for PyTorch in the Neuron SDK and tune models for peak performance on Trainium and InferentiaCollaborate across compiler, runtime, framework, and hardware teams to optimize ML workloadsBuild infrastructure to onboard diverse models and architecturesImplement high-performance kernels and features for ML ops leveraging Neuron architectureAnalyze system-level performance across multiple generations of Neuron hardwarePerform profiling to identify bottlenecks and apply optimizations (fusion, sharding, tiling, scheduling)Conduct comprehensive testing (unit, end-to-end) with CI/CD pipelinesWork with customers to enable and optimize ML models on AWS acceleratorsEngage with open source ecosystems to ensure seamless integration and peak performance\nKey requirementsBachelor's degree in computer science or equivalent5+ years of professional software development experience5+ years in design or architecture of large-scale systemsFundamentals of ML and LLMs, with experience optimizing model executionSoftware development in C++ and PythonStrong understanding of system performance, memory management, and parallel computingCollaboration across cross-functional teamsMentorship and technical leadershipStrong debugging and analytical thinkingFamiliarity with PyTorch, JIT compilation, and AOT tracingCUDA kernels or low-level ML kernelsExperience with kernel development (e.g., CUTLASS, FlashInfer)","company":"Amazon","rawCompany":"amazon","city":"San Jose","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-09-16T03:07:55.899Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference","description":"Overview\nIn this role you will help enable and optimize distributed inference for PyTorch within the Neuron SDK on AWS accelerators (Trainium and Inferentia). You will work across software and hardware teams to push performance for large models, including LLMS, while shaping the Neuron inference stack. You’ll design high-performance kernels, implement optimizations, and collaborate with customers to maximize model efficiency at scale. This is a unique chance to contribute to AI acceleration at the intersection of ML, HPC, and distributed systems.\n\nCompensation / BenefitsHealth insurance (medical, dental, vision)401(k) matchingPaid time offParental leaveRSUsSign-on payments\nResponsibilitiesDesign, develop, and optimize ML models and frameworks for deployment on custom ML acceleratorsLead distributed inference support for PyTorch in the Neuron SDK and tune models for peak performance on Trainium and InferentiaCollaborate across compiler, runtime, framework, and hardware teams to optimize ML workloadsBuild infrastructure to onboard diverse models and architecturesImplement high-performance kernels and features for ML ops leveraging Neuron architectureAnalyze system-level performance across multiple generations of Neuron hardwarePerform profiling to identify bottlenecks and apply optimizations (fusion, sharding, tiling, scheduling)Conduct comprehensive testing (unit, end-to-end) with CI/CD pipelinesWork with customers to enable and optimize ML models on AWS acceleratorsEngage with open source ecosystems to ensure seamless integration and peak performance\nKey requirementsBachelor's degree in computer science or equivalent5+ years of professional software development experience5+ years in design or architecture of large-scale systemsFundamentals of ML and LLMs, with experience optimizing model executionSoftware development in C++ and PythonStrong understanding of system performance, memory management, and parallel computingCollaboration across cross-functional teamsMentorship and technical leadershipStrong debugging and analytical thinkingFamiliarity with PyTorch, JIT compilation, and AOT tracingCUDA kernels or low-level ML kernelsExperience with kernel development (e.g., CUTLASS, FlashInfer)","datePosted":"2026-09-16T03:07:55.899Z","dateModified":"2026-09-16T03:07:55.899Z","hiringOrganization":{"@type":"Organization","name":"Amazon","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Jose","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"8d246cb56f310effe2d3126e"},"url":"https://jobsearcher.com/jobs/8d246cb56f310effe2d3126e"}}