{"schemaVersion":"jobsearcher.job.v1","id":"558b67e2e29f0bfe3f837860","url":"https://jobsearcher.com/jobs/558b67e2e29f0bfe3f837860","canonicalUrl":"https://jobsearcher.com/jobs/558b67e2e29f0bfe3f837860","title":"Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs","description":"Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team focuses on maximizing performance for AWS's custom ML accelerators. Engineers craft high-performance kernels for ML functions, ensuring every FLOP counts to deliver optimal performance for demanding workloads. We combine deep hardware knowledge with ML expertise to push AI acceleration to new limits. The AWS Neuron SDK is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium accelerators. It includes an ML compiler, runtime, and application framework that integrates with popular ML frameworks like PyTorch, enabling unparalleled inference and training performance. Key Responsibilities Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models. Analyze and optimize kernel-level performance across multiple generations of Neuron hardware. Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks. Implement compiler optimizations such as fusion, sharding, tiling, and scheduling. Work directly with customers to enable and optimize their ML models on AWS accelerators. Collaborate across teams to develop innovative kernel optimization techniques. About the Team The team operates at the intersection of machine learning, high-performance computing, and distributed architectures. Engineers work closely with customers on model enablement, providing direct support and optimization expertise to ensure optimal performance on AWS ML accelerators. The team emphasizes small, agile collaboration and fosters a culture of invention and experimentation. Basic Qualifications 5+ years of professional software development experience. 5+ years of programming with at least one software programming language. 5+ years of leading design or architecture of new and existing systems. 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations. Experience as a mentor, tech lead, or engineering team leader. Preferred Qualifications Bachelor's degree in computer science or equivalent. 6+ years of full software development experience. Expertise in accelerator architectures for ML or HPC (GPUs, CPUs, FPGAs, or custom architectures). Experience with GPU kernel optimization and GPGPU computing (CUDA, NKI, Triton, OpenCL, SYCL, or ROCm). Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA. Experience developing high‐performance libraries for HPC applications. Proficiency in low‐level performance optimization for GPUs. Experience with LLVM/MLIR backend development for GPUs. Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends. Experience with parallel programming and optimization techniques. Understanding of GPU memory hierarchies and optimization strategies. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. #J-18808-Ljbffr","company":"Amazon","rawCompany":"amazon","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-07-08T00:37:27.092Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs","description":"Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team focuses on maximizing performance for AWS's custom ML accelerators. Engineers craft high-performance kernels for ML functions, ensuring every FLOP counts to deliver optimal performance for demanding workloads. We combine deep hardware knowledge with ML expertise to push AI acceleration to new limits. The AWS Neuron SDK is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium accelerators. It includes an ML compiler, runtime, and application framework that integrates with popular ML frameworks like PyTorch, enabling unparalleled inference and training performance. Key Responsibilities Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models. Analyze and optimize kernel-level performance across multiple generations of Neuron hardware. Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks. Implement compiler optimizations such as fusion, sharding, tiling, and scheduling. Work directly with customers to enable and optimize their ML models on AWS accelerators. Collaborate across teams to develop innovative kernel optimization techniques. About the Team The team operates at the intersection of machine learning, high-performance computing, and distributed architectures. Engineers work closely with customers on model enablement, providing direct support and optimization expertise to ensure optimal performance on AWS ML accelerators. The team emphasizes small, agile collaboration and fosters a culture of invention and experimentation. Basic Qualifications 5+ years of professional software development experience. 5+ years of programming with at least one software programming language. 5+ years of leading design or architecture of new and existing systems. 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations. Experience as a mentor, tech lead, or engineering team leader. Preferred Qualifications Bachelor's degree in computer science or equivalent. 6+ years of full software development experience. Expertise in accelerator architectures for ML or HPC (GPUs, CPUs, FPGAs, or custom architectures). Experience with GPU kernel optimization and GPGPU computing (CUDA, NKI, Triton, OpenCL, SYCL, or ROCm). Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA. Experience developing high‐performance libraries for HPC applications. Proficiency in low‐level performance optimization for GPUs. Experience with LLVM/MLIR backend development for GPUs. Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends. Experience with parallel programming and optimization techniques. Understanding of GPU memory hierarchies and optimization strategies. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. #J-18808-Ljbffr","datePosted":"2026-07-08T00:37:27.092Z","dateModified":"2026-07-08T00:37:27.092Z","hiringOrganization":{"@type":"Organization","name":"Amazon","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"558b67e2e29f0bfe3f837860"},"url":"https://jobsearcher.com/jobs/558b67e2e29f0bfe3f837860"}}