{"schemaVersion":"jobsearcher.job.v1","id":"fa423f9bd794cd73d67f82a4","url":"https://jobsearcher.com/jobs/fa423f9bd794cd73d67f82a4","canonicalUrl":"https://jobsearcher.com/jobs/fa423f9bd794cd73d67f82a4","title":"Machine learning engineer II, AWS Inference Optimization","description":"This role is for a Machine Learning Engineer focused on AWS inference optimization. You will work on improving inference performance for large language OSS models, with ownership of price-performance for Amazon LLM inference across SageMaker, Hyperpod, and Bedrock.\r\nWhat You’ll DoDevelop model servers.\r\nBuild CUDA kernels in vLLM and SGLang.\r\nCreate services for GenAI optimization and benchmarking.\r\nCreate or modify a mid-size application or service.\r\nOptimize large language OSS models such as Qwen, Gemma, gptoss, and others by improving inference stacks including vLLM and SGLang.\r\nPerform performance tuning for GenAI inference onAmazon SageMaker ,Amazon Bedrock , andHyperpod .\r\nImplement inference optimization techniques includingSpeculative decoding ,Disaggregated Inference , andCUDA kernel tuning .\r\nOwn price-performance for Amazon LLM inference deployed on SageMaker, Hyperpod, and Bedrock.\r\nDeliver production solutions that leverage existing academic and industrial research or apply practical, original thinking.\r\nDeliver solutions intocustomer-facing products .\r\nKey TechnologiesvLLM, SGLang\r\nAmazon SageMaker, Amazon Bedrock\r\nHyperpod\r\nCUDA\r\nC#, C++, Java, Perl\r\nTransformer architecture\r\nRequirements3+ yearsof non-internship professional software development experience.\r\n2+ yearsof non-internship design or architecture experience, including design patterns and reliability and scaling of new and existing systems.\r\n1+ yearof software development engineer or related occupational experience.\r\n1+ yeardesigning and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using C#, C++, Java, or Perl.\r\nBachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Mathematics, or a related field.\r\nKnowledge of machine learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques.\r\nPreferred Qualifications3+ yearsof full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.\r\nBachelor’s degree in computer science or equivalent.\r\nEducationBachelor’s degree (Computer Science, Engineering, Mathematics, or related field).\r\nLocation and Work ModeSanta Clara, CA(onsite)\r\nCompensationUSD 165,200 - 223,600per year.\r\nBenefitsSign-on payments\r\nRestricted stock units (RSUs)\r\nHealth insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)\r\n401(k) matching\r\nPaid time off\r\nParental leave\r\nWorkplace accommodation or adjustment during the application and hiring process (including support for the interview or onboarding process)\r\nLos Angeles County ApplicantsJob duties for this position include:\r\nWork safely and cooperatively with other employees, supervisors, and staff.\r\nAdhere to standards of excellence despite stressful conditions.\r\nCommunicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service.\r\nFollow all federal, state, and local laws and Company policies.\r\nCriminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position, including the abilities and responsibilities listed above, as well as the abilities to adhere to Company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation.\r\nPursuant to the Los Angeles County Fair Chance Ordinance, qualified applicants with arrest and conviction records will be considered for employment.#J-18808-Ljbffr","company":"Amazon Development Center Us","rawCompany":"amazon development center us","city":"Santa Clara","state":"CA","isRemote":false,"isActive":true,"createdAt":"2026-11-04T02:09:57.469Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Machine learning engineer II, AWS Inference Optimization","description":"This role is for a Machine Learning Engineer focused on AWS inference optimization. You will work on improving inference performance for large language OSS models, with ownership of price-performance for Amazon LLM inference across SageMaker, Hyperpod, and Bedrock.\r\nWhat You’ll DoDevelop model servers.\r\nBuild CUDA kernels in vLLM and SGLang.\r\nCreate services for GenAI optimization and benchmarking.\r\nCreate or modify a mid-size application or service.\r\nOptimize large language OSS models such as Qwen, Gemma, gptoss, and others by improving inference stacks including vLLM and SGLang.\r\nPerform performance tuning for GenAI inference onAmazon SageMaker ,Amazon Bedrock , andHyperpod .\r\nImplement inference optimization techniques includingSpeculative decoding ,Disaggregated Inference , andCUDA kernel tuning .\r\nOwn price-performance for Amazon LLM inference deployed on SageMaker, Hyperpod, and Bedrock.\r\nDeliver production solutions that leverage existing academic and industrial research or apply practical, original thinking.\r\nDeliver solutions intocustomer-facing products .\r\nKey TechnologiesvLLM, SGLang\r\nAmazon SageMaker, Amazon Bedrock\r\nHyperpod\r\nCUDA\r\nC#, C++, Java, Perl\r\nTransformer architecture\r\nRequirements3+ yearsof non-internship professional software development experience.\r\n2+ yearsof non-internship design or architecture experience, including design patterns and reliability and scaling of new and existing systems.\r\n1+ yearof software development engineer or related occupational experience.\r\n1+ yeardesigning and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using C#, C++, Java, or Perl.\r\nBachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Mathematics, or a related field.\r\nKnowledge of machine learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques.\r\nPreferred Qualifications3+ yearsof full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.\r\nBachelor’s degree in computer science or equivalent.\r\nEducationBachelor’s degree (Computer Science, Engineering, Mathematics, or related field).\r\nLocation and Work ModeSanta Clara, CA(onsite)\r\nCompensationUSD 165,200 - 223,600per year.\r\nBenefitsSign-on payments\r\nRestricted stock units (RSUs)\r\nHealth insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)\r\n401(k) matching\r\nPaid time off\r\nParental leave\r\nWorkplace accommodation or adjustment during the application and hiring process (including support for the interview or onboarding process)\r\nLos Angeles County ApplicantsJob duties for this position include:\r\nWork safely and cooperatively with other employees, supervisors, and staff.\r\nAdhere to standards of excellence despite stressful conditions.\r\nCommunicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service.\r\nFollow all federal, state, and local laws and Company policies.\r\nCriminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position, including the abilities and responsibilities listed above, as well as the abilities to adhere to Company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation.\r\nPursuant to the Los Angeles County Fair Chance Ordinance, qualified applicants with arrest and conviction records will be considered for employment.#J-18808-Ljbffr","datePosted":"2026-11-04T02:09:57.469Z","dateModified":"2026-11-04T02:09:57.469Z","hiringOrganization":{"@type":"Organization","name":"Amazon Development Center Us","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Santa Clara","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"fa423f9bd794cd73d67f82a4"},"url":"https://jobsearcher.com/jobs/fa423f9bd794cd73d67f82a4"}}