{"schemaVersion":"jobsearcher.job.v1","id":"7fe8995a708f6d18a2f22ed7","url":"https://jobsearcher.com/jobs/7fe8995a708f6d18a2f22ed7","canonicalUrl":"https://jobsearcher.com/jobs/7fe8995a708f6d18a2f22ed7","title":"AMD GPU Performance Engineer","description":"AMD GPU Performance EngineerLocation: RemoteRole OverviewWe are looking for an AMD GPU Performance Engineer to optimize vLLM inference performance across the AMD accelerator ecosystem. This role focuses on developing and optimizing GPU backends, kernels, runtime paths, and benchmarking infrastructure using ROCm, HIP, Triton, CK, and AITER.The ideal candidate will have deep knowledge of AMD GPU architecture, kernel optimization, performance profiling, and LLM inference systems.Key ResponsibilitiesBuild and optimize AMD GPU backends, kernels, and runtime paths for vLLM.Optimize performance-critical operations, including attention, GEMM, sampling, KV cache, and communication-heavy workloads.Develop and improve GPU kernels using ROCm, HIP, Triton, CK, AITER, and related tools.Profile GPU workloads and identify bottlenecks across memory behavior, execution, and runtime performance.Build and maintain benchmarking infrastructure to measure inference performance and detect regressions.Use hardware counters, correctness tests, and reproducible benchmarks to guide optimization.Improve the usability, performance, and maintainability of AMD GPU support in vLLM.Optimize inference paths involving batching, decoding, quantization, and memory management.Required QualificationsBachelor's degree or equivalent experience in Computer Science, Engineering, Systems, Machine Learning, or a related field.Hands-on experience optimizing AMD GPU workloads using ROCm, HIP, Triton, CK, AITER, or similar tools.Deep understanding of AMD GPU execution, memory behavior, toolchains, and kernel performance.Experience optimizing ML kernels or inference paths such as attention, GEMM, sampling, KV cache, and fused kernels.Strong performance profiling and benchmarking skills.Ability to use hardware counters, correctness tests, and reproducible benchmarks to guide optimization.Preferred QualificationsExperience with vLLM, SGLang, TensorRT-LLM, ROCm-based serving, or other LLM inference systems.Familiarity with batching, KV cache, decoding, and production inference serving tradeoffs.Knowledge of compiler and kernel technologies such as Triton, MLIR, LLVM, CK, AITER, and HIP.Experience with INT8, FP8, mixed-precision, or AMD-specific numeric formats, including accuracy and performance tradeoffs.","company":"Mindsource","rawCompany":"mindsource","city":"California","state":"MO","isRemote":false,"isActive":false,"createdAt":"2026-10-29T08:08:31.695Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"17-2061.00","title":"Computer Hardware Engineers","slug":"computer-hardware-engineers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"334111","title":"Electronic Computer Manufacturing","slug":"electronic-computer-manufacturing"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AMD GPU Performance Engineer","description":"AMD GPU Performance EngineerLocation: RemoteRole OverviewWe are looking for an AMD GPU Performance Engineer to optimize vLLM inference performance across the AMD accelerator ecosystem. This role focuses on developing and optimizing GPU backends, kernels, runtime paths, and benchmarking infrastructure using ROCm, HIP, Triton, CK, and AITER.The ideal candidate will have deep knowledge of AMD GPU architecture, kernel optimization, performance profiling, and LLM inference systems.Key ResponsibilitiesBuild and optimize AMD GPU backends, kernels, and runtime paths for vLLM.Optimize performance-critical operations, including attention, GEMM, sampling, KV cache, and communication-heavy workloads.Develop and improve GPU kernels using ROCm, HIP, Triton, CK, AITER, and related tools.Profile GPU workloads and identify bottlenecks across memory behavior, execution, and runtime performance.Build and maintain benchmarking infrastructure to measure inference performance and detect regressions.Use hardware counters, correctness tests, and reproducible benchmarks to guide optimization.Improve the usability, performance, and maintainability of AMD GPU support in vLLM.Optimize inference paths involving batching, decoding, quantization, and memory management.Required QualificationsBachelor's degree or equivalent experience in Computer Science, Engineering, Systems, Machine Learning, or a related field.Hands-on experience optimizing AMD GPU workloads using ROCm, HIP, Triton, CK, AITER, or similar tools.Deep understanding of AMD GPU execution, memory behavior, toolchains, and kernel performance.Experience optimizing ML kernels or inference paths such as attention, GEMM, sampling, KV cache, and fused kernels.Strong performance profiling and benchmarking skills.Ability to use hardware counters, correctness tests, and reproducible benchmarks to guide optimization.Preferred QualificationsExperience with vLLM, SGLang, TensorRT-LLM, ROCm-based serving, or other LLM inference systems.Familiarity with batching, KV cache, decoding, and production inference serving tradeoffs.Knowledge of compiler and kernel technologies such as Triton, MLIR, LLVM, CK, AITER, and HIP.Experience with INT8, FP8, mixed-precision, or AMD-specific numeric formats, including accuracy and performance tradeoffs.","datePosted":"2026-10-29T08:08:31.695Z","dateModified":"2026-10-29T08:08:31.695Z","hiringOrganization":{"@type":"Organization","name":"Mindsource","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"California","addressRegion":"MO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"7fe8995a708f6d18a2f22ed7"},"url":"https://jobsearcher.com/jobs/7fe8995a708f6d18a2f22ed7"}}