{"schemaVersion":"jobsearcher.job.v1","id":"622dc2fef0916a5845fa64aa","url":"https://jobsearcher.com/jobs/622dc2fef0916a5845fa64aa","canonicalUrl":"https://jobsearcher.com/jobs/622dc2fef0916a5845fa64aa","title":"Machine Learning Inference Engineer","description":"🚨 Machine Learning Inference Engineer📍 San Francisco (On-Site)I’m working with an early-stage infrastructure company building a next-generation AI cloud — rethinking how frontier models run across heterogeneous compute environments. This team is tackling one of the hardest problems in AI infrastructure: making large-scale inference fast, reliable, and production-ready.💡 What makes this role interesting:• Work directly on LLM inference internals• Optimise latency, throughput, and memory at scale• Build serving systems across GPUs + next-gen accelerators• Hands-on with vLLM, TensorRT-LLM, and custom runtimes• Shape core infrastructure at an early-stage company🧠 You’ll:• Build end-to-end inference systems from request → runtime → response• Design batching, scheduling, and queuing systems• Improve KV cache management + memory efficiency• Debug performance bottlenecks across model, runtime, and hardware layers• Partner closely with ML, infra, and systems teams🔧 Looking for:• Experience building ML inference or model serving systems• Strong systems engineering or backend infrastructure fundamentals• Experience with scaling, distributed systems, or performance optimisation• Strong Python and/or C++ skills• Familiarity with modern inference frameworks is a plus","company":"Acceler8 Talent","rawCompany":"acceler8 talent","city":"Menlo Park","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-05-18T12:45:05.543Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Machine Learning Inference Engineer","description":"🚨 Machine Learning Inference Engineer📍 San Francisco (On-Site)I’m working with an early-stage infrastructure company building a next-generation AI cloud — rethinking how frontier models run across heterogeneous compute environments. This team is tackling one of the hardest problems in AI infrastructure: making large-scale inference fast, reliable, and production-ready.💡 What makes this role interesting:• Work directly on LLM inference internals• Optimise latency, throughput, and memory at scale• Build serving systems across GPUs + next-gen accelerators• Hands-on with vLLM, TensorRT-LLM, and custom runtimes• Shape core infrastructure at an early-stage company🧠 You’ll:• Build end-to-end inference systems from request → runtime → response• Design batching, scheduling, and queuing systems• Improve KV cache management + memory efficiency• Debug performance bottlenecks across model, runtime, and hardware layers• Partner closely with ML, infra, and systems teams🔧 Looking for:• Experience building ML inference or model serving systems• Strong systems engineering or backend infrastructure fundamentals• Experience with scaling, distributed systems, or performance optimisation• Strong Python and/or C++ skills• Familiarity with modern inference frameworks is a plus","datePosted":"2026-05-18T12:45:05.543Z","dateModified":"2026-05-18T12:45:05.543Z","hiringOrganization":{"@type":"Organization","name":"Acceler8 Talent","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Menlo Park","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"622dc2fef0916a5845fa64aa"},"url":"https://jobsearcher.com/jobs/622dc2fef0916a5845fa64aa"}}