{"schemaVersion":"jobsearcher.job.v1","id":"ab8bad76d3ff327207c885ed","url":"https://jobsearcher.com/jobs/ab8bad76d3ff327207c885ed","canonicalUrl":"https://jobsearcher.com/jobs/ab8bad76d3ff327207c885ed","title":"Software Engineer, Inference","description":"OverviewIn this role you will help design and operate Sierra's inference architecture for self-hosted models and third-party providers. You will shape how inference traffic flows, manage capacity and latency, and ensure cost-efficient, reliable production performance. You'll collaborate with frontier labs and providers to scale AI infrastructure and support models throughout their lifecycle. This is a systems-first, AI-focused role at scale that blends distributed infrastructure with cutting-edge inference techniques.Compensation / BenefitsFlexible (unlimited) paid time offMedical, dental, vision benefits for you and familyLife insurance and disability benefitsRetirement plan (country-dependent)Parental leaveFertility and family building benefits through CarrotResponsibilitiesDesign and shape Sierra's inference architecture across models, infrastructure, and providersBuild and operate self-hosted inference on GPU infrastructure, including containers and inference enginesDevelop routing, failover, capacity management, and quota systems for low-latency, reliable inference at scaleWork with Applied Research to optimize latency, throughput, and cost via techniques like speculative decoding and serving-engine optimizationsCollaborate with inference providers to tune engines and push the serving stack forwardSupport broader model lifecycle by contributing to post-training infrastructure in partnership with Models and Agent Runtime teamsKey requirementsDeep systems thinking and distributed systems fundamentalsExperience designing, building, and operating large-scale production systemsStrong judgment on latency, reliability, capacity, and cost tradeoffsExperience owning complex infrastructure end-to-end from architecture to production operationsCuriosity about applying systems expertise to AI infrastructure and quick learning of evolving techOwnership mindsetAnalytical problem solvingCollaborative cross-team communicationExperience with large-scale production systemsDistributed systems fundamentalsML infrastructure, MLOps, or production inference systems (nice to have)","company":"Sierra","rawCompany":"sierra","city":"Everett","state":"WA","isRemote":false,"isActive":false,"createdAt":"2026-10-26T13:33:15.931Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineer, Inference","description":"OverviewIn this role you will help design and operate Sierra's inference architecture for self-hosted models and third-party providers. You will shape how inference traffic flows, manage capacity and latency, and ensure cost-efficient, reliable production performance. You'll collaborate with frontier labs and providers to scale AI infrastructure and support models throughout their lifecycle. This is a systems-first, AI-focused role at scale that blends distributed infrastructure with cutting-edge inference techniques.Compensation / BenefitsFlexible (unlimited) paid time offMedical, dental, vision benefits for you and familyLife insurance and disability benefitsRetirement plan (country-dependent)Parental leaveFertility and family building benefits through CarrotResponsibilitiesDesign and shape Sierra's inference architecture across models, infrastructure, and providersBuild and operate self-hosted inference on GPU infrastructure, including containers and inference enginesDevelop routing, failover, capacity management, and quota systems for low-latency, reliable inference at scaleWork with Applied Research to optimize latency, throughput, and cost via techniques like speculative decoding and serving-engine optimizationsCollaborate with inference providers to tune engines and push the serving stack forwardSupport broader model lifecycle by contributing to post-training infrastructure in partnership with Models and Agent Runtime teamsKey requirementsDeep systems thinking and distributed systems fundamentalsExperience designing, building, and operating large-scale production systemsStrong judgment on latency, reliability, capacity, and cost tradeoffsExperience owning complex infrastructure end-to-end from architecture to production operationsCuriosity about applying systems expertise to AI infrastructure and quick learning of evolving techOwnership mindsetAnalytical problem solvingCollaborative cross-team communicationExperience with large-scale production systemsDistributed systems fundamentalsML infrastructure, MLOps, or production inference systems (nice to have)","datePosted":"2026-10-26T13:33:15.931Z","dateModified":"2026-10-26T13:33:15.931Z","hiringOrganization":{"@type":"Organization","name":"Sierra","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Everett","addressRegion":"WA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"ab8bad76d3ff327207c885ed"},"url":"https://jobsearcher.com/jobs/ab8bad76d3ff327207c885ed"}}