{"schemaVersion":"jobsearcher.job.v1","id":"9f4ebe3612cf2ae1de18bcf5","url":"https://jobsearcher.com/jobs/9f4ebe3612cf2ae1de18bcf5","canonicalUrl":"https://jobsearcher.com/jobs/9f4ebe3612cf2ae1de18bcf5","title":"Senior/Staff Software Engineer (Back-End), Inference","description":"OverviewIn this role you will evolve the Model Vault backend to support enterprise-scale deployments with strong security and reliability. You will shape architecture across identity, deployments, billing, and observability to deliver scalable, secure model inference. You'll build and operate control-plane services that provision, configure, and manage model deployments across clouds. You will tackle complex backend and security challenges where standard SaaS patterns fall short, driving end-to-end delivery from architecture to production rollout. This is an opportunity to influence how Cohere serves large enterprises with trusted AI at scale.Compensation / Benefitsweekly lunch stipendfull health and dental benefitsRRSP matching, 401K, Pension6 weeks of paid vacationhome office stipendremote-friendly with coworking supportResponsibilitiesEvolve and scale backend systems powering Model Vault, including authentication/authorization, deployment management, billing, metering, and customer lifecycleLead major architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundationsBuild highly reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platformsDesign APIs and distributed systems with guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observabilityIncorporate security and privacy into platform architecture (tenant isolation, least-privilege, auditability, secrets management, encryption, confidential computing)Solve complex problems spanning backend services, cloud infrastructure, security, and AI inference beyond conventional SaaS patternsDrive projects end-to-end from architecture and threat modeling through implementation, rollout, production operations, and iteration based on customer workloadsKey requirementsStrong backend engineer with fundamentals in distributed systems, databases, networking, operating systems, and securityProficiency in production systems using Go, Python, Java, C++, Rust, or similar languagesExperience designing and operating production systems with emphasis on correctness, availability, security, and performance at scaleAbility to define architecture for ambiguous, high-impact problems and deliver reliable production systemsSolid systems-design instincts: concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, graceful degradationAwareness of security boundaries: authentication, authorization, identity, cryptography, secrets, tenant isolation, security risksComfort across backend services, APIs, databases, distributed systems, and cloud infrastructureWillingness to dive into unfamiliar codebases and debug cross-boundary issuesAttention to production engineering details: instrumentation, capacity planning, migrations, backward compatibility, incident response, safe rolloutsTrack record delivering technically difficult projects that become reliable for engineers and customersownership mindsetability to drive cross-functional initiativesstrong analytical and problem-solving abilitiesGoPythonJava","company":"Cohere","rawCompany":"cohere","city":"Tucson","state":"AZ","isRemote":false,"isActive":false,"createdAt":"2026-10-26T13:22:20.139Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior/Staff Software Engineer (Back-End), Inference","description":"OverviewIn this role you will evolve the Model Vault backend to support enterprise-scale deployments with strong security and reliability. You will shape architecture across identity, deployments, billing, and observability to deliver scalable, secure model inference. You'll build and operate control-plane services that provision, configure, and manage model deployments across clouds. You will tackle complex backend and security challenges where standard SaaS patterns fall short, driving end-to-end delivery from architecture to production rollout. This is an opportunity to influence how Cohere serves large enterprises with trusted AI at scale.Compensation / Benefitsweekly lunch stipendfull health and dental benefitsRRSP matching, 401K, Pension6 weeks of paid vacationhome office stipendremote-friendly with coworking supportResponsibilitiesEvolve and scale backend systems powering Model Vault, including authentication/authorization, deployment management, billing, metering, and customer lifecycleLead major architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundationsBuild highly reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platformsDesign APIs and distributed systems with guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observabilityIncorporate security and privacy into platform architecture (tenant isolation, least-privilege, auditability, secrets management, encryption, confidential computing)Solve complex problems spanning backend services, cloud infrastructure, security, and AI inference beyond conventional SaaS patternsDrive projects end-to-end from architecture and threat modeling through implementation, rollout, production operations, and iteration based on customer workloadsKey requirementsStrong backend engineer with fundamentals in distributed systems, databases, networking, operating systems, and securityProficiency in production systems using Go, Python, Java, C++, Rust, or similar languagesExperience designing and operating production systems with emphasis on correctness, availability, security, and performance at scaleAbility to define architecture for ambiguous, high-impact problems and deliver reliable production systemsSolid systems-design instincts: concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, graceful degradationAwareness of security boundaries: authentication, authorization, identity, cryptography, secrets, tenant isolation, security risksComfort across backend services, APIs, databases, distributed systems, and cloud infrastructureWillingness to dive into unfamiliar codebases and debug cross-boundary issuesAttention to production engineering details: instrumentation, capacity planning, migrations, backward compatibility, incident response, safe rolloutsTrack record delivering technically difficult projects that become reliable for engineers and customersownership mindsetability to drive cross-functional initiativesstrong analytical and problem-solving abilitiesGoPythonJava","datePosted":"2026-10-26T13:22:20.139Z","dateModified":"2026-10-26T13:22:20.139Z","hiringOrganization":{"@type":"Organization","name":"Cohere","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Tucson","addressRegion":"AZ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"9f4ebe3612cf2ae1de18bcf5"},"url":"https://jobsearcher.com/jobs/9f4ebe3612cf2ae1de18bcf5"}}