{"schemaVersion":"jobsearcher.job.v1","id":"8ae0bbe860e7775c7a5b090a","url":"https://jobsearcher.com/jobs/8ae0bbe860e7775c7a5b090a","canonicalUrl":"https://jobsearcher.com/jobs/8ae0bbe860e7775c7a5b090a","title":"Software Engineer, Infrastructure","description":"About Us\nTavus is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations. AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.\nImagine a therapist anyone can afford. A personal trainer that adapts to your schedule. A fleet of medical assistants that can give every patient the attention they need. With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.\nWe’re a Series B company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.\nBe part of shaping a future where humans and machines truly understand each other.\nThe Role\nWe're hiring a Senior Software Engineer (Infrastructure) to own the systems behind CVI, our real-time conversational product. Every live conversation between a person and a PAL runs on infrastructure your team owns. You'll take goals like uptime, latency, and cost and chase them wherever they lead, including into backend services and product code.\nWhat you'll own\nCVI's inference deployments. The GPU infrastructure serving live conversations across multiple providers and regions. You'll join as an early senior member of a growing infra team, working on projects like tuning the newest GPU generations and cutting cold-start and model load times so users wait less.\nExpanding our GPU footprint. You'll bring on new providers and regions, stand up clusters on EKS, and build the routing, scheduling, and throughput needed for fast weight loading.\nUptime. You'll be one of the people pushing our uptime bar higher, along with the security and SOC2 work that keeps our infrastructure trustworthy.\nFix what you find. When you see a problem, you have the trust and the mandate to fix it or flag it. Reworking our deploy pipeline so shipping is fast and boring is exactly the kind of thing you'd take on.\nWhat this role has shipped\nMulti-provider, multi-region inference infrastructure: routes live conversations across GPU providers and regions, so one provider's outage never becomes a user's problem\nCUDA optimizations for Phoenix, our video rendering model: doubled the frame rate by tracing and optimizing hot paths with our researchers\nParallel conversations on a single GPU: several live conversations sharing one card, multiplying what the fleet can serve\nWho you are\nYou own outcomes. You don't stop where \"infrastructure\" ends. If the fix lives in backend code or the CVI stack, you dive in, and you don't wait for a ticket to do it.\nYou're energized by unfamiliar problems. If the next thing that matters is standing up a training deployment you've never touched, you jump in and learn on the fly.\nYou adapt as priorities evolve. In a space moving this fast, the most important thing to build can change as we learn. When it does, you adjust course without losing momentum.\nYou care about this problem. Keeping large-scale, real-time systems fast and reliable is something you think about unprompted.\nRequirements\nHands-on GPU inference experience. You've deployed and optimized inference workloads on GPUs and know what it takes to build reliable systems on top of GPU cloud providers.\nKubernetes and EKS depth, including routing and scheduling. You're comfortable designing how work gets placed across a fleet, and writing the services that make it happen.\nDeep AWS experience. You're at home spinning up new services and turning them into simple, repeatable processes others can build on.\nA senior track record of ownership. You've set technical direction, made decisions others built on, and carried ambiguous work over the finish line. You explain complex ideas clearly, to engineers and non-engineers alike.\nNice to have\nExperience with GCP\nExperience with video streaming infrastructure\nExperience with training infrastructure or LLM serving\nExperience with SOC2 or security compliance\nIf you don't check every box but this sounds like the work you want to be doing, apply anyway.","company":"Tavus","rawCompany":"tavus","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-08-14T12:39:33.053Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineer, Infrastructure","description":"About Us\nTavus is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations. AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.\nImagine a therapist anyone can afford. A personal trainer that adapts to your schedule. A fleet of medical assistants that can give every patient the attention they need. With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.\nWe’re a Series B company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.\nBe part of shaping a future where humans and machines truly understand each other.\nThe Role\nWe're hiring a Senior Software Engineer (Infrastructure) to own the systems behind CVI, our real-time conversational product. Every live conversation between a person and a PAL runs on infrastructure your team owns. You'll take goals like uptime, latency, and cost and chase them wherever they lead, including into backend services and product code.\nWhat you'll own\nCVI's inference deployments. The GPU infrastructure serving live conversations across multiple providers and regions. You'll join as an early senior member of a growing infra team, working on projects like tuning the newest GPU generations and cutting cold-start and model load times so users wait less.\nExpanding our GPU footprint. You'll bring on new providers and regions, stand up clusters on EKS, and build the routing, scheduling, and throughput needed for fast weight loading.\nUptime. You'll be one of the people pushing our uptime bar higher, along with the security and SOC2 work that keeps our infrastructure trustworthy.\nFix what you find. When you see a problem, you have the trust and the mandate to fix it or flag it. Reworking our deploy pipeline so shipping is fast and boring is exactly the kind of thing you'd take on.\nWhat this role has shipped\nMulti-provider, multi-region inference infrastructure: routes live conversations across GPU providers and regions, so one provider's outage never becomes a user's problem\nCUDA optimizations for Phoenix, our video rendering model: doubled the frame rate by tracing and optimizing hot paths with our researchers\nParallel conversations on a single GPU: several live conversations sharing one card, multiplying what the fleet can serve\nWho you are\nYou own outcomes. You don't stop where \"infrastructure\" ends. If the fix lives in backend code or the CVI stack, you dive in, and you don't wait for a ticket to do it.\nYou're energized by unfamiliar problems. If the next thing that matters is standing up a training deployment you've never touched, you jump in and learn on the fly.\nYou adapt as priorities evolve. In a space moving this fast, the most important thing to build can change as we learn. When it does, you adjust course without losing momentum.\nYou care about this problem. Keeping large-scale, real-time systems fast and reliable is something you think about unprompted.\nRequirements\nHands-on GPU inference experience. You've deployed and optimized inference workloads on GPUs and know what it takes to build reliable systems on top of GPU cloud providers.\nKubernetes and EKS depth, including routing and scheduling. You're comfortable designing how work gets placed across a fleet, and writing the services that make it happen.\nDeep AWS experience. You're at home spinning up new services and turning them into simple, repeatable processes others can build on.\nA senior track record of ownership. You've set technical direction, made decisions others built on, and carried ambiguous work over the finish line. You explain complex ideas clearly, to engineers and non-engineers alike.\nNice to have\nExperience with GCP\nExperience with video streaming infrastructure\nExperience with training infrastructure or LLM serving\nExperience with SOC2 or security compliance\nIf you don't check every box but this sounds like the work you want to be doing, apply anyway.","datePosted":"2026-08-14T12:39:33.053Z","dateModified":"2026-08-14T12:39:33.053Z","hiringOrganization":{"@type":"Organization","name":"Tavus","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"8ae0bbe860e7775c7a5b090a"},"url":"https://jobsearcher.com/jobs/8ae0bbe860e7775c7a5b090a"}}