{"schemaVersion":"jobsearcher.job.v1","id":"0eda2983e355d7a439cccb33","url":"https://jobsearcher.com/jobs/0eda2983e355d7a439cccb33","canonicalUrl":"https://jobsearcher.com/jobs/0eda2983e355d7a439cccb33","title":"Rust Engineer","description":"Rust Engineer\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services.\n\nWe’re looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.\n\nAbout The Role\nYou’ll own LiteLLM’s migration to Rust end to end. This is a high-stakes, high-visibility role: you’ll plan the migration directly with the CTO, structure the codebase so it’s ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.\n\nThis is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.\n\nResponsibilities\n\nOwn the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.\n\nPlan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.\n\nDesign and execute a gradual rollout that holds stability as the top constraint while the migration progresses.\n\nRestructure the existing codebase so it’s positioned for a clean, incremental move to Rust.\n\nDrive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.\n\nCollaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.\n\nWhat We’re Looking For\n\nDeep, long-standing expertise in Rust. You’ve been writing production Rust for years and know it cold.\n\nObsessive about performance. You care about latency and throughput at a level most engineers don’t.\n\nStrong instinct for stability, with a track record of balancing ambitious change against reliability.\n\nMajor bonus: prior experience leading codebase migrations from another language to Rust.\n\nMajor bonus: a demonstrated history of shipping performance‑critical systems.\n\nFamiliarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.\n\nWhy Join LiteLLM?\n\nOwn one of the most important technical bets in the company’s roadmap.\n\nDefine the architectural foundation that the entire platform will run on.\n\nFast‑paced growth environment with deep technical ownership.\n\nCompetitive salary, health, dental, and vision benefits.\n\nAbout LiteLLM\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\n#J-18808-Ljbffr","company":"Litellm","rawCompany":"litellm","city":"Millbrae","state":"CA","isRemote":false,"isActive":true,"createdAt":"2026-06-21T03:26:29.694Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"17-2199.00","title":"Engineers, All Other","slug":"engineers-all-other"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Rust Engineer","description":"Rust Engineer\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services.\n\nWe’re looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.\n\nAbout The Role\nYou’ll own LiteLLM’s migration to Rust end to end. This is a high-stakes, high-visibility role: you’ll plan the migration directly with the CTO, structure the codebase so it’s ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.\n\nThis is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.\n\nResponsibilities\n\nOwn the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.\n\nPlan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.\n\nDesign and execute a gradual rollout that holds stability as the top constraint while the migration progresses.\n\nRestructure the existing codebase so it’s positioned for a clean, incremental move to Rust.\n\nDrive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.\n\nCollaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.\n\nWhat We’re Looking For\n\nDeep, long-standing expertise in Rust. You’ve been writing production Rust for years and know it cold.\n\nObsessive about performance. You care about latency and throughput at a level most engineers don’t.\n\nStrong instinct for stability, with a track record of balancing ambitious change against reliability.\n\nMajor bonus: prior experience leading codebase migrations from another language to Rust.\n\nMajor bonus: a demonstrated history of shipping performance‑critical systems.\n\nFamiliarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.\n\nWhy Join LiteLLM?\n\nOwn one of the most important technical bets in the company’s roadmap.\n\nDefine the architectural foundation that the entire platform will run on.\n\nFast‑paced growth environment with deep technical ownership.\n\nCompetitive salary, health, dental, and vision benefits.\n\nAbout LiteLLM\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\n#J-18808-Ljbffr","datePosted":"2026-06-21T03:26:29.694Z","dateModified":"2026-06-21T03:26:29.694Z","hiringOrganization":{"@type":"Organization","name":"Litellm","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0eda2983e355d7a439cccb33"},"url":"https://jobsearcher.com/jobs/0eda2983e355d7a439cccb33"}}