{"schemaVersion":"jobsearcher.job.v1","id":"e5c8b7f6aab66e00c570a134","url":"https://jobsearcher.com/jobs/e5c8b7f6aab66e00c570a134","canonicalUrl":"https://jobsearcher.com/jobs/e5c8b7f6aab66e00c570a134","title":"Founding Engineer - ML Performance","description":"The problem we saw\nMost AI infrastructure is built for batch: send a query, wait, get a response, reset. Powerful, but transactional. AI is becoming interactive — sessions that hold state, models that stay alive between turns, generation that responds as it runs — and the infrastructure to deliver that at scale doesn't really exist yet.\nThe bottleneck isn't the models anymore. It's the infrastructure underneath them.\nWhat we're building to fix it\nuRun is the inference cloud for interactive AI: the compute layer that makes real-time, stateful inference possible at scale. We came out of stealth in April 2026, are backed by top-tier investors, and are founded by Keegan McCallum, who scaled inference infrastructure for some of the most demanding generative AI workloads in production.\nWe're an infrastructure company. We build the layer that model labs, builders, and research teams ship on top of.\nWhere you come in\nPerformance is uRun's core differentiator. We're not chasing incremental gains — we're building infrastructure that runs 10–100x faster than the status quo. As our ML Performance Engineer, you will be the person who makes that true.\nThis is a founding technical hire. You will write custom CUDA kernels, push GPU utilization to its limits, and own inference latency end-to-end across the stack. You will work directly with the founding team on the hardest performance problems in production AI infrastructure — and your fingerprints will be on everything we ship.\nWhat you'll actually be doing day-to-day\nWrite custom CUDA kernels that unlock performance headroom unavailable through off-the-shelf frameworks\nOptimize model inference end-to-end, targeting sub-50ms latency across our inference platform\nDrive 10x performance improvements across the stack: memory bandwidth, kernel fusion, operator scheduling, and beyond\nImplement zero-copy distributed memory optimizations across multi-GPU and multi-node environments\nOwn GPU utilization and memory management, squeezing every available FLOP out of the hardware we run\nProfile, benchmark, and instrument the full inference pipeline to find and eliminate bottlenecks systematically\nSet the performance engineering bar for the team: define what fast looks like and build the tooling to measure it\nWhat skills you need for the journey\nDeep, hands-on CUDA expertise: you have written custom kernels in production, not just called into cuBLAS\nStrong background in model inference and post-training optimization at scale\nFluency in GPU memory hierarchy, warp scheduling, kernel fusion, and hardware-aware algorithm design\nExperience profiling and benchmarking complex inference pipelines: you know where the time goes and how to get it back\nAble to operate at the frontier with minimal guidance — you identify the problem, design the approach, and ship the fix\nThings that will give you an edge\nPublic work in GPU optimization or inference efficiency — open source contributions, a published paper, or a side project that shows your depth (vLLM, Flash-Attention, TensorRT-LLM, PyTorch, or equivalent)\nExperience with hardware-aware optimization frameworks: CuTe, Triton, TileLang, or similar\nFamiliarity with distributed memory and communication primitives: NCCL, InfiniBand, NVLink, RoCE\nContributions to or deep familiarity with PyTorch Distributed, Ray core, or similar systems\nExperience optimizing for video generation or other high-throughput, latency-sensitive generative workloads\nPrior work at an inference-focused company or research lab pushing the boundary of what GPU hardware can do\nWhat you'll get in return\nCompetitive salary and meaningful equity in an early-stage AI infrastructure company. The band above is our target; for an exceptional candidate we'll go higher. Equity is real — you're early, and the grant reflects that.\nHealth, dental, and vision\n401(k) — company-supported retirement savings\nFSA/HSA — flexible spending accounts for healthcare costs\nPaid time off — we trust you to manage your time\nTop-tier tooling — access to the best AI tools available: Claude, Codex, Kimi, and whatever else helps you move faster\nMacBook Pro and AirPods — the hardware you need, on us\nHow we work (and what that feels like day-to-day)\nWe build the stage, not the show. We're an infrastructure company, a developer-tools company, and a production partner for model labs, and focus is a deliberate choice we've made and hold to.\nDay-to-day, that means a small team, a high bar, and real ownership. You won't wait for permission or inherit a backlog of someone else's decisions, in a founding security role, the function is what you make it.\nIt also means ambiguity: priorities shift, not everything is documented, and you'll often be the person who decides what \"secure enough, for now\" means. That suits some people and not others, and we'd rather you know that before you apply.\nWatch our launch party video\nRead the manifesto\nFollow us on LinkedIn\nFollow us on X\n\nCompensation Range: $250K - $395K","company":"Urun","rawCompany":"urun","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-08-06T13:38:02.110Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Founding Engineer - ML Performance","description":"The problem we saw\nMost AI infrastructure is built for batch: send a query, wait, get a response, reset. Powerful, but transactional. AI is becoming interactive — sessions that hold state, models that stay alive between turns, generation that responds as it runs — and the infrastructure to deliver that at scale doesn't really exist yet.\nThe bottleneck isn't the models anymore. It's the infrastructure underneath them.\nWhat we're building to fix it\nuRun is the inference cloud for interactive AI: the compute layer that makes real-time, stateful inference possible at scale. We came out of stealth in April 2026, are backed by top-tier investors, and are founded by Keegan McCallum, who scaled inference infrastructure for some of the most demanding generative AI workloads in production.\nWe're an infrastructure company. We build the layer that model labs, builders, and research teams ship on top of.\nWhere you come in\nPerformance is uRun's core differentiator. We're not chasing incremental gains — we're building infrastructure that runs 10–100x faster than the status quo. As our ML Performance Engineer, you will be the person who makes that true.\nThis is a founding technical hire. You will write custom CUDA kernels, push GPU utilization to its limits, and own inference latency end-to-end across the stack. You will work directly with the founding team on the hardest performance problems in production AI infrastructure — and your fingerprints will be on everything we ship.\nWhat you'll actually be doing day-to-day\nWrite custom CUDA kernels that unlock performance headroom unavailable through off-the-shelf frameworks\nOptimize model inference end-to-end, targeting sub-50ms latency across our inference platform\nDrive 10x performance improvements across the stack: memory bandwidth, kernel fusion, operator scheduling, and beyond\nImplement zero-copy distributed memory optimizations across multi-GPU and multi-node environments\nOwn GPU utilization and memory management, squeezing every available FLOP out of the hardware we run\nProfile, benchmark, and instrument the full inference pipeline to find and eliminate bottlenecks systematically\nSet the performance engineering bar for the team: define what fast looks like and build the tooling to measure it\nWhat skills you need for the journey\nDeep, hands-on CUDA expertise: you have written custom kernels in production, not just called into cuBLAS\nStrong background in model inference and post-training optimization at scale\nFluency in GPU memory hierarchy, warp scheduling, kernel fusion, and hardware-aware algorithm design\nExperience profiling and benchmarking complex inference pipelines: you know where the time goes and how to get it back\nAble to operate at the frontier with minimal guidance — you identify the problem, design the approach, and ship the fix\nThings that will give you an edge\nPublic work in GPU optimization or inference efficiency — open source contributions, a published paper, or a side project that shows your depth (vLLM, Flash-Attention, TensorRT-LLM, PyTorch, or equivalent)\nExperience with hardware-aware optimization frameworks: CuTe, Triton, TileLang, or similar\nFamiliarity with distributed memory and communication primitives: NCCL, InfiniBand, NVLink, RoCE\nContributions to or deep familiarity with PyTorch Distributed, Ray core, or similar systems\nExperience optimizing for video generation or other high-throughput, latency-sensitive generative workloads\nPrior work at an inference-focused company or research lab pushing the boundary of what GPU hardware can do\nWhat you'll get in return\nCompetitive salary and meaningful equity in an early-stage AI infrastructure company. The band above is our target; for an exceptional candidate we'll go higher. Equity is real — you're early, and the grant reflects that.\nHealth, dental, and vision\n401(k) — company-supported retirement savings\nFSA/HSA — flexible spending accounts for healthcare costs\nPaid time off — we trust you to manage your time\nTop-tier tooling — access to the best AI tools available: Claude, Codex, Kimi, and whatever else helps you move faster\nMacBook Pro and AirPods — the hardware you need, on us\nHow we work (and what that feels like day-to-day)\nWe build the stage, not the show. We're an infrastructure company, a developer-tools company, and a production partner for model labs, and focus is a deliberate choice we've made and hold to.\nDay-to-day, that means a small team, a high bar, and real ownership. You won't wait for permission or inherit a backlog of someone else's decisions, in a founding security role, the function is what you make it.\nIt also means ambiguity: priorities shift, not everything is documented, and you'll often be the person who decides what \"secure enough, for now\" means. That suits some people and not others, and we'd rather you know that before you apply.\nWatch our launch party video\nRead the manifesto\nFollow us on LinkedIn\nFollow us on X\n\nCompensation Range: $250K - $395K","datePosted":"2026-08-06T13:38:02.110Z","dateModified":"2026-08-06T13:38:02.110Z","hiringOrganization":{"@type":"Organization","name":"Urun","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"e5c8b7f6aab66e00c570a134"},"url":"https://jobsearcher.com/jobs/e5c8b7f6aab66e00c570a134"}}