Senior Backend Engineer, LLM Inference Systems
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Inception in San Francisco is seeking experienced backend engineers to own the systems that serve our diffusion LLMs in production. You will build and operate infrastructure that handles billions of inference requests, optimizing for latency, throughput, cost, and reliability.
This role sits at the intersection of ML systems and backend infrastructure, with responsibilities spanning scalable services, model serving, load balancing, canary deployments, and observability tooling to ensure SLA