JOBSEARCHER

LLM Inference Performance Engineer

XapplyMillbrae, CAL6 LeadOctober 9th, 2026
Baseten is seeking an Software Engineer focusing on inference performance to accelerate AI workloads at scale. You will optimize runtime internals, quantization, decoding, and KV-cache management across GPUs, improving speed and cost efficiency for customers. You will work on cutting-edge baseten inference stack, benchmark across architectures, and contribute to open-source engines. A strong background in GPU/LLM optimization is essential.