LLM Inference Performance Engineer
Baseten is seeking an Software Engineer focusing on inference performance to accelerate AI workloads at scale. You will optimize runtime internals, quantization, decoding, and KV-cache management across GPUs, improving speed and cost efficiency for customers.
You will work on cutting-edge baseten inference stack, benchmark across architectures, and contribute to open-source engines. A strong background in GPU/LLM optimization is essential.