Staff Software Engineer, Inference Performance Optimization, GenAI, DeepMind
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Title
Minimum Qualifications:
Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related technical field, or equivalent practical experience.8 years of experience in software development.
Experience in Python and C++, including navigating, debugging, and modifying serving codebases.
Experience with AI model execution constraints, throughput-latency tradeoffs, memory bandwidth limitations, and modern serving architectures.
Preferred Qualifications:
Experience with real world LLM inference serving environments or direct contributions to modern open-source inference frameworks (e.g., vLLM, TensorRT-LLM, SGLang, Dynamo).Experience profiling workloads using standard ML profilers (e.g., PyTorch profiler) and internal trace analysis tools. Experience with observability and reliability for large distributed systems. Familiarity with GPU/TPU/accelerator performance concepts (e.g. memory bandwidth, quantization, collective communication, kernel), and can reason their implications to the overall inference serving performance.