Staff Software Engineer, Inference Performance Optimization, GenAI, DeepMind

Job TitleMinimum Qualifications:Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related technical field, or equivalent practical experience.8 years of experience in software development.Experience in Python and C++, including navigating, debugging, and modifying serving codebases.Experience with AI model execution constraints, throughput-latency tradeoffs, memory bandwidth limitations, and modern serving architectures.Preferred Qualifications:Experience with real world LLM inference serving environments or direct contributions to modern open-source inference frameworks (e.g., vLLM, TensorRT-LLM, SGLang, Dynamo).Experience profiling workloads using standard ML profilers (e.g., PyTorch profiler) and internal trace analysis tools.Experience with observability and reliability for large distributed systems.Familiarity with GPU/TPU/accelerator performance concepts (e.g. memory bandwidth, quantization, collective communication, kernel), and can reason their implications to the overall inference serving performance.