JOBSEARCHER

LLM Inference Intern: GPU, KV Cache & SoC

Samsung Semiconductor in San Jose, CA, is offering a summer internship to work on cutting-edge SoC storage and memory projects. You will deploy and operate an LLM inference service on a multi-GPU server and build a reproducible benchmark harness to measure latency and throughput. The role requires hands-on experience with Python and PyTorch on NVIDIA GPUs under Linux and familiarity with vLLM, SGLang, or Hugging Face TGI.