Machine Learning Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Title: Customer Facing Engineer (Inference)
About the Role:
We’re working with a well‑funded AI infrastructure company (over $1.4B raised) building a next‑generation platform for production LLM inference.
We’re hiring a customer‑facing inference engineer to help enterprise customers deploy, optimize, and troubleshoot LLM inference workloads in real production environments.
This role is not focused on GenAI application development — it is focused on LLM inference performance, GPU optimization, and runtime expertise.
What You’ll Do:
- Work directly with enterprise customers on LLM inference deployments
- Optimize inference performance (latency, throughput, GPU utilization)
- Troubleshoot runtime issues across model, GPU, and infrastructure layers
- Support customer adoption of modern inference stacks
- Collaborate with product + engineering to improve inference tooling
- Must‑HavesStrong experience with LLM inference in production
- Hands‑on expertise with at least one:vLLMSGLangTensorRT‑LLMTritonPyTorch DynamoGPU inference deployments
- Model bring‑upSolid Python engineering skills
- Experience working directly with customers or external engineering teams
- Ability to debug complex ML systems end‑to‑end