Machine Learning Engineer
The Company & Mission Our client is a venture backed defense AI company building small language and vision models that run fully on device for the US military: no cloud, no internet, no data center. The models run on laptops, drones and robots in the field, and a warfighter has to trust the answer. They’re hiring an ML Engineer to make that work.
What you’ll do:
- Shrink and speed up models for constrained hardware: quantization, distillation, pruning, and inference optimization
- Post train and evaluate small language and vision models for military tasks
- Own projects end to end on a small team, from experiment to something running on a real device
- Work directly with the founding team
What we’re looking for:
- 3+ years of hands on ML engineering, with shipped models, not only pipelines or API integrations
- Direct experience with at least one of: quantization, distillation, post training, or inference optimization (llama.cpp, TensorRT LLM, vLLM, ONNX, CUDA, Metal or similar)
- Strong Python and PyTorch. C++ or Rust is a plus
- Comfortable running models on laptops or edge hardware with tight memory and latency budgets
- Evidence of depth: a project, repo, paper or system you can walk us through in detail
- Not a fit ifYour experience is mainly RAG, prompt engineering, or calling hosted LLM APIsYou need a large team, a big GPU cluster, or a defined research agenda handed to you
- You are not a US citizen. Citizenship is required, and sponsorship isn’t available
- Compensation and details
- Base of $175K to $300K depending on experience, plus equity
- Fully remote anywhere in the US