Senior Machine Learning Engineer, Core Systems
About the Role:
Anthropic is dedicated to building reliable, interpretable, and steerable AI systems. We are seeking a Senior ML Engineer to join our Core Systems team to optimize the training and inference infrastructure for our Claude family of foundation models.
Responsibilities:
Architect and implement high-performance distributed training and inference pipelines for massive transformer models.
Work hand-in-hand with research scientists to unblock scaling bottlenecks and improve hardware utilization.
Develop low-latency inference runtimes and model optimization techniques (quantization, pruning, kernel fusion).
Monitor and triage large-scale cluster performance issues across heterogeneous GPU clusters.
Requirements:
5+ years of software engineering experience with a strong focus on large-scale machine learning infrastructure.
Expert-level C++ and Python programming skills.
Deep familiarity with distributed training paradigms (FSDP, Tensor Parallelism, Pipeline Parallelism).
Experience working with cloud providers (AWS, GCP) and orchestration tools like Kubernetes.
Benefits:
Competitive salary and generous equity package.
Premium medical, dental, and vision benefits.
Flexible working hours and remote-friendly culture within the US.
Annual learning and development stipend.