Senior AI Infrastructure Software Engineer - DGX Cloud
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Overview:
In this role you will design, build and maintain AI platforms for large-scale training, inference and GenAI workloads. You will optimize tooling to boost efficiency and resiliency, and perform root cause analysis across the stack from application to hardware. You will contribute to NVIDIA's AI infrastructure products and co-design APIs for resiliency. Expect a culture of learning, growth and blameless postmortems that values initiative and collaboration. This is a high-impact, hands-on role shaping scalable cloud AI infrastructure.
Compensation / Benefitsequitybenefitsremote work optionsgrowth opportunities
Responsibilities:
Develop platform and tools for large-scale AI, LLM, and GenAI infrastructureDevelop and optimize tools to improve AI/ML workload efficiency and resiliencyRoot cause analyze and triage failures from application to hardware levelEnhance infrastructure and products underpinning NVIDIA's AI platformsCo-design and implement APIs for integration with resiliency stacks on the platformDefine meaningful reliability metrics to track and improve system and service reliabilityApply problem-solving, root cause analysis and optimization
Key requirements:
8+ years in developing software infrastructure for large-scale AI systemsBachelor's degree in Computer Science or related field (or equivalent experience) Strong debugging and RCA skills across application to hardwareProven track record building and scaling distributed systemsExperience with AI training/inference and data infrastructure servicesFamiliar with Kubernetes and operating large-scale observability platforms (ELK, Prometheus, Loki) Proficiency in Python, C/C++, and scripting languagesExcellent communication and collaboration, and a culture of diversity and curiosityexcellent communicationcollaborationproblem solvingKubernetesELKPrometheus