Senior Systems Software Engineer, GPU Fleet Telemetry
Overview:
As a Senior Software Engineer on the DGX Cloud / Fleet Intelligence team, you will build agent-side and collector systems to monitor GPU health, host telemetry, inventory, attestation, and BMC data across NVIDIA's GPU fleet. You'll contribute to open source software used by developers, operators, and customers, while improving deployment, observability, and backend workflows. You'll work closely with cross-functional teams to deliver reliable fleet observability at cloud scale. This role offers meaningful impact through building resilient, scalable infrastructure for enterprise AI workloads. Compensation / Benefitsequitybenefits
Responsibilities:
- Design and develop Fleet Intelligence agent software for Linux hosts, bare metal, and Kubernetes GPU nodes
- Build telemetry and health collection for GPUs, drivers, runtimes, InfiniBand, containers, and OS state
- Develop inventory, enrollment, node identity, attestation, local state, and backend export workflows; maintain API, Prometheus metrics, file export, and OTLP/HTTP paths
- Enhance Kubernetes daemonset deployment, systemd packaging, .deb/.rpm packaging, and container image workflows
- Contribute to open source Fleet Intelligence agent/collector software (code, tests, docs, release artifacts)
- Contribute to out-of-band collection using Redfish/BMC interfaces for inventory and attestation
- Improve collector concurrency, rate limiting, retry logic, credential handling, partial-failure handling, and backend submission
- Collaborate with backend, infrastructure, SRE, security, and datacenter ops teams to ensure reliable GPU fleet observability
Key requirements:
- 5+ years of software engineering experience with a related degree or equivalent
- Strong Go development experience for Linux services, CLIs, agents, or daemons
- Rust experience or willingness to work in Rust for out-of-band collector development
- Strong Linux systems knowledge (processes, filesystems, networking, service lifecycle, logs, permissions, host diagnostics)
- Experience with telemetry/observability/fleet-management, and with Docker, Kubernetes, Helm, and production deployment workflows
- Experience contributing to open source projects and working in public repositories with code review, docs, release notes, and signed commits
- Familiarity with secure credential handling, enrollment flows, tokens/JWTs, and service-to-service authentication
- Strong debugging skills across hardware-adjacent software, OS, containers, and distributed backendscollaboration with cross-functional teamsstrong debugging and problem-solvingattention to detail and reliability
- GoRust (or willingness to learn)
- Linux systems