Senior Data Engineer - EDA Datacenter Analytics and Observability
Overview:
Apply fast, check the full description by scrolling below to find out the full requirements for this role. As a Senior Data Engineer at NVIDIA, you will design and evolve analytics-ready data platforms for observability, reliability, and capacity forecasting across EDA datacenters. You’ll partner with observability, infrastructure, and data science teams to transform large-scale telemetry into trusted datasets for analysts and engineers. You will shape data models, pipelines, and quality controls that support predictive analytics and long-term insights. This role offers impact across global compute clusters and data platforms, with a focus on scalability and self-service analytics. Compensation / Benefitsequitybenefits
Responsibilities:
- Design, build, and maintain analytics-focused data pipelines ingesting and curating observability data
- Develop reliable ingestion for metrics, logs, traces, and hardware health telemetry from CPU/GPU clusters
- Integrate data from Prometheus, Grafana, Elastic/OpenSearch, and Spark-based platforms into unified datasets
- Model and organize data to support exploratory analysis, reliability modeling, forecasting, and trend analysis
- Build and optimize batch and streaming workflows for near-real-time and historical analytics
- Implement data quality checks, validation, and monitoring for accuracy and consistency
- Define retention, aggregation, and enrichment strategies balancing analysis needs and storage costs
- Enable self-service analytics through improved discoverability and documentation
- Collaborate with data scientists and analysts to evolve datasets for new models and insights
- Improve pipeline scalability, reliability, and performance as datacenter scope grows
Key requirements:
- 10+ years designing, building, and operating large-scale data pipelines and data platforms
- Proficiency in Python and SQL for analytical workloads
- Hands-on experience with distributed processing frameworks like Spark
- Familiarity with xaygatp observability/telemetry data (metrics, logs, traces, time-series)
- Experience designing flexible data models and schemas for forecasting
- Ability to own data engineering initiatives end-to-end with cross-functional partners
- Experience implementing data quality, validation, and monitoring for analytics pipelines
- Strong communication and collaboration skills with engineering and infrastructure teams
- Adaptability in fast-paced environments with evolving analytical needscollaborationstrong communicationadaptability
- PythonSQLSpark or similar distributed processing framework