Senior Observability Engineer
Role Summary:
As part of the Platform Engineering organization, the Senior Observability Engineer will enable application, services, and infrastructure teams to fully adopt and operationalize New Relic and our observability ecosystem. This role blends platform engineering, developer enablement, instrumentation expertise, and strong cross‑enterprise partnership. You will build the frameworks, tooling, standards, and automation that make logs, metrics, traces, and digital/store/on-prem experience monitoring easy, consistent, reliable, and self‑service for all teams.
Key Responsibilities:
- Design, maintain, and enhance platform‑level New Relic capabilities: APM, browser monitoring, mobile, infrastructure monitoring, logs, synthetics, dashboards, alerting policies, NerdGraph automation, access control.
- Develop and maintain strategies and standards for metrics, events, traces, logging, and ingestion optimization to ensure signal quality and cost efficiency.
- Define and maintain instrumentation standards using OpenTelemetry or agent based programming languages such as Java, Node.js, Python, or. NET in Azure.
- Integrate observability requirements into GitHub Actions pipelines and create reusable pipeline templates for teams.
- Deploy and manage telemetry agents/collectors/polling engines for on‑prem systems on different operating systems using SolarWinds.
- Improve reliability through standardized dashboards, synthetic monitoring, and service
health indicators to reduce MTTR/MMTD.
- Partner with application, SRE, cloud, and architecture teams to drive observability adoption.
- Govern tagging, metadata standards, and account structure across environments.
- Mentor junior team members, run enablement sessions, and promote observability best
practices across the enterprise.
- Take part in the scheduled on-call rotation as needed.
- 5+ years in Observability, SRE, Software Development, or Cloud Engineering roles.
- Expert understanding of OpenTelemetry (SDK + Collector) and proven experience rolling out
instrumentation at scale.
- Hands-on experience with New Relic across logs, metrics, traces, dashboards, alerts,
NerdGraph API, tags/metadata, NRQL and service maps.
- Proficient in patching, upgrading and securing SolarWinds.
- Strong experience integrating telemetry for Azure/AWS/GCP cloud services.
- Experience onboarding logs/metrics from 3rd party integration
- Experience CI/CD pipeline experience with GitHub Actions, reusable workflows, and
compliance gates.
- Strong communication, collaboration, and stakeholder management skills.
- Hands-on experience in scripting language such as PowerShell, Shell or Python,
- Experience in troubleshoot networking issues on Cloud and on-prem environment.
Preferred Skills:
- Exposure SLO/SLA frameworks, golden signals, and performance testing.
- Familiarity with service catalog integrations, error budgets, or maturity frameworks.
- Prior experience working in retail, e‑commerce, or large distributed systems environments.
- Proficiency in scripting languages (e.g., Python, Bash) and infrastructure-as-code tools (e.g.,
Terraform, Ansible).
- Familiarity with serverless platform, containerization and orchestration (Docker, Kubernetes,
AFA, ACA).
- Experience with AI-driven observability and performance optimization practices.
- Committed to continuous learning and process improvement, and maintaining an open-minded attitude toward change and innovation.
Pay: $55.00 - $65.00 per hour
Benefits:
- Dental insurance
- Health insurance
- Vision insurance
Work Location: Remote