Operational Engineer – AI Infrastructure
Job Title: Operational Engineer – AI Infrastructure
Duration: Long Term
Experience: 5+ Years
Location: NY/ San Francisco CA/Houston TX/Seattle WAJob Summary
We are seeking an experienced Operational Engineer – AI Infrastructure to support the day-to-day reliability, availability, and performance of production AI infrastructure services. The ideal candidate will have a strong background in infrastructure operations, incident management, monitoring, ticketing systems, and operational process improvement. This role involves monitoring production environments, coordinating incident response, maintaining operational documentation, and collaborating with GPU infrastructure, platform engineering, networking, hardware operations, and Site Reliability Engineering (SRE) teams. The successful candidate will help improve service reliability, strengthen operational processes, and drive automation to reduce repetitive tasks and prevent recurring incidents.
Key Responsibilities:
Manage end-to-end incident and service-request lifecycles, including ticket creation, categorization, prioritization, ownership, status updates, escalation, documentation, and verified closure.
Monitor production infrastructure health, respond to alerts, assess service impact, coordinate troubleshooting, and maintain clear communication during incidents.
Maintain operational runbooks, shift handoff documentation, escalation procedures, on-call schedules, and service ownership records.
Collaborate with GPU infrastructure, platform engineering, networking, hardware operations, and SRE teams to troubleshoot issues and minimize service disruptions.
Coordinate maintenance activities, change readiness, incident reviews, and post-incident corrective actions to improve operational reliability.
Track service performance, incident trends, operational metrics, and SLA/SLO compliance to identify areas for improvement.
Develop and maintain dashboards, reports, and workflow improvements to enhance operational visibility and efficiency.
Identify repetitive manual processes and implement automation using scripting, APIs, and workflow integration tools.
Ensure operational records and documentation are accurate, complete, and aligned with established service management procedures.
Support continuous improvement initiatives focused on incident response, service quality, operational consistency, and production readiness.
Required Qualifications:
5+ years of experience supporting production infrastructure, cloud services, platform operations, SRE, NOC, or infrastructure engineering environments.
Hands-on experience with incident management, service requests, ticketing workflows, escalation procedures, and issue resolution through verified closure.
Experience with monitoring and alerting tools, production health dashboards, on-call response, and incident coordination.
Working knowledge of Linux systems, networking fundamentals, cloud infrastructure, and production service troubleshooting.
Experience using IT service management (ITSM) and collaboration tools such as Jira, Jira Service Management, or equivalent platforms.
Familiarity with observability and incident response tools such as Grafana, PagerDuty, metrics, alerts, and dashboards.
Strong documentation skills, including maintaining runbooks, operational procedures, incident timelines, and shift handoff records.
Excellent communication, prioritization, and cross-functional coordination skills, particularly during high-priority incidents.
Ability to analyze operational data, identify recurring issues, and recommend improvements to service reliability and incident response.
Preferred Qualifications:
Experience supporting AI infrastructure, GPU compute clusters, high-performance computing (HPC), bare-metal servers, or data center IT operations.
Familiarity with GPU infrastructure operations, GPU nodes, hardware incident workflows, and cross-team escalation processes.
Scripting or automation experience using Python, Bash, APIs, or workflow integration tools.
Experience supporting 24/7 production operations, on-call rotations, and multi-team incident bridges.
Knowledge of SLA/SLO reporting, service reliability metrics, root cause analysis, and corrective action tracking.
Experience improving ITSM workflows, operational dashboards, incident reporting, and service management processes.
Technical SkillsITSM & Ticketing: Jira, Jira Service Management, Incident Management, Service Requests, Change Management.
Monitoring & Observability: Grafana, PagerDuty, Metrics, Alerting, Dashboards, Incident Timelines.
Infrastructure: Linux, Networking, Cloud Infrastructure, Production Services, Infrastructure Troubleshooting.
Automation & Scripting: Python, Bash, APIs, Workflow Automation.
Operations & Reliability: Incident Response, On-Call Support, Runbooks, Escalation Management, SLA/SLO Reporting, Root Cause Analysis.
AI Infrastructure: GPU Compute, AI Infrastructure Operations, HPC, Bare-Metal Servers, Hardware Operations Coordination.--