{"schemaVersion":"jobsearcher.job.v1","id":"6eea982810a04eab5385b617","url":"https://jobsearcher.com/jobs/6eea982810a04eab5385b617","canonicalUrl":"https://jobsearcher.com/jobs/6eea982810a04eab5385b617","title":"Senior DevOps Engineer","description":"Senior DevOps / Cloud Platform Engineer – ML AI Infrastructure Job Summary We are looking for a Senior DevOps / Cloud Platform Engineer with strong experience in AWS, Kubernetes, CI/CD, infrastructure automation, and ML/AI infrastructure to design, deploy, manage, and optimize cloud infrastructure supporting our machine learning and AI services. The ideal candidate will have hands‑on experience with AWS EKS, SageMaker, Bedrock, Docker, Kubernetes, Terraform, Helm, GitHub Actions, Databricks, Elasticsearch, and self-hosted LLM deployments . This role will work closely with Data Engineering, Machine Learning, and Software Engineering teams to build reliable, scalable, secure, and cost‑efficient platforms for ML services across development and production environments. In this role you will...\r\nKey ResponsibilitiesAWS Kubernetes Infrastructure Design, deploy, and administer AWS infrastructure supporting ML and AI workloads.\r\nManage Amazon EKS clusters , including cluster provisioning, upgrades, scaling, networking, and troubleshooting.\r\nWork with AWS SageMaker, AWS Bedrock, EKS, ECS, and related AWS services .\r\nConfigure and manage Kubernetes Ingress controllers such as NGINX and AWS ALB .\r\nManage Cloudflare Tunnels, DNS, Cloudflare configuration, networking, and security .\r\nTroubleshoot application, networking, compute, and infrastructure issues across AWS and Kubernetes environments.\r\nImplement best practices for security, reliability, availability, and scalability.\r\nCI/CD Azure-to-AWS Migration Build and maintain CI/CD pipelines for ML and AI services.\r\nDevelop and manage GitHub Actions and Azure DevOps pipelines using YAML.\r\nMigrate repositories and CI/CD workflows from Azure DevOps to GitHub/AWS .\r\nAutomate build, test, containerization, deployment, and release processes.\r\nEstablish deployment strategies across development, staging, and production environments.\r\nML Service Deployment Deploy and manage ML services across AWS EKS/ECS and SageMaker .\r\nBuild and maintain Docker containers and Kubernetes deployments.\r\nManage environment segregation and configuration across Dev, QA, and Production.\r\nDevelop and maintain Kubernetes manifests and Helm charts .\r\nTroubleshoot ML service deployment, networking, scaling, and runtime issues.\r\nApp Runner to EKS Migration Lead migration of existing services from AWS App Runner to Amazon EKS .\r\nContainerize applications and develop Kubernetes manifests/Helm charts.\r\nDesign appropriate Kubernetes architecture, networking, ingress, scaling, and deployment strategies.\r\nEnsure minimal service disruption during migration and establish operational best practices on EKS.\r\nSelf-Hosted LLM AI Infrastructure Deploy and manage self-hosted Large Language Models and inference services.\r\nWork with model serving frameworks such as vLLM .\r\nDesign containerized infrastructure for GPU-based model serving and inference.\r\nManage model versions, deployments, configurations, and rollback strategies.\r\nSupport migration of ML services from managed APIs/services to self-hosted models .\r\nWork with engineering teams on API integration and inference infrastructure.\r\nDatabricks Administration Administer Databricks workspaces, clusters, permissions, and access controls .\r\nManage cluster configuration, policies, and resource utilization.\r\nSupport LMI Insights and related ML/AI workloads.\r\nTroubleshoot Databricks infrastructure and connectivity issues.\r\nImplement appropriate security and access-control practices.\r\nElasticsearch Infrastructure Design, deploy, and manage Elasticsearch clusters .\r\nPerform cluster sizing, scaling, configuration, and performance optimization.\r\nManage indices, mappings, retention, and data lifecycle requirements.\r\nSupport Kibana configuration, dashboards, and troubleshooting.\r\nMonitor Elasticsearch health, capacity, and performance.\r\nMonitoring, Reliability Auto-Scaling Implement monitoring and observability for Kubernetes, AWS, and ML services.\r\nUse Prometheus, Grafana, and AWS CloudWatch for monitoring and alerting.\r\nConfigure Kubernetes HPA/VPA and other auto-scaling mechanisms.\r\nEstablish proactive alerting for infrastructure and application health.\r\nPerform capacity planning and resource optimization.\r\nIdentify opportunities for AWS infrastructure and compute cost optimization .\r\nInfrastructure as Code Automation Build and maintain infrastructure using Terraform .\r\nDevelop reusable Terraform modules for AWS and Kubernetes infrastructure.\r\nManage Kubernetes deployments using Helm charts .\r\nAutomate infrastructure provisioning, configuration, deployments, and operational tasks.\r\nMaintain infrastructure documentation and deployment standards.\r\nCross-Team Collaboration Partner closely with Data Engineering, ML Engineering, Data Science, and Software Engineering teams.\r\nUnderstand data pipelines, SQL, APIs, and ML service architecture sufficiently to troubleshoot end-to-end workflows.\r\nCoordinate infrastructure requirements for new ML models and services.\r\nParticipate in production incident resolution, root-cause analysis, and continuous improvement.\r\nEstablish engineering standards around deployment, monitoring, security, and operational ownership.\r\nRequired SkillsExperience 5+ years of experience in DevOps, Cloud Infrastructure, SRE, or Platform Engineering.\r\nStrong hands-on experience with AWS .\r\nStrong experience administering Amazon EKS and Kubernetes in production.\r\nHands-on experience with: AWS EKS AWS SageMaker AWS Bedrock AWS ECS AWS App Runner Kubernetes Docker NGINX / AWS ALB Ingress Cloudflare / Cloudflare Tunnels\r\nStrong experience with Terraform and Helm .\r\nStrong experience developing CI/CD pipelines using GitHub Actions and/or Azure DevOps.\r\nStrong YAML scripting and Git experience.\r\nExperience migrating CI/CD pipelines and repositories from Azure to AWS/GitHub .\r\nExperience deploying and operating ML/AI services.\r\nExperience with self-hosted LLM/model serving , preferably vLLM .\r\nExperience with GPU-based workloads is highly desirable.\r\nExperience with Databricks administration .\r\nExperience managing Elasticsearch and Kibana .\r\nExperience with Prometheus, Grafana, and CloudWatch .\r\nStrong understanding of Kubernetes HPA/VPA, networking, ingress, DNS, and service discovery .\r\nStrong understanding of cloud networking fundamentals.\r\nExperience with production troubleshooting, monitoring, capacity planning, and cost optimization.\r\nStrong understanding of security, IAM, secrets management, and access control.\r\nPreferred / Nice-to-Have SkillsExperience supporting Generative AI / LLM platforms .\r\nExperience with GPU infrastructure and NVIDIA/CUDA environments.\r\nExperience with model lifecycle and model version management.\r\nExperience migrating workloads between managed cloud services and Kubernetes.\r\nExperience with AWS networking such as VPC, load balancers, security groups, and Route 53.\r\nExperience with API gateways and microservice architectures.\r\nExperience with Python or shell scripting for infrastructure automation.\r\nExperience working with Data Engineering and ML teams in a production environment.\r\nWhat You'll OwnAWS ML/AI infrastructure EKS cluster administration and upgrades\r\nML service deployment and production operations\r\nCI/CD automation\r\nApp Runner → EKS migration\r\nSelf-hosted LLM infrastructure and vLLM\r\nDatabricks platform administration\r\nElasticsearch infrastructure\r\nMonitoring and auto-scaling\r\nTerraform and Helm-based infrastructure automation\r\nCloud cost, reliability, and performance optimization\r\nIdeal CandidateThe ideal candidate is a hands‑on infrastructure engineer who can independently take an ML/AI service from containerization → CI/CD → AWS infrastructure → EKS deployment → monitoring → scaling → production support . They should be comfortable working across both traditional DevOps infrastructure and modern AI/ML infrastructure , and should be able to collaborate closely with Data Engineering and ML teams while taking ownership of the underlying platform. #LI-Onsite#J-18808-Ljbffr","company":"Edcast","rawCompany":"edcast","city":"Mountain View","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-11-04T02:44:59.552Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1244.00","title":"Network and Computer Systems Administrators","slug":"network-and-computer-systems-administrators"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior DevOps Engineer","description":"Senior DevOps / Cloud Platform Engineer – ML AI Infrastructure Job Summary We are looking for a Senior DevOps / Cloud Platform Engineer with strong experience in AWS, Kubernetes, CI/CD, infrastructure automation, and ML/AI infrastructure to design, deploy, manage, and optimize cloud infrastructure supporting our machine learning and AI services. The ideal candidate will have hands‑on experience with AWS EKS, SageMaker, Bedrock, Docker, Kubernetes, Terraform, Helm, GitHub Actions, Databricks, Elasticsearch, and self-hosted LLM deployments . This role will work closely with Data Engineering, Machine Learning, and Software Engineering teams to build reliable, scalable, secure, and cost‑efficient platforms for ML services across development and production environments. In this role you will...\r\nKey ResponsibilitiesAWS Kubernetes Infrastructure Design, deploy, and administer AWS infrastructure supporting ML and AI workloads.\r\nManage Amazon EKS clusters , including cluster provisioning, upgrades, scaling, networking, and troubleshooting.\r\nWork with AWS SageMaker, AWS Bedrock, EKS, ECS, and related AWS services .\r\nConfigure and manage Kubernetes Ingress controllers such as NGINX and AWS ALB .\r\nManage Cloudflare Tunnels, DNS, Cloudflare configuration, networking, and security .\r\nTroubleshoot application, networking, compute, and infrastructure issues across AWS and Kubernetes environments.\r\nImplement best practices for security, reliability, availability, and scalability.\r\nCI/CD Azure-to-AWS Migration Build and maintain CI/CD pipelines for ML and AI services.\r\nDevelop and manage GitHub Actions and Azure DevOps pipelines using YAML.\r\nMigrate repositories and CI/CD workflows from Azure DevOps to GitHub/AWS .\r\nAutomate build, test, containerization, deployment, and release processes.\r\nEstablish deployment strategies across development, staging, and production environments.\r\nML Service Deployment Deploy and manage ML services across AWS EKS/ECS and SageMaker .\r\nBuild and maintain Docker containers and Kubernetes deployments.\r\nManage environment segregation and configuration across Dev, QA, and Production.\r\nDevelop and maintain Kubernetes manifests and Helm charts .\r\nTroubleshoot ML service deployment, networking, scaling, and runtime issues.\r\nApp Runner to EKS Migration Lead migration of existing services from AWS App Runner to Amazon EKS .\r\nContainerize applications and develop Kubernetes manifests/Helm charts.\r\nDesign appropriate Kubernetes architecture, networking, ingress, scaling, and deployment strategies.\r\nEnsure minimal service disruption during migration and establish operational best practices on EKS.\r\nSelf-Hosted LLM AI Infrastructure Deploy and manage self-hosted Large Language Models and inference services.\r\nWork with model serving frameworks such as vLLM .\r\nDesign containerized infrastructure for GPU-based model serving and inference.\r\nManage model versions, deployments, configurations, and rollback strategies.\r\nSupport migration of ML services from managed APIs/services to self-hosted models .\r\nWork with engineering teams on API integration and inference infrastructure.\r\nDatabricks Administration Administer Databricks workspaces, clusters, permissions, and access controls .\r\nManage cluster configuration, policies, and resource utilization.\r\nSupport LMI Insights and related ML/AI workloads.\r\nTroubleshoot Databricks infrastructure and connectivity issues.\r\nImplement appropriate security and access-control practices.\r\nElasticsearch Infrastructure Design, deploy, and manage Elasticsearch clusters .\r\nPerform cluster sizing, scaling, configuration, and performance optimization.\r\nManage indices, mappings, retention, and data lifecycle requirements.\r\nSupport Kibana configuration, dashboards, and troubleshooting.\r\nMonitor Elasticsearch health, capacity, and performance.\r\nMonitoring, Reliability Auto-Scaling Implement monitoring and observability for Kubernetes, AWS, and ML services.\r\nUse Prometheus, Grafana, and AWS CloudWatch for monitoring and alerting.\r\nConfigure Kubernetes HPA/VPA and other auto-scaling mechanisms.\r\nEstablish proactive alerting for infrastructure and application health.\r\nPerform capacity planning and resource optimization.\r\nIdentify opportunities for AWS infrastructure and compute cost optimization .\r\nInfrastructure as Code Automation Build and maintain infrastructure using Terraform .\r\nDevelop reusable Terraform modules for AWS and Kubernetes infrastructure.\r\nManage Kubernetes deployments using Helm charts .\r\nAutomate infrastructure provisioning, configuration, deployments, and operational tasks.\r\nMaintain infrastructure documentation and deployment standards.\r\nCross-Team Collaboration Partner closely with Data Engineering, ML Engineering, Data Science, and Software Engineering teams.\r\nUnderstand data pipelines, SQL, APIs, and ML service architecture sufficiently to troubleshoot end-to-end workflows.\r\nCoordinate infrastructure requirements for new ML models and services.\r\nParticipate in production incident resolution, root-cause analysis, and continuous improvement.\r\nEstablish engineering standards around deployment, monitoring, security, and operational ownership.\r\nRequired SkillsExperience 5+ years of experience in DevOps, Cloud Infrastructure, SRE, or Platform Engineering.\r\nStrong hands-on experience with AWS .\r\nStrong experience administering Amazon EKS and Kubernetes in production.\r\nHands-on experience with: AWS EKS AWS SageMaker AWS Bedrock AWS ECS AWS App Runner Kubernetes Docker NGINX / AWS ALB Ingress Cloudflare / Cloudflare Tunnels\r\nStrong experience with Terraform and Helm .\r\nStrong experience developing CI/CD pipelines using GitHub Actions and/or Azure DevOps.\r\nStrong YAML scripting and Git experience.\r\nExperience migrating CI/CD pipelines and repositories from Azure to AWS/GitHub .\r\nExperience deploying and operating ML/AI services.\r\nExperience with self-hosted LLM/model serving , preferably vLLM .\r\nExperience with GPU-based workloads is highly desirable.\r\nExperience with Databricks administration .\r\nExperience managing Elasticsearch and Kibana .\r\nExperience with Prometheus, Grafana, and CloudWatch .\r\nStrong understanding of Kubernetes HPA/VPA, networking, ingress, DNS, and service discovery .\r\nStrong understanding of cloud networking fundamentals.\r\nExperience with production troubleshooting, monitoring, capacity planning, and cost optimization.\r\nStrong understanding of security, IAM, secrets management, and access control.\r\nPreferred / Nice-to-Have SkillsExperience supporting Generative AI / LLM platforms .\r\nExperience with GPU infrastructure and NVIDIA/CUDA environments.\r\nExperience with model lifecycle and model version management.\r\nExperience migrating workloads between managed cloud services and Kubernetes.\r\nExperience with AWS networking such as VPC, load balancers, security groups, and Route 53.\r\nExperience with API gateways and microservice architectures.\r\nExperience with Python or shell scripting for infrastructure automation.\r\nExperience working with Data Engineering and ML teams in a production environment.\r\nWhat You'll OwnAWS ML/AI infrastructure EKS cluster administration and upgrades\r\nML service deployment and production operations\r\nCI/CD automation\r\nApp Runner → EKS migration\r\nSelf-hosted LLM infrastructure and vLLM\r\nDatabricks platform administration\r\nElasticsearch infrastructure\r\nMonitoring and auto-scaling\r\nTerraform and Helm-based infrastructure automation\r\nCloud cost, reliability, and performance optimization\r\nIdeal CandidateThe ideal candidate is a hands‑on infrastructure engineer who can independently take an ML/AI service from containerization → CI/CD → AWS infrastructure → EKS deployment → monitoring → scaling → production support . They should be comfortable working across both traditional DevOps infrastructure and modern AI/ML infrastructure , and should be able to collaborate closely with Data Engineering and ML teams while taking ownership of the underlying platform. #LI-Onsite#J-18808-Ljbffr","datePosted":"2026-11-04T02:44:59.552Z","dateModified":"2026-11-04T02:44:59.552Z","hiringOrganization":{"@type":"Organization","name":"Edcast","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Mountain View","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"6eea982810a04eab5385b617"},"url":"https://jobsearcher.com/jobs/6eea982810a04eab5385b617"}}