JOBSEARCHER

MLOps / ML Platform Engineer

Job DescriptionRemote — United States | Full-time We’re looking for a hands-on MLOps / ML Platform Engineer to build, support, and improve production infrastructure used by Machine Learning and Data Science teams. This role sits between DevOps, cloud infrastructure, and MLOps. You’ll work with AWS and Kubernetes infrastructure while helping ML teams deploy, serve, scale, monitor, and operate models reliably in production.
What you’ll do: Build, operate, and improve production cloud infrastructure on AWS Support Kubernetes-based workloads, particularly Amazon EKS Provision and manage infrastructure using Terraform, Terragrunt, CloudFormation, or similar IaC tools Work closely with ML Engineers and Data Scientists to support production ML workloads Build and support infrastructure for ML pipelines, model deployment, model serving, and inference Operate MLOps platforms such as Databricks, SageMaker, MLflow, or similar technologies Support Databricks clusters, jobs, pipelines, compute, and model-serving workloads Support scalable inference infrastructure, including compute capacity, autoscaling, and production reliability Monitor ML infrastructure and production workloads, including serving health, latency, resource utilization, and related ML/model metrics Build and maintain CI/CD workflows for application and ML model deployments using tools such as GitLab CI/CD, Jenkins, or GitHub Actions Automate infrastructure and operational processes using Python and Bash Maintain monitoring and observability using Prometheus, Grafana, CloudWatch, Coralogix, or similar tools Troubleshoot production infrastructure, deployment, ML platform, and serving issues and participate in RCA Apply cloud security and DevSecOps practices across infrastructure and deployment workflows Help improve infrastructure supporting newer AI use cases, including LLMs, AI agents, MCP integrations, and AI-assisted engineering workflows
What we’re looking for: 3+ years of experience in DevOps, MLOps, Platform Engineering, SRE, Cloud Engineering, or a similar infrastructure-focused role Strong hands-on experience with AWS Production experience with Kubernetes/EKS Hands-on Infrastructure as Code experience with Terraform or similar tooling Production experience supporting ML/MLOps infrastructure Experience working directly with MLOps, ML Engineering, or Data Science teams Hands-on experience with at least one MLOps platform such as Databricks, SageMaker, MLflow, or Kubeflow Experience supporting ML pipelines and model deployment Experience with model serving and/or inference infrastructure in production Experience monitoring and troubleshooting production ML infrastructure and workloads CI/CD experience with Jenkins, GitLab CI/CD, GitHub Actions, or similar tools Python and/or Bash scripting Strong Linux, networking, observability, and production troubleshooting skills
Nice to have: Databricks model serving and ML pipelines SageMaker endpoints and ML pipelines MLflow Model Registry and experiment tracking GPU-based Kubernetes workloads Autoscaling for high-throughput inference Model drift, data quality, inference performance, or model-specific monitoring Helm, ArgoCD, GitOps, or service mesh technologies Serverless/event-driven AWS infrastructure such as Lambda, API Gateway, and SQS Multi-cloud experience LLMOps, RAG, AI agents, MCP, or other agentic AI infrastructure FinOps and cloud cost optimization Cloud security and DevSecOps experience Candidates must be authorized to work in the United States without requiring employer visa sponsorship now or in the future.