{"schemaVersion":"jobsearcher.job.v1","id":"228a7ec0c9f23efe1b74cc8b","url":"https://jobsearcher.com/jobs/228a7ec0c9f23efe1b74cc8b","canonicalUrl":"https://jobsearcher.com/jobs/228a7ec0c9f23efe1b74cc8b","title":"DevOps Engineer","description":"Job Description: DevOps Engineer (AWS, Databricks & Kubernetes)Role OverviewWe are seeking an experienced DevOps Engineer to design, deploy, and operate scalable data and analytics platforms on AWS, leveraging Databricks, Kubernetes, and Infrastructure as Code (Terraform). This role focuses on platform reliability, security, automation, and cost optimization while supporting enterprise data workloads across Dev, Test, and Production environments.You will work closely with data engineering, cloud engineering, DevOps, and analytics teams to build and maintain highly available, automated, and secure platforms.Key ResponsibilitiesDatabricks & Data PlatformDesign, deploy, and manage Databricks on AWS using Terraform and Infrastructure as Code best practices.Provision and maintain Databricks workspaces, clusters, jobs, cluster policies, and instance profiles.Configure integration with Amazon S3 for data storage, logs, and DBFS root.Implement governance, access controls, and workspace security for enterprise Databricks usage.Optimize Databricks performance and cost efficiency through cluster auto‑scaling, spot instances, and usage monitoring.AWS Cloud InfrastructureDesign and manage AWS infrastructure required for Databricks and Kubernetes, including:VPC, Subnets, Route Tables, Security GroupsIAM Roles, Policies, and Instance ProfilesEC2, Auto Scaling GroupsNAT Gateways, Internet GatewaysAWS KMS for encryption at restCloudWatch for logging and monitoringEnsure secure networking patterns and platform isolation across environments.Kubernetes (EKS)Design, deploy, and operate Kubernetes clusters (Amazon EKS) to support data services and platform components.Manage Kubernetes resources including:Pods, Deployments, Services, ConfigMaps, SecretsIngress controllers and service networkingIntegrate Kubernetes‑based services with Databricks‑centric data platforms where applicable.Implement security best practices in Kubernetes (RBAC, network policies, secrets management).Monitor and optimize Kubernetes cluster performance, availability, and costs.CI/CD & AutomationBuild and maintain CI/CD pipelines for:Terraform infrastructure deploymentsDatabricks workspace and job promotionKubernetes application deploymentsManage Git‑based workflows, environment promotions, and release automation.Enforce infrastructure standards, validations, and approval workflows.DevOps, Reliability & CollaborationManage Dev/Test/Prod environments with proper isolation, governance, and lifecycle controls.Implement monitoring, alerting, and troubleshooting for Databricks, AWS, and Kubernetes platforms.Ensure high availability, reliability, and disaster recovery readiness.Collaborate with data engineers, platform teams, and cloud architects to support data pipelines, analytics, and machine learning workloads.Document platform architecture, operational procedures, and best practices.Required Skills & QualificationsStrong hands‑on experience with Databricks on AWS.Proven expertise with Terraform and Infrastructure as Code.Solid knowledge of AWS core services:VPC, IAM, EC2, S3, CloudWatch, KMSPractical experience managing Kubernetes, preferably Amazon EKS.Experience building and managing CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, Azure DevOps).Strong understanding of cloud security, networking, and identity management.Experience managing multi‑environment (Dev/Test/Prod) platforms.Scripting skills in Python, Bash, or Shell.Strong problem‑solving, debugging, and operational support skills.Good to HaveAWS Certifications (Solutions Architect, DevOps Engineer).Databricks certifications (Platform Administrator, Data Engineer).Experience with Spark, Delta Lake, and data lakehouse architectures.Experience with container observability tools (Prometheus, Grafana).Knowledge of FinOps / cloud cost optimization practices.Familiarity with service mesh or advanced Kubernetes networking is a plus.What We OfferWork on modern cloud‑native data platformsExposure to AWS, Databricks, and Kubernetes at scaleCollaborative, engineering‑driven cultureOpportunities for learning, growth, and certificationsIf you want, I can:Convert this into a Senior / Lead roleShorten it for LinkedIn or job portalsAdd mandatory vs optional skillsTailor it for pure EKS‑heavy or Databricks‑heavy environments","company":"Usefulbi","rawCompany":"usefulbi","city":"Alameda","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-04-28T10:43:34.007Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"DevOps Engineer","description":"Job Description: DevOps Engineer (AWS, Databricks & Kubernetes)Role OverviewWe are seeking an experienced DevOps Engineer to design, deploy, and operate scalable data and analytics platforms on AWS, leveraging Databricks, Kubernetes, and Infrastructure as Code (Terraform). This role focuses on platform reliability, security, automation, and cost optimization while supporting enterprise data workloads across Dev, Test, and Production environments.You will work closely with data engineering, cloud engineering, DevOps, and analytics teams to build and maintain highly available, automated, and secure platforms.Key ResponsibilitiesDatabricks & Data PlatformDesign, deploy, and manage Databricks on AWS using Terraform and Infrastructure as Code best practices.Provision and maintain Databricks workspaces, clusters, jobs, cluster policies, and instance profiles.Configure integration with Amazon S3 for data storage, logs, and DBFS root.Implement governance, access controls, and workspace security for enterprise Databricks usage.Optimize Databricks performance and cost efficiency through cluster auto‑scaling, spot instances, and usage monitoring.AWS Cloud InfrastructureDesign and manage AWS infrastructure required for Databricks and Kubernetes, including:VPC, Subnets, Route Tables, Security GroupsIAM Roles, Policies, and Instance ProfilesEC2, Auto Scaling GroupsNAT Gateways, Internet GatewaysAWS KMS for encryption at restCloudWatch for logging and monitoringEnsure secure networking patterns and platform isolation across environments.Kubernetes (EKS)Design, deploy, and operate Kubernetes clusters (Amazon EKS) to support data services and platform components.Manage Kubernetes resources including:Pods, Deployments, Services, ConfigMaps, SecretsIngress controllers and service networkingIntegrate Kubernetes‑based services with Databricks‑centric data platforms where applicable.Implement security best practices in Kubernetes (RBAC, network policies, secrets management).Monitor and optimize Kubernetes cluster performance, availability, and costs.CI/CD & AutomationBuild and maintain CI/CD pipelines for:Terraform infrastructure deploymentsDatabricks workspace and job promotionKubernetes application deploymentsManage Git‑based workflows, environment promotions, and release automation.Enforce infrastructure standards, validations, and approval workflows.DevOps, Reliability & CollaborationManage Dev/Test/Prod environments with proper isolation, governance, and lifecycle controls.Implement monitoring, alerting, and troubleshooting for Databricks, AWS, and Kubernetes platforms.Ensure high availability, reliability, and disaster recovery readiness.Collaborate with data engineers, platform teams, and cloud architects to support data pipelines, analytics, and machine learning workloads.Document platform architecture, operational procedures, and best practices.Required Skills & QualificationsStrong hands‑on experience with Databricks on AWS.Proven expertise with Terraform and Infrastructure as Code.Solid knowledge of AWS core services:VPC, IAM, EC2, S3, CloudWatch, KMSPractical experience managing Kubernetes, preferably Amazon EKS.Experience building and managing CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, Azure DevOps).Strong understanding of cloud security, networking, and identity management.Experience managing multi‑environment (Dev/Test/Prod) platforms.Scripting skills in Python, Bash, or Shell.Strong problem‑solving, debugging, and operational support skills.Good to HaveAWS Certifications (Solutions Architect, DevOps Engineer).Databricks certifications (Platform Administrator, Data Engineer).Experience with Spark, Delta Lake, and data lakehouse architectures.Experience with container observability tools (Prometheus, Grafana).Knowledge of FinOps / cloud cost optimization practices.Familiarity with service mesh or advanced Kubernetes networking is a plus.What We OfferWork on modern cloud‑native data platformsExposure to AWS, Databricks, and Kubernetes at scaleCollaborative, engineering‑driven cultureOpportunities for learning, growth, and certificationsIf you want, I can:Convert this into a Senior / Lead roleShorten it for LinkedIn or job portalsAdd mandatory vs optional skillsTailor it for pure EKS‑heavy or Databricks‑heavy environments","datePosted":"2026-04-28T10:43:34.007Z","dateModified":"2026-04-28T10:43:34.007Z","hiringOrganization":{"@type":"Organization","name":"Usefulbi","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Alameda","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"228a7ec0c9f23efe1b74cc8b"},"url":"https://jobsearcher.com/jobs/228a7ec0c9f23efe1b74cc8b"}}