{"schemaVersion":"jobsearcher.job.v1","id":"4dcdd6c995bea913b4385fec","url":"https://jobsearcher.com/jobs/4dcdd6c995bea913b4385fec","canonicalUrl":"https://jobsearcher.com/jobs/4dcdd6c995bea913b4385fec","title":"Data Platform Engineer – Databricks & AWS","description":"**FULLY REMOTE**ScolerTec is seeking Data Platform Engineer – Databricks & AWS to design, administer, optimize, secure, and support an enterprise Databricks Lakehouse environment. This role is heavily hands-on and will support scalable data engineering, analytics, governance, performance, reliability, and platform operations.The ideal candidate has strong production experience administering Databricks on AWS, including Unity Catalog, clusters, SQL Warehouses, Workflows, Delta Lake, Spark, Terraform, monitoring, security, and performance optimization.Key ResponsibilitiesDesign, configure, administer, and maintain enterprise Databricks Lakehouse environments.Manage Databricks workspaces, compute, clusters, SQL Warehouses, serverless capabilities, and workload management.Implement and administer Unity Catalog, including catalogs, schemas, tables, groups, RBAC, permissions, and governance controls.Develop and optimize data pipelines and ETL/ELT workloads using Apache Spark, Delta Lake, Delta Live Tables, and Databricks Workflows.Automate platform provisioning, configuration, and deployment using Terraform, Python, SQL, Databricks APIs, and Asset Bundles.Perform Spark and SQL performance tuning, scalability testing, and troubleshooting.Implement monitoring, logging, alerting, observability, capacity planning, and operational health dashboards.Optimize Databricks platform costs through autoscaling, auto-termination, right-sizing, workload isolation, and usage analysis.Integrate Databricks with AWS services, enterprise data sources, governance platforms, BI tools, and AI/ML environments.Implement IAM, RBAC, encryption, networking, auditing, security, and compliance controls.Support high availability, disaster recovery, incident response, root-cause analysis, upgrades, patching, and release management.Establish reusable platform standards, reference architectures, runbooks, and engineering practices.Provide technical guidance to data engineers and platform users.QualificationsStrong hands-on experience implementing and administering Databricks Lakehouse Platform in production.Significant experience with Unity Catalog, cluster management, SQL Warehouses, and Databricks job/workflow orchestration.Strong experience operating Databricks in AWS environments.Strong SQL and Apache Spark experience, including performance tuning and workload optimization.Experience with Delta Lake and modern lakehouse architectures.Hands-on experience with Terraform or comparable Infrastructure as Code.Strong Python and Bash scripting experience.Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, or Azure DevOps.Experience with CloudWatch, Datadog, Prometheus, Grafana, Elastic, or comparable observability tools.Understanding of AWS IAM, networking, access controls, security, auditing, and resource governance.Experience troubleshooting platform, pipeline, compute, and data-processing issues.Knowledge of ETL/ELT, distributed data processing, data ingestion, and lakehouse architecture.Federal or regulated-environment experience is preferred.Preferred CertificationsDatabricks Certified Data Engineer Professional or AssociateDatabricks Certified Associate Platform AdministratorDatabricks Certified Associate Developer for Apache SparkAWS Certified Data EngineerAWS Certified Solutions Architect – ProfessionalAWS SysOps AdministratorCertified Kubernetes AdministratorRelevant DevOps/DevSecOps certification","company":"Scolertec","rawCompany":"scolertec","city":"Seattle","state":"WA","isRemote":false,"isActive":false,"createdAt":"2026-11-04T03:48:40.613Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Platform Engineer – Databricks & AWS","description":"**FULLY REMOTE**ScolerTec is seeking Data Platform Engineer – Databricks & AWS to design, administer, optimize, secure, and support an enterprise Databricks Lakehouse environment. This role is heavily hands-on and will support scalable data engineering, analytics, governance, performance, reliability, and platform operations.The ideal candidate has strong production experience administering Databricks on AWS, including Unity Catalog, clusters, SQL Warehouses, Workflows, Delta Lake, Spark, Terraform, monitoring, security, and performance optimization.Key ResponsibilitiesDesign, configure, administer, and maintain enterprise Databricks Lakehouse environments.Manage Databricks workspaces, compute, clusters, SQL Warehouses, serverless capabilities, and workload management.Implement and administer Unity Catalog, including catalogs, schemas, tables, groups, RBAC, permissions, and governance controls.Develop and optimize data pipelines and ETL/ELT workloads using Apache Spark, Delta Lake, Delta Live Tables, and Databricks Workflows.Automate platform provisioning, configuration, and deployment using Terraform, Python, SQL, Databricks APIs, and Asset Bundles.Perform Spark and SQL performance tuning, scalability testing, and troubleshooting.Implement monitoring, logging, alerting, observability, capacity planning, and operational health dashboards.Optimize Databricks platform costs through autoscaling, auto-termination, right-sizing, workload isolation, and usage analysis.Integrate Databricks with AWS services, enterprise data sources, governance platforms, BI tools, and AI/ML environments.Implement IAM, RBAC, encryption, networking, auditing, security, and compliance controls.Support high availability, disaster recovery, incident response, root-cause analysis, upgrades, patching, and release management.Establish reusable platform standards, reference architectures, runbooks, and engineering practices.Provide technical guidance to data engineers and platform users.QualificationsStrong hands-on experience implementing and administering Databricks Lakehouse Platform in production.Significant experience with Unity Catalog, cluster management, SQL Warehouses, and Databricks job/workflow orchestration.Strong experience operating Databricks in AWS environments.Strong SQL and Apache Spark experience, including performance tuning and workload optimization.Experience with Delta Lake and modern lakehouse architectures.Hands-on experience with Terraform or comparable Infrastructure as Code.Strong Python and Bash scripting experience.Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, or Azure DevOps.Experience with CloudWatch, Datadog, Prometheus, Grafana, Elastic, or comparable observability tools.Understanding of AWS IAM, networking, access controls, security, auditing, and resource governance.Experience troubleshooting platform, pipeline, compute, and data-processing issues.Knowledge of ETL/ELT, distributed data processing, data ingestion, and lakehouse architecture.Federal or regulated-environment experience is preferred.Preferred CertificationsDatabricks Certified Data Engineer Professional or AssociateDatabricks Certified Associate Platform AdministratorDatabricks Certified Associate Developer for Apache SparkAWS Certified Data EngineerAWS Certified Solutions Architect – ProfessionalAWS SysOps AdministratorCertified Kubernetes AdministratorRelevant DevOps/DevSecOps certification","datePosted":"2026-11-04T03:48:40.613Z","dateModified":"2026-11-04T03:48:40.613Z","hiringOrganization":{"@type":"Organization","name":"Scolertec","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Seattle","addressRegion":"WA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"4dcdd6c995bea913b4385fec"},"url":"https://jobsearcher.com/jobs/4dcdd6c995bea913b4385fec"}}