{"schemaVersion":"jobsearcher.job.v1","id":"6cb67efeaa4c0450d08d16b9","url":"https://jobsearcher.com/jobs/6cb67efeaa4c0450d08d16b9","canonicalUrl":"https://jobsearcher.com/jobs/6cb67efeaa4c0450d08d16b9","title":"Databricks Data Platform Architect","description":"Databricks Data Platform Architect (DevOps & Infrastructure Focus)\r\nLocation:Alameda, CA – Onsite (5 days/week)\r\nAbout the RoleWe are looking for a hands‑on Databricks Data Platform Architect to design, build, and operate our enterprise lakehouse platform on AWS.\r\nThis role combines DevOps, Infrastructure Engineering, and Data Engineering architecture.\r\nYou will own the reliability, scalability, security, and performance of our Databricks environment and enable data teams to build high-quality, production‑grade pipelines.\r\nIf you enjoy building platforms from the ground up, automating everything, and solving performance problems at scale, this role is for you.\r\nWhat You’ll OwnPlatform & Infrastructure Architecture (Core Focus)Architect and manage Databricks on AWS end-to-end\r\nImplement CI/CD for notebooks, jobs, and pipelines\r\nDefine cluster policies, autoscaling, and environment isolation (dev/stage/prod)\r\nSet up monitoring, logging, and alerting (CloudWatch/Datadog)\r\nDrive cost optimization and compute efficiency strategies\r\nEnsure high availability, reliability, and production uptime\r\nDesign lakehouse architecture (bronze/silver/gold)\r\nOptimize Spark/Delta workloads for performance and scalability\r\nEstablish data engineering standards and best practices\r\nSupport batch and streaming workloads\r\nTroubleshoot performance bottlenecks and production incidents\r\nSecurity, Governance & ComplianceImplement role-based access control using Unity Catalog\r\nSecure S3, IAM, and external locations\r\nEnforce data access policies and PII protection\r\nEnable audit logging and compliance guardrails\r\nPartner with security and governance teams to ensure best practices\r\nRequired Qualifications8+ years in Data Engineering / Platform Engineering / Cloud Infrastructure\r\n4+ years hands‑on with Databricks in production\r\nStrong expertise in Apache Spark, Python, and SQL\r\nDeep knowledge of AWS (S3, IAM, VPC, CloudWatch, networking)\r\nExperience with Terraform or other IaC tools\r\nCI/CD implementation experience for data platforms\r\nStrong troubleshooting and performance tuning skills\r\nPreferredExperience with Delta Lake optimization (ZORDER, OPTIMIZE, partitioning)\r\nWorkflow orchestration tools (Airflow/Databricks Workflows)\r\nExperience with enterprise data governance tools (Unity Catalog/Atlan/Collibra)\r\nKnowledge of GDPR/HIPAA or regulated environments\r\nPrior experience building platforms for multiple teams\r\nWhat Success Looks LikeClear environment separation and automation\r\nSelf‑service data platform for engineers and analysts\r\nStrong security and governance with minimal friction#J-18808-Ljbffr","company":"Usefulbi","rawCompany":"usefulbi","city":"Raleigh","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-11-04T01:55:45.112Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Data Platform Architect","description":"Databricks Data Platform Architect (DevOps & Infrastructure Focus)\r\nLocation:Alameda, CA – Onsite (5 days/week)\r\nAbout the RoleWe are looking for a hands‑on Databricks Data Platform Architect to design, build, and operate our enterprise lakehouse platform on AWS.\r\nThis role combines DevOps, Infrastructure Engineering, and Data Engineering architecture.\r\nYou will own the reliability, scalability, security, and performance of our Databricks environment and enable data teams to build high-quality, production‑grade pipelines.\r\nIf you enjoy building platforms from the ground up, automating everything, and solving performance problems at scale, this role is for you.\r\nWhat You’ll OwnPlatform & Infrastructure Architecture (Core Focus)Architect and manage Databricks on AWS end-to-end\r\nImplement CI/CD for notebooks, jobs, and pipelines\r\nDefine cluster policies, autoscaling, and environment isolation (dev/stage/prod)\r\nSet up monitoring, logging, and alerting (CloudWatch/Datadog)\r\nDrive cost optimization and compute efficiency strategies\r\nEnsure high availability, reliability, and production uptime\r\nDesign lakehouse architecture (bronze/silver/gold)\r\nOptimize Spark/Delta workloads for performance and scalability\r\nEstablish data engineering standards and best practices\r\nSupport batch and streaming workloads\r\nTroubleshoot performance bottlenecks and production incidents\r\nSecurity, Governance & ComplianceImplement role-based access control using Unity Catalog\r\nSecure S3, IAM, and external locations\r\nEnforce data access policies and PII protection\r\nEnable audit logging and compliance guardrails\r\nPartner with security and governance teams to ensure best practices\r\nRequired Qualifications8+ years in Data Engineering / Platform Engineering / Cloud Infrastructure\r\n4+ years hands‑on with Databricks in production\r\nStrong expertise in Apache Spark, Python, and SQL\r\nDeep knowledge of AWS (S3, IAM, VPC, CloudWatch, networking)\r\nExperience with Terraform or other IaC tools\r\nCI/CD implementation experience for data platforms\r\nStrong troubleshooting and performance tuning skills\r\nPreferredExperience with Delta Lake optimization (ZORDER, OPTIMIZE, partitioning)\r\nWorkflow orchestration tools (Airflow/Databricks Workflows)\r\nExperience with enterprise data governance tools (Unity Catalog/Atlan/Collibra)\r\nKnowledge of GDPR/HIPAA or regulated environments\r\nPrior experience building platforms for multiple teams\r\nWhat Success Looks LikeClear environment separation and automation\r\nSelf‑service data platform for engineers and analysts\r\nStrong security and governance with minimal friction#J-18808-Ljbffr","datePosted":"2026-11-04T01:55:45.112Z","dateModified":"2026-11-04T01:55:45.112Z","hiringOrganization":{"@type":"Organization","name":"Usefulbi","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Raleigh","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"6cb67efeaa4c0450d08d16b9"},"url":"https://jobsearcher.com/jobs/6cb67efeaa4c0450d08d16b9"}}