{"schemaVersion":"jobsearcher.job.v1","id":"3d55c0861f1268ad9b8ed8b8","url":"https://jobsearcher.com/jobs/3d55c0861f1268ad9b8ed8b8","canonicalUrl":"https://jobsearcher.com/jobs/3d55c0861f1268ad9b8ed8b8","title":"Databricks Architect - Enterprise Data Platform","description":"Job DescriptionWe are seeking a highly skilled Databricks Architect to lead the design and implementation of next-generation data platforms built on the Lakehouse paradigm.This role goes beyond pipeline development—you will own the Databricks platform architecture end-to-end, driving scalability, governance, performance, and cost optimization across enterprise data ecosystems.Databricks Platform ArchitectureArchitect and implement enterprise-scale Databricks environments (dev/test/prod)Design secure, scalable Lakehouse architecture using Delta LakeData Engineering & ProcessingBuild and optimize high-performance data pipelines using Apache Spark (PySpark / Scala)Implement Medallion Architecture (Bronze, Silver, Gold)Develop batch and real-time streaming pipelines using Structured StreamingGovernance, Security & ComplianceImplement fine-grained access control using Unity CatalogDefine enterprise-wide data governance, lineage, and auditingPerformance & Cost OptimizationOptimize workloads using partitioning, caching, and Photon engineDesign cost-efficient cluster strategies (autoscaling, spot instances, DBU optimization)Monitor and improve query and pipeline performance at scaleCloud IntegrationArchitect Databricks solutions on AWS / Azure / GCPIntegrate with cloud-native services (AWS S3/Glue, Azure ADLS/ADF, etc.)AI SkillsExperience with Agentbricks and AI agents at scale to build use casesProduction and establish guardrails with AI use casesMust-Have SkillsAdvanced proficiency in SQL and PythonHands-on experience with Delta Lake, Medallion Architecture, and Unity CatalogStrong experience with at least one cloud platform (AWS / Azure / GCP)Experience with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions)Knowledge of workflow orchestration tools (Airflow or equivalent)Good to HaveDatabricks certifications (Associate / Professional)Experience with Databricks SQL & dashboardsExposure to ML pipelines (MLflow)Experience with Kafka or event-driven architecturesDomain experience in Finance / Retail / HealthcareWhat Makes You a Great FitStrong architectural mindset with ability to design scalable data platformsDeep understanding of performance tuning and cost optimizationAbility to balance technical depth with business impactExcellent communication and stakeholder management skillsRequired Skills: SQL, Python, Delta Lake, Medallion architecture, unity catalog, AWS, Azure, GCP, Azure DevOps, Jenkins, GitHub Actions, Airflow, Databricks certifications, Databricks SQL and dashboards, ML pipelines, MLflow, Kafka, Finance domain, Retail domain, healthcare domain","company":"Codebase","rawCompany":"codebase","city":"Jersey City","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-05-17T19:10:32.869Z","occupations":[{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Architect - Enterprise Data Platform","description":"Job DescriptionWe are seeking a highly skilled Databricks Architect to lead the design and implementation of next-generation data platforms built on the Lakehouse paradigm.This role goes beyond pipeline development—you will own the Databricks platform architecture end-to-end, driving scalability, governance, performance, and cost optimization across enterprise data ecosystems.Databricks Platform ArchitectureArchitect and implement enterprise-scale Databricks environments (dev/test/prod)Design secure, scalable Lakehouse architecture using Delta LakeData Engineering & ProcessingBuild and optimize high-performance data pipelines using Apache Spark (PySpark / Scala)Implement Medallion Architecture (Bronze, Silver, Gold)Develop batch and real-time streaming pipelines using Structured StreamingGovernance, Security & ComplianceImplement fine-grained access control using Unity CatalogDefine enterprise-wide data governance, lineage, and auditingPerformance & Cost OptimizationOptimize workloads using partitioning, caching, and Photon engineDesign cost-efficient cluster strategies (autoscaling, spot instances, DBU optimization)Monitor and improve query and pipeline performance at scaleCloud IntegrationArchitect Databricks solutions on AWS / Azure / GCPIntegrate with cloud-native services (AWS S3/Glue, Azure ADLS/ADF, etc.)AI SkillsExperience with Agentbricks and AI agents at scale to build use casesProduction and establish guardrails with AI use casesMust-Have SkillsAdvanced proficiency in SQL and PythonHands-on experience with Delta Lake, Medallion Architecture, and Unity CatalogStrong experience with at least one cloud platform (AWS / Azure / GCP)Experience with CI/CD tools (Azure DevOps, Jenkins, GitHub Actions)Knowledge of workflow orchestration tools (Airflow or equivalent)Good to HaveDatabricks certifications (Associate / Professional)Experience with Databricks SQL & dashboardsExposure to ML pipelines (MLflow)Experience with Kafka or event-driven architecturesDomain experience in Finance / Retail / HealthcareWhat Makes You a Great FitStrong architectural mindset with ability to design scalable data platformsDeep understanding of performance tuning and cost optimizationAbility to balance technical depth with business impactExcellent communication and stakeholder management skillsRequired Skills: SQL, Python, Delta Lake, Medallion architecture, unity catalog, AWS, Azure, GCP, Azure DevOps, Jenkins, GitHub Actions, Airflow, Databricks certifications, Databricks SQL and dashboards, ML pipelines, MLflow, Kafka, Finance domain, Retail domain, healthcare domain","datePosted":"2026-05-17T19:10:32.869Z","dateModified":"2026-05-17T19:10:32.869Z","hiringOrganization":{"@type":"Organization","name":"Codebase","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Jersey City","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"3d55c0861f1268ad9b8ed8b8"},"url":"https://jobsearcher.com/jobs/3d55c0861f1268ad9b8ed8b8"}}