Data Architect, Databricks

Overview In this senior role, you own the end-to-end Databricks-on-Azure lakehouse architecture at enterprise scale, defining platform design, governance, CI/CD, security, and medallion standards. You drive adoption across a regulated organization while remaining hands-on and providing technical leadership across product domains. You collaborate with SRE, Data Governance, Legal, and Analytics to align architecture with compliance and data rights. This role shapes CoverMyMeds' data strategy to enable faster access to medications and better health outcomes. Compensation / Benefitscompetitive compensationbonus opportunitieslong-term incentive opportunitiesTotal Rewards programcareer growth opportunities ResponsibilitiesOwn end-to-end architecture for the Databricks-on-Azure lakehouse, including Unity Catalog, workspace federation, storage topology, cluster governance, and cost optimization.Define and enforce medallion architecture standards (Landing, Bronze, Silver, Gold) across data teams and domains.Establish CI/CD deployment patterns for Databricks Asset Bundles with audit-ready, environment-promoted pipelines.Lead platform scaling decisions: networking, workspace growth, and multi-subscription design across CMMA and CMMB.Design and govern fine-grained access controls using Unity Catalog ABAC, RBAC, and row/column security.Drive performance standards for Delta Lake pipelines (partitioning, Z-ORDER, liquid clustering, OPTIMIZE/VACUUM, Photon).Define ingestion accelerators and reusable templates (CDC via Qlik, ADF, SFTP, Kafka, API).Partner with SRE, DBA, Data Governance, Legal, and Analytics to align architecture with compliance and data rights.Provide architectural guidance on PHI/PII handling, masking, HIPAA-aligned access controls, and multi-environment policies.Evaluate build-vs-buy decisions across toolchain (ingestion, orchestration, data quality, cataloging, monitoring) and mentor engineers. Key requirements10+ years in data engineering and data architecture; at least 4 years in principal/lead capacity.Proven experience implementing Databricks at enterprise scale: workspace provisioning, Unity Catalog, metastore design, SCIM, and governance.Deep Delta Lake expertise: ACID, schema evolution, time travel, Change Data Feed, performance tuning.Strong Azure proficiency: ADLS Gen2, Data Factory, Key Vault, Private Endpoints, VNet design, Entra ID.Experience building medallion lakehouse architectures in regulated environments with PHI/PII data.Proven ability to define and enforce CI/CD standards for data platforms with audit trails.Solid data governance understanding: cataloging, lineage, data quality, data rights, integration with SailPoint/Okta.Excellent communication and stakeholder management; ability to translate architecture for leadership.strong communicationstakeholder managementleadership and mentorshipDatabricks on AzureUnity Catalog configurationDelta Lake optimization