{"schemaVersion":"jobsearcher.job.v1","id":"1a651d10aae990ed3acf9413","url":"https://jobsearcher.com/jobs/1a651d10aae990ed3acf9413","canonicalUrl":"https://jobsearcher.com/jobs/1a651d10aae990ed3acf9413","title":"Databricks Data Architect / Lead Databricks Architect","description":"Job Title: Databricks Data Architect / Lead Databricks ArchitectJob SummaryWe are looking for a highly experienced Databricks Data Architect to design and implement enterprise-scale Lakehouse and real-time data platforms. The ideal candidate will have strong hands-on expertise in Databricks, Apache Spark/PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, AWS, and Medallion Architecture.The candidate should be capable of owning end-to-end architecture, defining technical standards, designing scalable data pipelines, implementing governance and security, and optimizing Databricks platforms for performance and cost.Key Responsibilities- Design and own enterprise Databricks Lakehouse architectures.- Define and implement Bronze, Silver, and Gold Medallion Architecture.- Architect batch and real-time data ingestion and processing solutions.- Develop scalable pipelines using Databricks, PySpark, Spark SQL, Delta Lake, and Auto Loader.- Build real-time streaming solutions using Structured Streaming and Apache/Confluent Kafka.- Design CDC-based architectures using technologies such as Debezium and Kafka.- Implement Delta Lake capabilities including MERGE, schema evolution, time travel, OPTIMIZE, Z-ORDER, VACUUM, and partitioning strategies.- Implement enterprise data governance using Databricks Unity Catalog.- Define RBAC/ABAC, table/column-level security, lineage, auditing, and cross-workspace governance.- Design solutions for data quality, observability, security, and regulatory compliance.- Optimize Databricks workloads for performance and DBU/cloud cost.- Design cluster policies and leverage Serverless, Photon, auto-scaling, and appropriate compute strategies.- Architect Databricks solutions integrated with AWS services such as S3, Glue, Lambda, Redshift, Athena, EMR, Step Functions, IAM, Lake Formation, CloudWatch, and Secrets Manager.- Implement infrastructure using Terraform and/or AWS CloudFormation.- Establish CI/CD processes for Databricks notebooks, jobs, pipelines, and infrastructure.- Produce architecture diagrams, design specifications, technical roadmaps, and architecture decision records.- Work with business, engineering, security, DevOps, and executive stakeholders.- Mentor Data Engineers and provide architectural and technical leadership.Required Skills- Strong hands-on experience with:- Databricks- Apache Spark- PySpark- Python- SQL- Delta Lake- Unity Catalog- Auto Loader- Structured Streaming- Medallion Architecture- Apache Kafka / Confluent Kafka- AWS- S3- AWS Glue- Redshift- IAM- CI/CD- Terraform / CloudFormationPreferred Skills- Databricks Certified Data Engineer Professional or equivalent certification- AWS Solutions Architect certification- Kafka Schema Registry- Debezium CDC- MLflow / Model Registry- Databricks AI/ML capabilities- RAG and Generative AI architectures- LangGraph or similar agent orchestration frameworks- Data governance and regulatory compliance experience including HIPAA, GDPR, or PCI-DSSIdeal CandidateWe are specifically looking for an architect-level candidate, not only a Databricks developer. The person should have experience making architecture decisions, building enterprise platforms from the ground up, handling high-volume batch and streaming workloads, implementing governance, and communicating architecture decisions with both technical and business stakeholders.","company":"Quebec Solution","rawCompany":"quebec solution","city":"Dallas","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-09-01T08:22:39.889Z","occupations":[{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Data Architect / Lead Databricks Architect","description":"Job Title: Databricks Data Architect / Lead Databricks ArchitectJob SummaryWe are looking for a highly experienced Databricks Data Architect to design and implement enterprise-scale Lakehouse and real-time data platforms. The ideal candidate will have strong hands-on expertise in Databricks, Apache Spark/PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, AWS, and Medallion Architecture.The candidate should be capable of owning end-to-end architecture, defining technical standards, designing scalable data pipelines, implementing governance and security, and optimizing Databricks platforms for performance and cost.Key Responsibilities- Design and own enterprise Databricks Lakehouse architectures.- Define and implement Bronze, Silver, and Gold Medallion Architecture.- Architect batch and real-time data ingestion and processing solutions.- Develop scalable pipelines using Databricks, PySpark, Spark SQL, Delta Lake, and Auto Loader.- Build real-time streaming solutions using Structured Streaming and Apache/Confluent Kafka.- Design CDC-based architectures using technologies such as Debezium and Kafka.- Implement Delta Lake capabilities including MERGE, schema evolution, time travel, OPTIMIZE, Z-ORDER, VACUUM, and partitioning strategies.- Implement enterprise data governance using Databricks Unity Catalog.- Define RBAC/ABAC, table/column-level security, lineage, auditing, and cross-workspace governance.- Design solutions for data quality, observability, security, and regulatory compliance.- Optimize Databricks workloads for performance and DBU/cloud cost.- Design cluster policies and leverage Serverless, Photon, auto-scaling, and appropriate compute strategies.- Architect Databricks solutions integrated with AWS services such as S3, Glue, Lambda, Redshift, Athena, EMR, Step Functions, IAM, Lake Formation, CloudWatch, and Secrets Manager.- Implement infrastructure using Terraform and/or AWS CloudFormation.- Establish CI/CD processes for Databricks notebooks, jobs, pipelines, and infrastructure.- Produce architecture diagrams, design specifications, technical roadmaps, and architecture decision records.- Work with business, engineering, security, DevOps, and executive stakeholders.- Mentor Data Engineers and provide architectural and technical leadership.Required Skills- Strong hands-on experience with:- Databricks- Apache Spark- PySpark- Python- SQL- Delta Lake- Unity Catalog- Auto Loader- Structured Streaming- Medallion Architecture- Apache Kafka / Confluent Kafka- AWS- S3- AWS Glue- Redshift- IAM- CI/CD- Terraform / CloudFormationPreferred Skills- Databricks Certified Data Engineer Professional or equivalent certification- AWS Solutions Architect certification- Kafka Schema Registry- Debezium CDC- MLflow / Model Registry- Databricks AI/ML capabilities- RAG and Generative AI architectures- LangGraph or similar agent orchestration frameworks- Data governance and regulatory compliance experience including HIPAA, GDPR, or PCI-DSSIdeal CandidateWe are specifically looking for an architect-level candidate, not only a Databricks developer. The person should have experience making architecture decisions, building enterprise platforms from the ground up, handling high-volume batch and streaming workloads, implementing governance, and communicating architecture decisions with both technical and business stakeholders.","datePosted":"2026-09-01T08:22:39.889Z","dateModified":"2026-09-01T08:22:39.889Z","hiringOrganization":{"@type":"Organization","name":"Quebec Solution","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dallas","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"1a651d10aae990ed3acf9413"},"url":"https://jobsearcher.com/jobs/1a651d10aae990ed3acf9413"}}