{"schemaVersion":"jobsearcher.job.v1","id":"19d42bd745ba347e99a7d931","url":"https://jobsearcher.com/jobs/19d42bd745ba347e99a7d931","canonicalUrl":"https://jobsearcher.com/jobs/19d42bd745ba347e99a7d931","title":"Lead Databricks Architect","description":"Senior Databricks Architect (100% Remote)Company OverviewOur client is a leading provider of large-scale infrastructure and engineering services that support essential industries across North America. They are committed to investing in modern data platforms and fostering a culture of continuous learning, collaboration, and technical excellence.\r\nRole SummaryThe Intersect Group is seeking a highly skilled Senior Databricks Architect to lead the design, development, and optimization of a modern data platform leveraging the Databricks Lakehouse architecture. This role combines deep technical expertise with leadership responsibilities, driving data engineering, analytics, and AI/ML initiatives across multiple concurrent projects.\r\nYou will serve as a hands‑on architect and trusted advisor, partnering with internal teams and external resources to implement scalable, high-performance data solutions. This role requires someone who can own delivery end‑to‑end, guide junior resources, and ensure consistent execution across a complex, multi‑project environment.\r\nKey ResponsibilitiesArchitect, design, and implement scalable data solutions using Databricks Lakehouse architecture.\r\nLead hands‑on development, including building and optimizing data pipelines, notebooks, and workflows in Python and SQL.\r\nServe as the primary technical escalation point for Databricks-related challenges across development and production environments.\r\nCollaborate with cross‑functional teams—including data modelers, engineers, and external consultants—to deliver projects on time.\r\nOversee multiple initiatives (6–10 concurrently), ensuring alignment across varying project stages and stakeholders.\r\nImplement and optimize Databricks features such as Auto Loader, Delta Live Tables (DLT), and streaming data pipelines.\r\nEstablish and enforce best practices for performance, scalability, security, and data governance (e.g., row‑level security, column masking, encryption).\r\nMentor junior team members and contribute to overall team development through knowledge sharing and technical guidance.\r\nProvide regular updates on progress, risks, and blockers to leadership.\r\nKey Requirements5+ years of experience in data architecture, data engineering, or AI/ML solutions with ownership of technical delivery.\r\nExtensive hands‑on expertise withDatabricks , including Lakehouse architecture and Medallion design patterns.\r\nStrong experience implementing Databricks inAzure environments .\r\nProficiency inPython and SQLfor building data pipelines and analytics solutions.\r\nExperience with large‑scale distributed systems and big data technologies (e.g., Apache Spark, Hadoop, Cassandra).\r\nExpertise in building and optimizing data ingestion frameworks, including Auto Loader, Delta Live Tables, and streaming solutions.\r\nStrong understanding of data security and governance practices within Databricks environments.\r\nProven ability to lead projects end‑to‑end and manage multiple priorities simultaneously.\r\nExcellent communication skills and a collaborative mindset, with the ability to work across internal teams and external partners.\r\nPreferred QualificationsDatabricks certifications in data engineering or related disciplines.\r\nExperience with Azure networking or security configurations.\r\nExposure to AI/ML workloads and advanced analytics use cases.\r\nCall to ActionIf you are a hands‑on Databricks expert who thrives in complex environments and enjoys leading high‑impact data initiatives, we encourage you to apply. Please submit your resume and contact information toThe Intersect Groupfor immediate consideration.#J-18808-Ljbffr","company":"Intersect Group","rawCompany":"intersect group","city":"Dallas","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-06-20T01:06:52.786Z","occupations":[{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Databricks Architect","description":"Senior Databricks Architect (100% Remote)Company OverviewOur client is a leading provider of large-scale infrastructure and engineering services that support essential industries across North America. They are committed to investing in modern data platforms and fostering a culture of continuous learning, collaboration, and technical excellence.\r\nRole SummaryThe Intersect Group is seeking a highly skilled Senior Databricks Architect to lead the design, development, and optimization of a modern data platform leveraging the Databricks Lakehouse architecture. This role combines deep technical expertise with leadership responsibilities, driving data engineering, analytics, and AI/ML initiatives across multiple concurrent projects.\r\nYou will serve as a hands‑on architect and trusted advisor, partnering with internal teams and external resources to implement scalable, high-performance data solutions. This role requires someone who can own delivery end‑to‑end, guide junior resources, and ensure consistent execution across a complex, multi‑project environment.\r\nKey ResponsibilitiesArchitect, design, and implement scalable data solutions using Databricks Lakehouse architecture.\r\nLead hands‑on development, including building and optimizing data pipelines, notebooks, and workflows in Python and SQL.\r\nServe as the primary technical escalation point for Databricks-related challenges across development and production environments.\r\nCollaborate with cross‑functional teams—including data modelers, engineers, and external consultants—to deliver projects on time.\r\nOversee multiple initiatives (6–10 concurrently), ensuring alignment across varying project stages and stakeholders.\r\nImplement and optimize Databricks features such as Auto Loader, Delta Live Tables (DLT), and streaming data pipelines.\r\nEstablish and enforce best practices for performance, scalability, security, and data governance (e.g., row‑level security, column masking, encryption).\r\nMentor junior team members and contribute to overall team development through knowledge sharing and technical guidance.\r\nProvide regular updates on progress, risks, and blockers to leadership.\r\nKey Requirements5+ years of experience in data architecture, data engineering, or AI/ML solutions with ownership of technical delivery.\r\nExtensive hands‑on expertise withDatabricks , including Lakehouse architecture and Medallion design patterns.\r\nStrong experience implementing Databricks inAzure environments .\r\nProficiency inPython and SQLfor building data pipelines and analytics solutions.\r\nExperience with large‑scale distributed systems and big data technologies (e.g., Apache Spark, Hadoop, Cassandra).\r\nExpertise in building and optimizing data ingestion frameworks, including Auto Loader, Delta Live Tables, and streaming solutions.\r\nStrong understanding of data security and governance practices within Databricks environments.\r\nProven ability to lead projects end‑to‑end and manage multiple priorities simultaneously.\r\nExcellent communication skills and a collaborative mindset, with the ability to work across internal teams and external partners.\r\nPreferred QualificationsDatabricks certifications in data engineering or related disciplines.\r\nExperience with Azure networking or security configurations.\r\nExposure to AI/ML workloads and advanced analytics use cases.\r\nCall to ActionIf you are a hands‑on Databricks expert who thrives in complex environments and enjoys leading high‑impact data initiatives, we encourage you to apply. Please submit your resume and contact information toThe Intersect Groupfor immediate consideration.#J-18808-Ljbffr","datePosted":"2026-06-20T01:06:52.786Z","dateModified":"2026-06-20T01:06:52.786Z","hiringOrganization":{"@type":"Organization","name":"Intersect Group","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dallas","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"19d42bd745ba347e99a7d931"},"url":"https://jobsearcher.com/jobs/19d42bd745ba347e99a7d931"}}