Lead Databricks Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
A company is looking for a Lead Databricks Engineer to design, build, and scale their cloud-based lakehouse platform.
Key Responsibilities
Architect and implement an enterprise lakehouse on Databricks across major cloud platforms
Design scalable batch and streaming data pipelines and establish ingestion patterns from various sources
Mentor data engineers and lead architecture and code reviews while engaging with stakeholders to align business needs with the data platform roadmap
Required Qualifications
8+ years of data engineering experience, with 4+ years on Databricks
Deep expertise in Apache Spark, including performance tuning and partitioning strategies
Strong hands-on experience with Delta Lake, Unity Catalog, and Databricks Workflows
Production experience on at least one major cloud platform (AWS, Azure, or GCP)
Proficiency in Python and SQL, with a comfort level in Scala being a plus