{"schemaVersion":"jobsearcher.job.v1","id":"4d2e761c6b525c7edcc906eb","url":"https://jobsearcher.com/jobs/4d2e761c6b525c7edcc906eb","canonicalUrl":"https://jobsearcher.com/jobs/4d2e761c6b525c7edcc906eb","title":"Databricks Engineer","description":"We are seeking a Senior Databricks Engineer with 8+ years of experience to design, build, and optimize enterprise-grade data solutions on Databricks. In this role, you will work with broad latitude and independence, translating complex business objectives into scalable, cost-effective data architecture. You will bridge the gap between technical requirements and business needs—conducting feasibility studies, analyzing user workflows, and delivering high-performance lakehouse analytics.Key ResponsibilitiesPipeline & Lakehouse Architecture: Design, build, and maintain scalable ETL/ELT ingestion pipelines utilizing Lakeflow Declarative Pipelines (DLT), PySpark/Scala, and the Medallion Architecture (Bronze, Silver, Gold).Business Analysis & Data Modeling: Collaborate with stakeholders to capture requirements, perform cost/benefit analyses, and build robust dimensional models (Star/Snowflake schemas).Analytics & Visualization: Develop dynamic native Databricks SQL dashboards, Databricks Apps, and custom analytical solutions to surface actionable insights.Governance & Operations: Implement data quality, security, and governance frameworks. Optimize workload performance, monitor compute efficiency, and manage pipeline orchestration via Lakeflow Jobs or Airflow.Candidate QualificationsRequired Experience (8+ Years)Databricks & Spark: Hands-on experience architecting and tuning ETL/ELT data pipelines on Databricks using Apache Spark (PySpark or Scala).Lakehouse Stack: Deep knowledge of Delta Lake, Medallion architecture, and Lakeflow Declarative Pipelines (DLT).Data Modeling & SQL: Strong proficiency in SQL and dimensional data modeling (Star/Snowflake schemas).Analytics & Governance: Experience developing native Databricks dashboards/apps and establishing data security, quality, and governance practices.Orchestration: Experience scheduling and managing offline jobs using Lakeflow Jobs (Databricks Workflows) or similar tools (e.g., Airflow).Communication: Exceptional verbal and written communication skills with a proven ability to translate complex data concepts for business leadership.Preferred QualificationsActive Databricks Certification (Data Engineer Associate or Professional).Experience with CI/CD practices for data pipelines (Git-based workflows, DevOps).Prior experience in public sector or state government environments.","company":"Shaarpro","rawCompany":"shaarpro","city":"Austin","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-07-27T12:05:01.221Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Engineer","description":"We are seeking a Senior Databricks Engineer with 8+ years of experience to design, build, and optimize enterprise-grade data solutions on Databricks. In this role, you will work with broad latitude and independence, translating complex business objectives into scalable, cost-effective data architecture. You will bridge the gap between technical requirements and business needs—conducting feasibility studies, analyzing user workflows, and delivering high-performance lakehouse analytics.Key ResponsibilitiesPipeline & Lakehouse Architecture: Design, build, and maintain scalable ETL/ELT ingestion pipelines utilizing Lakeflow Declarative Pipelines (DLT), PySpark/Scala, and the Medallion Architecture (Bronze, Silver, Gold).Business Analysis & Data Modeling: Collaborate with stakeholders to capture requirements, perform cost/benefit analyses, and build robust dimensional models (Star/Snowflake schemas).Analytics & Visualization: Develop dynamic native Databricks SQL dashboards, Databricks Apps, and custom analytical solutions to surface actionable insights.Governance & Operations: Implement data quality, security, and governance frameworks. Optimize workload performance, monitor compute efficiency, and manage pipeline orchestration via Lakeflow Jobs or Airflow.Candidate QualificationsRequired Experience (8+ Years)Databricks & Spark: Hands-on experience architecting and tuning ETL/ELT data pipelines on Databricks using Apache Spark (PySpark or Scala).Lakehouse Stack: Deep knowledge of Delta Lake, Medallion architecture, and Lakeflow Declarative Pipelines (DLT).Data Modeling & SQL: Strong proficiency in SQL and dimensional data modeling (Star/Snowflake schemas).Analytics & Governance: Experience developing native Databricks dashboards/apps and establishing data security, quality, and governance practices.Orchestration: Experience scheduling and managing offline jobs using Lakeflow Jobs (Databricks Workflows) or similar tools (e.g., Airflow).Communication: Exceptional verbal and written communication skills with a proven ability to translate complex data concepts for business leadership.Preferred QualificationsActive Databricks Certification (Data Engineer Associate or Professional).Experience with CI/CD practices for data pipelines (Git-based workflows, DevOps).Prior experience in public sector or state government environments.","datePosted":"2026-07-27T12:05:01.221Z","dateModified":"2026-07-27T12:05:01.221Z","hiringOrganization":{"@type":"Organization","name":"Shaarpro","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Austin","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"4d2e761c6b525c7edcc906eb"},"url":"https://jobsearcher.com/jobs/4d2e761c6b525c7edcc906eb"}}