{"schemaVersion":"jobsearcher.job.v1","id":"97817fa1886991a9fe7fcbca","url":"https://jobsearcher.com/jobs/97817fa1886991a9fe7fcbca","canonicalUrl":"https://jobsearcher.com/jobs/97817fa1886991a9fe7fcbca","title":"Databricks Engineer","description":"US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other\r\nWork Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other\r\nJob Summary:This position serves as the principal technical authority for the Databricks Lakehouse platform within the organization. The successful candidate will drive the adoption, implementation, and optimization of Databricks across data pipelines, analytics, and artificial intelligence initiatives. This role requires collaboration with cross-functional teams including data engineering, data science, analytics, and infrastructure to design robust, scalable solutions and troubleshoot complex technical issues.\r\nKey Responsibilities:Lead the design, implementation, and optimization of end-to-end solutions on Databricks, including Unity Catalog, Delta Lake, Databricks SQL, Workflows, Jobs, and Mosaic AI.\r\nArchitect, build, and maintain scalable data ingestion, transformation, and orchestration pipelines using Databricks tools such as Spark, Delta Live Tables, and Auto Loader.\r\nIdentify and resolve performance bottlenecks in Spark jobs, clusters, and SQL queries while implementing cost optimization and auto-scaling strategies.\r\nEstablish and enforce Databricks best practices for security, data governance, compliance, and Unity Catalog implementation.\r\nSupport data science and machine learning teams by implementing MLflow, Feature Store, Vector Search, and generative AI capabilities on Databricks.\r\nProvide root cause analysis and rapid resolution for complex technical issues as the escalation point for production workloads.\r\nMentor data engineers, analysts, and developers through training sessions, documentation, and the creation of internal centers of excellence.\r\nDesign seamless integrations between Databricks and cloud platforms, ETL tools, BI tools, data catalogs, and orchestration systems.\r\nImplement robust monitoring, logging, alerting, and dashboarding for Databricks workloads using native and external tools.\r\nEvaluate new Databricks features and roadmaps to recommend adoption strategies that drive business value.\r\nRequired Qualifications:\r\nBachelor's degree in Information Technology, Computer Science, Business Administration, or a related field, or equivalent work experience.\r\n7+ years in Data Engineering or Architecture, with at least 4+ years dedicated exclusively to the Databricks ecosystem.\r\nProven track record implementing Unity Catalog from scratch, including row- and column-level security and cross-workspace governance.\r\nDeep, low-level Apache Spark tuning expertise (e.g., managing data skew, optimizing shuffles, utilizing Adaptive Query Execution, caching strategies, and Photon engine optimization).\r\nHands-on experience building production-grade Generative AI or LLM applications using Databricks Mosaic AI, Vector Search, and MLflow.\r\nAdvanced proficiency in Python, Scala, and SQL optimized specifically for distributed computing environments\r\nProduction experience with Infrastructure as Code (IaC) tools like Terraform to deploy and manage Databricks workspaces, clusters, and permissions.\r\nExperience setting up secure network topologies for Databricks, including Private Link/VPC Peering , encryption keys (BYOK), and IP access lists.\r\nStrong background in CI/CD pipelines (e.g., GitHub Actions, Azure DevOps, GitLab) using Databricks Asset Bundles (DABs) or Databricks CLI.\r\nPreferred Qualifications:\r\nDatabricks Certified Solutions Architect or Databricks Certified Data Engineer Professional.\r\nDatabricks Certified Machine Learning Professional.\r\nCloud Architecture certification, such as AWS Certified Solutions Architect or Azure Solutions Architect Expert.\r\nWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.#J-18808-Ljbffr","company":"Quantum Technologies","rawCompany":"quantum technologies","city":"Washington","state":"DC","isRemote":false,"isActive":false,"createdAt":"2026-11-13T01:52:49.924Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Engineer","description":"US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other\r\nWork Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other\r\nJob Summary:This position serves as the principal technical authority for the Databricks Lakehouse platform within the organization. The successful candidate will drive the adoption, implementation, and optimization of Databricks across data pipelines, analytics, and artificial intelligence initiatives. This role requires collaboration with cross-functional teams including data engineering, data science, analytics, and infrastructure to design robust, scalable solutions and troubleshoot complex technical issues.\r\nKey Responsibilities:Lead the design, implementation, and optimization of end-to-end solutions on Databricks, including Unity Catalog, Delta Lake, Databricks SQL, Workflows, Jobs, and Mosaic AI.\r\nArchitect, build, and maintain scalable data ingestion, transformation, and orchestration pipelines using Databricks tools such as Spark, Delta Live Tables, and Auto Loader.\r\nIdentify and resolve performance bottlenecks in Spark jobs, clusters, and SQL queries while implementing cost optimization and auto-scaling strategies.\r\nEstablish and enforce Databricks best practices for security, data governance, compliance, and Unity Catalog implementation.\r\nSupport data science and machine learning teams by implementing MLflow, Feature Store, Vector Search, and generative AI capabilities on Databricks.\r\nProvide root cause analysis and rapid resolution for complex technical issues as the escalation point for production workloads.\r\nMentor data engineers, analysts, and developers through training sessions, documentation, and the creation of internal centers of excellence.\r\nDesign seamless integrations between Databricks and cloud platforms, ETL tools, BI tools, data catalogs, and orchestration systems.\r\nImplement robust monitoring, logging, alerting, and dashboarding for Databricks workloads using native and external tools.\r\nEvaluate new Databricks features and roadmaps to recommend adoption strategies that drive business value.\r\nRequired Qualifications:\r\nBachelor's degree in Information Technology, Computer Science, Business Administration, or a related field, or equivalent work experience.\r\n7+ years in Data Engineering or Architecture, with at least 4+ years dedicated exclusively to the Databricks ecosystem.\r\nProven track record implementing Unity Catalog from scratch, including row- and column-level security and cross-workspace governance.\r\nDeep, low-level Apache Spark tuning expertise (e.g., managing data skew, optimizing shuffles, utilizing Adaptive Query Execution, caching strategies, and Photon engine optimization).\r\nHands-on experience building production-grade Generative AI or LLM applications using Databricks Mosaic AI, Vector Search, and MLflow.\r\nAdvanced proficiency in Python, Scala, and SQL optimized specifically for distributed computing environments\r\nProduction experience with Infrastructure as Code (IaC) tools like Terraform to deploy and manage Databricks workspaces, clusters, and permissions.\r\nExperience setting up secure network topologies for Databricks, including Private Link/VPC Peering , encryption keys (BYOK), and IP access lists.\r\nStrong background in CI/CD pipelines (e.g., GitHub Actions, Azure DevOps, GitLab) using Databricks Asset Bundles (DABs) or Databricks CLI.\r\nPreferred Qualifications:\r\nDatabricks Certified Solutions Architect or Databricks Certified Data Engineer Professional.\r\nDatabricks Certified Machine Learning Professional.\r\nCloud Architecture certification, such as AWS Certified Solutions Architect or Azure Solutions Architect Expert.\r\nWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.#J-18808-Ljbffr","datePosted":"2026-11-13T01:52:49.924Z","dateModified":"2026-11-13T01:52:49.924Z","hiringOrganization":{"@type":"Organization","name":"Quantum Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Washington","addressRegion":"DC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"97817fa1886991a9fe7fcbca"},"url":"https://jobsearcher.com/jobs/97817fa1886991a9fe7fcbca"}}