Databricks Engineer
Position SummaryWe are seeking an experienced Databricks Lead Engineer / Technical Lead to drive large-scale data platform modernization initiatives. The ideal candidate will possess deep expertise in Databricks Lakehouse architecture, Delta Lake, Databricks Workflows, and hands-on experience migrating enterprise data platforms from Azure Synapse and SQL Server to Databricks. This role requires strong technical leadership, client-facing communication skills, and the ability to guide cross-functional teams through complex data transformation projects.Key ResponsibilitiesLead the design, development, and implementation of enterprise-scale data solutions using Databricks Lakehouse Platform.Design and build scalable data pipelines utilizing Databricks Workflows, Delta Lake, and Spark-based processing frameworks.Drive end-to-end migration of data warehouses, ETL pipelines, and reporting workloads from Azure Synapse and SQL Server to Databricks.Collaborate with Data Architects, Business Stakeholders, and Delivery Teams to define migration strategies and target-state architectures.Configure and manage Unity Catalog, including catalogs, schemas, tables, governance policies, and access controls.Ensure adherence to data governance, security, and compliance requirements across the Databricks ecosystem.Provide technical leadership, solution guidance, and mentorship to offshore and onshore development teams.Act as the primary technical point of contact for client stakeholders, facilitating discussions, solution reviews, and project planning.Conduct code reviews, performance tuning, and optimization of Databricks workloads.Support deployment automation and platform standardization initiatives.Required Skills & QualificationsTechnical SkillsStrong hands-on experience with:Databricks WorkflowsDatabricks Lakehouse ArchitectureDelta LakeApache Spark (PySpark/Scala preferred)Proven experience migrating:Azure Synapse Analytics workloads to DatabricksSQL Server ETL processes to DatabricksEnterprise data warehouses and data pipelinesExpertise in designing and implementing scalable ETL/ELT frameworks.Hands-on experience with Unity Catalog, including:Catalog and schema managementTable creation and managementRole-based access control (RBAC)Data governance implementationStrong understanding of cloud-based data engineering principles and best practices.Leadership & Stakeholder ManagementExperience serving as an Onshore Technical Lead for data engineering programs.Strong client-facing communication and stakeholder management skills.Ability to work closely with:Client Business StakeholdersData ArchitectsProgram ManagersDelivery LeadsExperience leading distributed teams across onshore and offshore locations.Good to Have SkillsExperience with Databricks Asset Bundles (DABs).Familiarity with Azure DevOps and CI/CD implementation for Databricks deployments.Understanding of Infrastructure-as-Code and deployment automation practices.Knowledge of retail, restaurant, or hospitality operational data systems such as:ToastHotSchedulesCrunchtimeExperience with modern data governance and data quality frameworks.Preferred Experience8+ years of overall Data Engineering experience.4+ years of hands-on Databricks development and solution design experience.Prior experience leading cloud data migration and modernization programs.Experience working in Agile/Scrum delivery environments.EducationBachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.