Lead Databricks Engineer – Cloud Migration & Lakehouse
Key Responsibilities Lead and execute migration of legacy data platforms (on‑prem / non‑standard tools) to Databricks on cloud under the Olympus programPerform application, data, and pipeline refactoring to cloud‑native Databricks patternsDrive migration planning including dependency analysis, sequencing, and cutover strategySupport coexistence models and transition from dual‑run to cloud‑only execution Databricks Lakehouse EngineeringDesign and implement Databricks Lakehouse architecture Build scalable batch and streaming pipelines using PySpark, Spark SQLLeverage Delta Lake for reliability, versioning, and performanceOptimize compute usage and cost in line with enterprise cloud efficiency goals Required Qualifications8–12+ years in data engineering / platform modernizationStrong hands‑on experience with Databricks in large‑scale enterprisesProven experience delivering cloud migration programs (on‑prem → cloud)Deep expertise in Apache Spark, PySpark, Spark SQLExperience embedding controls, reconciliation, and data quality in migrationsExperience in regulated environments (banking / financial services preferred)