Databricks Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Overview:
In this role you will help migrate Hadoop workloads to the Databricks Lakehouse, building scalable data solutions and optimizing pipelines. You will collaborate with data engineering, analytics, and governance teams to ensure successful migration and ongoing performance improvements. The position focuses on adopting advanced Databricks features and delivering measurable cost savings and data reliability. This is a hands-on, cross-functional role with a strong emphasis on impact and iterative delivery.
Responsibilities:
Identify Hadoop jobs and data sources to support migration planningParticipate in selecting scalable MVP migration use casesProvision and configure Databricks workspaces with Lakehouse architectureExecute pilot migrations using Databricks Migration Accelerator or partner solutionsValidate post-migration performance, cost efficiency, and data integrityEnable and test advanced Databricks features to optimize data layout and healthEngage with cross-functional teams to document learnings, blockers, and gapsTrack key success metrics and contribute to a phased migration roadmap
Key requirements:
Bachelor's degree in Computer Science, Information Technology, or related field or equivalent experience 5-8 years of data engineering experience with hands-on Databricks and HadoopProficiency in Spark (Scala or PySpark), ETL development, and data migration practicesExperience with Lakehouse architecture, Delta Lake, and Databricks advanced features (Lakehouse Federation, Unity Catalog) is a strong plusSolid understanding of Azure cloud platform and data governance conceptsStrong analytical and problem-solving skillsAbility to work collaboratively with cross-functional teams and communicate with technical and non-technical stakeholdersstrong collaborationeffective communicationanalytical mindsetDatabricksSpark (Scala/PySpark)ETL pipeline development