JOBSEARCHER

Data Engineer (Wilmington)

Hiring: Databricks Engineer (PySpark & Data Lake)Wilmington, DE ( IN Person Interview) | 5 Days Onsite | Long-Term ProjectWe're looking for a strong Data Engineer to drive the modernization of legacy ETL systems by migrating Ab Initio workflows into scalable PySpark pipelines on Databricks.This is a great opportunity to work on large-scale data transformation, building cloud-native architectures while ensuring high performance, data quality, and reliability.Key ResponsibilitiesMigrate legacy ETL workflows (Ab Initio → PySpark on Databricks)Design & develop scalable, modular data pipelinesBuild ETL/ELT pipelines integrating Snowflake & other data sourcesSupport batch & near real-time data processingCreate data lineage & optimize workflowsPerform testing, validation & UAT supportDrive deployment, migration & system cutover strategiesWhat We're Looking ForStrong experience with Databricks & PySparkHands-on in ETL/ELT pipeline developmentExperience with Snowflake / Data Lake architecturesBackground in legacy ETL migration (Ab Initio preferred)Strong understanding of data governance, optimization & performanceIf you or someone in your network is a fit, feel free to reach out or share your resume at salomon@hgtechinc.net