W2 - Sr. Databricks Engineer (PySpark and Data Lake) || New Jersey / Plano, TX

Hiring: Senior Databricks Engineer (PySpark + Data Lake)Location: NJ / Plano, TX (5 Days Onsite Any JPMC Office Location)Employment Type: W2Duration: Long-Term ContractOpenings: 5 PositionsWe are actively hiring experienced Senior Databricks Engineers to support a large-scale data modernization initiative. This role focuses on migrating legacy ETL workflows from Ab Initio to cloud-native Databricks pipelines using Apache Spark (PySpark).Key ResponsibilitiesAnalyze and migrate legacy ETL workflows from Ab Initio to PySparkDesign, develop, and optimize scalable data pipelines on DatabricksBuild and maintain ETL/ELT pipelines integrating data from Snowflake and other enterprise sourcesSupport batch and near real-time data processingCreate data lineage, data flow diagrams, and optimize data processesDevelop unit, integration, and reconciliation testing frameworksSupport deployment, migration strategy, and production cutoversWork with scheduling tools like Control-MCollaborate with architects, analysts, and business stakeholders for UAT/FAT sign-offsRequired Skills8+ years of Data Engineering experienceStrong hands-on experience with PySpark and DatabricksExperience with Ab Initio to PySpark migrationExpertise in ETL/ELT pipeline developmentStrong knowledge of Data Lakes, Data Warehousing, and SnowflakeExperience in Data Lineage, Data Governance, and Data QualityStrong coding skills in PythonExperience with batch and real-time processing frameworksPreferredExperience in Banking/Financial Services domainExperience with cloud platforms like Amazon Web Services / Microsoft AzureStrong troubleshooting and production support experience