Data Engineer – Azure Data Platform (Data Lake & Databricks)
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job SummaryWe are seeking an experienced Senior Data Engineer with strong expertise in Azure Data Lake and Azure Databricks to design, build, and optimize scalable enterprise data platforms within a banking and financial services environment. The ideal candidate will have deep experience building modern cloud-based data solutions, implementing large-scale ETL/ELT pipelines, and enabling advanced analytics and reporting capabilities.Job Title: Senior Data Engineer – Azure Data Platform (Data Lake & Databricks)Locations:Jersey City, NJCharlotte, NCExperience Required: 12+ YearsWork Mode: Onsite / Hybrid (as per client requirement)Looking for Banking / Financial Services domain experienced candidates.W2 rate : $65/hr (Slightly Negotiable)Contract : 12+ MonthsNote : Once candidates pass the assessment test, face-to-face (F2F) interviews will be conducted on Friday, March 27, at the Jersey City, NJ, and Charlotte, NC locations.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake Storage (ADLS Gen2).Build robust ETL/ELT frameworks for ingesting structured and unstructured data from multiple banking systems.Implement data transformation workflows using PySpark, Spark SQL, and Databricks notebooks.Architect and manage enterprise data lakes supporting analytics, regulatory reporting, and business intelligence.Optimize performance and cost efficiency of Databricks workloads and Azure storage solutions.Develop data models supporting risk, finance, payments, and customer analytics use cases.Integrate data solutions with Azure ecosystem services such as Azure Data Factory, Azure Synapse, and Azure SQL.Ensure data governance, lineage, quality, and security standards aligned with financial regulations.Implement CI/CD pipelines using Azure DevOps for automated deployment.Monitor and troubleshoot data workflows and production data issues.Collaborate with cross-functional teams in Agile delivery environments.Required Skills & QualificationsCore Technical Skills12+ years of experience in Data Engineering or Data Platform development.Strong hands-on experience with:Azure Data Lake Storage (ADLS Gen2)Azure DatabricksPySpark / Apache SparkExpertise in building large-scale data pipelines and distributed data processing.Strong SQL and data modeling experience.Experience with Azure Data Factory (ADF) for orchestration.Knowledge of Delta Lake architecture and optimization techniques.Experience handling batch and near real-time data processing.Azure & Cloud SkillsAzure ecosystem experience including:Azure DatabricksAzure Data FactoryAzure Synapse AnalyticsAzure Key VaultAzure Monitor / Log AnalyticsCI/CD implementation using Azure DevOps.Infrastructure automation and environment management knowledge.