Lead Data Engineer
Lead Data Engineer Lead the design and implementation of scalable data platforms and engineering solutions aligned with business needs. Optimize data pipelines for performance, reliability, and cost efficiency using Azure Data Factory (ADF), Azure Databricks, and SQL.Implement incremental data loads, handle schema changes, process large datasets, and troubleshoot production failures. Design fault-tolerant pipelines with restart and recovery mechanisms to prevent duplicate records. Lead and mentor data engineers while establishing engineering standards and best practices. Collaborate with cross-functional teams to translate business requirements into technical solutions. Strong hands-on experience with scenario-based problem-solving in Databricks, ADF, PySpark, and SQL.