Lead Data Engineer
Lead Data EngineerLarge Healthcare organization is seeking a lead Data Engineer to join their expanding teamThis is What You’ll DoLead design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta LakeEnhancement of CI/CD pipelines and Azure DevOps, Git, and automated deployment frameworks to streamline development and release processesEnsure data quality and consistency through data integration, transformation, and cleansingFamiliarity with security and governance best practices using Unity Catalog, Azure RBAC, managed identities, and data access controls to ensure compliance and secure data management is preferredResponsibility includes leading a team of data engineers and mentoring in best practices.Utilize Python for data manipulation, automation, and custom data solutionsCollaborate with stakeholders to understand data needs and translate them into technical solutionsParticipate in on-call rotation and assist with after-hours issues, as requiredPerform other duties as assigned