Lead Data Engineer

JOB DESCRIPTION:Looking at 8-10 years of software development and deployment experience with at least 7 years of hands-on experience with SQL, Databricks, DataStage (or other ETL tool).Write SQL for processing raw data, Kafka ingestions, ADF pipelines, data validation, and QA.Knowledge working with APIs to collect or ingest data.Experience with advanced SQL and Python.Strong Database knowledge, SQL & No-SQL preferred.OTHER RESPONSIBILITIES:Data Architecture Design: Responsible for designing the overall data architecture and data modeling strategies for the BI system. They collaborate with stakeholders to understand business requirements and translate them into a robust and scalable data model. Create logical and physical data models using best practices to ensure high data quality and reduced redundancy.Data Integration: Will work on integrating data from various sources, such as databases warehouses and external systems. They develop strategies for data extraction, transformation, and loading (ETL) processes to ensure data accuracy, consistency, and availability for reporting and analysis.