Lead Data Engineer

Job Details:Mandatory Skills:• Advanced expertise in ETL / ELT pipeline design• Handling:o Batch data processingo Near real time / streaming data• Experience with structured and semi structured data• Strong knowledge of:o Incremental loadingo CDC (Change Data Capture)• Pipeline orchestration and dependency management• Strong programming skills in Python or Scala or Java (nice to have)• Performance optimization for large scale data processing• Solid understanding of:o Dimensional modeling (Star / Snowflake)o Normalized and denormalized models• Strong experience on: Azure, AWS, or GCP• Hands on with Data Warehouses (Snowflake, Synapse, BigQuery, Redshift)Data Architecture & Solution Design• Design end to end data engineering architectures• Define scalable solutions for:o Data lakes / lakehouseo Data warehouseso Streaming and real time systems• Ensure alignment with enterprise architecture, security, and compliance standards• Review and approve technical designsData Pipeline Development & Management• Lead development of ETL / ELT pipelines• Handle:o Batch and real time ingestiono Structured and semi structured data• Optimize pipelines for performance, reliability, and cost• Manage schema evolution and data dependenciesData Quality, Reliability & Operations• Establish data quality standards and validation rules• Implement monitoring, alerting, and observability• Perform root cause analysis for data incidents• Drive operational excellence and stabilityDevOps / DataOps Enablement• Build CI/CD pipelines for data workloads• Automate testing, deployment, and rollback• Improve reliability through automation