Lead Data Engineer
Job DetailsMandatory Skills:Advanced expertise in ETL / ELT pipeline designHandlingBatch data processingNear real time / streaming dataExperience with structured and semi structured dataStrong Knowledge OfIncremental loadingCDC (Change Data Capture)Pipeline orchestration and dependency managementStrong programming skills in Python or Scala or Java (nice to have)Performance optimization for large scale data processingSolid Understanding OfDimensional modeling (Star / Snowflake)Normalized and denormalized modelsStrong experience on: Azure, AWS, or GCPHands on with Data Warehouses (Snowflake, Synapse, BigQuery, Redshift)Data Architecture & Solution DesignDesign end to end data engineering architecturesDefine Scalable Solutions ForData lakes / lakehouseData warehousesStreaming and real time systemsEnsure alignment with enterprise architecture, security, and compliance standardsReview and approve technical designsData Pipeline Development & ManagementLead development of ETL / ELT pipelinesHandleBatch and real time ingestionStructured and semi structured dataOptimize pipelines for performance, reliability, and costManage schema evolution and data dependenciesData Quality, Reliability & OperationsEstablish data quality standards and validation rulesImplement monitoring, alerting, and observabilityPerform root cause analysis for data incidentsDrive operational excellence and stabilityDevOps / DataOps EnablementBuild CI/CD pipelines for data workloadsAutomate testing, deployment, and rollbackImprove reliability through automationExperience>11 Years