Data Engineering (DE) Lead
Experience8+ yearsPlatform FocusGCP · DataFlowRole DescriptionOwn data-engineering delivery on GCP/DataFlow, including ingestion, transformation, standardisation, reconciliation, publication and operational engineering standards.Key ResponsibilitiesDefine reusable DataFlow/GCP ingestion and transformation patterns.Implement source ingestion from Epic, ELMS, Oracle, terminology and other approved sources.Build raw/source-preserving, standardised/cleansed and curated/mastered processing layers.Implement standardisation, validation, transformation and reference-data enrichment.Build reconciliation controls between source, MDM/RDM and downstream publication.Build publication pipelines to GCP data products, APIs, events and tables/files.Implement replay, restart, idempotency, audit and monitoring; optimise performance and cost.Establish CI/CD, code quality and production support procedures.Primary DeliverablesData engineering architecture / designIngestion and transformation pipelinesReconciliation frameworkPublication pipelinesOperational monitoring and runbooksCI/CD and engineering standardsRequired Experience & Skills8+ years in data engineering, hands-on with GCP and DataFlow (or equivalent).Large-scale batch, incremental and event-driven pipeline experience.Experience feeding and reconciling MDM/RDM data.Strong on operationalisation: monitoring, replay, CI/CD.Good to HaveBigQuery, Pub/Sub and Dataflow depth.Healthcare data engineering.Integration with Informatica MDM loads.