JOBSEARCHER

Senior Data Engineer

HI,Our client is looking for a Senior Data Engineer in Irving, TX / Wilmington, DE. Below is the detailed requirement.Title: Senior Data EngineerLocation: Irving, TX / Wilmington, DERequired Skills: Apache Spark (PySpark / Scala), Cloudera Hadoop and CDCJob description:Bachelor’s degree in computer science, Information Technology, or a related fieldApache Spark (PySpark and/or Scala) in large-scale production environmentsCloudera Hadoop ecosystem (HDFS, Hive, YARN, Spark on Cloudera)Strong SQL expertise with complex transformations, performance tuning, and reconciliation logicEnterprise RDBMS experience with Oracle and MS SQL ServerBatch ingestion, incremental ingestion, and CDC processing patternsCDC concepts and tooling (tool-agnostic: GoldenGate, Debezium, or equivalent)Data merge, deduplication, watermarking, checkpointing, and SCD handlingGoogle Cloud Platform services, including Dataproc, Composer and DataplexHybrid on prem to cloud data architecture and migration patternsMetadata-driven framework development and data quality validation techniquesCI/CD pipeline implementation using enterprise tooling (GitHub Actions, Jenkins, DevOps)Git-based development workflows, code reviews, and automated testing practicesExperience using Copilot or similar AI-assisted development tools safely and effectively in enterprise environmentsLogging, monitoring, alerting, and operational readiness practicesSecure coding, access control, and compliance-aware developmentDocumentation of design artifacts, runbooks, and operational procedures