Senior Data Engineer
Job Title:
Senior Data EngineerLocation: Mclean, VA/ Richmond, VA - HybridDuration: 07+ Months Contract with ExtensionJob id – 180924
Responsibilities:
Designing and implementing high-performance data pipelines that handle large volumes of data Ensuring data integrity through advanced quality checks and lineage tracking Required Skills & Qualifications: Core Languages: Expert-level proficiency in Python and PySpark. AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR. Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred). Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality. Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL). Preferred Experience Industry: Experience within the Financial Services industry is a huge plus. Real-time Processing: Experience with Kinesis or Kafka integration for low-latency data delivery. DevOps: Familiarity with CI/CD for data pipelines and Infrastructure as Code.