Senior Data Engineer (Python / AWS)

Data Engineer (Python / AWS) Our client is hiring a Data Engineer to build, test, and operate secure Python-based data pipelines and transformation services supporting modernized mission workflows for a federal customer. Despite the title, this is first and foremost a Python development role. If you think of yourself as a Python developer who works with data, please read on. Two gates before you invest time in applying: this role requires U.S. citizenship plus previous professional experience supporting the U.S. Federal Government, either as a federal employee or contractor. It also requires an active Tier 2 background investigation or higher, completed or favorably adjudicated within the previous 18 months. A Public Trust counts. An active Secret clearance is preferred but not required. Key Responsibilities Build secure Python and AWS ETL/ELT pipelines for ingestion, transformation, reconciliation, and delivery. Develop and evolve relational data models, schemas, indexes, constraints, views, and access patterns for MariaDB, PostgreSQL, or comparable platforms. Develop data workflows and interfaces using Python on AWS Lambda and PySpark for event-driven, batch, and distributed transformation workloads. Create automated data-quality checks for accuracy, completeness, consistency, timeliness, uniqueness, and business-rule conformance. Implement source-to-target mapping, lineage, auditability, restartability, exception handling, and controlled replay. Develop parity tests that compare legacy and modern processing outcomes. Tune SQL and pipeline performance for high-volume batch and near-real-time workloads. Implement monitoring, logging, alerting, and operational dashboards for pipeline health, latency, failures, and data quality. Automate CI/CD, version-controlled data changes, deployments, rollback, and operational recovery controls. Collaborate with architects, mission SMEs, Appian developers, testers, security personnel, and interface partners. Minimum Qualifications U.S. Citizen. Authorization to work in the U.S. will not suffice. Previous professional experience supporting the U.S. Federal Government, either as a federal employee or contractor. Active Tier 2 background investigation or higher, completed or favorably adjudicated within the previous 18 months. 4 or more years of professional experience in data engineering, database development, or data-platform delivery. Bachelor's degree in Computer Science, Information Systems, Data Engineering, or equivalent, OR 4 additional years of relevant professional experience in lieu of a degree. Advanced Python software-engineering skills and experience building AWS Lambda functions and PySpark data-transformation pipelines. Experience building, testing, and operating production ETL/ELT pipelines with automated data-quality controls. Experience with data modeling, schema migration, source-to-target mapping, lineage, reconciliation, and data-quality automation. Experience integrating data platforms with REST APIs, application services, file exchanges, and event-driven interfaces. Experience with Git, CI/CD, automated testing, logging, monitoring, performance tuning, and production support. Active CompTIA Security+ or equivalent DoW-approved baseline cybersecurity certification, or the ability to obtain one within the first 30 days of starting. Highly Desired Qualifications Active Secret security clearance. Previous professional experience supporting a DoW organization, mission, or customer. Experience using Palantir Foundry for data integration, transformation, lineage, governance, and operational workflows. Experience modernizing COBOL flat files or legacy relational data into a modern relational architecture. Experience integrating with Appian, Python microservices, financial transactions, logistics workflows, or high-volume external interfaces. Experience serving as a technical team lead, mentoring junior engineers, or assisting teammates across delivery tasks. Experience with BI, analytics, archival, records-retention, or NARA-aligned data lifecycle requirements. Do not have Security+ yet? Apply anyway. You can earn it before your start date, which comes with a signing bonus, or within your first 30 days of starting, which does not. Location Fully remote, with travel 4 to 8 times per year. The Washington, DC metropolitan area is preferred but not required. Candidates must reside in one of the following: AZ, CO, DC, FL, GA, HI, IL, KY, MD, MO, NC, NJ, NV, OH, OK, PA, TN, TX, UT, or VA. Salary Range: $130,000 - $155,000 per year. Job Type: Full-time Pay: $130,000.00 - $155,000.00 per year Benefits: 401(k) 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Application Question(s): This role supports a federal government program and requires U.S. citizenship. Are you a U.S. citizen? Which state do you live in? Our client can currently hire only in: VA, MD, DC, NJ, FL, OH, OK, GA, TX, MO, HI, NC, NV, CO, AZ, TN, MN, IL, UT, and PA. Do you hold an active CompTIA Security+ certification? If not, please still apply. You can either earn it before your start date, which comes with a signing bonus, or earn it within your first 90 days of hire, which does not. Let us know which applies to you. Education: Bachelor's (Preferred) Experience: API Development: 1 year (Preferred) Federal Information Systems: 2 years (Preferred) Scrum: 2 years (Preferred) Professional: 5 years (Preferred) SQL: 2 years (Preferred) Spark Hadoop or Equivalent: 2 years (Preferred) Jira: 2 years (Preferred) Python: 2 years (Preferred) Security clearance: Secret (Required) Work Location: Remote