{"schemaVersion":"jobsearcher.job.v1","id":"7b91ce4ae08b1c9e089551da","url":"https://jobsearcher.com/jobs/7b91ce4ae08b1c9e089551da","canonicalUrl":"https://jobsearcher.com/jobs/7b91ce4ae08b1c9e089551da","title":"Senior Data Engineer","description":"A world-leading technology solutions provider specializing in government contracting is seeking a skilled professional to contribute to critical data infrastructure projects for a key defense client. This organization is committed to delivering innovative and reliable services that support national security initiatives, fostering an environment of excellence and mission-driven purpose.The Role Design, build, test, deploy, and maintain automated and manual ETL/ELT pipelines for approximately 15–20 DoD/DAF/ANG source systems. Implement ingestion patterns for various data types, supporting near-real-time data currency requirements. Develop SQL and Python transformation logic for data cleansing, standardization, validation, and enrichment. Build and operate Azure Databricks jobs, orchestration sequences, and workload schedules, optimizing execution performance and cloud-compute utilization. Implement automated data-quality checks, monitoring, logging, alerting, and recoverable error-handling patterns. Triage critical pipeline failures, perform root-cause analysis, and restore service within required response windows. Maintain pipeline code, configuration, infrastructure/deployment scripts, and test assets in Git, executing automated CI/CD build and security testing.What You'll Need Demonstrated hands-on experience developing production-grade ETL/ELT pipelines using Azure Databricks or comparable Spark-based platforms. Advanced SQL and Python skills for data transformation, validation, automation, and performance optimization. Experience with batch and streaming ingestion, APIs, schema management, orchestration, monitoring, and data quality. Proficiency with Git-based version control and CI/CD practices for data-engineering solutions. Knowledge of data warehousing/lakehouse patterns, query optimization, access control, and secure data handling. Active SECRET security clearance is required.What's On Offer Opportunity to work on critical defense sector projects with significant impact. Comprehensive benefits package including medical, dental, vision, 401(k) with employer match, and PTO. Hybrid work model with telework options available. Supportive environment focused on professional growth and mission success.Apply via Haystack today!","company":"Haystack","rawCompany":"haystack","city":"Andrews Air Force Base","state":"MD","isRemote":false,"isActive":false,"createdAt":"2026-09-08T08:55:02.285Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer","description":"A world-leading technology solutions provider specializing in government contracting is seeking a skilled professional to contribute to critical data infrastructure projects for a key defense client. This organization is committed to delivering innovative and reliable services that support national security initiatives, fostering an environment of excellence and mission-driven purpose.The Role Design, build, test, deploy, and maintain automated and manual ETL/ELT pipelines for approximately 15–20 DoD/DAF/ANG source systems. Implement ingestion patterns for various data types, supporting near-real-time data currency requirements. Develop SQL and Python transformation logic for data cleansing, standardization, validation, and enrichment. Build and operate Azure Databricks jobs, orchestration sequences, and workload schedules, optimizing execution performance and cloud-compute utilization. Implement automated data-quality checks, monitoring, logging, alerting, and recoverable error-handling patterns. Triage critical pipeline failures, perform root-cause analysis, and restore service within required response windows. Maintain pipeline code, configuration, infrastructure/deployment scripts, and test assets in Git, executing automated CI/CD build and security testing.What You'll Need Demonstrated hands-on experience developing production-grade ETL/ELT pipelines using Azure Databricks or comparable Spark-based platforms. Advanced SQL and Python skills for data transformation, validation, automation, and performance optimization. Experience with batch and streaming ingestion, APIs, schema management, orchestration, monitoring, and data quality. Proficiency with Git-based version control and CI/CD practices for data-engineering solutions. Knowledge of data warehousing/lakehouse patterns, query optimization, access control, and secure data handling. Active SECRET security clearance is required.What's On Offer Opportunity to work on critical defense sector projects with significant impact. Comprehensive benefits package including medical, dental, vision, 401(k) with employer match, and PTO. Hybrid work model with telework options available. Supportive environment focused on professional growth and mission success.Apply via Haystack today!","datePosted":"2026-09-08T08:55:02.285Z","dateModified":"2026-09-08T08:55:02.285Z","hiringOrganization":{"@type":"Organization","name":"Haystack","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Andrews Air Force Base","addressRegion":"MD","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"7b91ce4ae08b1c9e089551da"},"url":"https://jobsearcher.com/jobs/7b91ce4ae08b1c9e089551da"}}