{"schemaVersion":"jobsearcher.job.v1","id":"12df98ec3e58e14b439e944c","url":"https://jobsearcher.com/jobs/12df98ec3e58e14b439e944c","canonicalUrl":"https://jobsearcher.com/jobs/12df98ec3e58e14b439e944c","title":"Lead Data Engineer","description":"SHR Consulting Group, LLC is a small business delivering enterprise IT, cybersecurity, and program management services to the Department of Defense and federal civilian agencies. We support mission-critical infrastructure at the Pentagon and across the National Capital Region, and we invest in our people through competitive compensation, professional certification support, and long-term career growth on stable, multi-year programs.\n\nWe are seeking a senior Lead Data Engineer as a Key Personnel for a bid opportunity to lead data pipeline engineering, operations, performance, migration, and integration activities supporting an enterprise FEMA effort.\n\nThis position is CONTINGENT UPON CONTRACT AWARD. Candidates selected for consideration must be willing to authorize the submission of their resume and qualifications in support of our proposal response.\n\nKey Responsibilities\n\nLead technical delivery for FEMA pipeline engineering, operations, performance, and migration.\nDesign, construct, test, deploy, and maintain scalable batch and streaming data pipelines.\nBuild and maintain metadata-driven ingestion pipelines.\nImplement robust schema evolution and data-processing patterns.\nDiagnose and resolve production pipeline failures and complex data-storage issues.\nDesign pipelines consistent with FEMA's multi-zone/Medallion architecture.\nDevelop modular, parameterized, and reusable pipeline patterns.\nImplement scalable ingestion and transformation solutions supporting increasing data volume, velocity, and concurrency.\nImplement engineering practices for reliability and cost efficiency, including:\nIncremental processing\nIdempotent and restartable jobs\nPartitioning\nStorage/file-layout optimization\nCompute right-sizing\nDevelop automated testing, data-quality validation, and deployment automation.\nDiagnose schema drift, missing or late data, checkpoint/watermark failures, orchestration faults, and performance degradation.\nConduct root-cause analysis of significant or recurring production issues.\nSupport migration of legacy data, pipelines, reporting workloads, and dependencies.\nSupport source-system onboarding and integration using APIs, connectors, batch/file transfers, CDC, and custom integration patterns.\nProvide technical leadership and mentoring to Senior Data Engineers and other engineering staff.\n\nRequired Qualifications\n\nExtensive hands-on experience designing and developing enterprise data pipelines.\nDemonstrated experience with Databricks or comparable cloud-based Lakehouse/data engineering platforms.\nStrong experience with metadata-driven data ingestion frameworks.\nStrong knowledge of schema evolution and enterprise data-processing patterns.\nDemonstrated ability to troubleshoot live production pipeline failures.\nExperience debugging complex data-storage and processing structures.\nExperience designing batch and streaming pipelines.\nExperience with cloud-based data engineering in Federal or similarly regulated environments.\nStrong understanding of CI/CD, automated testing, data-quality validation, and deployment automation.\nExperience with scalable data architectures and high-volume enterprise data environments.\nAbility to provide hands-on technical leadership to engineering teams.\n\nHighly Desired Technical Experience\n\nDatabricks\nApache Spark / PySpark\nSQL\nPython\nDelta Lake\nMedallion/Lakehouse architectures\nStructured Streaming or comparable streaming technologies\nCloud data services\nREST APIs and source-system integration\nChange Data Capture (CDC)\nCI/CD and Infrastructure/Deployment Automation\nData quality and observability tooling\nGit/version control\nFinOps and cloud performance optimization\n\nPreferred Qualifications\n\nPrior FEMA or DHS experience.\nExperience migrating legacy Federal data environments to modern cloud data platforms.\nExperience supporting data platforms used for AI/ML and Retrieval-Augmented Generation (RAG).\nExperience engineering feature pipelines, curated AI datasets, vector/embedding data stores, or AI data products.\nExperience with Federal security requirements including NIST, FISMA, FedRAMP, and DHS 4300A.\n\nClearance Requirements\n\nU.S. Citizenship.\nMust be able to obtain and maintain the Government-required suitability/fitness determination and IT access authorization.\n\nBenefits\n\nCompetitive salary commensurate with experience.\nComprehensive medical, dental, and vision coverage.\n401(k) with company contribution.\nPaid time off and eleven federal holidays.\nCertification reimbursement and training support.\nLife and disability insurance.\n\nSHR Consulting Group, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.","company":"Shr Consulting Group","rawCompany":"shr consulting group","city":"Paris","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-09-10T11:19:45.115Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541519","title":"Other Computer Related Services","slug":"other-computer-related-services"},{"code":"541330","title":"Engineering Services","slug":"engineering-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"SHR Consulting Group, LLC is a small business delivering enterprise IT, cybersecurity, and program management services to the Department of Defense and federal civilian agencies. We support mission-critical infrastructure at the Pentagon and across the National Capital Region, and we invest in our people through competitive compensation, professional certification support, and long-term career growth on stable, multi-year programs.\n\nWe are seeking a senior Lead Data Engineer as a Key Personnel for a bid opportunity to lead data pipeline engineering, operations, performance, migration, and integration activities supporting an enterprise FEMA effort.\n\nThis position is CONTINGENT UPON CONTRACT AWARD. Candidates selected for consideration must be willing to authorize the submission of their resume and qualifications in support of our proposal response.\n\nKey Responsibilities\n\nLead technical delivery for FEMA pipeline engineering, operations, performance, and migration.\nDesign, construct, test, deploy, and maintain scalable batch and streaming data pipelines.\nBuild and maintain metadata-driven ingestion pipelines.\nImplement robust schema evolution and data-processing patterns.\nDiagnose and resolve production pipeline failures and complex data-storage issues.\nDesign pipelines consistent with FEMA's multi-zone/Medallion architecture.\nDevelop modular, parameterized, and reusable pipeline patterns.\nImplement scalable ingestion and transformation solutions supporting increasing data volume, velocity, and concurrency.\nImplement engineering practices for reliability and cost efficiency, including:\nIncremental processing\nIdempotent and restartable jobs\nPartitioning\nStorage/file-layout optimization\nCompute right-sizing\nDevelop automated testing, data-quality validation, and deployment automation.\nDiagnose schema drift, missing or late data, checkpoint/watermark failures, orchestration faults, and performance degradation.\nConduct root-cause analysis of significant or recurring production issues.\nSupport migration of legacy data, pipelines, reporting workloads, and dependencies.\nSupport source-system onboarding and integration using APIs, connectors, batch/file transfers, CDC, and custom integration patterns.\nProvide technical leadership and mentoring to Senior Data Engineers and other engineering staff.\n\nRequired Qualifications\n\nExtensive hands-on experience designing and developing enterprise data pipelines.\nDemonstrated experience with Databricks or comparable cloud-based Lakehouse/data engineering platforms.\nStrong experience with metadata-driven data ingestion frameworks.\nStrong knowledge of schema evolution and enterprise data-processing patterns.\nDemonstrated ability to troubleshoot live production pipeline failures.\nExperience debugging complex data-storage and processing structures.\nExperience designing batch and streaming pipelines.\nExperience with cloud-based data engineering in Federal or similarly regulated environments.\nStrong understanding of CI/CD, automated testing, data-quality validation, and deployment automation.\nExperience with scalable data architectures and high-volume enterprise data environments.\nAbility to provide hands-on technical leadership to engineering teams.\n\nHighly Desired Technical Experience\n\nDatabricks\nApache Spark / PySpark\nSQL\nPython\nDelta Lake\nMedallion/Lakehouse architectures\nStructured Streaming or comparable streaming technologies\nCloud data services\nREST APIs and source-system integration\nChange Data Capture (CDC)\nCI/CD and Infrastructure/Deployment Automation\nData quality and observability tooling\nGit/version control\nFinOps and cloud performance optimization\n\nPreferred Qualifications\n\nPrior FEMA or DHS experience.\nExperience migrating legacy Federal data environments to modern cloud data platforms.\nExperience supporting data platforms used for AI/ML and Retrieval-Augmented Generation (RAG).\nExperience engineering feature pipelines, curated AI datasets, vector/embedding data stores, or AI data products.\nExperience with Federal security requirements including NIST, FISMA, FedRAMP, and DHS 4300A.\n\nClearance Requirements\n\nU.S. Citizenship.\nMust be able to obtain and maintain the Government-required suitability/fitness determination and IT access authorization.\n\nBenefits\n\nCompetitive salary commensurate with experience.\nComprehensive medical, dental, and vision coverage.\n401(k) with company contribution.\nPaid time off and eleven federal holidays.\nCertification reimbursement and training support.\nLife and disability insurance.\n\nSHR Consulting Group, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.","datePosted":"2026-09-10T11:19:45.115Z","dateModified":"2026-09-10T11:19:45.115Z","hiringOrganization":{"@type":"Organization","name":"Shr Consulting Group","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Paris","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"12df98ec3e58e14b439e944c"},"url":"https://jobsearcher.com/jobs/12df98ec3e58e14b439e944c"}}