Data Engineer - Senior
DescriptionAbout us:BDR Solutions, LLC, (BDR) supports the U.S. Federal Government in successfully achieving its mission and goals. Our service and solution delivery starts with understanding each client's end-state, and then seamlessly integrating within each Agency's organization to improve and enhance business and technical operations and deployments.(Military Veterans are highly encouraged to apply)Role Overview:BDR Solutions is seeking a seasoned Cloud Data Engineering Lead to support IRS data platform initiatives, focusing on secure, scalable architecture and tenant onboarding within a Databricks and AWS ecosystem. This role leads data governance, workspace design, and end-to-end onboarding processes while ensuring compliance with federal security standards and IRS requirements. The ideal candidate brings strong technical expertise, federal experience, and the ability to partner closely with stakeholders to drive adoption and operational excellence.Responsibilities:Active MBI - mandatory; candidates in process do NOT qualifyCurrent or recent IRS contract experience strongly preferred8+ years in cloud data engineering; 3-5 years hands-on Databricks (Unity Catalog, Delta Live Tables, Auto Loader, Genie)Databricks Certified Data Engineer Professional or advanced equivalent - must be current and in good standing at awardAWS Certified Solutions Architect or Data Engineer - Associate or ProfessionalDeep experience with medallion architecture (Bronze/Silver/Gold), Delta Lake, and CDC patternsProficiency in Python, PySpark, and SQL for enterprise pipeline developmentHands-on AWS: S3, IAM, VPC, CloudWatch, Glue, AthenaExperience with RBAC/ABAC, row-level security, PII column maskingFamiliarity with IRS OneSDLC, FISMA, NIST 800-53, and FedRAMP HighBachelor's degree in Computer Science, Information Technology, or related fieldRequired Minimum Qualifications:Lead workspace architecture, Unity Catalog governance, and cluster policy design for IRS tenant organizationsPerform tenant discovery and requirements gathering, source profiling, and security classification for new data intake requestsDevelop end-to-end technical designs for tenant onboarding including Data Sharing Agreements and SLA documentationMaintain Requirements Traceability Matrix (RTM) and prepare Architecture Review Board (ARB) submissionsContribute to tenant onboarding automation, financial operations integration, and ROI reportingDeliver tenant training materials and facilitate weekly office hours for IRS program teamsSupport P1/P2 incident response within SLA for tenant-related platform issuesProvide NIST 800-53 control evidence within 5 business days of IRS audit requestsClearance Required: Minimum Background Investigation (MBI) - ACTIVETools and Platforms:Preferred Tools & Technologies: Terraform, GitHub Actions or Azure DevOps, Kafka/MSK, dbt, Great Expectations, Splunk/Datadog, Collibra/Alation, AWS Lake Formation, and experience with data mesh or modern data product architectures.Clearance Required: Minimum Background Investigation (MBI) - ACTIVENice to Have Qualifications:Databricks EcosystemAzure DevOps or GitHub ActionsExperience with machine learning pipelinesKnowledge of data governance frameworksFamiliarity with real-time streaming systemsCertifications in cloud platforms (AWS Certified Data Analytics, Azure Data Engineer)In addition, U.S Citizenship is required. Select applicants will be subject to a government security investigation and must meet eligibility requirements for access to classified information and be able to obtain a government-granted security clearance. Individuals may also be subject to a background investigation including, but not limited to criminal history, employment and education verification, drug testing, and creditworthiness.This position is contingent upon contract award. Employment is not guaranteed and will proceed only if the associated contract is awarded and funded.The compensation range for this position is $110,000 - 170,000. Compensation decisions depend on a wide range of factors, including but not limited to location, skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.