Senior Data Engineer & Analytics Lead
Senior Data Engineer & Analytics LeadRemote | United States | Full-Time | W-2Clearance: U.S. Citizenship required; ability to obtain Public TrustWe are seeking a Senior Data Engineer & Analytics Lead to support a high-impact federal data and analytics program. This is a hands-on role for someone who enjoys building scalable data platforms, developing production-grade pipelines, improving data quality, and working closely with analytics and machine learning teams.
Key Responsibilities:
Design, build, and maintain scalable ETL/ELT data pipelines across multiple source systems and data formats.
Develop data models using Data Vault 2.0, dimensional modeling, and Gold-tier analytics models.
Work extensively with Azure Databricks, PySpark, Python, SQL, and Delta Lake.
Implement data quality, reconciliation, deduplication, and validation processes.
Support Power BI datasets, semantic models, and analytics solutions.
Optimize data pipelines and queries for performance, reliability, and cost.
Participate in code reviews, CI/CD, source control, and production deployments.
Collaborate with data scientists, ML engineers, architects, analysts, and external partners.
Create and maintain technical documentation, data dictionaries, pipeline specifications, diagrams, and runbooks.
Provide technical leadership and review partner-developed solutions to ensure production readiness.
Required Qualifications:
8+ years of experience in data engineering or analytics engineering.3+ years of experience with Azure Databricks or a comparable lakehouse platform.
Strong hands-on experience with SQL, Python/PySpark, Spark, ETL/ELT, and data modeling.
Experience with Data Vault 2.0 and/or dimensional modeling.
Experience with Delta Lake, orchestration, data quality, and performance tuning.
Familiarity with Unity Catalog, Git/source control, CI/CD, and automated deployments.
Experience supporting Power BI or enterprise analytics platforms.
Strong technical communication and documentation skills.
Bachelor's degree.
Ability to meet required federal suitability, security, and access requirements.
Preferred:
- Experience supporting federal/government data environments.
- Experience with Impact Level 5 (IL-5) or higher environments.
- Azure Data Engineer or Databricks certification.
- Experience with Service
- Now, government financial, audit, or regulated data.
- Experience with Infrastructure as Code and Databricks Asset Bundles.