Databricks Data Engineer

Databricks Platform Engineer/AdminThis position requires an ACTIVE SECRET security clearance. Your application will not be reviewed if you do not have an ACTIVE security clearance at SECRET or above.Elevate Government Solutions is a high growth Technology Services company focused on driving technological change in the government space. Our teams engage with various government agencies to develop and deploy emerging technology solutions using a tailored Agile methodology.We are seeking a highly motivated and intellectually curious Databricks Platform Engineer/Admin to join our team working with a Federal client. The position will be a remote role open to US citizens residing in the United States with a Secret security clearance.Responsibilities:Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLTImplement Medallion architecture (bronze/silver/gold) for data curation and qualityBuild ingestion frameworks for structured/semi-structured/unstructured data from files, databases, APIs, and streaming sources (Kafka, Kinesis, Auto Loader)Design data models (dimensional or domain-specific) supporting downstream analyticsBuild and consume APIs for data integration with downstream systemsOptimize Spark jobs for performance and cost (partitioning, caching, cluster sizing)Implement data quality checks and pipeline monitoringDocument data flows and lineage for maintainabilityRequirements:5+ years data engineering experience, 2+ years on DatabricksStrong PySpark and SQL for production-grade transformationsExperience with both batch and streaming data processingSolid grounding in data modeling and data architecture principlesPython proficiency and Git-based CI/CD workflow experienceFamiliarity with Unity Catalog (catalogs, schemas, grants) from a consumer perspectiveExperience with DLT or Workflows orchestration a plus4 year Bachelor's Degree in Computer Science/Eng or related (highly preferred)Benefits:Health Insurance401k matchUnlimited Vacation11 Federal HolidaysRemote workTrainingMentoring/Coaching