Databricks Data Engineer
Databricks Platform Engineer/AdminThis position requires an ACTIVE SECRET security clearance. Your application will not be reviewed if you do not have an ACTIVE security clearance at SECRET or above. Elevate Government Solutions is a high growth Technology Services company focused on driving technological change in the government space. Our teams engage with various government agencies to develop and deploy emerging technology solutions using a tailored Agile methodology. We are seeking a highly motivated and intellectually curious Databricks Platform Engineer/Admin to join our team working with a Federal client. The position will be a remote role open to US citizens residing in the United States with a Secret security clearance.
Responsibilities:
- Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLTImplement Medallion architecture (bronze/silver/gold) for data curation and quality
- Build ingestion frameworks for structured/semi-structured/unstructured data from files, databases, APIs, and streaming sources (Kafka, Kinesis, Auto Loader)
- Design data models (dimensional or domain-specific) supporting downstream analytics
- Build and consume APIs for data integration with downstream systems
- Optimize Spark jobs for performance and cost (partitioning, caching, cluster sizing)
- Implement data quality checks and pipeline monitoring
- Document data flows and lineage for maintainability
Requirements:
- 5+ years data engineering experience, 2+ years on Databricks
- Strong PySpark and SQL for production-grade transformations
- Experience with both batch and streaming data processing
- Solid grounding in data modeling and data architecture principles
- Python proficiency and Git-based CI/CD workflow experience
- Familiarity with Unity Catalog (catalogs, schemas, grants) from a consumer perspective
- Experience with DLT or Workflows orchestration a plus 4 year Bachelor's Degree in Computer Science/Eng or related (highly preferred)
Benefits:
- Health Insurance 401k match
- Unlimited Vacation11 Federal Holidays
- Remote work
TrainingMentoring/Coaching