Databricks Platform Engineer/Admin
Senior Databricks Platform Engineer / Administrator This is a remote position.
Location:
Remote – United States Security Clearance: Active Secret or higher REQUIRED Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Senior Databricks Platform Engineer / Administrator to help design, deploy, govern, and support enterprise Databricks environments for a federal client. Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered. The ideal candidate will bring deep hands-on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.
Responsibilities:
- Deploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
- Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
- Design and implement supporting AWS networking architecture, including VPCs, subnets, Private
- Link, Transit Gateway, security groups, and DNS.Manage Databricks control-plane and data-plane connectivity.
- Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
- Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
- Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
- Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
- Monitor platform health, utilization, performance, and cost. Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
- Serve as an escalation point for platform incidents, troubleshooting, and root-cause analysis.
- Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.
Requirements:
Active Secret security clearance or higher is required.
U.S. citizenship required.6+ years of experience engineering, administering, or supporting Databricks platforms.
Strong hands-on experience with Databricks in AWS environments.
Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
Strong knowledge of Databricks Secure Reference Architecture.
Hands-on Unity Catalog administration experience.
Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
Strong understanding of CI/CD practices and infrastructure-as-code methodologies.
Python proficiency.
Linux systems administration experience.
Hands-on experience with AWS services including: VPC IAM S3 KMS EC2 CloudWatch.
Strong troubleshooting and root-cause analysis capabilities.
Strong communication skills with the ability to advise stakeholders on technical and platform decisions.
Preferred Qualifications:
AWS GovCloud experience.
Experience working within regulated, security-sensitive, or compliance-heavy environments.
Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.