Data Platform Engineer
Overview:
In this role you enable domain teams to own data products by administering the Databricks and Lakebase platforms, enforcing standards, and building self-serve infrastructure. You will partner with Cloud, Security, and DBA teams to maintain secure, compliant data platforms across Azure. You ensure reliable, auditable data access, governance, and CI/CD for multi-team data workloads. This position offers hands-on platform enablement at scale with a focus on HIPAA/SOC 2 compliance and healthcare data. You'll be a front door for domain teams from kickoff to daily unblocking, shaping how Lantern delivers data-driven care. Compensation / Benefits Medical Insurance Dental Insurance Vision Insurance Short & Long Term Disability Life Insurance 401k with company match
Responsibilities:
- Administer Azure Databricks and Unity Catalog according to architecture standards
- Develop self-serve provisioning workflows and templates for domain teams
- Act as DBA for Lakebase Postgres estates: provisioning, tuning, backups, and recovery
- Implement IaC (Terraform) for Azure resources and security primitives
- Enforce access governance: Unity Catalog, ABAC, RLS, masking, and RBACBuild audit, lineage, and event-sourced logging for governance
- Operate platform observability (Datadog, metrics/logs, SLOs)
- Manage CI/CD pipelines for data workloads and DBT/Databricks assets
- Collaborate with Cloud Platform, Azure SQL DBA, and Security teams
- Escalate and unblock domain engineers on policies, performance, and CI steps
- Produce KPI reporting and contribute to platform roadmap
- Document reusable patterns for knowledge base
Key requirements:
- 4+ years in platform or infrastructure engineering supporting data/analytics
- Deep hands-on Databricks experience (workspace, Unity Catalog, Delta Lake)
- Azure expertise (Entra ID, networking, Key Vault, IaC via Terraform/Bicep)
- PostgreSQL administration experience (Lakebase: backups, tuning, HA/DR)
- Identity and access architecture experience (OBO, service principals)CI/CD pipelines with GitHub Actions and/or Azure DevOpsPython or scripting for automation
- Experience with AI tools to accelerate engineering work
- Regulated environment experience (HIPAA/SOC 2)
- Comfort with elevated privileges in PHI environments and appropriate escalation
- Ability to enforce standards via automation rather than authority
- Strong problem-solving and cross-functional collaborationstrong communicationcollaborationproblem-solving under incident pressure
- Databricks (workspace, Unity Catalog, Delta Lake)
- Azure (Entra ID, Key Vault, networking)
- Terraform/Bicep IaC