Data Platform Engineer (Databricks)
Overview
In this contract role, you will design and enhance platform capabilities that enable rapid, reliable data access for quantitative researchers. You’ll build reusable data products and self-service data access, connecting research with production via scalable patterns. You’ll work across Databricks-centric platforms to improve data quality, lineage, and observability, accelerating research-to-production delivery while reducing friction between researchers and engineers.
ResponsibilitiesDesign, build, and enhance platform capabilities within Databricks and related technologiesBuild reusable data products and self-service capabilitiesDesign and maintain data pipelines and integration frameworksImprove data quality, reliability, lineage, and monitoringAccelerate research-to-production delivery: prototype solutions with researchers; establish productionization patterns
Key requirements8+ years of platform and data solutions experienceHands-on Databricks experience (workspace, notebooks, jobs) and building platform capabilitiesPythonSQLModern CI/CD, IaC (Terraform strongly preferred)Data Governance and observability (Unity Catalog, lineage, monitoring)Orchestration (Airflow)AI fluency: use of AI agents (Claude Code preferred) as a primary tool to design, build, test, and support solutionsDatabricks platform capabilitiesPythonSQLCI/CDTerraform (IaC)Data governance and observability (Unity Catalog, lineage, monitoring)