Databricks Pipeline Engineer
A company is looking for a Databricks Pipeline Engineer to support the design, implementation, and operation of Databricks in a government enterprise environment.
Key Responsibilities
Lead data engineering efforts within Databricks, focusing on pipeline development on AWS
Unify organizational data capabilities and standardize data migration to a unified data warehouse
Integrate Databricks with existing analytics platforms and serve as a technical advisor to stakeholders
Required Qualifications
Must be a US Citizen
Minimum 7 years of experience with Databricks and AWS in a government setting
Strong understanding of Apache Spark, Lakehouse architectures, and Delta Lake
Experience with AWS Cloud Native data and ETL capabilities
Strong Python skills and experience in Agile environments