Databricks Pipeline Engineer

ECS is seeking a Databricks Pipeline Engineer to work remotely. Please Note: This position is contingent upon additional funding.ECS is seeking a Databricks Pipeline Engineer to support the design, implementation, and long-term operation of Databricks within a complex Government enterprise environment. This role will work closely with various stakeholders during initial implementation and will support with data engineering projects as Databricks is rolled out within the environment.The ideal candidate will bring strong Databricks and AWS experience, familiarity with architecting solutions for scale and governance, and is comfortable integrating Databricks with other data platforms.Key responsibilities include:Lead data engineering efforts within Databricks to include pipeline development within Databricks on AWS in an enterprise environmentProvide unification for organization and enterprise data capabilities to break down organizational data and operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouseSupport the integration of Databricks with existing analytics platforms and metadata solutionsServe as a technical advisor to stakeholders and help upskill internal teams through guidance/documentationAssist and develop customer use case applications of DatabricksSalary Range: $150,000 - $180,000General Description of BenefitsMust be a US CitizenAbility to successfully maintain a DHS Entry on Duty (EOD)/Public TrustMinimum 7 years of hands-on experience architecting, designing, data engineering with Databricks and AWS in a government setting.Strong understanding and experience in areas such as Apache Spark, Lakebase, Lakehouse architectures, Delta Lake, Delta Sharing, Medallion Architecture, Data & AI Governance, and use case acceleration.Demonstrated hands-on experience with AWS Cloud Native data and ETL capabilities (S3, Lambdas, Glue, etc.)Demonstrated experience leveraging data to provide search, enrichment, correlation, AI/ML Model Training, in alignment with government mission and business use casesExperience integrating Databricks with other analytics platforms.Prior consulting or customer-facing experience in data architecture or modernization initiatives.Strong Python skills.Experience in Agile environments and managing cross-functional technical delivery.