{"schemaVersion":"jobsearcher.job.v1","id":"ca120e2bddc9f8d268503e4a","url":"https://jobsearcher.com/jobs/ca120e2bddc9f8d268503e4a","canonicalUrl":"https://jobsearcher.com/jobs/ca120e2bddc9f8d268503e4a","title":"Data Engineer Lakehouse","description":"About the roleAugmented is hiring a Data Engineer to build and run a modern lakehouse platform for one of our large enterprise clients in a regulated industry. You will design reliable batch and streaming pipelines, model data for analytics and AI use cases, and help retire legacy warehouse workloads.You will join a small, senior delivery team that works directly with client stakeholders. The work spans greenfield builds and migrations, with a strong focus on data quality, governance and cost.Key responsibilitiesDesign and build lakehouse pipelines using a medallion (bronze/silver/gold) architecture on Delta Lake or Apache IcebergDevelop batch and streaming ingestion from databases, APIs, files and event streams (CDC, Kafka)Write production-grade PySpark and SQL transformations; tune Spark jobs for performance and costModel curated data sets (dimensional, Data Vault or wide tables) for BI, analytics and ML teamsImplement data quality checks, lineage and observability; own pipeline SLAs and incident responseApply governance and security controls: Unity Catalog or equivalent, row/column-level access, PII handlingMigrate legacy warehouse and ETL workloads (e.g. Teradata, Oracle, SSIS, Informatica) to the lakehouseBuild CI/CD for data code and infrastructure-as-code for platform resourcesPartner with client architects, analysts and data scientists; document designs and decisionsRequired qualifications4+ years in data engineering, with 2+ years on a lakehouse platform (Databricks, or Spark with Delta Lake/Iceberg)Strong Python (PySpark) and advanced SQLHands-on with at least one major cloud: Azure, AWS or GCP (storage, compute, IAM, networking basics)Experience with orchestration such as Databricks Workflows, Airflow or Azure Data FactorySolid grasp of data modelling, partitioning, file formats (Parquet) and Spark performance tuningGit-based workflows and CI/CD (GitHub Actions, Azure DevOps or GitLab)Clear communicator, comfortable working directly with enterprise client teamsLegally entitled to work in the USNice to haveDatabricks Certified Data Engineer (Associate or Professional), or equivalent cloud data certificationdbt, Delta Live Tables / Lakeflow, or Spark Structured Streaming in productionTerraform or Bicep for platform provisioningExperience in Life Sciences (GxP, clinical or commercial data) or Financial Services (risk, payments, regulatory reporting)Exposure to feature stores, vector search or data products for AI/MLConsulting or client-facing delivery backgroundTech stack• Platform: Databricks (Unity Catalog), Delta Lake / Apache Iceberg• Languages: Python (PySpark), SQL• Cloud: Azure (ADLS Gen2) or AWS (S3)• Ingestion & streaming: Kafka / Event Hubs, CDC tools, Auto Loader• Orchestration: Databricks Workflows, Airflow, Azure Data Factory• Transformation: Spark, dbt, Delta Live Tables• DevOps: Git, CI/CD pipelines, Terraform• Consumption: Power BI, Tableau, Databricks SQLWhy AugmentedAugmented is an AI-native engineering delivery hub serving large enterprises in Life Sciences, Legal and Fintech, with teams in Toronto and the US.Work on high-impact data platforms for enterprise clientsSmall, senior teams with direct access to client decision-makersExposure to AI-native delivery practices and modern tooling","company":"Augmented","rawCompany":"augmented","city":"Chicago","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-10-28T09:38:03.708Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer Lakehouse","description":"About the roleAugmented is hiring a Data Engineer to build and run a modern lakehouse platform for one of our large enterprise clients in a regulated industry. You will design reliable batch and streaming pipelines, model data for analytics and AI use cases, and help retire legacy warehouse workloads.You will join a small, senior delivery team that works directly with client stakeholders. The work spans greenfield builds and migrations, with a strong focus on data quality, governance and cost.Key responsibilitiesDesign and build lakehouse pipelines using a medallion (bronze/silver/gold) architecture on Delta Lake or Apache IcebergDevelop batch and streaming ingestion from databases, APIs, files and event streams (CDC, Kafka)Write production-grade PySpark and SQL transformations; tune Spark jobs for performance and costModel curated data sets (dimensional, Data Vault or wide tables) for BI, analytics and ML teamsImplement data quality checks, lineage and observability; own pipeline SLAs and incident responseApply governance and security controls: Unity Catalog or equivalent, row/column-level access, PII handlingMigrate legacy warehouse and ETL workloads (e.g. Teradata, Oracle, SSIS, Informatica) to the lakehouseBuild CI/CD for data code and infrastructure-as-code for platform resourcesPartner with client architects, analysts and data scientists; document designs and decisionsRequired qualifications4+ years in data engineering, with 2+ years on a lakehouse platform (Databricks, or Spark with Delta Lake/Iceberg)Strong Python (PySpark) and advanced SQLHands-on with at least one major cloud: Azure, AWS or GCP (storage, compute, IAM, networking basics)Experience with orchestration such as Databricks Workflows, Airflow or Azure Data FactorySolid grasp of data modelling, partitioning, file formats (Parquet) and Spark performance tuningGit-based workflows and CI/CD (GitHub Actions, Azure DevOps or GitLab)Clear communicator, comfortable working directly with enterprise client teamsLegally entitled to work in the USNice to haveDatabricks Certified Data Engineer (Associate or Professional), or equivalent cloud data certificationdbt, Delta Live Tables / Lakeflow, or Spark Structured Streaming in productionTerraform or Bicep for platform provisioningExperience in Life Sciences (GxP, clinical or commercial data) or Financial Services (risk, payments, regulatory reporting)Exposure to feature stores, vector search or data products for AI/MLConsulting or client-facing delivery backgroundTech stack• Platform: Databricks (Unity Catalog), Delta Lake / Apache Iceberg• Languages: Python (PySpark), SQL• Cloud: Azure (ADLS Gen2) or AWS (S3)• Ingestion & streaming: Kafka / Event Hubs, CDC tools, Auto Loader• Orchestration: Databricks Workflows, Airflow, Azure Data Factory• Transformation: Spark, dbt, Delta Live Tables• DevOps: Git, CI/CD pipelines, Terraform• Consumption: Power BI, Tableau, Databricks SQLWhy AugmentedAugmented is an AI-native engineering delivery hub serving large enterprises in Life Sciences, Legal and Fintech, with teams in Toronto and the US.Work on high-impact data platforms for enterprise clientsSmall, senior teams with direct access to client decision-makersExposure to AI-native delivery practices and modern tooling","datePosted":"2026-10-28T09:38:03.708Z","dateModified":"2026-10-28T09:38:03.708Z","hiringOrganization":{"@type":"Organization","name":"Augmented","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Chicago","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"ca120e2bddc9f8d268503e4a"},"url":"https://jobsearcher.com/jobs/ca120e2bddc9f8d268503e4a"}}