{"schemaVersion":"jobsearcher.job.v1","id":"b77bdf231abb7cad0b909ce2","url":"https://jobsearcher.com/jobs/b77bdf231abb7cad0b909ce2","canonicalUrl":"https://jobsearcher.com/jobs/b77bdf231abb7cad0b909ce2","title":"Lead Data Engineer - IM","description":"Overview:Lead Data Engineer - IMMust Have Technical/Functional SkillsData Bricks , EBT ,Airflow , Asset Management expRoles & ResponsibilitiesLead Data Engineer - Information Management (IM)Experience8-15 YearsRole OverviewWe are looking for a highly skilled Lead Data Engineer with strong hands-on experience in Databricks, dbt, and Python, and a proven track record of leading and executing data platform migration and modernization programs. The ideal candidate will have experience migrating legacy data warehouses, ETL platforms, and cloud/on-prem data ecosystems to a modern Databricks Lakehouse architecture using dbt-based transformation frameworks. This is a hands-on leadership role requiring deep technical expertise, solution design capabilities, and the ability to mentor engineering teams while driving enterprise-scale data modernization initiatives.Key ResponsibilitiesData Engineering & DevelopmentDesign, build, and maintain scalable data pipelines using Databricks, PySpark, SQL, and Python.Develop and optimize ELT/ETL processes for large-scale data ingestion and transformation.Implement robust data quality, monitoring, and reconciliation frameworks.Build reusable data engineering components and frameworks.Data Platform Migration & ModernizationLead migration of legacy data platforms, data warehouses, and ETL ecosystems to Databricks Lakehouse.Transform existing ETL workloads to modern ELT patterns using dbt.Analyze source environments and define migration approaches, roadmap, and execution strategy.Drive code conversion, performance optimization, and workload modernization efforts.Databricks EngineeringDevelop solutions leveraging:Databricks Lakehouse PlatformDelta LakeUnity CatalogDatabricks WorkflowsStructured StreamingMedallion Architecture (Bronze, Silver, Gold)Optimize Spark jobs and Databricks workloads for performance and cost efficiency.dbt DevelopmentBuild and maintain dbt models, macros, tests, and documentation.Implement incremental processing and reusable transformation frameworks.Establish data lineage, testing, and CI/CD best practices.Work closely with business and analytics teams to build trusted datasets.Leadership & CollaborationLead a team of data engineers and developers.Perform code reviews and enforce engineering standards.Collaborate with architects, product owners, business analysts, and stakeholders.Mentor junior engineers and drive adoption of best practices.Skills:Digital : Google Data Engineering","company":"Transeu","rawCompany":"transeu","city":"Irvine","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-09-19T13:00:10.116Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer - IM","description":"Overview:Lead Data Engineer - IMMust Have Technical/Functional SkillsData Bricks , EBT ,Airflow , Asset Management expRoles & ResponsibilitiesLead Data Engineer - Information Management (IM)Experience8-15 YearsRole OverviewWe are looking for a highly skilled Lead Data Engineer with strong hands-on experience in Databricks, dbt, and Python, and a proven track record of leading and executing data platform migration and modernization programs. The ideal candidate will have experience migrating legacy data warehouses, ETL platforms, and cloud/on-prem data ecosystems to a modern Databricks Lakehouse architecture using dbt-based transformation frameworks. This is a hands-on leadership role requiring deep technical expertise, solution design capabilities, and the ability to mentor engineering teams while driving enterprise-scale data modernization initiatives.Key ResponsibilitiesData Engineering & DevelopmentDesign, build, and maintain scalable data pipelines using Databricks, PySpark, SQL, and Python.Develop and optimize ELT/ETL processes for large-scale data ingestion and transformation.Implement robust data quality, monitoring, and reconciliation frameworks.Build reusable data engineering components and frameworks.Data Platform Migration & ModernizationLead migration of legacy data platforms, data warehouses, and ETL ecosystems to Databricks Lakehouse.Transform existing ETL workloads to modern ELT patterns using dbt.Analyze source environments and define migration approaches, roadmap, and execution strategy.Drive code conversion, performance optimization, and workload modernization efforts.Databricks EngineeringDevelop solutions leveraging:Databricks Lakehouse PlatformDelta LakeUnity CatalogDatabricks WorkflowsStructured StreamingMedallion Architecture (Bronze, Silver, Gold)Optimize Spark jobs and Databricks workloads for performance and cost efficiency.dbt DevelopmentBuild and maintain dbt models, macros, tests, and documentation.Implement incremental processing and reusable transformation frameworks.Establish data lineage, testing, and CI/CD best practices.Work closely with business and analytics teams to build trusted datasets.Leadership & CollaborationLead a team of data engineers and developers.Perform code reviews and enforce engineering standards.Collaborate with architects, product owners, business analysts, and stakeholders.Mentor junior engineers and drive adoption of best practices.Skills:Digital : Google Data Engineering","datePosted":"2026-09-19T13:00:10.116Z","dateModified":"2026-09-19T13:00:10.116Z","hiringOrganization":{"@type":"Organization","name":"Transeu","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Irvine","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b77bdf231abb7cad0b909ce2"},"url":"https://jobsearcher.com/jobs/b77bdf231abb7cad0b909ce2"}}