{"schemaVersion":"jobsearcher.job.v1","id":"4c5ff3da7733e503ad0aecdf","url":"https://jobsearcher.com/jobs/4c5ff3da7733e503ad0aecdf","canonicalUrl":"https://jobsearcher.com/jobs/4c5ff3da7733e503ad0aecdf","title":"Data Engineering Lead","description":"Builders is committed to reliability, fairness, and customer-first service, earning an A rating by AM Best and recognition through Top Workplaces “Culture Excellence” honors. This role supports an insurance business built on strong partnerships and mutual respect, with an onsite opportunity in Atlanta, GA to lead a platform that helps teams modernize and govern data for property and casualty insurance.\r\nAs the technical owner of the Azure Databricks lakehouse platform, you will drive architecture, modernization, governance alignment, and engineering leadership to deliver a scalable, secure, reliable, high-performing foundation for property and casualty data.\r\nWhat you’ll doDesign theDatabricks lakehouse architectureusing abronze/silver/goldapproach onDelta Lakefor policy, rating, claims, billing, reinsurance, and customer data.\r\nPlan and lead phased migration fromGuidewire(PolicyCenter, ClaimCenter, BillingCenter) and legacy systems into Azure Databricks, includinghistorical loads ,incremental/CDCloads,reconciliation , anddecommissioning support .\r\nModel core property and casualty insurance entities:accounts ,policies ,insured risks and exposures ,coverages ,endorsements ,premiums ,claims ,reserves ,payments , andrecoveries .\r\nProvide data forActuarial and Financeuse cases includingwritten/earned/unearned premium ,loss triangles ,IBNR(incurred but not reported) inputs,loss ratios , andSchedule P and NAICstatutory reporting.\r\nIntegratethird-partysources such asgeospatialandweatherdata.\r\nDefine and operationalizeUnity Catalogdesign:metastore ,catalogs ,schemas ,development/test/production environments , naming conventions,permissions ,row/column-level security , andlineage .\r\nManagepipeline orchestration and operationsin Databricks, includingDatabricks Workflows(Lakeflow Jobs), scheduling, dependencies,retries ,alerting and SLA monitoring , and productionfailure handlingwithrunbooks .\r\nOwnperformance and costwork:Spark tuning ,partitioning ,liquid clustering ,Photon , andcluster/SQL warehouse sizing .\r\nPartner with IT and a Platform Engineer on infrastructure forstorage ,networking ,security ,identity ,IaC , andCI/CD .\r\nSet standards for pipelines,testing ,code review , anddocumentation , and lead mentoring and review for Data Engineers and junior contractors.\r\nCollaborate with thedata governance leadto implement access controls,PII masking ,lineage , anddata quality rules .\r\nPerform other duties as assigned.\r\nWhat you bringAssociate degreeor an equivalent combination of education and experience.\r\n10+ yearsof data engineering experience, including6+ years hands-onwithDatabricks(PySpark, Spark SQL, Delta Lake), plus experience leading or mentoring engineering teams.\r\nDatabricks Data Engineer Professionalcertification;Azure data or solutions architectcertification is preferred.\r\nStrong knowledge ofUnity Catalog : governance model, permissions, row/column-level security, lineage, and system tables.\r\nExperience leadinglarge data migrationsfrom core insurance and legacy systems into a lakehouse or data warehouse, with property and casualty domain knowledge and familiarity with the policy and claims lifecycle and core P&C KPIs.\r\nKnowledge ofdata modelingincluding dimensional modeling, data vault, SCD patterns, and insurance data models.\r\nExpert technical skills acrossSparkinternals and performance tuning,streaming(structured streaming, Auto Loader),CDCpatterns,MERGE , andLakeflow/Delta Live Tables .\r\nExpert-levelSQLandPython , with software engineering practices such as testing, code review, and modular design.\r\nKnowledge of data infrastructure:ADLS Gen2 ,Azure Data Factory ,Event Hubs ,Key Vault ,Entra ID ,VNets , andPrivate Link .\r\nExperience scheduling and monitoring production pipelines withDatabricks Workflowsand/orAzure Data Factory , including dependencies, parameterization, and monitoring with Databricks system tables.\r\nExperience withGit -based version control (GitHub or Bitbucket), including branching strategies, pull request reviews, and Databricks Git folders.\r\nInfrastructure-as-code and CI/CD for data usingTerraform ,Databricks Asset Bundles ,Azure DevOps ,GitHub Actions , orBitbucket Pipelines .\r\nExperience withGuidewire data(Guidewire DataHub/InfoCenter, Cloud Data Access) is preferred, including supporting actuarial reserving and pricing; API and integration tools such asMuleSoftare preferred.\r\nKnowledge of insurance data standards such asACORDis preferred.\r\nBenefits at BuildersCompetitive Salary\r\nBonus Structure\r\nProfit Sharing\r\nMedical, Dental, Vision Insurance\r\nEmployer Paid Short Term Disability\r\nEmployer Paid Long Term Disability\r\nEmployer Paid Life Insurance\r\nVoluntary Life Insurance\r\n401K with Company Match\r\nPTO\r\nEqual OpportunityBuilders Insurance Group is an equal opportunity employer. Applicants are welcomed from all walks of life, and the company does not discriminate based on any protected status. This is part of building a diverse and inclusive workplace.#J-18808-Ljbffr","company":"Builders","rawCompany":"builders","city":"Atlanta","state":"GA","isRemote":false,"isActive":false,"createdAt":"2026-11-04T02:44:34.776Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"11-3021.00","title":"Computer and Information Systems Managers","slug":"computer-and-information-systems-managers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"524298","title":"All Other Insurance Related Activities","slug":"all-other-insurance-related-activities"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineering Lead","description":"Builders is committed to reliability, fairness, and customer-first service, earning an A rating by AM Best and recognition through Top Workplaces “Culture Excellence” honors. This role supports an insurance business built on strong partnerships and mutual respect, with an onsite opportunity in Atlanta, GA to lead a platform that helps teams modernize and govern data for property and casualty insurance.\r\nAs the technical owner of the Azure Databricks lakehouse platform, you will drive architecture, modernization, governance alignment, and engineering leadership to deliver a scalable, secure, reliable, high-performing foundation for property and casualty data.\r\nWhat you’ll doDesign theDatabricks lakehouse architectureusing abronze/silver/goldapproach onDelta Lakefor policy, rating, claims, billing, reinsurance, and customer data.\r\nPlan and lead phased migration fromGuidewire(PolicyCenter, ClaimCenter, BillingCenter) and legacy systems into Azure Databricks, includinghistorical loads ,incremental/CDCloads,reconciliation , anddecommissioning support .\r\nModel core property and casualty insurance entities:accounts ,policies ,insured risks and exposures ,coverages ,endorsements ,premiums ,claims ,reserves ,payments , andrecoveries .\r\nProvide data forActuarial and Financeuse cases includingwritten/earned/unearned premium ,loss triangles ,IBNR(incurred but not reported) inputs,loss ratios , andSchedule P and NAICstatutory reporting.\r\nIntegratethird-partysources such asgeospatialandweatherdata.\r\nDefine and operationalizeUnity Catalogdesign:metastore ,catalogs ,schemas ,development/test/production environments , naming conventions,permissions ,row/column-level security , andlineage .\r\nManagepipeline orchestration and operationsin Databricks, includingDatabricks Workflows(Lakeflow Jobs), scheduling, dependencies,retries ,alerting and SLA monitoring , and productionfailure handlingwithrunbooks .\r\nOwnperformance and costwork:Spark tuning ,partitioning ,liquid clustering ,Photon , andcluster/SQL warehouse sizing .\r\nPartner with IT and a Platform Engineer on infrastructure forstorage ,networking ,security ,identity ,IaC , andCI/CD .\r\nSet standards for pipelines,testing ,code review , anddocumentation , and lead mentoring and review for Data Engineers and junior contractors.\r\nCollaborate with thedata governance leadto implement access controls,PII masking ,lineage , anddata quality rules .\r\nPerform other duties as assigned.\r\nWhat you bringAssociate degreeor an equivalent combination of education and experience.\r\n10+ yearsof data engineering experience, including6+ years hands-onwithDatabricks(PySpark, Spark SQL, Delta Lake), plus experience leading or mentoring engineering teams.\r\nDatabricks Data Engineer Professionalcertification;Azure data or solutions architectcertification is preferred.\r\nStrong knowledge ofUnity Catalog : governance model, permissions, row/column-level security, lineage, and system tables.\r\nExperience leadinglarge data migrationsfrom core insurance and legacy systems into a lakehouse or data warehouse, with property and casualty domain knowledge and familiarity with the policy and claims lifecycle and core P&C KPIs.\r\nKnowledge ofdata modelingincluding dimensional modeling, data vault, SCD patterns, and insurance data models.\r\nExpert technical skills acrossSparkinternals and performance tuning,streaming(structured streaming, Auto Loader),CDCpatterns,MERGE , andLakeflow/Delta Live Tables .\r\nExpert-levelSQLandPython , with software engineering practices such as testing, code review, and modular design.\r\nKnowledge of data infrastructure:ADLS Gen2 ,Azure Data Factory ,Event Hubs ,Key Vault ,Entra ID ,VNets , andPrivate Link .\r\nExperience scheduling and monitoring production pipelines withDatabricks Workflowsand/orAzure Data Factory , including dependencies, parameterization, and monitoring with Databricks system tables.\r\nExperience withGit -based version control (GitHub or Bitbucket), including branching strategies, pull request reviews, and Databricks Git folders.\r\nInfrastructure-as-code and CI/CD for data usingTerraform ,Databricks Asset Bundles ,Azure DevOps ,GitHub Actions , orBitbucket Pipelines .\r\nExperience withGuidewire data(Guidewire DataHub/InfoCenter, Cloud Data Access) is preferred, including supporting actuarial reserving and pricing; API and integration tools such asMuleSoftare preferred.\r\nKnowledge of insurance data standards such asACORDis preferred.\r\nBenefits at BuildersCompetitive Salary\r\nBonus Structure\r\nProfit Sharing\r\nMedical, Dental, Vision Insurance\r\nEmployer Paid Short Term Disability\r\nEmployer Paid Long Term Disability\r\nEmployer Paid Life Insurance\r\nVoluntary Life Insurance\r\n401K with Company Match\r\nPTO\r\nEqual OpportunityBuilders Insurance Group is an equal opportunity employer. Applicants are welcomed from all walks of life, and the company does not discriminate based on any protected status. This is part of building a diverse and inclusive workplace.#J-18808-Ljbffr","datePosted":"2026-11-04T02:44:34.776Z","dateModified":"2026-11-04T02:44:34.776Z","hiringOrganization":{"@type":"Organization","name":"Builders","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Atlanta","addressRegion":"GA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"4c5ff3da7733e503ad0aecdf"},"url":"https://jobsearcher.com/jobs/4c5ff3da7733e503ad0aecdf"}}