Senior Data Engineer (Regulatory and Compliance Reporting Engineer)

Senior Data Engineer (Regulatory and Compliance Reporting Engineer) Columbia, TNJob Summary:We are seeking an experienced Data Engineer to design, develop, and maintain data pipelines that extract transactional insurance data from on-premises Guidewire and legacy systems and deliver to regulatory bodies for compliance. The role requires someone who can work with Guidewire’s complex relational schemas and the external insurance ecosystem, ensuring accurate and timely data delivery to regulatory bodies, risk aggregators, and specialized reinsurers. Key Responsibilities:Design and automate complex downstream extracts like Bordereaux for Hartford Steam Boiler (HSB), CLUE, Current carrier, Verisk and other Insurance services offices.Develop and maintain Third Party mandatory industry reports for Verisk, LexisNexis (C.L.U.E) and Current Carrier.Develop and maintain Premium/loss and claims datasets, ensuring they reconcile with General ledger (GL).Develop and maintain the logic to calculate Written, Earned, and Unearned Premium (UEP) at the transaction level, accounting for mid-term endorsements and cancellations.Develop Extracts to match XML/JSON transformation, SFTP automation, and API-based data delivery. Develop and maintain data pipelines, ETL/ELT processes, and data integration workflows using Azure Data Factory (ADF), Databricks, and Storage Accounts.Provide technical leadership, mentoring, and guidance to team members while contributing as an independent contributor.Work in Agile development environments, participating in sprint planning, stand-ups, and retrospectives.Ensure data quality, governance, and security standards are maintained across all platforms. Required Qualifications:10+ years of professional experience in data engineering, data warehouse development, or related roles.Knowledge of Datahub/Info Center is highly preferredExperienced in developing complex extracts from Guidewire Policy center and billing center to Support Outbound Extracts for industry partners, ensuring compliance with proprietary file formats and transmission protocolsInsurance industry experience, specifically with policies, quotes, claims, or related domains.Strong understanding of P&C insurance lifecycles (submissions, renewals, FNOL, subrogation).Strong Hands-on experience with Azure Data Stack:ADF (pipelines, orchestration, data flows)Storage AccountsKey VaultsHands-on experience with Snowflake (SnowSQL, Snowpark, Snow pipe, Streams & Tasks, Dynamic Tables, Cortex AI).Experience in Agile development environments.Ability to work independently while providing leadership to projects and teams.Willingness to relocate or travel as required.