Director of Data Engineering

Position SummaryThe Director of Data Engineering is responsible for building and operating the data engineering function within Ryan Specialty’s corporate data organization. This role is accountable for the silver and gold layer of the medallion data architecture thus transforming raw ingested data into clean, conformed, and business-ready data assets that serve as the foundation for downstream consumption. Beyond technical delivery, this role builds and scales a high-performing engineering team, establishes disciplined software development practices, and manages the contractor and external parties that augment internal capacity.An ideal candidate should be collaborative and dynamic and be able to work across the organization on a fast-paced and quickly evolving team.The Leader Will Have Five Primary Responsibilities Own and deliver the silver and gold layer of the medallion data architecture Establish and enforce a standardized software development lifecycle for all data engineering work Build, mentor, and develop a high-performing data engineering team Partner with IT on data platform infrastructure, tooling, and integrationWhat will your job entail?Own the Databricks medallion architecture from silver forward: transformation patterns, data quality enforcement, business logic application, gold-layer curation, and pipeline orchestrationEstablish and enforce a standardized SDLC that all team members must follow: version control, code review, testing, CI/CD, and documentationDesign and implement a data quality framework in partnership with the VP of Data Governance who defines it from a business perspectiveLead Master Data Management (MDM) technical implementation: entity resolution pipeline design, match-and-merge workflow configuration, golden record integration into the gold layer, and performance optimizationServe as the primary interface between the data organization and the IT data platform teamTranslate engineering requirements into platform specification across Azure and Databricks for the IT data platform team to deliverConduct structured code reviews that are explicitly developmental for data engineersBuild a library of engineering standards, patterns, and examplesOwn the technical planning for contractor-staffed project delivery podsDesign and maintain the employee and contractor onboarding processProvide ongoing technical oversight for all data engineersOwn technical compliance enforcement in the Databricks environment: data lineage tracking via Unity Catalog, access audit logs, encryption verification, and contractor access governanceHire, mentor, develop, and assess a team of data engineers and contractorsPosition QualificationsBachelor’s degree in computer science, information systems, engineering, or a related technical field7+ years in data engineering with at least 3 years in leadership or management roleProven experience owning large-scale data engineering development in a cloud-native environmentDeep expertise in Azure Databricks, including Unity Catalog, Delta Lake, Delta Live Tables, PySpark, Spark SQL, Databricks SQL, Jobs/Workflows, and cluster managementHands-on experience with data quality frameworks, including implementing quality gates, monitoring pipelines, and designing alerting systemsStrong SQL skills with experience in large-scale dimensional modeling (star schema, slowly changing dimensions, multi-source fact table design)Experience with cloud data lake architectures on Azure (ADLS Gen2, Azure Data Factory, Azure DevOps, Azure Key Vault). AWS experience is acceptable if Databricks experience is strongProficiency in Python for data engineering (PySpark, pandas, orchestration scripts, SDK integrations)Hands-on experience with CI/CD pipelines for data (Azure DevOps or equivalent); comfortable reviewing infrastructure-as-code, deployment scripts, and PR pipelinesDemonstrated ability to push back on senior stakeholders and enforce process disciplineTrack record of building and scaling data engineering teams in a high-growth environment: establishing code review norms, architecture decision record, knowledge-sharing sessions, and technology onboarding programsExperience managing contractors and external development partnersExperience in the insurance industry, particularly E&S lines preferred; or a strong willingness to learnAbility to understand and communicate with technical and business expertsUnique Skill RequirementsIntellectual curiosity with a strong drive to learnCritical thinker with an open mind to innovative solutionsHigh emotional intelligenceExceptional communication skillsStrong collaboration and relationship building skillsAbility to navigate ambiguityHighly structured in executionSkilled at simplifying complex environments*****Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time*****Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.How We Support Our TeammatesRyan Specialty seeks to offer our employees a comprehensive and best-in-class benefits package that helps them — and their family members — achieve their physical, financial, and emotional well-being goals. In addition to paid time off for company holidays, vacation, sick and personal days, Ryan offers paid parental leave, mental health services and more.The target salary range for this position is $132,000.00 - $165,000.00 annually.The wage range for this role considers many factors, such as training, transferable skills, work experience, licensure and certification, business needs, and market demands. The pay range is subject to change and may be modified in the future. Full-time roles are eligible for bonuses and benefits. For additional information on Ryan Specialty Total Rewards, visit our website https://benefits.ryansg.com/.We provide individuals with disabilities reasonable accommodations to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment in accordance with applicable law. Please contact us to request an accommodation at HR@Ryansg.comThe above is intended to describe this job's general requirements. It is not to be construed as an exhaustive statement of duties, responsibilities, or physical requirements. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.