{"schemaVersion":"jobsearcher.job.v1","id":"c25e52c06a923a7efc8e3b4e","url":"https://jobsearcher.com/jobs/c25e52c06a923a7efc8e3b4e","canonicalUrl":"https://jobsearcher.com/jobs/c25e52c06a923a7efc8e3b4e","title":"Director, Data Engineering","description":"We are looking for a Director, Data Engineering, to lead the continued optimization and maturation of our existing large-scale data platform. This is hands-on technical leadership role: roughly 60% of your time will be spent as a working solution architect – improving, rearchitecting, and scaling data pipelines, infrastructure, and models that power the business. The remaining 40% will be focused on strategic alignment, technical direction, and resource management for the Data Engineering team. A key part of the mandate is ensuring the platform remains AI/ML ready as it scales – well modeled and well governed so that advanced analytics teams can reliably and efficiently access high-quality data.\n\nReporting to the VP-Data Engineering, AI & ML, you will lead a team of Data Engineers – setting the technical execution direction while staying close enough to the architecture and code to guide hard decision, unblock the team, and ensure the platform continues to scale reliably and security as usage and AI/ML initiatives grow.\n\nApplicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over work authorization sponsorship now or in the future for this position.\n\nKey Accountabilities/Deliverables:\n\nSolution Architecture & Hands-On Delivery\n\nOwn the technical evolution of our existing large-scale data platform, identifying and riving improvements to architecture, performance and scalability data volume and complexity use cases grow\n\nAct as the lead solution architect for data engineering initiatives\n\nPersonally design, prototype, and development of frameworks and critical platform components – especially for high-risk/high complexity initiatives\n\nHave a forward-thinking posture as it comes to creating an AI/ML ready data platform\n\nParticipate in the evaluation, selection and implementation of data platform tooling (i.e. – storage, orchestration, compute, streaming)\n\nReinforce existing data observability solutions/standards across pipelines and the platform\n\nDiagnose and resolve complex production issues/technical debt across the data platform – partnering directly with other engineers to resolve.\n\nStrategy, Technical Direction & Resource Management\n\nPartner with VP-Data Engineering, AI & ML to define and execute the roadmap for a fully optimized and scalable data platform – ensuring alignment to broader company and data strategies including AI/ML readiness assessments\n\nSet technical direction and architectural standards for the team by working closely with Enterprise Architecture\n\nManage, mentor, and develop data engineers\n\nParticipate in resource planning and prioritization across the team’s product roadmap – balancing business requests with platform-based initiatives\n\nRepresent Data Engineering planning, budgeting, and resource management discussions as needed\n\nStay current with emerging trends in data engineering and data platform architecture – brining innovations into continued data maturity for the organization.\n\nTechnical Knowledge and Understanding:\n\nTechnical Knowledge\n\nDeep expertise in data pipeline design, optimization, and distributed data processing architectures with experience identifying and resolving performance and scalability bottlenecks\n\nPlatforms: Hands on experience with Snowflake or Databricks (experience in an architecture role with these platforms is a plus), Azure Synapse Analytics/MS Fabric\n\nStrong knowledge of cloud data platforms (AWS, Azure, or GCP) and modern data warehouse/Lakehouse architectures (Delta Lake, Iceberg)\n\nWorking familiarity with AI/ML data requirements and tooling to support AI/ML enablement\n\nStrong working proficiency with at least two programming languages (Python, Scala, SQL)\n\nSolid understanding of data governance, security, and compliance practices in a regulated or enterprise environment\n\nExperience with IAC and CI/CD practices for data systems (i.e. Terraform, GitHub Actions)\n\nLeadership & Soft Skills\n\nProven ability to set technical direction while remaining hands-on and credible at the architecture and code level\n\nStrong stakeholder management skills – the ability to translate between technical and non-technical audiences\n\nExcellent prioritization and resource management skills across competing technical and business demands\n\nA coaching mindset with genuine investment in growing the technical and soft skills of direct reports\n\nRequirements:\n\nBachelor Degree in Computer Science or related field or equivalent work experience.\n\n10+ years experience in data engineering with significant experience in optimizing, scaling, and evolving large-scale mature data platforms\n\n3+ years in an architect role (Solution, Enterprise, Data, Platform) with direct ownership of solution designs\n\n3+ years in a leadership role managing data engineering teams – including direct people management responsibilities\n\nWorking knowledge of how data platforms enable AI/ML solutions\n\nTrack record of balancing hands-on technical delivery with people leadership and strategic planning\n\nNice to Have\n\nExperience designing or implementing Agentic workflows for data engineering\n\nExperience working with Property & Casualty insurance carriers\n\nExperience with Data Vault 2.0 or Ensemble data modeling techniques\n\n#LI-Hybrid\n\n-\n\nAt Core Specialty, you will receive a competitive salary and opportunities for professional development and advancement. We offer medical, dental, vision, and life insurances; short and long-term disability; a Company-match of 100% of a 6% contribution 401(k) plan; an Employee Assistance Plan; Health Savings Account, Flexible Spending Account, Health Reimbursement Account, and a wellness program","company":"Core Specialty","rawCompany":"core specialty","city":"Dayton","state":"OH","isRemote":false,"isActive":false,"createdAt":"2026-08-24T09:15:48.491Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Director, Data Engineering","description":"We are looking for a Director, Data Engineering, to lead the continued optimization and maturation of our existing large-scale data platform. This is hands-on technical leadership role: roughly 60% of your time will be spent as a working solution architect – improving, rearchitecting, and scaling data pipelines, infrastructure, and models that power the business. The remaining 40% will be focused on strategic alignment, technical direction, and resource management for the Data Engineering team. A key part of the mandate is ensuring the platform remains AI/ML ready as it scales – well modeled and well governed so that advanced analytics teams can reliably and efficiently access high-quality data.\n\nReporting to the VP-Data Engineering, AI & ML, you will lead a team of Data Engineers – setting the technical execution direction while staying close enough to the architecture and code to guide hard decision, unblock the team, and ensure the platform continues to scale reliably and security as usage and AI/ML initiatives grow.\n\nApplicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over work authorization sponsorship now or in the future for this position.\n\nKey Accountabilities/Deliverables:\n\nSolution Architecture & Hands-On Delivery\n\nOwn the technical evolution of our existing large-scale data platform, identifying and riving improvements to architecture, performance and scalability data volume and complexity use cases grow\n\nAct as the lead solution architect for data engineering initiatives\n\nPersonally design, prototype, and development of frameworks and critical platform components – especially for high-risk/high complexity initiatives\n\nHave a forward-thinking posture as it comes to creating an AI/ML ready data platform\n\nParticipate in the evaluation, selection and implementation of data platform tooling (i.e. – storage, orchestration, compute, streaming)\n\nReinforce existing data observability solutions/standards across pipelines and the platform\n\nDiagnose and resolve complex production issues/technical debt across the data platform – partnering directly with other engineers to resolve.\n\nStrategy, Technical Direction & Resource Management\n\nPartner with VP-Data Engineering, AI & ML to define and execute the roadmap for a fully optimized and scalable data platform – ensuring alignment to broader company and data strategies including AI/ML readiness assessments\n\nSet technical direction and architectural standards for the team by working closely with Enterprise Architecture\n\nManage, mentor, and develop data engineers\n\nParticipate in resource planning and prioritization across the team’s product roadmap – balancing business requests with platform-based initiatives\n\nRepresent Data Engineering planning, budgeting, and resource management discussions as needed\n\nStay current with emerging trends in data engineering and data platform architecture – brining innovations into continued data maturity for the organization.\n\nTechnical Knowledge and Understanding:\n\nTechnical Knowledge\n\nDeep expertise in data pipeline design, optimization, and distributed data processing architectures with experience identifying and resolving performance and scalability bottlenecks\n\nPlatforms: Hands on experience with Snowflake or Databricks (experience in an architecture role with these platforms is a plus), Azure Synapse Analytics/MS Fabric\n\nStrong knowledge of cloud data platforms (AWS, Azure, or GCP) and modern data warehouse/Lakehouse architectures (Delta Lake, Iceberg)\n\nWorking familiarity with AI/ML data requirements and tooling to support AI/ML enablement\n\nStrong working proficiency with at least two programming languages (Python, Scala, SQL)\n\nSolid understanding of data governance, security, and compliance practices in a regulated or enterprise environment\n\nExperience with IAC and CI/CD practices for data systems (i.e. Terraform, GitHub Actions)\n\nLeadership & Soft Skills\n\nProven ability to set technical direction while remaining hands-on and credible at the architecture and code level\n\nStrong stakeholder management skills – the ability to translate between technical and non-technical audiences\n\nExcellent prioritization and resource management skills across competing technical and business demands\n\nA coaching mindset with genuine investment in growing the technical and soft skills of direct reports\n\nRequirements:\n\nBachelor Degree in Computer Science or related field or equivalent work experience.\n\n10+ years experience in data engineering with significant experience in optimizing, scaling, and evolving large-scale mature data platforms\n\n3+ years in an architect role (Solution, Enterprise, Data, Platform) with direct ownership of solution designs\n\n3+ years in a leadership role managing data engineering teams – including direct people management responsibilities\n\nWorking knowledge of how data platforms enable AI/ML solutions\n\nTrack record of balancing hands-on technical delivery with people leadership and strategic planning\n\nNice to Have\n\nExperience designing or implementing Agentic workflows for data engineering\n\nExperience working with Property & Casualty insurance carriers\n\nExperience with Data Vault 2.0 or Ensemble data modeling techniques\n\n#LI-Hybrid\n\n-\n\nAt Core Specialty, you will receive a competitive salary and opportunities for professional development and advancement. We offer medical, dental, vision, and life insurances; short and long-term disability; a Company-match of 100% of a 6% contribution 401(k) plan; an Employee Assistance Plan; Health Savings Account, Flexible Spending Account, Health Reimbursement Account, and a wellness program","datePosted":"2026-08-24T09:15:48.491Z","dateModified":"2026-08-24T09:15:48.491Z","hiringOrganization":{"@type":"Organization","name":"Core Specialty","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Dayton","addressRegion":"OH","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"c25e52c06a923a7efc8e3b4e"},"url":"https://jobsearcher.com/jobs/c25e52c06a923a7efc8e3b4e"}}