Senior Data Engineer

PRISM is a joint powers authority (JPA) that provides risk management and insurance solutions for public entities throughout California. Our organization is member driven meaning that our public entity members have numerous opportunities available to participate in the governance of our JPA.One of PRISM’s greatest assets is its staff. PRISM employees are smart, creative, hard-working, and passionate individuals working in areas ranging from member services, risk control, claims administration, information technology, accounting, and risk pool administration. Working here requires energy, commitment, and teamwork. At the same time, we offer a great work environment built upon our Core Values of People, Families, Trust, Integrity, and Growth. We are looking for an individual who shares these values to join the PRISM team.We are seeking a Senior Data Engineer to play a central role in our data platform modernization. This is a hands-on technical position focused on migrating our on-premises MS SQL Server environment and Qlik reporting layer into Microsoft Fabric (Fabric Lakehouse, Data Factory, and Data Warehouse) with Power BI as our reporting layer. You will design and build robust data pipelines, establish solid data modeling standards, and help set the engineering foundation that the team will scale on for years to come.This role also carries a mentorship responsibility — you will collaborate with others in the Data & Analytics team who are earlier in their Fabric journey, conduct code reviews, and help grow the team's collective capability on the new platform.Job ResponsibilitiesMigration & Platform EngineeringContribute to the technical migration from MS SQL Server (on-prem) and Qlik to Microsoft Fabric and Power BIDesign and implement data pipelines using Fabric Data Factory (pipelines and dataflows) and Fabric Notebooks, leveraging Python and Spark SQL for complex transformations and business logicBuild and maintain Lakehouse architecture on OneLake, including medallion layer design (Bronze / Silver / Gold)Develop and optimize data models in Fabric Data Warehouse and/or Fabric LakehouseWrite performant transformation logic using Python, Spark SQL, and T-SQLData Modeling & ArchitectureDesign scalable, maintainable data models aligned to business and reporting needsEstablish and enforce naming conventions, schema standards, and documentation practicesCollaborate with analysts and Power BI developers to ensure the semantic layer is well-structured and performs at scaleDevOps & Engineering ExcellenceOwn and maintain CI/CD pipelines for data assets using Azure DevOps.Implement version control practices, testing frameworks, and deployment automation for data pipelinesDesign and manage data platform orchestration across pipelines, notebooks, and warehouse workloads — including scheduling, dependency management, alerting, and failure handlingProactively identify and resolve performance bottlenecks across pipelines, notebooks, SQL code, and overall platform architectureParticipate in architecture discussions and contribute to platform roadmap decisionsCompliance & Data GovernanceEnsure all data handling practices comply with regulatory requirements and organizational PII policiesImplement appropriate data masking, access controls, and audit logging within the platformPartner with security and compliance teams to maintain data governance standardsMentorshipPartner with and actively uplift team members who are growing their Fabric skillsConduct code reviews with constructive, solutions-oriented feedbackContribute to internal documentation, runbooks, and knowledge sharingApproach technical challenges with a growth mindset — modeling curiosity, continuous learning, and a bias toward practical, solutions-focused problem solvingRequirements We are seeking candidates who can fulfill this position through a hybrid work model consisting of mostly remote work and in-person work in our Folsom office several times throughout year. Minimum Required Skills & ExperienceProven experience as a data engineer, with a strong track record in data pipeline development and data modelingHands-on experience with Microsoft Fabric — specifically Lakehouse/OneLake, Data Factory, and Data WarehouseStrong proficiency in Python for data engineering tasksWorking knowledge of Spark SQL and distributed compute conceptsDeep experience with MS SQL Server and T-SQLUnderstanding of CI/CD practices applied to data engineering (Azure DevOps)Ability to communicate technical concepts clearly to non-technical stakeholdersDesirable Skills & ExperienceFamiliarity with Power BI semantic models and dataset design (Direct Lake)Experience in a government or public sector environmentExperience working with compliance-regulated data and implementing appropriate controls for PIIMicrosoft certifications (DP-700 Fabric Data Engineer, DP-600 Fabric Analytics Engineer, DP-203 Data Engineer, or similar)The salary listed reflects the entire range for this classification. Starting salary is dependent on experience and may be offered up to the midpoint of the salary range. Any starting salary above the midpoint requires authorization by the PRISM Executive Committee.A generous benefit package is provided including medical, dental, vision, short term disability, long-term disability, paid family leave, life insurance, CalPERS retirement, deferred compensation program, sick leave, vacation leave, flexible spending account, dependent care spending account, Scholarshare 529 Plan, and section 125 cafeteria benefits. PRISM employees do not pay into Social Security except for the Medicare portion of the cost.