Lead Data Engineer
Lead Data EngineerLocation: West Sacramento, CAWork Model: Hybrid — 2–3 days per week onsiteEngagement: Contract, initially up to 12 months, with potential extensionsPosition OverviewProgile is seeking an experienced Lead Developer to support client Investment Data Warehouse (IDW) environment and the development, enhancement, and maintenance of Generative Business Intelligence (GenBI), AI/ML, and data solutions.Provide technical leadership for enterprise-level BI and data warehouse initiatives, guide development teams, collaborate with business stakeholders, and help design and deliver production-grade data and AI solutions.Key Responsibilities• Lead technical teams developing enterprise BI, data warehouse, AI/ML, and GenAI solutions.• Design and deliver production-grade dashboards, data models, APIs, and analytics products.• Lead data engineering and ETL/ELT development.• Work with cloud data warehouse technologies such as Snowflake, Amazon Redshift, or comparable platforms.• Develop and optimize SQL, data models, semantic layers, and BI solutions.• Apply OpenAI APIs or similar LLM platforms to business intelligence and analytics use cases.• Develop natural-language-to-SQL/query capabilities and prompt strategies.• Guide prompt engineering and GenAI solution design.• Collaborate with analysts, developers, technical teams, and business stakeholders.• Lead requirements discovery, documentation, solution design, implementation, and delivery.• Support ongoing enhancement and maintenance of CalSTRS' IDW platform.Required QualificationsCandidates must demonstrate all of the following:• 10+ years of experience in data/BI engineering or analytics.• 5+ years leading teams of at least three members implementing enterprise BI and/or large data warehouse solutions.• 5+ years working with AI/ML or GenAI technologies.• At least two production-grade BI/data product deliveries, such as dashboards, data models, or APIs.• 2+ years with ETL/ELT pipelines, data warehouses such as Snowflake or Amazon Redshift, and orchestration tools such as Airflow or dbt.• 2+ years using OpenAI APIs or comparable LLM platforms.• Experience with natural-language-to-SQL/query systems and prompt engineering.• 2+ years advanced SQL, data modeling, semantic layers, and at least one major BI platform such as Power BI, Tableau, or Looker.• 2+ years leading analysts/developers and collaborating with stakeholders on BI/data warehouse requirements.Preferred Qualifications• AWS certification.• Snowflake certification.• Power BI or Tableau certification.• AI/ML or GenAI credentials/coursework.• Bachelor's degree in Computer Science, Computer Engineering, or related field.• Experience working with government/public-sector organizations.• Ability to work onsite 2–3 days per week in West Sacramento.