Data Engineer (Databricks)

Position: Senior Data Engineer (Databricks)Duration: 12 monthsLocation: Austin, TX (Hybrid Mode)Job ID: 529701754Agency: HHSCWork Mode: Hybrid work- Local onlyAnticipated start date: 09/01/2026 Interview Mode: In person or MS TeamsThe primary work location(s) will be at 4601 W Gudalupe St Austin, TX 78751.SPECIAL REQUIREMENTSPosition will be 3 days remote with 2 days (Mondays and Thursdays) required to be onsite at the location listed above.Project will only accept LOCAL ONLY candidates for this position. ***Days are subject to change per manager***OTHER SPECIAL REQUIREMENTS DESCRIPTION OF SERVICESTexas Health and Human Services Commission requires the services of 2 Systems Analyst 3, hereafter referred to as Candidate(s), who meets the general qualifications of Systems Analyst 3, Applications/Software Development and the specifications outlined in this document for the Texas Health and Human Services Commission.All work products resulting from the project shall be considered "works made for hire" and are the property of the Texas Health and Human Services Commission and may include pre-selection requirements that potential Vendors (and their Candidates) submit to and satisfy criminal background checks as authorized by Texas law. Texas Health and Human Services Commission will pay no fees for interviews or discussions, which occur during the process of selecting a Candidate(s).8 or more years of experience, relies on experience and judgment to plan and accomplish goals, independently performs a variety of complicated tasks, a wide degree of creativity and latitude is expected.Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives. Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system: Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports. Writes detailed description of user needs, program functions, and steps required to develop or modify computer program. Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.The Databricks Engineer should design, develop, and optimize scalable data solutions on Databricks, leveraging PySpark or Scala for large-scale data processing. Build and maintain ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting. Develop robust data models and implement data quality, validation, and governance frameworks. Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights. Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency.Minimum Requirements:CANDIDATE SKILLS AND QUALIFICATIONSCandidates that do not meet or exceed the minimum stated requirements (skills/experience) will be displayed to customers but may not be chosen for this opportunity.YearsRequired/PreferredExperience8RequiredExperience in IT, supporting design, development, deployment, or delivery of technology solutions.8RequiredExperience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.8RequiredExperience in data warehousing and dimensional data modeling (star/snowflake schemas).8RequiredProficiency in SQL and Python (or Scala) for large-scale data processing.8RequiredExperience designing and developing dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps).8RequiredExperience implementing data governance, data quality, and data security practices.8RequiredExperience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines.8RequiredExperience with Delta Lake, medallion architecture (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow).8RequiredExcellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders.1PreferredExperience working in public sector or state government environments.1PreferredDatabricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).1PreferredExperience with CI/CD practices for data pipelines (DevOps, Git-based workflows).