Data Engineer (Databrick)

Databrick Data EngineerLocation: Must reside in one of the following states: MN, WI, IA, SD, NDDuration: Full-TimeMust Haves:Senior-level/5+ years data engineering experienceStrong SQL and python abilityDatabricks experienceStrong interpersonal and articulate communication skillsPlusses:STRONGLY prefer health plan / health insurance / managed care / payer experience Experience in other technologies related to their tech stack (Azure, PySpark, GitHub, PowerBI, Airflow)Relevant certifications (Azure, Databricks etc)Insight Global is seeking 5 Data Engineers to join a large payor/provider. This person will be responsible for:Solution and build enriched objects in the gold zoneDesign, develop, and implement end-to-end data solutions using Azure Databricks.Convert current SQL to Python code in Databricks.Modify and maintain data pipelines.Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.Update or maintain existing data pipelines in a production setting.Ensure data quality and integrity by implementing data validation and cleansing processes.Demonstrate strong verbal communication and critical thinking skills, working well within a team environment and not being afraid to speak up.