{"schemaVersion":"jobsearcher.job.v1","id":"ff7b35c61c5d04b6dfbd9ab1","url":"https://jobsearcher.com/jobs/ff7b35c61c5d04b6dfbd9ab1","canonicalUrl":"https://jobsearcher.com/jobs/ff7b35c61c5d04b6dfbd9ab1","title":"Lead Data Engineer","description":"Overview\nAs Lead Data Engineer you will architect and optimize cloud-native data systems to support healthcare data workflows. You’ll drive enterprise data platforms on Databricks and AWS, shaping scalable lakehouse architectures and governance. The role combines hands-on pipeline work with mentoring the data team and ensuring HIPAA-compliant data handling. You will partner across teams to enable secure, compliant data ingestion of HL7 and FHIR data, delivering reliable risk-adjusted reporting for Medicare Advantage.\n\nCompensation / Benefitsremote work401(k) with employer matchingmedical, dental, and vision insurancepaid time off (vacation, sick leave, holidays)life insurance and disability benefitsHSAs/FSAs for healthcare and dependent care\nResponsibilitiesDesign, implement, and maintain cloud-native data pipelines on AWS using DatabricksArchitect scalable lakehouse structures with Apache Iceberg for healthcare dataEstablish data governance and lineage via Databricks Unity CatalogImplement RBAC, data masking, and row-level security for PHIArchitect and scale ingestion frameworks for HL7 and FHIR data feedsOversee end-to-end processing of Medicare Advantage data assets and risk adjustment workflowsEnsure HIPAA compliance and robust data governanceMentor junior engineers, perform code reviews, and promote best practices\nKey requirements7+ years of data engineering experienceAt least 2 years in a technical lead roleExperience building large-scale pipelines in DatabricksProduction experience deploying data infrastructure on AWS (S3, EMR, Lambda, IAM, Glue)Hands-on experience processing Medicare Advantage data and CMS submissionsExperience with HL7 and FHIR interoperability standardsExperience implementing enterprise RBAC and PHI row-level securityMastery of Python, PySpark, and advanced SQLDeep knowledge of Apache IcebergExpert Databricks Unity CatalogUS healthcare data architecture understandingSecurity and compliance implementation expertiseDomain expertise in Medicare Advantage workflowsHIPAA compliance knowledgeDatabricks Certified Data Engineer Professional (preferred)AWS Certified Data Analytics (preferred)Familiarity with Apache Airflow or AWS Step Functions (preferred)collaborationmentorshipattention to governance and compliancePythonPySparkAdvanced SQL","company":"Ust Global","rawCompany":"ust global","city":"Phoenix","state":"AZ","isRemote":false,"isActive":true,"createdAt":"2026-09-15T03:26:51.304Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer","description":"Overview\nAs Lead Data Engineer you will architect and optimize cloud-native data systems to support healthcare data workflows. You’ll drive enterprise data platforms on Databricks and AWS, shaping scalable lakehouse architectures and governance. The role combines hands-on pipeline work with mentoring the data team and ensuring HIPAA-compliant data handling. You will partner across teams to enable secure, compliant data ingestion of HL7 and FHIR data, delivering reliable risk-adjusted reporting for Medicare Advantage.\n\nCompensation / Benefitsremote work401(k) with employer matchingmedical, dental, and vision insurancepaid time off (vacation, sick leave, holidays)life insurance and disability benefitsHSAs/FSAs for healthcare and dependent care\nResponsibilitiesDesign, implement, and maintain cloud-native data pipelines on AWS using DatabricksArchitect scalable lakehouse structures with Apache Iceberg for healthcare dataEstablish data governance and lineage via Databricks Unity CatalogImplement RBAC, data masking, and row-level security for PHIArchitect and scale ingestion frameworks for HL7 and FHIR data feedsOversee end-to-end processing of Medicare Advantage data assets and risk adjustment workflowsEnsure HIPAA compliance and robust data governanceMentor junior engineers, perform code reviews, and promote best practices\nKey requirements7+ years of data engineering experienceAt least 2 years in a technical lead roleExperience building large-scale pipelines in DatabricksProduction experience deploying data infrastructure on AWS (S3, EMR, Lambda, IAM, Glue)Hands-on experience processing Medicare Advantage data and CMS submissionsExperience with HL7 and FHIR interoperability standardsExperience implementing enterprise RBAC and PHI row-level securityMastery of Python, PySpark, and advanced SQLDeep knowledge of Apache IcebergExpert Databricks Unity CatalogUS healthcare data architecture understandingSecurity and compliance implementation expertiseDomain expertise in Medicare Advantage workflowsHIPAA compliance knowledgeDatabricks Certified Data Engineer Professional (preferred)AWS Certified Data Analytics (preferred)Familiarity with Apache Airflow or AWS Step Functions (preferred)collaborationmentorshipattention to governance and compliancePythonPySparkAdvanced SQL","datePosted":"2026-09-15T03:26:51.304Z","dateModified":"2026-09-15T03:26:51.304Z","hiringOrganization":{"@type":"Organization","name":"Ust Global","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Phoenix","addressRegion":"AZ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"ff7b35c61c5d04b6dfbd9ab1"},"url":"https://jobsearcher.com/jobs/ff7b35c61c5d04b6dfbd9ab1"}}