{"schemaVersion":"jobsearcher.job.v1","id":"f8eaa44c0f10f44f6f191dca","url":"https://jobsearcher.com/jobs/f8eaa44c0f10f44f6f191dca","canonicalUrl":"https://jobsearcher.com/jobs/f8eaa44c0f10f44f6f191dca","title":"Senior Data Engineer","description":"HomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsHomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsJob DescriptionJob OverviewJob ID:J53604Job Title:Senior Data EngineerLocation:New York, NYDuration:12 Months + ExtensionDomain Exposure:Media/ EntertainmentWork Authorization:US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EADClient:To Be Discussed LaterEmployment Type:W-2, 1099, C2CView All JobsSimilar JobsSenior Azure Engineer - Boston, MASenior Business Analyst - Irvine, CASenior SailPoint IAM Architect - Rosemead, CASenior Java Backend Developer - Phoenix,, AZSenior Machine Learning Engineer - San Jose, CAJob DescriptionWe are looking for an experienced Senior Data Engineer to join our Enrolment as a Product Platform team. The candidate will contribute to building a modern, scalable healthcare enrollment data platform using Databricks.The immediate priority is developing and delivering X12 EDI 837/835 processing capabilities. The ideal candidate should have strong hands-on experience with Databricks, PySpark, Python, and healthcare EDI standards.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Databricks.Build and support X12 EDI processing capabilities, particularly 837, 835, and 834 transactions.Develop high-volume, production-grade data engineering solutions.Work with Delta Lake, Apache Spark, Databricks Notebooks, and Pipelines.Process and transform healthcare enrollment, eligibility, and claims-related data.Ensure data security and compliance with HIPAA guidelines, including PII and PHI handling.Troubleshoot, optimize, and maintain existing data pipelines.Work independently in a fast-paced program environment.Required Skills:6+ years of experience in Data Engineering.Strong hands-on experience with Databricks (Delta Lake, Spark, Notebooks, Pipelines).Strong working knowledge of X12 EDI standards – 837, 835, and 834.Proficiency in Python and PySpark.Experience building and maintaining high-volume, production-grade data pipelines.Healthcare domain experience with knowledge of PII, PHI, and HIPAA compliance.Familiarity with healthcare enrollment and eligibility data workflows.Ability to work independently and deliver in a fast-paced environment.Good To Have:Previous experience with healthcare clearinghouse integrations.Experience with healthcare EDI transaction processing and integrations.Apply NowEqual Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2008-2018, Machine Learning Technologies LLC. All Rights Reserved.","company":"Machine Learning Technologies","rawCompany":"machine learning technologies","city":"New York","state":"NY","isRemote":false,"isActive":false,"createdAt":"2026-11-04T02:23:30.742Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer","description":"HomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsHomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsJob DescriptionJob OverviewJob ID:J53604Job Title:Senior Data EngineerLocation:New York, NYDuration:12 Months + ExtensionDomain Exposure:Media/ EntertainmentWork Authorization:US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EADClient:To Be Discussed LaterEmployment Type:W-2, 1099, C2CView All JobsSimilar JobsSenior Azure Engineer - Boston, MASenior Business Analyst - Irvine, CASenior SailPoint IAM Architect - Rosemead, CASenior Java Backend Developer - Phoenix,, AZSenior Machine Learning Engineer - San Jose, CAJob DescriptionWe are looking for an experienced Senior Data Engineer to join our Enrolment as a Product Platform team. The candidate will contribute to building a modern, scalable healthcare enrollment data platform using Databricks.The immediate priority is developing and delivering X12 EDI 837/835 processing capabilities. The ideal candidate should have strong hands-on experience with Databricks, PySpark, Python, and healthcare EDI standards.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Databricks.Build and support X12 EDI processing capabilities, particularly 837, 835, and 834 transactions.Develop high-volume, production-grade data engineering solutions.Work with Delta Lake, Apache Spark, Databricks Notebooks, and Pipelines.Process and transform healthcare enrollment, eligibility, and claims-related data.Ensure data security and compliance with HIPAA guidelines, including PII and PHI handling.Troubleshoot, optimize, and maintain existing data pipelines.Work independently in a fast-paced program environment.Required Skills:6+ years of experience in Data Engineering.Strong hands-on experience with Databricks (Delta Lake, Spark, Notebooks, Pipelines).Strong working knowledge of X12 EDI standards – 837, 835, and 834.Proficiency in Python and PySpark.Experience building and maintaining high-volume, production-grade data pipelines.Healthcare domain experience with knowledge of PII, PHI, and HIPAA compliance.Familiarity with healthcare enrollment and eligibility data workflows.Ability to work independently and deliver in a fast-paced environment.Good To Have:Previous experience with healthcare clearinghouse integrations.Experience with healthcare EDI transaction processing and integrations.Apply NowEqual Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2008-2018, Machine Learning Technologies LLC. All Rights Reserved.","datePosted":"2026-11-04T02:23:30.742Z","dateModified":"2026-11-04T02:23:30.742Z","hiringOrganization":{"@type":"Organization","name":"Machine Learning Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"New York","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f8eaa44c0f10f44f6f191dca"},"url":"https://jobsearcher.com/jobs/f8eaa44c0f10f44f6f191dca"}}