{"schemaVersion":"jobsearcher.job.v1","id":"f0c08391c5ccce98efb5da10","url":"https://jobsearcher.com/jobs/f0c08391c5ccce98efb5da10","canonicalUrl":"https://jobsearcher.com/jobs/f0c08391c5ccce98efb5da10","title":"Azure Databricks Engineer","description":"Data EngineerKey Responsibilities:\r\nDesign and implement scalable data processes focused on fulfilling product requirements.\r\nLarge complex components; influencing overall product architecture and patterns.\r\nAutonomously implement component design in line with pre-defined Data and (ELT/ETL) architectural patterns.\r\nPartner with Business, Technical and Strategic Product stakeholders to manage project commitments in an agile framework; rapidly delivering value to our customers via technology solutions.\r\nDevelop, construct, test, document and maintain data pipelines.\r\nIdentify ways to improve data reliability, efficiency, and quality.\r\nDesign and develop resilient, reliable, scalable and self-healing solutions to meet and exceed customer requirements.\r\nEnsure that all parts of the application eco-system are thoroughly and effectively covered with telemetry.\r\nFocus on automation, quality and streamlining new and existing data processing.\r\nCreate data monitoring capabilities for each business process and work with data consumers on updates to data processes.\r\nDevelop data pipelines using Python, Spark and/or Scala.\r\nAutomate and orchestrate data pipelines using Azure Data Factory or Delta Live Tables\r\nHelp maintain the integrity and security of the company data.\r\nCommunicate clearly and effectively in oral and written forms and be able to present and demonstrate work to technical and non-technical stakeholders.\r\nRequired Qualifications:\r\nUndergraduate degree or equivalent experience\r\nMinimum 5 to 7 years of IT experience in Software Engineering.\r\nMinimum 3 to 5 years of experience in big data processing for batch and/or streaming data; data includes file systems, data structures/databases, automation, security, messaging, movement, etc.\r\nMinimum 3 to 5 years of experience with Python and Spark in developing data processing pipelines.\r\nMinimum 3 to 5 years of ETL programming experience in Databricks using Scala/Java.\r\nMinimum 3 to 5 years of supporting extensive data analysis using advanced SQL concepts and window functions\r\nMinimum 2 to 3 years of experience working on large scale programs, with multiple concurrent projects.\r\nMinimum 2 to 3 years of experience with Agile methodologies and Test-Driven Development.\r\nExperience with Continuous Development/ Integration (CI/CD) /DevOps skills, (Jenkins, Git, Azure DevOps/ Git Actions).\r\nStrong written and oral communications along with presentation and interpersonal skills\r\nAbility to lead and delegate work across other members of the data engineering team\r\nPreferred Qualifications:\r\nMinimum 2 to 3 years of cloud experience, preferably Azure.\r\nMinimum 2 to 3 years experience with Databricks or other big data platforms.\r\nMinimum 2 to 3 years automation/orchestration experience using Azure Data Factory\r\nExperience and familiarity with data across Healthcare Provider domains (i.e. Patient, Provider, Encounter, Billing, Claims, Eligibility etc.)\r\nFamiliarity/Experience with Clinical data exchange formats like HL7, FHIR, CCD etc.\r\nFamiliarity/experience with FHIR resources and data model\r\nExperience in Big data processing in healthcare domain\r\nCloud development and computing.\r\nKnowledge of cutting to edge technologies (AI, ML, Blockchain, Wearables, IOT).\r\nKnowledge/Experience with Microservice design, Java Spring, Kafka, RabbitMQ.","company":"Software Technology","rawCompany":"software technology","city":"Washington","state":"DC","isRemote":false,"isActive":false,"createdAt":"2026-08-09T01:25:19.859Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Azure Databricks Engineer","description":"Data EngineerKey Responsibilities:\r\nDesign and implement scalable data processes focused on fulfilling product requirements.\r\nLarge complex components; influencing overall product architecture and patterns.\r\nAutonomously implement component design in line with pre-defined Data and (ELT/ETL) architectural patterns.\r\nPartner with Business, Technical and Strategic Product stakeholders to manage project commitments in an agile framework; rapidly delivering value to our customers via technology solutions.\r\nDevelop, construct, test, document and maintain data pipelines.\r\nIdentify ways to improve data reliability, efficiency, and quality.\r\nDesign and develop resilient, reliable, scalable and self-healing solutions to meet and exceed customer requirements.\r\nEnsure that all parts of the application eco-system are thoroughly and effectively covered with telemetry.\r\nFocus on automation, quality and streamlining new and existing data processing.\r\nCreate data monitoring capabilities for each business process and work with data consumers on updates to data processes.\r\nDevelop data pipelines using Python, Spark and/or Scala.\r\nAutomate and orchestrate data pipelines using Azure Data Factory or Delta Live Tables\r\nHelp maintain the integrity and security of the company data.\r\nCommunicate clearly and effectively in oral and written forms and be able to present and demonstrate work to technical and non-technical stakeholders.\r\nRequired Qualifications:\r\nUndergraduate degree or equivalent experience\r\nMinimum 5 to 7 years of IT experience in Software Engineering.\r\nMinimum 3 to 5 years of experience in big data processing for batch and/or streaming data; data includes file systems, data structures/databases, automation, security, messaging, movement, etc.\r\nMinimum 3 to 5 years of experience with Python and Spark in developing data processing pipelines.\r\nMinimum 3 to 5 years of ETL programming experience in Databricks using Scala/Java.\r\nMinimum 3 to 5 years of supporting extensive data analysis using advanced SQL concepts and window functions\r\nMinimum 2 to 3 years of experience working on large scale programs, with multiple concurrent projects.\r\nMinimum 2 to 3 years of experience with Agile methodologies and Test-Driven Development.\r\nExperience with Continuous Development/ Integration (CI/CD) /DevOps skills, (Jenkins, Git, Azure DevOps/ Git Actions).\r\nStrong written and oral communications along with presentation and interpersonal skills\r\nAbility to lead and delegate work across other members of the data engineering team\r\nPreferred Qualifications:\r\nMinimum 2 to 3 years of cloud experience, preferably Azure.\r\nMinimum 2 to 3 years experience with Databricks or other big data platforms.\r\nMinimum 2 to 3 years automation/orchestration experience using Azure Data Factory\r\nExperience and familiarity with data across Healthcare Provider domains (i.e. Patient, Provider, Encounter, Billing, Claims, Eligibility etc.)\r\nFamiliarity/Experience with Clinical data exchange formats like HL7, FHIR, CCD etc.\r\nFamiliarity/experience with FHIR resources and data model\r\nExperience in Big data processing in healthcare domain\r\nCloud development and computing.\r\nKnowledge of cutting to edge technologies (AI, ML, Blockchain, Wearables, IOT).\r\nKnowledge/Experience with Microservice design, Java Spring, Kafka, RabbitMQ.","datePosted":"2026-08-09T01:25:19.859Z","dateModified":"2026-08-09T01:25:19.859Z","hiringOrganization":{"@type":"Organization","name":"Software Technology","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Washington","addressRegion":"DC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f0c08391c5ccce98efb5da10"},"url":"https://jobsearcher.com/jobs/f0c08391c5ccce98efb5da10"}}