{"schemaVersion":"jobsearcher.job.v1","id":"fbce98cdade732bc53c743f6","url":"https://jobsearcher.com/jobs/fbce98cdade732bc53c743f6","canonicalUrl":"https://jobsearcher.com/jobs/fbce98cdade732bc53c743f6","title":"Senior Azure Data Engineer","description":"Local to Cary NC only!\r\nDesign and build batch and streaming data pipelines using Azure, Databricks, and Kafka.\r\nDevelop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala\r\nImplement and support Data Lake / Lakehouse architectures\r\nIntegrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.\r\nExpertise in handling Data migration using API's.\r\nApply data quality checks and support data governance basics (metadata, lineage, access controls)\r\nOptimize Spark jobs for performance, reliability, and cost\r\nCollaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers\r\nRequired Skills & Experience:8+ years of experience in data engineering in azure using Azure Databricks.\r\nStrong experience with Azure Data Lake, Databricks, ADF, Postgres.\r\nStrong Data Engineering experience in Big Data (Cloudera)\r\nHands-on expertise in SQL, Python and PySpark or Scala\r\nProven experience with batch & real-time ingestion\r\nExperience with Kafka and big data processing\r\nAdded good to have experience with:Informatica PowerCenter\r\nInformatica IDMC or equivalent cloud data integration tools\r\nSQL Server, Oracle, Azure SQL\r\nCosmos DB\r\nUnix/Linux\r\nMaestro (or similar enterprise schedulers)\r\nData tools such as Precisely or equivalent\r\nAdded AdvantageInsurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)\r\nExperience with Azure DevOps (AzDO) and GitHub-based CI/CD\r\nPractical usage of Copilot for data engineering and development productivity\r\nExposure to Generative AI / GenAI use cases in data platforms and analytics\r\nRole Descriptions:Microsoft Azure (ADB/ADF)\r\nEssential Skills:Microsoft Azure (ADB/ADF)#J-18808-Ljbffr","company":"Programmers.io","rawCompany":"programmersio","city":"Cary","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-09-27T01:10:29.844Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Azure Data Engineer","description":"Local to Cary NC only!\r\nDesign and build batch and streaming data pipelines using Azure, Databricks, and Kafka.\r\nDevelop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala\r\nImplement and support Data Lake / Lakehouse architectures\r\nIntegrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.\r\nExpertise in handling Data migration using API's.\r\nApply data quality checks and support data governance basics (metadata, lineage, access controls)\r\nOptimize Spark jobs for performance, reliability, and cost\r\nCollaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers\r\nRequired Skills & Experience:8+ years of experience in data engineering in azure using Azure Databricks.\r\nStrong experience with Azure Data Lake, Databricks, ADF, Postgres.\r\nStrong Data Engineering experience in Big Data (Cloudera)\r\nHands-on expertise in SQL, Python and PySpark or Scala\r\nProven experience with batch & real-time ingestion\r\nExperience with Kafka and big data processing\r\nAdded good to have experience with:Informatica PowerCenter\r\nInformatica IDMC or equivalent cloud data integration tools\r\nSQL Server, Oracle, Azure SQL\r\nCosmos DB\r\nUnix/Linux\r\nMaestro (or similar enterprise schedulers)\r\nData tools such as Precisely or equivalent\r\nAdded AdvantageInsurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)\r\nExperience with Azure DevOps (AzDO) and GitHub-based CI/CD\r\nPractical usage of Copilot for data engineering and development productivity\r\nExposure to Generative AI / GenAI use cases in data platforms and analytics\r\nRole Descriptions:Microsoft Azure (ADB/ADF)\r\nEssential Skills:Microsoft Azure (ADB/ADF)#J-18808-Ljbffr","datePosted":"2026-09-27T01:10:29.844Z","dateModified":"2026-09-27T01:10:29.844Z","hiringOrganization":{"@type":"Organization","name":"Programmers.io","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Cary","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"fbce98cdade732bc53c743f6"},"url":"https://jobsearcher.com/jobs/fbce98cdade732bc53c743f6"}}