{"schemaVersion":"jobsearcher.job.v1","id":"12d67a14367d358d95a054de","url":"https://jobsearcher.com/jobs/12d67a14367d358d95a054de","canonicalUrl":"https://jobsearcher.com/jobs/12d67a14367d358d95a054de","title":"Data Engineer (ADF, Orchestration, Data Flows, Snowflake) | REMOTE","description":"Data Engineer Position10+ years of IT experience. Background candidates should ideally have come from SSIS/SQL transitioning to Azure Data Factory (Data Integration) Snowflake (Source and Target End Point). Azure has a lot of components to it such as Fabric, DataBricks, ADF, Pyspark. They need candidates that can use ADF as both orchestration and integration. Many candidates claim to have ADF but for orchestration really just use Pyspark to trigger the jobs through ADF. They need to be advanced at building the integration through data flows logic as well.\r\n100% Telecommute\r\nWork Hours:9am-5pm CST\r\nProject:\r\nAs a member of the Data Management team, the Data Engineer supports the Alabama EDS by developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance.\r\nThe Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications.\r\nResponsibilities:\r\nDevelop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfaced.\r\nEfficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users.\r\nAssist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flows.\r\nInvestigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions.\r\nDeveloping ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsets.\r\nDeveloping idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and Pipelines.\r\nAbility to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problems.\r\nCapturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using Tasks.\r\nOptimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responses.\r\nMust have the ability to build a highly efficient orchestrator that can schedule jobs, execute workflows, perform Data quality checks, and coordinate dependencies among tasks.\r\nResponsible for testing of ETL system code, data design, and pipelines and data flows. Root cause analysis on all processes and resolving production issues are also a part of the process and routine tests on databases and data flow and pipeline testing.\r\nResponsible for documenting the implementations, and test cases as well as responsible for building deployment documents needed for CI/CD.\r\nIdeal Background:Data Engineer with Healthcare (Medicaid) and Microsoft Azure based experience with Snowflake and Azure Data Factory\r\nTOP REQUIREMENTS:\r\n5+ years of Data engineering experience with a focus on Data Warehousing\r\n2+ years of experience creating pipelines in Azure Data Factory (ADF)\r\n3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL\r\nRequired:\r\n5+ years of Data engineering experience with a focus on Data Warehousing\r\n2+ years of experience creating pipelines in Azure Data Factory (ADF)\r\n5+ years developing ETL using Informatica PowerCenter, SSIS, Azure Data Factory, or similar tools.\r\n5+ years of experience with Relational Databases, such as Oracle, Snowflake, SQL Server, etc.\r\n3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL\r\n2+ years of experience with GitHub, SVN, or similar source control systems\r\n2+ years of experience processing structured and un-structured data.\r\nExperience with HL7 and FHIR standards, and processing files in these formats.\r\n3+ years analyzing project requirements and developing detailed specifications for ETL requirements.\r\nExcellent problem-solving and analytical skills, with the ability to troubleshoot and optimize data pipelines.\r\nAbility to adapt to evolving technologies and changing business requirements.\r\nBachelors or Advanced Degree in a related field such as Information Technology/Computer Science, Mathematics/Statistics, Analytics, Business\r\nPreferred:\r\n2+ years of batch or PowerShell scripting\r\n2+ years of experience with Python scripting.\r\n3+ years of data modeling experience in a data warehouse environment\r\nExperience or familiarity with Informatica Intelligent Cloud Services (specifically Data Integration)\r\nExperience designing and building APIs in Snowflake and ADF (e.g. REST, RPC)\r\nExperience with State Medicaid / Medicare / Healthcare applications\r\nAzure certifications related to data engineering or data analytics.\r\nRequired Skills: Data Analysis\r\nBasic Qualification:\r\nAdditional Skills:\r\nThis is a high PRIORITY requisition.","company":"Software Technology","rawCompany":"software technology","city":"New York","state":"NY","isRemote":true,"isActive":false,"createdAt":"2026-08-09T01:25:22.946Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer (ADF, Orchestration, Data Flows, Snowflake) | REMOTE","description":"Data Engineer Position10+ years of IT experience. Background candidates should ideally have come from SSIS/SQL transitioning to Azure Data Factory (Data Integration) Snowflake (Source and Target End Point). Azure has a lot of components to it such as Fabric, DataBricks, ADF, Pyspark. They need candidates that can use ADF as both orchestration and integration. Many candidates claim to have ADF but for orchestration really just use Pyspark to trigger the jobs through ADF. They need to be advanced at building the integration through data flows logic as well.\r\n100% Telecommute\r\nWork Hours:9am-5pm CST\r\nProject:\r\nAs a member of the Data Management team, the Data Engineer supports the Alabama EDS by developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance.\r\nThe Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications.\r\nResponsibilities:\r\nDevelop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfaced.\r\nEfficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users.\r\nAssist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flows.\r\nInvestigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions.\r\nDeveloping ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsets.\r\nDeveloping idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and Pipelines.\r\nAbility to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problems.\r\nCapturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using Tasks.\r\nOptimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responses.\r\nMust have the ability to build a highly efficient orchestrator that can schedule jobs, execute workflows, perform Data quality checks, and coordinate dependencies among tasks.\r\nResponsible for testing of ETL system code, data design, and pipelines and data flows. Root cause analysis on all processes and resolving production issues are also a part of the process and routine tests on databases and data flow and pipeline testing.\r\nResponsible for documenting the implementations, and test cases as well as responsible for building deployment documents needed for CI/CD.\r\nIdeal Background:Data Engineer with Healthcare (Medicaid) and Microsoft Azure based experience with Snowflake and Azure Data Factory\r\nTOP REQUIREMENTS:\r\n5+ years of Data engineering experience with a focus on Data Warehousing\r\n2+ years of experience creating pipelines in Azure Data Factory (ADF)\r\n3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL\r\nRequired:\r\n5+ years of Data engineering experience with a focus on Data Warehousing\r\n2+ years of experience creating pipelines in Azure Data Factory (ADF)\r\n5+ years developing ETL using Informatica PowerCenter, SSIS, Azure Data Factory, or similar tools.\r\n5+ years of experience with Relational Databases, such as Oracle, Snowflake, SQL Server, etc.\r\n3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL\r\n2+ years of experience with GitHub, SVN, or similar source control systems\r\n2+ years of experience processing structured and un-structured data.\r\nExperience with HL7 and FHIR standards, and processing files in these formats.\r\n3+ years analyzing project requirements and developing detailed specifications for ETL requirements.\r\nExcellent problem-solving and analytical skills, with the ability to troubleshoot and optimize data pipelines.\r\nAbility to adapt to evolving technologies and changing business requirements.\r\nBachelors or Advanced Degree in a related field such as Information Technology/Computer Science, Mathematics/Statistics, Analytics, Business\r\nPreferred:\r\n2+ years of batch or PowerShell scripting\r\n2+ years of experience with Python scripting.\r\n3+ years of data modeling experience in a data warehouse environment\r\nExperience or familiarity with Informatica Intelligent Cloud Services (specifically Data Integration)\r\nExperience designing and building APIs in Snowflake and ADF (e.g. REST, RPC)\r\nExperience with State Medicaid / Medicare / Healthcare applications\r\nAzure certifications related to data engineering or data analytics.\r\nRequired Skills: Data Analysis\r\nBasic Qualification:\r\nAdditional Skills:\r\nThis is a high PRIORITY requisition.","datePosted":"2026-08-09T01:25:22.946Z","dateModified":"2026-08-09T01:25:22.946Z","hiringOrganization":{"@type":"Organization","name":"Software Technology","sameAs":"https://jobsearcher.com"},"jobLocationType":"TELECOMMUTE","applicantLocationRequirements":{"@type":"Country","name":"US"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"New York","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"12d67a14367d358d95a054de"},"url":"https://jobsearcher.com/jobs/12d67a14367d358d95a054de"}}