JOBSEARCHER

Data Engineer

Job Description: Azure Data Engineer with 6+ years of experience designing, developing, and optimizing enterprise-scale data platforms using Microsoft Azure and SnowflakeProven expertise in building scalable data pipelines, data warehouses, and analytics solutions leveraging Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Snowflake, Python, SQL, and SparkExperienced in data modeling, ETL/ELT development, cloud migration, performance tuning, data governance, and implementing CI/CD practicesStrong background in integrating data from multiple sources and enabling business intelligence and advanced analytics solutionsKey Skills:
  • Azure Data Factory (ADF)
  • Azure DatabricksAzure Synapse AnalyticsSnowflake Data CloudPython, PySpark, SQLAzure Data Lake Storage (ADLS Gen2)
  • Azure FunctionsDelta LakeData Warehousing & Data ModelingETL / ELT DevelopmentCI/CD (Azure DevOps, Git)
  • Performance Tuning & OptimizationData Governance & SecurityPower BI IntegrationAgile & Scrum MethodologiesWhat you will do:
Design, develop, and maintain scalable data engineering solutions on Azure and Snowflake platformsBuild and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake to ingest, transform, and load data from various structured and unstructured sourcesDevelop and maintain enterprise data warehouses, data marts, and analytical datasets supporting reporting, BI, and advanced analytics initiatives Implement data transformation and orchestration processes using PySpark, SQL, Python, and Snowflake stored proceduresDesign and manage cloud-based data lakes using Azure Data Lake Storage (ADLS Gen2) and Delta Lake architectureCollaborate with business stakeholders, data analysts, and architects to gather requirements and translate them into scalable data solutionsMonitor and optimize data pipeline performance, ensuring reliability, scalability, and cost efficiencyImplement data quality frameworks, validation rules, and monitoring processes to ensure accurate and trusted dataManage Snowflake objects including databases, schemas, warehouses, tasks, streams, and data-sharing capabilitiesDevelop and maintain dimensional and normalized data models following industry best practicesImplement security controls, access management, encryption, and governance policies across Azure and Snowflake environmentsSupport cloud migration and modernization initiatives from on-premises or legacy platforms to Azure and SnowflakeAutomate deployment processes using Azure DevOps, Git repositories, and CI/CD pipelinesTroubleshoot production issues, perform root cause analysis, and provide timely resolution for data-related challengesParticipate in Agile ceremonies, code reviews, and technical design discussions to ensure high-quality solution deliveryCreate technical documentation, architecture diagrams, operational runbooks, and knowledge-transfer materialsPreferred Certifications: Microsoft Certified: Azure Data Engineer Associate (DP-203) SnowPro Core Certification About UsDatavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.