Data Engineer
Job SummaryWe are looking for an experienced Data Engineer with strong expertise in the Microsoft Azure Data Platform to design, develop, and optimize scalable data solutions. The ideal candidate will have hands-on experience with Microsoft Fabric, Azure Databricks, Azure Data Factory, Python, PySpark, SQL, and modern data warehousing techniques. Experience building enterprise-grade ETL/ELT pipelines, implementing data lakehouse architectures, and supporting analytics and AI initiatives is highly preferred.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Microsoft Fabric, Azure Data Factory (ADF), and Azure Databricks.Develop robust ETL/ELT processes to ingest, transform, and load structured and unstructured data from multiple enterprise systems.Build and optimize data solutions using Python, PySpark, SQL, and Spark technologies.Design and implement modern Lakehouse architecture using Microsoft Fabric and Delta Lake.Create and maintain data models for reporting, analytics, and machine learning workloads.Optimize Spark jobs and SQL queries for performance and cost efficiency.Implement data quality, validation, governance, and monitoring frameworks.Work closely with Data Architects, Business Analysts, Data Scientists, and BI developers to deliver scalable data solutions.Build reusable frameworks for ingestion, transformation, and orchestration.Implement CI/CD pipelines and Infrastructure as Code where applicable.Troubleshoot production issues and provide ongoing support for enterprise data platforms.Ensure compliance with security, governance, and data privacy standards.Required SkillsAzure Data PlatformMicrosoft FabricAzure DatabricksAzure Data Factory (ADF)Azure Data Lake Storage Gen2Azure Synapse Analytics (Preferred)Azure SQL DatabaseAzure Key VaultAzure MonitorProgrammingPythonPySparkSQLSpark SQLData EngineeringETL/ELT DevelopmentData Lakehouse ArchitectureDelta LakeData ModelingData WarehousingPerformance OptimizationData Quality FrameworksData ValidationData IntegrationDevOpsAzure DevOpsGitCI/CD PipelinesARM Templates/Bicep/Terraform (Preferred)Nice to HaveSnowflakeAzure FunctionsMicrosoft Power BIAzure Machine LearningAzure Event HubApache KafkaREST APIsDockerKubernetesPreferred CertificationsMicrosoft Certified: Azure Data Engineer Associate (DP-203)Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)Microsoft Certified: Azure Fundamentals (AZ-900)Required Experience5+ years of experience in Data Engineering.3+ years of experience with Azure Data Platform.2+ years of hands-on experience with Microsoft Fabric.Strong experience with Azure Databricks and PySpark.Expertise in Python and advanced SQL development.Experience building enterprise-scale data pipelines and data lakes.Hands-on experience with Azure Data Factory and orchestration.Strong understanding of data modeling, dimensional modeling, and data warehouse concepts.Experience with CI/CD, Git, and Azure DevOps.