JOBSEARCHER

Senior Data Engineer

We are seeking aSenior Data Engineerwith 10+ years of experience in designing and developing scalable data platforms, with strong hands-on expertise inMicrosoft Fabric, Azure Data Engineering, PySpark, SQL, and data warehousing. Key Skills & Responsibilities 10+ years of experience inData Engineering, ETL/ELT, data pipelines, and data warehousing. Strong hands-on experience withMicrosoft Fabric, includingOneLake, Lakehouse, Data Factory, Dataflows Gen2, Notebooks, and Fabric Warehousing. Design and develop scalableETL/ELT pipelinesusingMicrosoft Fabric and Azure Data Factory. Strong expertise inPython, PySpark, Spark SQL, and T-SQLfor large-scale data processing. Build and optimizeLakehouse and dimensional data modelsfor enterprise analytics. Experience integrating data fromAPIs, databases, cloud platforms, files, and enterprise applications. Strong knowledge ofAzure Data Lake Storage Gen2, Azure Synapse, Azure SQL, and cloud data services. Implement data quality, validation, data governance, security, and performance optimization. Develop reusable data transformation frameworks and optimizeSpark jobs and SQL queries. Experience withCI/CD, Git, Azure DevOps, and automated deployment of data solutions. Collaborate withData Architects, BI Developers, Data Scientists, and business teamsto deliver analytics-ready datasets. Troubleshoot pipeline failures, optimize workloads, and ensure reliable production data operations.
Preferred Skills: Microsoft Fabric | OneLake | Fabric Lakehouse | Fabric Data Factory | Dataflows Gen2 | Fabric Warehouse | Azure Data Factory | Azure Data Lake Gen2 | Azure Synapse | PySpark | Python | Spark SQL | T-SQL | ETL/ELT | Data Modeling | Data Warehousing | SQL Server | Power BI | Azure DevOps | Git | CI/CD | Data Governance | Data Quality Preference: Candidates with strongMicrosoft Fabric implementation experienceand those who areopen to relocating anywhere within the USAwill be highly preferred.