Azure Data Engineer

Job Title: Azure Data EngineerLocation : Dallas, TX or Charlotte, NC (Hybrid Onsite Role-3 Days Onsite Per Week) Duration : FulltimeTeams Meeting InterviewJob Description:We are looking for a Data Engineer with strong experience in Azure and Apache Spark to design and build scalable, high-performance data solutions. The ideal candidate will work on modern cloud data platforms, ensuring reliable data pipelines and supporting analytics and business intelligence needs. Familiarity with Databricks and Collibra will be an added advantage.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Azure servicesBuild and optimize Spark-based data processing applicationsImplement ETL/ELT workflows for batch and real-time data processingWork with Azure Data Factory (ADF) or similar tools for orchestrationStore and manage data in Azure Data Lake (ADLS) or cloud storage systemsPerform data transformation, cleansing, and validationEnsure data quality, governance, and security complianceCollaborate with analysts, data scientists, and business stakeholdersMonitor, debug, and optimize data workflowsRequired Skills & QualificationsTechnical SkillsStrong hands-on experience with Microsoft Azure (ADF, ADLS, Synapse or similar)Solid experience in Apache Spark (PySpark preferred)Proficiency in Python and SQLExperience in designing data pipelines and data modelsGood understanding of data warehousing conceptsExperience with version control and CI/CD pipelines (e.g., Azure DevOps)Nice-to-Have SkillsExperience with Azure Databricks for distributed data processingExposure to Collibra or similar data governance/catalog toolsKnowledge of Delta Lake architectureFamiliarity with streaming technologies (Kafka, Event Hub)Experience with BI tools such as Power BI