Senior Data Engineer
Role: Data Lead (Azure, ETL, ADF & Databricks)Location: Dallas, TX We are seeking an experienced Senior Azure Data Lead with strong expertise in Azure Data Factory (ADF), Azure Data Platform, Databricks, and ETL development. The ideal candidate will be responsible for designing, developing, and optimizing scalable data integration and analytics solutions to support enterprise reporting, business intelligence, and advanced analytics initiatives.The candidate should possess strong hands-on experience in modern data engineering practices, cloud-based data platforms, data warehousing, and big data processing.Key ResponsibilitiesData Engineering & ETL DevelopmentDesign, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).Build and optimize data ingestion frameworks for structured, semi-structured, and unstructured data.Develop reusable data transformation frameworks and data quality solutions.Implement efficient batch and near-real-time data processing pipelines.Databricks DevelopmentDevelop data transformation and processing workflows using Azure Databricks.Build scalable solutions utilizing PySpark, Spark SQL, and Delta Lake.Optimize Spark jobs for performance, reliability, and cost efficiency.Implement data cleansing, enrichment, aggregation, and validation processes.Azure Cloud Data PlatformDesign and support Azure-based data solutions leveraging:Azure Data Factory (ADF)Azure DatabricksAzure Data Lake Storage (ADLS Gen2)Azure Synapse AnalyticsAzure SQL DatabaseAzure Key VaultAzure FunctionsImplement secure and scalable data architectures aligned with enterprise standards.Data Warehousing & AnalyticsDesign and maintain dimensional data models and enterprise data warehouses.Support reporting and analytics requirements for business stakeholders.Optimize data models and query performance.Ensure data availability, integrity, and governance standards.DevOps & Automation:Implement CI/CD pipelines using Azure DevOps.Automate deployment, monitoring, and operational support activities.Support release management and production deployments.Monitor and troubleshoot data pipeline performance issues.Data Governance & SecurityImplement data security, privacy, and compliance controls.Ensure adherence to enterprise data governance policies.Maintain metadata management, lineage, and audit requirements.Support role-based access control and data protection standards.Required Qualifications:Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.7–10 years of experience in Data Engineering and ETL Development.5+ years of hands-on experience with Azure Data Services.Strong experience developing enterprise ETL/ELT solutions.Technical Skills:Azure Data Factory (ADF)Azure DatabricksPySparkSpark SQLSQL Server/T-SQLAzure Data Lake Storage (ADLS)Azure Synapse AnalyticsData Warehousing ConceptsETL/ELT Design and DevelopmentAzure DevOps