Data Engineer

Senior Databricks Data Engineer (Azure)Designed, built, and optimized scalable data pipelines on the Databricks Lakehouse platform using Azure, Python, PySpark, SQL, and Delta Lake.Modernized cloud-based data ecosystems with a focus on distributed data engineering, data modeling, governance, security, and CI/CD automation.Developed robust ETL/ELT pipelines, automated workflows with Apache Airflow and Databricks Workflows, and integrated data from APIs, databases, files, streaming sources, and MDM systems.Implemented Delta Lake and Unity Catalog to enable secure data governance, RBAC, lineage, metadata management, and data sharing.Built reusable frameworks using Databricks Repos, Delta Live Tables, and automated deployment pipelines.Created optimized SQL/T-SQL queries, curated datasets, and reporting solutions supporting BI, analytics, and data science initiatives.Worked with financial and regulated data, ensuring compliance, scalability, reliability, and high-performance data processing.Leveraged Azure, Databricks, and Snowflake to deliver enterprise-scale data engineering solutions and lead cross-functional data initiatives.