JOBSEARCHER

Senior Data Engineer

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

Senior Databricks Data Engineer (Azure | Lakehouse)OverviewWe are seeking a seasoned Databricks Data Engineer with deep expertise in Azure cloud services and modern data platforms. This role will focus on designing and optimizing large-scale data pipelines, modernizing cloud-based data ecosystems, and enabling secure, governed data solutions in a highly collaborative environment.This is an opportunity to work on cutting-edge data architecture while partnering closely with cross-functional teams to deliver scalable, high-performance data solutions.Key ResponsibilitiesDesign, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform, ensuring reliability, scalability, and governanceModernize cloud-based data ecosystems, contributing to architecture, distributed data engineering, modeling, security, and CI/CD automationDevelop and maintain ETL/ELT pipelines using Python, PySpark, and Spark SQLLeverage orchestration tools such as Apache Airflow for workflow automationDesign and optimize Delta Lake data models for performance and scalabilityImplement and manage Unity Catalog for RBAC, lineage, and secure data sharingBuild reusable frameworks using Databricks Workflows, Repos, and Delta Live TablesDevelop scalable ingestion pipelines for APIs, databases, files, streaming sources, and MDM systemsAutomate API integrations and workflows using Python and REST APIsSupport data governance, cataloging, lineage, and metadata management initiativesEnable downstream consumption for BI, analytics, and application use casesWrite and optimize SQL/T-SQL queries, stored procedures, and curated datasetsAutomate deployments, testing pipelines, and DevOps workflowsRequired Qualifications8+ years of experience designing and developing scalable data pipelines in modern data environmentsStrong expertise in data engineering and data warehousing conceptsAdvanced proficiency in SQL, Python, and ETL/ELT frameworks, including performance tuningHands-on experience with Azure and Databricks (Lakehouse architecture, Delta Lake, Unity Catalog)Experience working with enterprise-scale data systems and integrationsProven ability to lead and collaborate across cross-functional teamsPreferred ExperienceExperience with Snowflake or other modern cloud data platformsBackground working with regulated or highly governed datasetsFamiliarity with CI/CD, DevOps practices, and data pipeline automationWhat’s OfferedCompetitive compensation and comprehensive benefits package401(k) with employer contributionHealth, dental, and vision insuranceCollaborative, high-performing team environmentOpportunities for professional development and career growthTuition reimbursement for eligible programsWork EnvironmentCollaborative, product-focused teamEmphasis on clean architecture, scalability, and continuous improvementOpportunity to make a direct impact on modern data platform initiativesIf you're passionate about building scalable data systems and working with modern cloud technologies, we’d love to connect.