JOBSEARCHER

Lead Data Engineer

Lead Data Engineer – Databricks, Azure, Snowflake & Microsoft Fabric
Experience: 12- 15+ years
Employment Type: Full-Time – W2 Only
Location: USA – Hybrid / Onsite
Work Authorization: H4 EAD, L2S EAD, GC EAD, Green Card, US Citizen
Job Summary: We are looking for an experienced Lead Data Engineer with strong hands-on expertise in designing, developing, and implementing scalable enterprise data solutions. The ideal candidate should have extensive experience with Azure Data Engineering, Databricks, PySpark, Python, SQL, Snowflake, Microsoft Fabric, and modern data architecture. The candidate will lead end-to-end data engineering initiatives, build high-performance ETL/ELT pipelines, develop Lakehouse and Data Warehouse solutions, and drive data platform modernization across enterprise environments.
Key Responsibilities: Lead the design, development, and implementation of scalable ETL/ELT data pipelines. Architect and develop enterprise data solutions using Azure Databricks, PySpark, Python, and SQL.Build and optimize data pipelines using Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric. Design and implement Lakehouse, Data Warehouse, and modern data platform architectures. Develop and optimize Snowflake data warehouses, data models, and analytical solutions. Implement Delta Lake, Lakehouse architecture, CDC, incremental data processing, and data integration frameworks. Develop data transformation workflows using Spark SQL, PySpark, and Python. Build curated datasets, data marts, and semantic models for enterprise reporting and analytics. Optimize Spark jobs, SQL queries, pipeline performance, and cloud infrastructure costs. Implement data quality, data governance, metadata management, and data security standards. Establish CI/CD pipelines, automated deployments, monitoring, and production support processes. Collaborate with Solution Architects, Data Scientists, BI Developers, and business stakeholders. Lead technical discussions, perform code reviews, mentor engineers, and drive engineering best practices. Required Technical SkillsData Engineering: ETL, ELT, Data Pipelines, Data Integration, Data Warehousing. Programming: Python, PySpark, SQL, Spark SQL.Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2.Databricks: Apache Spark, Delta Lake, Delta Live Tables, Unity Catalog. Microsoft Fabric: OneLake, Fabric Data Factory, Lakehouse, Warehouse. Snowflake: Snowflake Architecture, SnowSQL, Streams, Tasks, Data Modeling. Big Data Technologies: Apache Spark, Hadoop, Kafka, Distributed Data Processing. Data Architecture: Lakehouse, Data Lake, Data Warehouse, Star Schema, Dimensional Modeling. BI & Analytics: Power BI, Semantic Models, Data Marts, DAX.Data Governance: Data Quality, Metadata Management, Data Lineage, Data Security. DevOps & CI/CD: Azure DevOps, Git, GitHub Actions, Jenkins, Terraform. Cloud Platforms: Microsoft Azure, AWS or GCP.
Preferred Qualifications: Experience leading enterprise-scale data engineering and cloud modernization initiatives. Strong understanding of Medallion Architecture (Bronze, Silver, Gold).Experience with Databricks Unity Catalog and Microsoft Purview. Knowledge of Snowflake Streams, Tasks, Snowpipe, and performance optimization. Experience with real-time data processing using Kafka and Azure Event Hubs. Familiarity with Infrastructure as Code using Terraform. Experience implementing automated data quality and monitoring frameworks. Strong technical leadership, communication, and problem-solving skills.
Technical Environment: Azure Databricks, PySpark, Python, SQL, Apache Spark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, ADLS Gen2, Microsoft Fabric, OneLake, Snowflake, Power BI, Kafka, Unity Catalog, Microsoft Purview, Azure DevOps, Git, Terraform, CI/CD, ETL/ELT, Lakehouse, Data Warehouse, Data Modeling.
Eligibility & Compliance: Full-Time W2 Employment Only. No C2C / Corp-to-Corp. No Third-Party Vendors. Candidates must be currently based in the USA.Strong hands-on technical and leadership experience is required.
How to Apply: Interested candidates can share their updated resumes at:
Email: manish.g@precisiontechcorp.com