Fabric Data Lead

Position: Fabric Data EngineerLocation: San Jose, CADuration: Long term ContractRole OverviewWe are seeking a Senior Fabric Data Engineer to design, build, and optimize enterprise-grade data solutions using Microsoft Fabric. The ideal candidate has deep expertise across Lakehouse, Data Engineering, Data Factory Pipelines, Real-time Analytics, SQL, and Power BI, with strong experience modernizing data platforms and delivering scalable, governed analytics solutions.Key Responsibilities1. Data Engineering & Lakehouse DevelopmentDesign and develop Lakehouse architecture using Fabric’s OneLake, Delta tables, and Medallion architecture.Build scalable Dataflows Gen2, Notebooks (PySpark / SQL), and Pipelines for ingestion, transformation, and orchestration.Optimize data models, pipelines, and storage for performance, cost efficiency, and governance.2. ETL / ELT & PipelinesCreate end-to-end ETL/ELT processes leveraging:Data Factory (Pipelines, Dataflows Gen2)Eventstream / Real-Time Hub (for streaming)Spark notebooks for batch + streaming workloadsImplement CI/CD for Fabric workloads using Git integration and deployment pipelines.3. Data Modeling & AnalyticsBuild semantic models in Fabric supporting analytics layers.Work closely with Power BI developers to define DAX measures, relationships, and governed datasets.Implement best practices for Dimensional Modeling, star schema, and performance tuning.4. Governance & SecurityImplement data governance frameworks, lineage, cataloging, and metadata management in Purview.Apply Fabric security best practices:Row-level security (RLS)Access control on OneLake and workspace rolesSensitivity labels and retention5. Collaboration & LeadershipPartner with cross-functional teams—Data Scientists, BI Engineers, Domain Owners, and Business Stakeholders.Provide technical mentorship to junior engineers.Contribute to establishing Fabric Center of Excellence, reusable standards, patterns, and accelerators.Required Skills7–10+ years of experience in Data Engineering.Strong hands-on experience with Microsoft Fabric (at least one production implementation).Deep knowledge of:PySpark / Spark SQLLakehouse & Delta architectureData Factory (Fabric)Power BI datasetsGit integration & DevOps practicesExpertise in designing high-performance data pipelines (batch + real-time).Strong SQL skills and understanding of distributed compute optimization.Preferred SkillsExperience with Azure Data Platform (ADLS, ADF, Synapse, Databricks).Exposure to KQL and Real-time Analytics in Fabric.Knowledge of Machine Learning pipelines or integration patterns.Experience with Purview or other data governance tools.Familiarity with Agile delivery and working in product-based data teams.