Data Engineer - Azure & Microsoft Fabric Platform

Job SummaryPGW Auto Glass (PGWAG) is seeking a highly motivated Data Engineer to help modernize and scale our enterprise analytics platform on Microsoft Azure and Microsoft Fabric. This role will focus on designing, developing, and maintaining cloud-native data engineering pipelines that support enterprise reporting, real-time analytics, AI/ML initiatives, pricing optimization, and operational intelligence across our network of branches and distribution centers throughout the United States and Canada.The ideal candidate will possess strong experience in Azure-based data engineering, real-time event streaming, batch processing, Lakehouse architectures, and modern analytics platforms. This role sits at the intersection of Data Engineering, Cloud Architecture, Real-Time Analytics, and AI enablement.The candidate will work closely with Pricing, Supply Chain, Operations, IT Infrastructure, and Executive Leadership teams to build scalable and resilient analytics solutions using Microsoft Fabric, Azure Databricks, Event Streaming technologies, and Power BI.Role OverviewWe are seeking a mid-level Data Engineer to design, scale, and maintain our dual-engine enterprise data platform on Microsoft Azure and Microsoft Fabric. This role balances both batch and real-time processing architectures, ensuring seamless data flow from transactional systems into analytics-ready storage and semantic models.This position is critical to PGWAG’s Cloud Modernization, Data Warehouse Modernization, and AI enablement initiatives.Key Responsibilities & DutiesMicrosoft Fabric & Azure Data Engineering Design, develop, and maintain scalable enterprise data pipelines using: Microsoft FabricAzure Data FactoryFabric Data FactoryAzure DatabricksAzure Event HubsOneLakeFabric LakehouseFabric Data Warehouse Build analytics-ready datasets supporting: Pricing AnalyticsSupply Chain AnalyticsPOS Sales AnalyticsCustomer Behavior AnalyticsExecutive DashboardsAI/ML workloadsDual-Engine Data Pipelines Build and manage parallel processing architectures using: Azure Data Factory for structured batch processingAzure Event Hubs / Kafka for real-time event ingestion Support ingestion patterns including: Batch ETL/ELTChange Data Capture (CDC) / Database mirroringStreaming ingestionAPI-based integrationsSaaS integrations Develop near real-time analytics solutions using Eventstream and Real-Time Intelligence capabilities in Microsoft Fabric. Stream & Batch Processing Develop and optimize PySpark workloads using: Azure DatabricksFabric SparkSpark Structured Streaming Process: High-volume historical datasetsXML/JSON log filesStreaming transactional eventsOperational telemetry data Build scalable transformation logic for both streaming and batch architecture. Data Modeling & Transformation Model and transform enterprise data using: ANSI SQLT-SQLdbt (Data Build Tool)Lakehouse design principles Design: Star schemasSnowflake schemasSemantic modelsCurated analytical datasets Support enterprise-wide self-service analytics initiatives using governed semantic layers. Storage & Lakehouse Architecture Maintain scalable Azure Data Lake Storage (ADLS Gen2) environments. Implement and optimize: Delta Lake table formatsACID-compliant storage patternsSchema evolution and enforcementPartitioning and performance tuning Support enterprise Lakehouse architecture using Microsoft Fabric OneLake. Power BI & Analytics Enablement Partner with Analytics and Business teams to deliver: Power BI dashboardsExecutive scorecardsKPI reportingSelf-service analytics solutions Build and maintain: Semantic modelsDirect Lake datasetsRow-level securityData governance standards Support Copilot-enabled analytics and AI-assisted reporting capabilities. Infrastructure, Automation & DevOps Deploy and maintain cloud infrastructure using: TerraformAzure Resource Manager (ARM)Infrastructure-as-Code principles Automate CI/CD workflows using: Azure DevOpsGitDocker Author and orchestrate enterprise workflows using: Azure Data FactoryFabric PipelinesManaged Apache AirflowControl-M integrations where applicableData Observability & Reliability Implement automated monitoring and alerting for: Batch failuresStreaming interruptionsData quality issuesSchema driftPipeline latency Build checksum and reconciliation frameworks between source systems and analytics platforms. Support enterprise data governance and operational resiliency initiatives. Qualifications & Skills:   Required Technical SkillsCloud & Data Platforms Microsoft Azure Microsoft Fabric Azure Data Lake Storage Gen2 (ADLS Gen2) Azure Databricks Azure Data Factory Azure Event Hubs Azure Synapse Analytics / Fabric Warehouse Programming & Query Languages Python PySpark ANSI SQL T-SQL Streaming & Batch Technologies Apache Spark Structured Streaming Apache Kafka Azure Stream Analytics Event-driven architectures Data Transformation & Storage dbt (Data Build Tool) Delta Lake Lakehouse architecture Data warehousing concepts Data Modeling Star Schema Snowflake Schema Semantic Layer Design Enterprise Data Modeling Preferred Qualifications Bachelor’s or Master’s degree in: Data ScienceComputer ScienceInformation SystemsEngineeringStatisticsMathematicsor related field 3–5 years of experience in: Data EngineeringCloud AnalyticsEnterprise Data PlatformsReal-Time Data Processing Experience with: Power BI AnalyticsFabric Real-Time IntelligenceOneLakeREST APIsXML/JSON processingEvent-driven architecture Exposure to: AI/ML workloadsAzure OpenAICopilot integrationsPredictive analytics Experience supporting enterprise analytics environments with large-scale operational datasets. Soft Skills Strong analytical and problem-solving mindset Excellent communication and collaboration skills Ability to work across technical and business teams Strong organizational and prioritization skills Ability to manage multiple initiatives simultaneously Curiosity and passion for emerging cloud and AI technologies Work Environment & Physical Requirements (if Applicable)PGW Auto Glass, LLC is working in a hybrid environment. Team members are expected to commute to our Cranberry Township, PA, Headquarters three days per week. Visa sponsorship is not available for this role.Why Join PGW Auto Glass? Opportunity to help modernize enterprise analytics using Microsoft Fabric and Azure AI technologies Exposure to cutting-edge cloud-native data engineering architectures Work on highly visible enterprise initiatives with executive sponsorship Opportunity to shape the future of AI-enabled analytics at PGWAG Collaborative environment with strong growth and innovation opportunities Benefits And Compensation Comprehensive health, dental, vision, and disability coverage options. Employer-provided life insurance and long-term disability benefits. Paid time off (PTO) and paid holidays. 401(k) retirement plan with company match. Parental leave and support continuing education.