JOBSEARCHER

Lead Data Engineer

Location: Philadelphia, PA || Hybrid 2 days/weekly in officecontract-to-hire.
Interview: 1st and 2nd round will be teams and then a final onsite IV.USC GC only
Client domain- medical device company Typical Hours: 40/hours
Must Haves: Degreed |10+ years of exp. | Cloud Data Platforms | Lead (Player/Coach) | Azure Cloud Services | Data Pipelines | DevOps | CI/CD | Data Engineering | Data Services. The Lead Data Engineer will own the design, delivery, and maturity of production-grade data pipelines and data platforms, with a primary emphasis on real-time streaming, IoT telemetry, Databricks, Azure, data services for APIs and microservices, and reliable data products for downstream consumption. This role is focused on building and leading the data engineering foundation that powers real-time decisioning, operational applications, analytics, ML/AI model development, and data services across our Philadelphia-based customer. We are looking for a Principal Data Engineer to serve as a hands-on technical and people leader for data engineering, data platform architecture, real-time streaming, and production data services. This role will focus on designing, building, operating, and improving data pipelines and data products while also bringing principal-level judgment to architecture, stakeholder shaping, delivery priorities, team management, and production readiness. The Top Three Things We Are Looking For Strong Hands-On Production Data Engineering Builder The right candidate must be able to personally design, build, optimize, and operate production data systems, not just advise others. They should be comfortable taking messy source systems, ambiguous data needs, and high-volume telemetry streams and turning them into reliable, secure, observable, and usable data products. This includes hands-on experience with Databricks, Spark, Delta Lake, SQL, Python/PySpark, Azure data services, streaming pipelines, orchestration, CI/CD, data quality, monitoring, troubleshooting, and cost-aware production operations. Stakeholder Shaping and Data Product Mindset The right candidate should think beyond pipeline delivery and understand how data becomes a usable product capability. They should naturally ask who will use the data, what decision or workflow it supports, what latency and quality expectations matter, what downstream systems depend on it, and how success will be measured. This role requires someone who can shape requirements with stakeholders, challenge incomplete asks constructively, define MVPs, create delivery paths, and translate business needs into scalable data architecture and production-ready data services. Principal-Level Ownership, Architecture, and Team Leadership Because this role will help set the direction for the data engineering function, we value candidates who can establish standards, manage and mentor engineers, drive cross-functional alignment, and make architecture decisions that balance speed, reliability, cost, governance, and long-term maintainability. This includes experience leading teams, setting technical direction, defining production readiness standards, improving engineering practices, and influencing decisions across data engineering, software engineering, ML/AI, analytics, product, business, and operations teams.
Preferred Qualifications: 12+ years of relevant professional experience in data engineering, software engineering, data platforms, distributed systems, analytics engineering, commercial software, or production data products. Experience working as a principal, staff, lead, manager, or architect-level data engineering leader in a production environment. Experience managing direct reports, setting team priorities, developing engineers, and improving team execution and accountability. Experience working in commercial software, SaaS, digital products, healthtech, fintech, IoT, consumer technology, or other product-driven environments. Experience in startup, scale-up, innovation, new product development, or rapid-build environments where the candidate had to operate with ambiguity and drive work forward independently. Experience with Azure Event Hubs, Azure Stream Analytics, Azure Service Bus, Azure Data Factory, Azure Functions, ADLS, Azure Cosmos DB, Event Grid, or similar Azure services. Experience with medical device telemetry, IoT data, remote patient monitoring, healthcare operations, regulated data, HIPAA-sensitive environments, or safety-critical workflows. Experience building data platforms or data products that support APIs, microservices, operational applications, ML/AI systems, GenAI workflows, RAG, analytics, and executive reporting. Experience with data contracts, semantic layers, feature stores, model-ready datasets, data lineage, schema evolution, CDC, and operational feedback loops. Experience with performance tuning, cost optimization, FinOps practices, data platform reliability, and production incident management. Experience partnering with product managers, software engineers, ML engineers, analysts, business leaders, and operations teams to turn data into usable business capabilities. Experience building MVPs, validating assumptions, iterating based on feedback, and maturing prototypes into durable production systems
Skills: data products, analytics, azure, building, architecture, data engineering, software, data, data services