Big Data Engineer

A global technology powerhouse is looking for a Big Data Engineer to join their team. This company is at the forefront of innovation, delivering cutting-edge solutions that transform industries and improve lives worldwide.The Role Build and operate an enterprise Unified Data Layer (UDL) for IT and OT data. Engineer batch, CDC, and streaming pipelines to deliver performant data products. Model curated and semantic layers, hardening run-state with testing, CI/CD, security, and observability. Partner closely with data teams and the larger IT organization to design and deliver scalable, secure data pipelines and models. Integrate OT data via OPC UA/MQTT, broker/DMZ patterns, and read-only historian feeds. Embed data quality rules, unit/integration tests, and validation checks.What You'll Need Minimum 5 years of experience in data engineering, building production pipelines at scale (batch/CDC/streaming). Hands-on experience with Azure data stack: Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault. Strong SQL and Python/PySpark skills, with comfort in Spark Structured Streaming and performance tuning. Experience implementing tests/observability (freshness, schema, expectations), and Git-based CI/CD. Familiarity with SAP S/4HANA structures and SAP DataSphere semantic modeling. Understanding of OT concepts: historians (PHD/PI), OPC UA/MQTT, event/batch frames, ISA-95/99 basics.What's On Offer Opportunity to work on critical data infrastructure for a global company. Contribute to projects spanning Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate analytics. Collaborate with a highly skilled data team and IT organization. Exposure to advanced data engineering practices and cutting-edge Azure technologies.Apply via Haystack today!