Senior Data Engineer | Streaming Platforms | Kafka, Iceberg & MPP
About The OpportunityWe are looking for a Senior Data Engineer to join a global leader in the Sports Digital Platform & E-commerce space.You will be part of the Streaming Data Platform team, responsible for designing and operating large-scale systems. If you thrive in environments where Kafka is the backbone and MPP databases are the playground, this is the place for you.ResponsibilitiesArchitect Real-Time Pipelines: Design and operate streaming flows with low-latency delivery to high-performance engines like StarRocks, Apache Pinot, or Druid.Master Data Skew: Implement advanced techniques (bucketing, salting, adaptive partitioning) to handle high-volume, complex data distributions.Optimize Storage: Work deeply with Apache Iceberg tables, managing compaction, file sizing, and snapshot strategies for streaming workloads.Performance Engineering: Fine-tune distributed query execution and storage layouts to balance performance and infrastructure costs.Collaborate & Innovate: Partner with analytics teams to model data for real-time dashboards that drive business decisions in a fast-paced global market.Required QualificationsCore Expertise: 5+ years of Software/Data Engineering experience with a heavy focus on Kafka (production-grade streaming).Streaming Ecosystem: Proven track record building pipelines with Java and/or Python.OLAP & MPP: Hands-on experience with StarRocks, Apache Pinot, or Apache Druid.Modern Table Formats: Working knowledge of Apache Iceberg for near-real-time workloads.Problem Solving: Deep understanding of data skew, repartitioning, and distributed query tuning.Operational Excellence: Experience monitoring and scaling production pipelines in cloud environments.