JOBSEARCHER

Software Engineer II

The Batch Processing Platform team is responsible for end to end big data infrastructure, data warehousing & business intelligence solutions that powers the rest of the business. The team owns both the critical data infrastructures from log ingestion, batch & stream processing, big data query & workflow systems, and also the data processing & ETL pipelines for data warehousing and business intelligence.
What You’ll Do:
  • You’ll have the opportunity to build the infrastructure platforms or the data processing pipelines that powers our critical business needs.
  • Building or using the cutting edge big data technologies such as Hadoop/Spark/Airflow/ Presto/TrinoSkills 2+ years of industry experience in big data infrastructure or data warehouse engineering.
  • Good communication skills
  • Passionate about working with data at hundreds of petabytes scale.
  • Solid experience in one of the languages in Java/Scala/Python.
  • Understanding of how to use AI tools.
  • Publications at conferences a plus
  • Experience with big data infrastructure (e.g. Hadoop/Spark/Airflow/Presto/Trino), using big data technologies for data processing.
  • Bachelor’s degree in a relevant field such as Computer Science, or equivalent experience.
Compensation: $55 - $75 per hourID: 37785918