Software Engineer II
The Batch Processing Platform team is responsible for end to end big data infrastructure, data warehousing & business intelligence solutions that powers the rest of the business. The team owns both the critical data infrastructures from log ingestion, batch & stream processing, big data query & workflow systems, and also the data processing & ETL pipelines for data warehousing and business intelligence.
What You’ll Do:
- You’ll have the opportunity to build the infrastructure platforms or the data processing pipelines that powers our critical business needs.
- Building or using the cutting edge big data technologies such as Hadoop/Spark/Airflow/ Presto/TrinoSkills 2+ years of industry experience in big data infrastructure or data warehouse engineering.
- Good communication skills
- Passionate about working with data at hundreds of petabytes scale.
- Solid experience in one of the languages in Java/Scala/Python.
- Understanding of how to use AI tools.
- Publications at conferences a plus
- Experience with big data infrastructure (e.g. Hadoop/Spark/Airflow/Presto/Trino), using big data technologies for data processing.
- Bachelor’s degree in a relevant field such as Computer Science, or equivalent experience.
Compensation: $55 - $75 per hourID: 37785918