Upvote
Downvote
Engineering Manager - PySpark
Share Job
- Suggest Revision
$192,000 - $260,000 a year
Full-time
- As PySpark continues to gain traction within the open source Apache Spark project and the Databricks Data Intelligence Platform, we're seeking a dedicated Engineering Team Lead to spearhead PySpark development initiatives, encompassing both open source and Databricks-specific components.
- Your primary mission will be to solidify the Apache Spark position as the go-to data processing framework within the Python community, while also using your expertise in Generative AI to make Apache Spark more user-friendly and approachable, significantly expanding its user base.
- By providing innovative, industry-leading Generative AI-based user experiences for working with data, you will help Apache Spark gain Data+AI thought leadership in the open-source community.
- Leading a talented engineering team in PySpark development and promoting the adoption of Apache Spark and the Databricks Data Intelligence Platform among Python users
- Driving the integration of Generative AI into Apache Spark to expand user base and improve user experience.
Active Job
Updated TodaySimilar Job
Relevance
Active