Senior Software Engineer, Spark & DataFusion Open Source
Apple Inc. in Cupertino, California is seeking a Senior Software Engineer to advance the Apple Data Platform by accelerating Apache Spark with Apache DataFusion Comet. You will design and implement operators and expressions in a native language, extend Comet's Spark integration, and optimize reads and writes for Iceberg and Parquet while ensuring exact Spark results. You will collaborate with open-source contributors and other teams at Apple, profile workloads, tune memory and I/O, and help roll