{"schemaVersion":"jobsearcher.job.v1","id":"951e91a11e846a49c839fade","url":"https://jobsearcher.com/jobs/951e91a11e846a49c839fade","canonicalUrl":"https://jobsearcher.com/jobs/951e91a11e846a49c839fade","title":"Query Engine Architect - Accelerated Apache Spark","description":"We are seeking an experienced Query Engine Architect to accelerate Apache Spark and related frameworks on GPUs. As Nvidia is leading the world in accelerated computing, we are building the next generation data processing ecosystem. Apache Spark is the most popular distributed data processing engine in data centers. It is used for a wide variety of workloads, from data preparation, feature generation, reporting, analytics, and more. Data scientists spend a considerable amount of time exploring data and iterating over machine learning (ML) experiments. Every hour of compute required to sort through datasets, extract features and fit ML algorithms impedes an efficient business workflow.\nAt NVIDIA, we are passionate about working on hard problems that have an impact. You will work with the open source community to enable Apache Spark data processing with GPUs. Data workflows can benefit tremendously from being accelerated, enabling data scientists to explore many more and larger datasets to achieve their business goals, faster and more efficiently.\nWhat you'll be doing:\nLead the query optimization effort on the RAPIDS Spark team.\nReview each stage of query processing, and identify areas for logical plan and physical plan optimization. Construct optimization of plans taking into account CPU / GPU hardware resources.\nFind opportunities for adaptive query execution that are resource aware, for example, adapting based on CPU or GPU characteristics\nIdentify where operator fusion could drive better performance\nReview columnar processing engine practices and see how they might apply to GPU based columnar processing\nEngage open source communities, including Apache Spark and\nRAPIDS\n, for technical discussions and contributions\nWork with Nvidia strategic partners on deploying accelerated data processing solutions in public cloud or on-premise clusters\nPresent technical solutions in industry conferences and meetups\nWhat we need to see:\nBS, MS, or PhD in Computer Science, Computer Engineering, or equivalent experience\n15+ years of work or research experience in software development\n5+ years working with key open source big-data projects as a contributor or committer including Apache Spark, Apache Hadoop, Apache Hive, Apache Flink, Apache Impala, Apache Drill, Apache Calcite, and Substrait\nOutstanding technical skills in crafting and implementing high-quality distributed systems\nDeep expertise in database query engines and query optimization\nExcellent programming skills in C++, Java, and/or Scala\nKnowledge of distributed system schedulers: Kubernetes, Hadoop YARN, Spark standalone, and/or Mesos\nAbility to work with multi-functional teams across boundaries and geographies\nHighly motivated with strong interpersonal skills\nWays to stand out from the crowd:\nContributions to major open source projects such as Apache Spark, Apache Hive, Apache Impala, Apache Drill, Substrait, Apache Calcite.\nWorking experience with acceleration libraries (CUDA, RAPIDS, UCX)\nBasic ML/DL experience with Spark ML and XGBoost\nWe are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. If you're passionate, creative, and driven, we'd love to have you join the team. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.\nThe base salary range is 272,000 USD - 419,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.\nYou will also be eligible for equity and\nbenefits\n. NVIDIA accepts applications on an ongoing basis.\nNVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.","company":"NVIDIA","rawCompany":"nvidia","city":"San Jose","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-04-12T21:11:44.369Z","occupations":[{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Query Engine Architect - Accelerated Apache Spark","description":"We are seeking an experienced Query Engine Architect to accelerate Apache Spark and related frameworks on GPUs. As Nvidia is leading the world in accelerated computing, we are building the next generation data processing ecosystem. Apache Spark is the most popular distributed data processing engine in data centers. It is used for a wide variety of workloads, from data preparation, feature generation, reporting, analytics, and more. Data scientists spend a considerable amount of time exploring data and iterating over machine learning (ML) experiments. Every hour of compute required to sort through datasets, extract features and fit ML algorithms impedes an efficient business workflow.\nAt NVIDIA, we are passionate about working on hard problems that have an impact. You will work with the open source community to enable Apache Spark data processing with GPUs. Data workflows can benefit tremendously from being accelerated, enabling data scientists to explore many more and larger datasets to achieve their business goals, faster and more efficiently.\nWhat you'll be doing:\nLead the query optimization effort on the RAPIDS Spark team.\nReview each stage of query processing, and identify areas for logical plan and physical plan optimization. Construct optimization of plans taking into account CPU / GPU hardware resources.\nFind opportunities for adaptive query execution that are resource aware, for example, adapting based on CPU or GPU characteristics\nIdentify where operator fusion could drive better performance\nReview columnar processing engine practices and see how they might apply to GPU based columnar processing\nEngage open source communities, including Apache Spark and\nRAPIDS\n, for technical discussions and contributions\nWork with Nvidia strategic partners on deploying accelerated data processing solutions in public cloud or on-premise clusters\nPresent technical solutions in industry conferences and meetups\nWhat we need to see:\nBS, MS, or PhD in Computer Science, Computer Engineering, or equivalent experience\n15+ years of work or research experience in software development\n5+ years working with key open source big-data projects as a contributor or committer including Apache Spark, Apache Hadoop, Apache Hive, Apache Flink, Apache Impala, Apache Drill, Apache Calcite, and Substrait\nOutstanding technical skills in crafting and implementing high-quality distributed systems\nDeep expertise in database query engines and query optimization\nExcellent programming skills in C++, Java, and/or Scala\nKnowledge of distributed system schedulers: Kubernetes, Hadoop YARN, Spark standalone, and/or Mesos\nAbility to work with multi-functional teams across boundaries and geographies\nHighly motivated with strong interpersonal skills\nWays to stand out from the crowd:\nContributions to major open source projects such as Apache Spark, Apache Hive, Apache Impala, Apache Drill, Substrait, Apache Calcite.\nWorking experience with acceleration libraries (CUDA, RAPIDS, UCX)\nBasic ML/DL experience with Spark ML and XGBoost\nWe are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. If you're passionate, creative, and driven, we'd love to have you join the team. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.\nThe base salary range is 272,000 USD - 419,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.\nYou will also be eligible for equity and\nbenefits\n. NVIDIA accepts applications on an ongoing basis.\nNVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.","datePosted":"2026-04-12T21:11:44.369Z","dateModified":"2026-04-12T21:11:44.369Z","hiringOrganization":{"@type":"Organization","name":"NVIDIA","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Jose","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"951e91a11e846a49c839fade"},"url":"https://jobsearcher.com/jobs/951e91a11e846a49c839fade"}}