Evaluation Lead

Waabi Evaluation Team Leader Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way.We are looking for a hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive and holistic analysis on all aspects of performance of the autonomy system. In this role, you will collaborate closely with the systems & safety team, responsible for defining the requirements & evaluation criteria, as well as the autonomy teams to understand their evaluation needs. You will get to work with Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!You will:Lead and build a cross functional team of software engineers, data analysts, and data scientists supporting automated workflows that provide high signal on autonomy performance.Design scalable production frameworks for sampling evaluation sets, developing and improving metrics, and systematically measuring the performance of both autonomy and the eval ecosystem itself.Design pipelines, tools, and dashboards to characterize autonomy performance for technical teams and executive leadership, collaborating closely with platform teams on implementation, and autonomy, systems and safety and product teams on requirements.Work closely with simulation and software teams to build solutions that leverage our data, metrics and simulation platforms effectively.Lead technical projects; contributing as an IC while also managing the team.Participate and share ideas in technical and architecture discussions, collaborating with researchers and engineers.Conduct regular one-on-one meetings to offer guidance and constructive feedback to direct reports.Qualifications:Minimum of 6+ years of autonomous vehicle industry experience including at least 2+ years managing high performing teamsExperience evaluating AI or machine learning models, ideally in self-driving or related fieldsMS/PhD or Bachelors degree in Computer Science, Data Science, Robotics and/or similar technical field(s) of studyStrong statistical backgroundExperience working with internal cross-functional partners/stakeholdersExperience with system design/architecture and algorithmsOpen-minded and collaborative team player with willingness to help othersPassionate about self-driving technologies, solving hard problems, and creating innovative solutions.Bonus/nice to have:Previous experience leading Autonomy Evaluation teamsExperience with large scale databases and analyticsThe US yearly salary range for this role is: $159,000 - $260,000 USD in addition to competitive perks & benefits. Perks/Benefits:Competitive compensation and equity awards.Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).Unlimited Vacation.Flexible hours and Work from Home support.Daily drinks, snacks and catered meals (when in office).Regularly scheduled team building activities and social events both on-site, off-site & virtually.As we grow, this list continues to evolve!Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.