{"schemaVersion":"jobsearcher.job.v1","id":"f8b4ad0639b7f5cde6b87d0d","url":"https://jobsearcher.com/jobs/f8b4ad0639b7f5cde6b87d0d","canonicalUrl":"https://jobsearcher.com/jobs/f8b4ad0639b7f5cde6b87d0d","title":"Lead Assessment Developer","description":"Outsmart is a mission-driven, early-stage startup reimagining higher education for the age of AI by creating an entirely new collegiate experience that expands access and opportunity. Backed by $38M from top venture firms including Khosla Ventures, Forerunner, DST Global Partners, and Lightspeed, the company is led by former Duolingo executives and a founding team that also includes Emmy Award winners. With a strong culture centered around high-impact, detail-oriented team members, Outsmart is already seeing significant traction, generating 1–5 million weekly organic views on social media.What You’ll Be DoingYou'll manage the full assessment development lifecycle at Outsmart — from item authoring through field testing, standard setting, scoring, and reporting. You'll work closely with psychometricians, faculty, product managers, and engineers to build rigorous, scalable assessments. As an AI-forward organization, you'll also help shape how AI tools are responsibly woven into our development and QA workflows.Who You AreMaster's degree (Ph.D. preferred) in educational measurement, assessment , or a related field3+ years managing operational, high-stakes assessment lifecycles end-to-endProven experience leading standard-setting studies and managing diverse SME panelsExperience managing external vendors for field tests and pilot studiesWorking knowledge of validity, reliability, and fairness standards (e.g., AERA/APA/NCME)Familiarity with cognitive complexity frameworks (DOK, Bloom's)Strong communicator who can translate psychometric concepts for non-technical audiencesBonus: knowledge of CTT, IRT, CDM, DIF,, AI-assisted item generation, or accreditation reviewsWhat You’ll OwnEnd-to-end assessment development operations for assigned assessmentsSME network — recruitment, training, calibration, and qualityStandard-setting studies — method selection, panel facilitation, and final reportingVendor and external partner relationships, SLAs, and security protocolsField testing and pilot operationsScoring operations for constructed-response and performance-based assessmentsProject timelines, risk identification, and stakeholder communicationCore assessment documentation — specs, blueprints, training materials, technical reportsWhat Helps You SucceedYou thrive in ambiguity and are energized by building from scratchYou balance psychometric rigor with startup pragmatism — you know when to ship and iterateYou communicate with unusual clarity across technical and non-technical audiencesYou take ownership without being asked and surface risks earlyYou're excited about AI's role in assessment and know where validation is non-negotiableYou care deeply about fairness and the learners behind every scoreSalary Range: $120K-$180KPerksCompetitive salary, equity, and benefitsHealthcare for you and your dependents (medical, dental, and vision)Parental leave for any full-time employee (birthing, non-birthing, and adoptive parents)15 PTO days per year, a winter break, and 12+ paid company holidays per yearRemote work daysLunch provided in-office dailyWorking with super talented people who want to make a difference in the worldOutsmart is committed to building an equitable and inclusive workplace and is proud to be an equal opportunity employer. We consider all qualified applicants for employment regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, veteran status, or any other characteristic protected by applicable law.","company":"Outsmart","rawCompany":"outsmart","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-05-17T14:31:31.988Z","occupations":[{"code":"11-3131.00","title":"Training and Development Managers","slug":"training-and-development-managers"},{"code":"11-9039.00","title":"Education Administrators, All Other","slug":"education-administrators-all-other"},{"code":"25-9031.00","title":"Instructional Coordinators","slug":"instructional-coordinators"}],"industries":[{"code":"611710","title":"Educational Support Services","slug":"educational-support-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Assessment Developer","description":"Outsmart is a mission-driven, early-stage startup reimagining higher education for the age of AI by creating an entirely new collegiate experience that expands access and opportunity. Backed by $38M from top venture firms including Khosla Ventures, Forerunner, DST Global Partners, and Lightspeed, the company is led by former Duolingo executives and a founding team that also includes Emmy Award winners. With a strong culture centered around high-impact, detail-oriented team members, Outsmart is already seeing significant traction, generating 1–5 million weekly organic views on social media.What You’ll Be DoingYou'll manage the full assessment development lifecycle at Outsmart — from item authoring through field testing, standard setting, scoring, and reporting. You'll work closely with psychometricians, faculty, product managers, and engineers to build rigorous, scalable assessments. As an AI-forward organization, you'll also help shape how AI tools are responsibly woven into our development and QA workflows.Who You AreMaster's degree (Ph.D. preferred) in educational measurement, assessment , or a related field3+ years managing operational, high-stakes assessment lifecycles end-to-endProven experience leading standard-setting studies and managing diverse SME panelsExperience managing external vendors for field tests and pilot studiesWorking knowledge of validity, reliability, and fairness standards (e.g., AERA/APA/NCME)Familiarity with cognitive complexity frameworks (DOK, Bloom's)Strong communicator who can translate psychometric concepts for non-technical audiencesBonus: knowledge of CTT, IRT, CDM, DIF,, AI-assisted item generation, or accreditation reviewsWhat You’ll OwnEnd-to-end assessment development operations for assigned assessmentsSME network — recruitment, training, calibration, and qualityStandard-setting studies — method selection, panel facilitation, and final reportingVendor and external partner relationships, SLAs, and security protocolsField testing and pilot operationsScoring operations for constructed-response and performance-based assessmentsProject timelines, risk identification, and stakeholder communicationCore assessment documentation — specs, blueprints, training materials, technical reportsWhat Helps You SucceedYou thrive in ambiguity and are energized by building from scratchYou balance psychometric rigor with startup pragmatism — you know when to ship and iterateYou communicate with unusual clarity across technical and non-technical audiencesYou take ownership without being asked and surface risks earlyYou're excited about AI's role in assessment and know where validation is non-negotiableYou care deeply about fairness and the learners behind every scoreSalary Range: $120K-$180KPerksCompetitive salary, equity, and benefitsHealthcare for you and your dependents (medical, dental, and vision)Parental leave for any full-time employee (birthing, non-birthing, and adoptive parents)15 PTO days per year, a winter break, and 12+ paid company holidays per yearRemote work daysLunch provided in-office dailyWorking with super talented people who want to make a difference in the worldOutsmart is committed to building an equitable and inclusive workplace and is proud to be an equal opportunity employer. We consider all qualified applicants for employment regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, veteran status, or any other characteristic protected by applicable law.","datePosted":"2026-05-17T14:31:31.988Z","dateModified":"2026-05-17T14:31:31.988Z","hiringOrganization":{"@type":"Organization","name":"Outsmart","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f8b4ad0639b7f5cde6b87d0d"},"url":"https://jobsearcher.com/jobs/f8b4ad0639b7f5cde6b87d0d"}}