<Back to Search
Medical Student
New York, NYMarch 20th, 2026
Our client, a leading medical education platform that provides AI-powered learning tools for medical students preparing for USMLE and COMLEX exams, is hiringEvaluator Subject Matter Experts (SMEs)to join their team.This project involves evaluating and assessingAI-generated medical education contentdesigned to support pre-clinical medical students. Evaluators will review responses generated by a Large Language Model (LLM) coveringbasic science topics and medical school curriculum , ensuring the information is accurate, complete, relevant, and educationally effective for first- and second-year medical students preparing forUSMLE Step 1 or COMLEX .Using internal evaluation tools and established scoring criteria, SMEs willrate AI-generated responses, provide expert feedback, and ensure the content meets appropriate medical education standards . This work plays a key role in improving the quality of AI-powered learning tools used by medical students.Part-time
Hours:5–15 hours per week during active evaluation cycles
Contract:Initial contract through December 2026 (high probability of extension)
Work Arrangement:Remote (U.S. time zones)
Compensation:$60/hourQUALIFICATIONS:
MD or DO required.
Candidates must meetone of the following criteria:
• CurrentPGY-1 residentin a U.S. medical residency program, OR
•Fourth-year medical studentfrom an ACGME-accredited medical school who has successfully passedUSMLE Step 1 & Step 2
Strong understanding ofbasic science topics and medical school curriculum
Familiarity withUSMLE Step 1 or COMLEX exam preparation content
Excellentattention to detail and analytical skills
Ability to evaluate educational content foraccuracy, completeness, relevance, and instructional quality
Comfortable usingevaluation tools, spreadsheets, and web-based platforms
Strong written communication skills with the ability to provideclear, actionable feedback
Ability to completeasynchronous evaluation tasks within set deadlines
Preferred: Prior experience reviewing or creatingmedical education content