<Back to Search
Medical Student
New York, NYMarch 20th, 2026
Our client, a leading medical education platform that provides AI-powered learning tools for medical students preparing for USMLE and COMLEX exams, is hiringEvaluator Subject Matter Experts (SMEs)to join their team.This project involves evaluating and assessingAI-generated medical education contentdesigned to support pre-clinical medical students. Evaluators will review responses generated by a Large Language Model (LLM) coveringbasic science topics and medical school curriculum , ensuring the information is accurate, complete, relevant, and educationally effective for first- and second-year medical students preparing forUSMLE Step 1 or COMLEX .Using internal evaluation tools and established scoring criteria, SMEs willrate AI-generated responses, provide expert feedback, and ensure the content meets appropriate medical education standards . This work plays a key role in improving the quality of AI-powered learning tools used by medical students.Part-time
Hours:5–15 hours per week during active evaluation cycles
Contract:Initial contract through December 2026 (high probability of extension)
Work Arrangement:Remote (U.S. time zones)
Compensation:$60/hourQUALIFICATIONS:
MD or DO required.
Candidates must meetone of the following criteria:
• CurrentPGY-1 residentin a U.S. medical residency program, OR
•Fourth-year medical studentfrom an ACGME-accredited medical school who has successfully passedUSMLE Step 1 & Step 2
Strong understanding ofbasic science topics and medical school curriculum
Familiarity withUSMLE Step 1 or COMLEX exam preparation content
Excellentattention to detail and analytical skills
Ability to evaluate educational content foraccuracy, completeness, relevance, and instructional quality
Comfortable usingevaluation tools, spreadsheets, and web-based platforms
Strong written communication skills with the ability to provideclear, actionable feedback
Ability to completeasynchronous evaluation tasks within set deadlines
Preferred: Prior experience reviewing or creatingmedical education content
927 matching similar jobs near New York, NY
- CNA - Start Your New Career
- EKG Technician - Start Your New Career
- Locum Physician (MD/DO) - Psychiatry - Child and Adolescent - $6,830 to $8,090 per week in Staten Island, NY
- Health Advisor
- Student Psychological Counselor/Crisis Services - Counseling Services Center (HEA)
- Nutritionist
- Teen Program Specialist - Harlem, NY
- {"title":"LVN Wellness Nurse Part Time"}
- Student Acacdemic Support Worker (MedPrep Program Facilitator)
- Variable Hours Officer, Group Fitness Instructor
- Summer Camp Counselor
- Camp Counselor - F.O. Moxley
- Behavioral Psychology Registered Nurse
- Physician Assistant / Telemedicine / New York / Permanent / Virtual Physician Assistant - NY Licensed
- Physician / Psychiatry - Child / New York / Permanent / Child Psychiatrist - New York City - Locums to Perm
- Physician / Pediatrics / New York / Permanent / Pediatric & Adolescent GYN - Fishkill/Yorktown Heights
- Physician / Pediatrics / New York / Permanent / Pediatric Adolescent Physician
- Physician / Pediatrics / New York / Permanent / Pediatric & Adolescent GYN - Yorktown Heights/ Fishkill, NY
- RN - Tele
- Behavioral Health/EAP Clinician I - Afterhours
- Nutrition Specialist
- Intern
- Art Therapist - Special Education Preschool - Manhattan
- Mental Health Therapist - Ketamine Clinic - Per Diem
- Mental Health Counselor
- DIRECTOR OF OUTPATIENT BEHAVIORAL HEALTH SERVICES
- Child/Adolescent FFS Therapist
- Licensed Mental Health Therapist (Ohio)
- Recreation Specialist (Marian Hall)
- Licensed Telehealth Therapist / Mental Health Counselor
- Early Intervention Teacher
- Licensed Behavioral Health Counselor Hybrid
- DGMH Therapist (Fee for Service)
- Licensed Mental Health Therapist (New York)
- Licensed Mental Health Therapist (Oregon)
- New York - Hospitalist/Nocturnist - Locum Need Job
- Physician / Psychiatry - Child/Adolescent / New York / Permanent / . Job
- Physician / Psychiatry - Child/Adolescent / New York / Permanent / Child and Adolescent Psychiatrist. 10-15 hours per week. Tele-Psychiatry. Job
- Physician / Internal Medicine / New York / Permanent / Hospitalist in NY StateCentral New York region Teaching facility70 miles to Albany International A Job
- Remote Virtual Prenatal Coach / Pregnancy Wellness Specialist