{"schemaVersion":"jobsearcher.job.v1","id":"0e1bdf12ac44ceef01965232","url":"https://jobsearcher.com/jobs/0e1bdf12ac44ceef01965232","canonicalUrl":"https://jobsearcher.com/jobs/0e1bdf12ac44ceef01965232","title":"Remote","description":"We are sharing a specialised part-time opportunity for licensed physicians in active clinical practice to contribute to advanced medical AI evaluation through clinical reasoning, scenario development, structured assessment, and expert review of model performance.Selected physicians will work with research teams to evaluate how AI systems approach realistic medical problems, identify gaps in clinical knowledge and reasoning, and help develop evaluation methods that reflect the complexity and nuance of evidence-based clinical practice.Key ResponsibilitiesClinical Reasoning EvaluationEvaluate AI performance on realistic medical problemsAssess the quality of clinical reasoning and decision-makingIdentify gaps in medical knowledge or clinical judgementReview model conclusions against evidence-based practiceDistinguish significant clinical errors from minor limitationsClinical Scenario DevelopmentCreate realistic scenarios for medical AI evaluationDesign cases requiring nuanced clinical judgementIncorporate diagnostic and management decision pointsDevelop scenarios reflecting real-world clinical complexityEnsure cases meaningfully test model reasoning capabilitiesEvaluation Framework DesignDesign systematic frameworks for medical AI assessmentDefine criteria for evaluating clinical reasoning qualityDevelop methods that capture nuance in clinical practiceSupport consistent assessment across repeated evaluation tasksRefine evaluation methods based on observed model performanceMedical Knowledge & Decision AnalysisAssess model understanding of clinical conceptsEvaluate diagnostic and treatment-related reasoningIdentify unsupported assumptions or missing considerationsApply specialty-specific expertise where relevantProvide structured rationale for evaluation decisionsResearch Collaboration & FeedbackCollaborate with research teams on medical AI evaluationCommunicate clinical findings clearly and conciselyProvide actionable feedback on model strengths and limitationsContribute to strategies for improving medical model performanceSupport development of clinically meaningful benchmarksIdeal ProfileLicensed physician currently engaged in active clinical practiceMD, DO, or equivalent medical qualificationPhysicians from any medical specialty may be consideredStrong experience with clinical decision-makingSolid understanding of evidence-based medicineAbility to assess complex medical reasoning objectivelyStrong analytical and critical-thinking capabilitiesExcellent written and verbal communication skillsComfortable explaining nuanced clinical decisions clearlyAbility to identify gaps in medical knowledge or reasoningInterest in how AI can support clinical practiceComfortable contributing to structured model-evaluation workflowsStrong problem-solving abilitiesAble to collaborate effectively with research teamsComfortable working independently in a remote environmentAble to integrate project work around existing clinical commitmentsEngagement DetailsPart-time remote engagementFlexible schedulingCommitment of up to 30 hours per weekInitial project duration of approximately 1 monthExtension may be available depending on performance and project fitWork will focus on clinical reasoning evaluation, scenario development, and medical benchmark designPhysicians from any clinical specialty may be consideredScheduling is intended to accommodate ongoing clinical commitmentsCompensation is not specified in the source materialsWork must be completed without using confidential, proprietary, patient-identifiable, protected health, unpublished clinical, or otherwise restricted information belonging to any patient, employer, healthcare organisation, research institution, client, or other third partyAbout the PlatformThis opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.","company":"24MAG","rawCompany":"24mag","isRemote":true,"isActive":false,"createdAt":"2026-10-09T04:40:40.184Z","occupations":[{"code":"29-1229.00","title":"Physicians, All Other","slug":"physicians-all-other"},{"code":"29-1299.00","title":"Healthcare Diagnosing or Treating Practitioners, All Other","slug":"healthcare-diagnosing-or-treating-practitioners-all-other"},{"code":"29-1216.00","title":"General Internal Medicine Physicians","slug":"general-internal-medicine-physicians"}],"industries":[{"code":"621111","title":"Offices of Physicians (except Mental Health Specialists)","slug":"offices-of-physicians-except-mental-health-specialists"},{"code":"621112","title":"Offices of Physicians, Mental Health Specialists","slug":"offices-of-physicians-mental-health-specialists"},{"code":"621999","title":"All Other Miscellaneous Ambulatory Health Care Services","slug":"all-other-miscellaneous-ambulatory-health-care-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Remote","description":"We are sharing a specialised part-time opportunity for licensed physicians in active clinical practice to contribute to advanced medical AI evaluation through clinical reasoning, scenario development, structured assessment, and expert review of model performance.Selected physicians will work with research teams to evaluate how AI systems approach realistic medical problems, identify gaps in clinical knowledge and reasoning, and help develop evaluation methods that reflect the complexity and nuance of evidence-based clinical practice.Key ResponsibilitiesClinical Reasoning EvaluationEvaluate AI performance on realistic medical problemsAssess the quality of clinical reasoning and decision-makingIdentify gaps in medical knowledge or clinical judgementReview model conclusions against evidence-based practiceDistinguish significant clinical errors from minor limitationsClinical Scenario DevelopmentCreate realistic scenarios for medical AI evaluationDesign cases requiring nuanced clinical judgementIncorporate diagnostic and management decision pointsDevelop scenarios reflecting real-world clinical complexityEnsure cases meaningfully test model reasoning capabilitiesEvaluation Framework DesignDesign systematic frameworks for medical AI assessmentDefine criteria for evaluating clinical reasoning qualityDevelop methods that capture nuance in clinical practiceSupport consistent assessment across repeated evaluation tasksRefine evaluation methods based on observed model performanceMedical Knowledge & Decision AnalysisAssess model understanding of clinical conceptsEvaluate diagnostic and treatment-related reasoningIdentify unsupported assumptions or missing considerationsApply specialty-specific expertise where relevantProvide structured rationale for evaluation decisionsResearch Collaboration & FeedbackCollaborate with research teams on medical AI evaluationCommunicate clinical findings clearly and conciselyProvide actionable feedback on model strengths and limitationsContribute to strategies for improving medical model performanceSupport development of clinically meaningful benchmarksIdeal ProfileLicensed physician currently engaged in active clinical practiceMD, DO, or equivalent medical qualificationPhysicians from any medical specialty may be consideredStrong experience with clinical decision-makingSolid understanding of evidence-based medicineAbility to assess complex medical reasoning objectivelyStrong analytical and critical-thinking capabilitiesExcellent written and verbal communication skillsComfortable explaining nuanced clinical decisions clearlyAbility to identify gaps in medical knowledge or reasoningInterest in how AI can support clinical practiceComfortable contributing to structured model-evaluation workflowsStrong problem-solving abilitiesAble to collaborate effectively with research teamsComfortable working independently in a remote environmentAble to integrate project work around existing clinical commitmentsEngagement DetailsPart-time remote engagementFlexible schedulingCommitment of up to 30 hours per weekInitial project duration of approximately 1 monthExtension may be available depending on performance and project fitWork will focus on clinical reasoning evaluation, scenario development, and medical benchmark designPhysicians from any clinical specialty may be consideredScheduling is intended to accommodate ongoing clinical commitmentsCompensation is not specified in the source materialsWork must be completed without using confidential, proprietary, patient-identifiable, protected health, unpublished clinical, or otherwise restricted information belonging to any patient, employer, healthcare organisation, research institution, client, or other third partyAbout the PlatformThis opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.","datePosted":"2026-10-09T04:40:40.184Z","dateModified":"2026-10-09T04:40:40.184Z","hiringOrganization":{"@type":"Organization","name":"24MAG","sameAs":"https://jobsearcher.com"},"jobLocationType":"TELECOMMUTE","applicantLocationRequirements":{"@type":"Country","name":"US"},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0e1bdf12ac44ceef01965232"},"url":"https://jobsearcher.com/jobs/0e1bdf12ac44ceef01965232"}}