{"schemaVersion":"jobsearcher.job.v1","id":"42645e8a74b86e025a5e61dc","url":"https://jobsearcher.com/jobs/42645e8a74b86e025a5e61dc","canonicalUrl":"https://jobsearcher.com/jobs/42645e8a74b86e025a5e61dc","title":"LLM Model Response Evaluation","description":"Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.Job DescriptionEvaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities. The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities. The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more. Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions. Each task will include detailed project guidelines within the evaluation platform. Qualifications3+ years of hands-on experience in LLM / GenAI data evaluation. Master's or PhD required (PhD candidates strongly preferred). Ability to research unfamiliar topics using trusted sources and make well-supported judgments. Comfortable evaluating content across multiple modalities Additional InformationFlexible and remote workVariable workload: Accept or decline tasks based on your availabilityNo guaranteed hours: Workload may vary weekly","company":"Upwork","rawCompany":"upwork","city":"Laurel","state":"MD","isRemote":false,"isActive":false,"createdAt":"2026-08-03T11:00:50.633Z","occupations":[{"code":"27-3043.00","title":"Writers and Authors","slug":"writers-and-authors"},{"code":"27-3041.00","title":"Editors","slug":"editors"},{"code":"15-1254.00","title":"Web Developers","slug":"web-developers"}],"industries":[{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"},{"code":"541990","title":"All Other Professional, Scientific, and Technical Services","slug":"all-other-professional-scientific-and-technical-services"},{"code":"541611","title":"Administrative Management and General Management Consulting Services","slug":"administrative-management-and-general-management-consulting-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"LLM Model Response Evaluation","description":"Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.Job DescriptionEvaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities. The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities. The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more. Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions. Each task will include detailed project guidelines within the evaluation platform. Qualifications3+ years of hands-on experience in LLM / GenAI data evaluation. Master's or PhD required (PhD candidates strongly preferred). Ability to research unfamiliar topics using trusted sources and make well-supported judgments. Comfortable evaluating content across multiple modalities Additional InformationFlexible and remote workVariable workload: Accept or decline tasks based on your availabilityNo guaranteed hours: Workload may vary weekly","datePosted":"2026-08-03T11:00:50.633Z","dateModified":"2026-08-03T11:00:50.633Z","hiringOrganization":{"@type":"Organization","name":"Upwork","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Laurel","addressRegion":"MD","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"42645e8a74b86e025a5e61dc"},"url":"https://jobsearcher.com/jobs/42645e8a74b86e025a5e61dc"}}