Language Model Evaluator - Fully Remote

Role ResponsibilitiesConduct fact-checking using trusted public sources and externaltools .Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.Assess reasoning quality, clarity, tone, and completeness of responses.Ensure model responses align with expected conversational behavior and system guidelines.Workindependently and asynchronouslyto meet deadlines while improvingAI model performance .Qualifications Must-HaveExcellent writing skills in EnglishStrong attention to detailBackground or experience in domains requiringstructured analytical thinking(e.g., research, policy, analytics, linguistics, engineering)PreferredPrior experience withRLHF, model evaluation, or data annotation workExperience writing or editinghigh-quality written contentExperience comparing multiple outputs and makingfine-grained qualitative judgments#J-18808-Ljbffr