JOBSEARCHER

Bilingual Language Quality Analyst | $18.14/hr Remote

Crossing HurdlesNew York, NYRemoteMay 23rd, 2026
Type: Hourly contract Compensation: $18.14/hour Location: Remote Commitment: 10–40 hours/week Role Responsibilities Evaluate LLM-generated responses for accuracy, relevance, and usefulness across diverse topics. Conduct fact-checking using trusted public sources and external tools. Generate high-quality human feedback by annotating strengths, weaknesses, and factual errors in model responses. Assess reasoning quality, clarity, tone, and completeness of AI outputs. Ensure responses align with expected conversational behavior and system guidelines. Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks. Requirements Native-level or near-native fluency in Spanish (ILR 5 / CEFR C2) and strong English proficiency. Demonstrated experience using large language models and understanding real-world LLM use cases. Excellent writing skills with the ability to provide clear, nuanced feedback. Strong attention to detail and analytical thinking skills. Ability to work across multiple topics, domains, and evaluation criteria. Background in structured analytical domains such as research, policy, analytics, linguistics, or engineering. J-18808-Ljbffr