Bilingual Language Quality Analyst | $18.14/hr Remote
Type: Hourly contract
Compensation: $18.14/hour
Location: Remote
Commitment: 10–40 hours/week
Role Responsibilities Evaluate LLM-generated responses for accuracy, relevance, and usefulness across diverse topics.
Conduct fact-checking using trusted public sources and external tools.
Generate high-quality human feedback by annotating strengths, weaknesses, and factual errors in model responses.
Assess reasoning quality, clarity, tone, and completeness of AI outputs.
Ensure responses align with expected conversational behavior and system guidelines.
Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.
Requirements Native-level or near-native fluency in Spanish (ILR 5 / CEFR C2) and strong English proficiency.
Demonstrated experience using large language models and understanding real-world LLM use cases.
Excellent writing skills with the ability to provide clear, nuanced feedback.
Strong attention to detail and analytical thinking skills.
Ability to work across multiple topics, domains, and evaluation criteria.
Background in structured analytical domains such as research, policy, analytics, linguistics, or engineering.
J-18808-Ljbffr