Data Engineer

We’re seeking a sharp, detail-oriented Research & Data Evaluation Associate to support the quality review of research datasets, benchmarks, and task design. In this role, you’ll work closely with our team to analyze submissions across a wide range of technical domains, identifying ambiguity, inconsistencies, and opportunities for methodological improvement.You’ll help enforce high standards for clarity, reproducibility, and data robustness — contributing directly to the infrastructure used to evaluate and align advanced AI systems.Why ApplyHelp define what “good” looks like in research benchmarks and data pipelinesCollaborate asynchronously in a flexible, remote-first settingGain exposure to state-of-the-art work in AI and model alignmentWork with a YC-backed company building next-gen evaluation and training infrastructure for AI labsResponsibilitiesReview research tasks, datasets, and benchmark contributions for quality and internal coherenceAssess clarity, formatting, and logical consistency across structured and unstructured contentIdentify vague, contradictory, or misleading components and suggest precise editsAnalyze results and data artifacts to flag strengths, weaknesses, and edge casesPropose new benchmark strategies or evaluation refinements to improve rigorRequired QualificationsComfortable working with research-level content across technical or data-heavy domainsStrong interest in systems evaluation, data quality, and reproducibilityAble to spot subtle inconsistencies and diagnose ambiguous or flawed instructionsDetail-obsessed, but capable of zooming out to evaluate high-level structure and purposeExcellent written communication and clear, constructive feedback skills