Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
We’re seeking a sharp, detail-oriented Research & Data Evaluation Associate to support the quality review of research datasets, benchmarks, and task design. In this role, you’ll work closely with our team to analyze submissions across a wide range of technical domains, identifying ambiguity, inconsistencies, and opportunities for methodological improvement. You’ll help enforce high standards for clarity, reproducibility, and data robustness — contributing directly to the infrastructure used to evaluate and align advanced AI systems. Why ApplyHelp define what “good” looks like in research benchmarks and data pipelines Collaborate asynchronously in a flexible, remote-first setting Gain exposure to state-of-the-art work in AI and model alignment Work with a YC-backed company building next-gen evaluation and training infrastructure for AI labs
Responsibilities:
- Review research tasks, datasets, and benchmark contributions for quality and internal coherence
- Assess clarity, formatting, and logical consistency across structured and unstructured content
- Identify vague, contradictory, or misleading components and suggest precise edits
- Analyze results and data artifacts to flag strengths, weaknesses, and edge cases
- Propose new benchmark strategies or evaluation refinements to improve rigor
Required Qualifications:
- Comfortable working with research-level content across technical or data-heavy domains
- Strong interest in systems evaluation, data quality, and reproducibility
- Able to spot subtle inconsistencies and diagnose ambiguous or flawed instructions
- Detail-obsessed, but capable of zooming out to evaluate high-level structure and purpose
- Excellent written communication and clear, constructive feedback skills