Senior Software Engineer – Python / TypeScript | AI Evaluation
We are looking for experienced Senior Software Engineers to support a technical AI evaluation project involving data pipelines, evaluation workflows, and preference-data quality.
What You'll Do:
- Design, refine, and maintain evaluation rubrics and criteria for preference data
- Review and label data with a strong focus on quality and consistency
- Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation
- Analyze findings and communicate clear technical recommendations
- Collaborate with researchers and engineers to turn qualitative judgments into scalable processes
Required Skills:
- 5+ years of professional software engineering experience
- Strong proficiency in Python, particularly building and maintaining pipelines or infrastructureOR strong experience with TypeScript, Golang, or JavaScriptExperience navigating or contributing to large codebases is a plus
- Hands-on experience with preference data collection and/or rubric creation
- Strong debugging, analytical, and problem-solving skills
- Excellent written and verbal communication
- Ability to evaluate technical quality and clearly explain why an implementation or output is effective
Engagement Details📍 Country: United States 🇺🇸Approved States: Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Texas, Virginia, Wisconsin, Wyoming
Skills: infrastructure, typescript, python, engineers, software