Senior Software Engineer | $100-$150/hr
Senior Software Engineer – Python / TypeScript | AI Evaluation
Experience: 5+ Years
Job Type: Contractor
Location: Remote – USA Preferred
Start Date: Immediate
Role Overview:
We are looking for a Senior Software Engineer with strong expertise in Python, TypeScript, JavaScript, or Golang to support cutting-edge AI evaluation and preference-data projects. The ideal candidate has experience working with large codebases, data pipelines, infrastructure, preference data, and rubric creation, along with strong technical judgment and communication skills.
Key Responsibilities:
Design, refine, and iterate on rubrics and evaluation criteria for preference data.
Review and label technical data while maintaining a high quality bar.
Identify subtle quality issues in AI-generated or preference-based datasets.
Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.
Key Requirements:
5+ years of professional software engineering experience.
Strong proficiency in Python, particularly building or maintaining pipelines and infrastructure, OR strong experience with TypeScript, JavaScript or Golang.
Hands-on experience with preference data collection and/or rubric creation.
Candidate Preferences:
Candidates from Tier-1 technology companies or Tier-1 universities are preferred.
A valid and updated LinkedIn profile is mandatory and must be included in the resume.
Candidates currently working with Microsoft are not eligible for this requirement.