Software Engineer | Remote

Work SnapshotType: Hourly contractLocation: RemoteCommitment: Full-time or Part-timeWhat You’ll Be DoingEvaluate AI-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completenessConduct fact-checking using trusted sources and validate outputs by executing codeAnnotate model responses by identifying strengths, gaps, and inaccuraciesAssess code quality, readability, and algorithmic soundnessEnsure responses align with expected conversational behavior and engineering best practicesApply consistent evaluation standards using defined taxonomies, benchmarks, and guidelinesWhat We’re Looking ForStrong experience in software engineering, data science, or systems designStrong academic background in computer science or a related technical fieldStrong experience in at least two programming languages such as Python, Java, C++, JavaScript, Go, Rust, or similarStrong problem-solving skills with the ability to handle complex coding challengesExperience contributing to open-source projects is a plusFamiliarity with using AI tools for coding and understanding their strengths and limitationsHigh attention to detail with the ability to identify logical flaws and inefficienciesStrong experience in model evaluation, data annotation, or RLHF is a plusAbility to explain complex technical concepts clearlyHow To ApplyUpload resumeInterviewSubmit form