Software Engineer - AI Testing
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
A company is looking for a Fluent English Software Engineer - AI Testing.
Key Responsibilities
Evaluate the performance of frontier language models on complex software engineering tasks
Identify bugs, logical errors, hallucinations, and reliability issues in model outputs
Design and review prompts, test cases, and evaluation scenarios for advanced coding workflows
Required Qualifications
3-4+ years of professional software engineering experience
Strong proficiency in at least one of: TypeScript, Ruby, Java, or C++
Demonstrated ability to reason about complex systems and debug non-obvious issues
Familiarity with modern AI / LLM tooling (Git, CLI workflows, testing frameworks, etc.)
Ability to critically evaluate model behavior rather than simply use model outputs