DevOps Engineer - AI Trainer (Remote)
About the Company:
DataAnnotation helps train advanced AI models by working with experts across technical and professional fields. Contributors evaluate AI-generated work and provide feedback to improve model performance.
About the Role:
As a DevOps Engineer - AI Trainer, you will evaluate AI coding agents by testing their ability to solve real-world software engineering tasks. You will analyze generated code, identify bugs and security issues, assess reasoning, and document failures to help improve the next generation of AI systems. This is a remote, flexible opportunity for professionals with strong software development experience.
Key Responsibilities:
Use advanced AI coding models to complete engineering tasks, including fixing bugs, extending APIs, and developing features.
Review AI-generated code against production-quality engineering standards and identify errors or weaknesses.
Evaluate AI reasoning and explain why a proposed solution succeeds or fails.
Test AI-generated code for security vulnerabilities, unreliable solutions, and falsely reported test results.
Document findings and provide clear written feedback to improve AI model performance.
Required Qualifications:
Professional software development experience or substantial open-source experience delivering production-quality code.
Strong written English skills to explain technical findings clearly and accurately.
Ability to analyze code, identify issues, and assess the quality of engineering solutions.
No formal degree required; practical skills and demonstrated experience are the priority.
Salary & Benefits:
Compensation of up to $150+ per hour, depending on task difficulty and specialization.
Flexible, remote work.
Opportunity to contribute to AI model training projects, with workload and earnings depending on available tasks and individual participation.