Copy of AI Code Reviewer & Systems Evaluation Engineer 1

Job Description Company DescriptionAn enterprise client is currently seeking experienced software engineers to contribute to improving advanced AI systems through human feedback. This work supports leading AI organizations in training large language models to better understand software development practices, debugging, and code quality.This is part of a cutting-edge initiative focused on enhancing how AI systems write, review, and optimize code in real-world scenarios. You'll play a key role in shaping how AI models evaluate performance, detect issues, and generate reliable outputs.Job DescriptionThis opportunity is ideal for engineers who enjoy analyzing systems, improving code quality, and working on complex technical challenges. You will contribute to AI training projects by evaluating outputs, refining logic, and identifying potential vulnerabilities.What You'll Do:Develop objective, verifiable evaluation criteria (rubrics) for system performanceReview system logs and execution paths to improve reliability and code qualityRefactor code and optimize system behavior toward ideal outcomesTest systems for vulnerabilities, including data exposure and edge-case failuresProvide detailed, high-quality feedback on system performance and outputsQualificationsRequirements:2+ years of experience in backend engineering, AI automation, or systems integrationStrong proficiency in at least two programming languages (e.g., Python, JavaScript, Go, Java)Experience working with SQL databasesProven ability to build and maintain production-grade systemsExperience working in live (non-mocked) environments with multi-step interactionsStrong analytical skills and attention to detailNice to Haves:Experience with multi-stage system workflows and coordination tasksFamiliarity with integrating tools such as APIs, databases, or external platformsUnderstanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation)Experience working with AI systems or agent-based workflowsComfort working with persistent state tracking or similar frameworksAdditional InformationFully remote and flexible work scheduleProject-based engagement with no guaranteed hoursWork on tasks based on availability and project assignmentPayment is based on completed tasks onlyMust accept project invitations before beginning workFreelancers may accept or decline tasks depending on availabilityNo guaranteed workload; volume may vary weekly