Technical Consultant (Remote)

Technical Consultant (Remote) | AI Systems & Agent Training🏢 AI Training / Model Evaluation (via Scale AI)🧭 Remote | Contract / Project-basedAbout the roleAn opportunity to contribute to the development of advanced AI agents and large language models (LLMs) by providing high-quality human feedback on system behaviour, workflows, and multi-step reasoning processes.You will help improve how autonomous AI systems plan, coordinate, and execute complex tasks in real-world environments.Key responsibilitiesProvide technical feedback to improve AI agent performance and reasoning qualityEvaluate multi-step workflows and system outputs in simulated and live environmentsSupport training of LLM-based agents on orchestration and task coordinationIdentify system failures such as logic errors, prompt injection risks, or workflow breakdownsAnalyse modular backend-style systems (data, logic, reporting layers)Test and assess integrations with APIs and external toolsDeliver structured, high-quality feedback for model improvementWork with complex multi-turn system interactions and persistent state behaviourRequirements2+ years’ experience in software engineering, backend development, or AI/automation systemsStrong programming skills in Python, JavaScript, Go, or JavaExperience with SQL databases and production-grade systemsAbility to work with modular, multi-service architecturesStrong analytical thinking and attention to detailExperience working with real-world, non-simulated systems preferredAbility to communicate technical feedback clearly and preciselyNice to haveExperience building multi-step or agent-based workflowsFamiliarity with API integrations (e.g., Gmail, Supabase, external tools)Understanding of AI agent behaviour, orchestration, or memory/state systemsKnowledge of security risks in AI systems (prompt injection, privilege escalation, data leakage)