JOBSEARCHER

Software Engineer - Data Quality

Software Engineer – Data Quality Remote | $125k–$225kMy client is a rapidly growing AI technology company building infrastructure for the next generation of AI systems. Backed by significant VC funding and working with startups, major enterprises and leading AI labs, they are looking for a Software Engineer – Data Quality to build tools that help assess, improve and scale the quality of AI training data and evaluations. You’ll work closely with research and quality teams to turn hands-on data review processes into reliable software products, spanning frontend, backend and data workflows.
The role:
  • Build full-stack tools for reviewing tasks, inspecting agent trajectories and investigating data quality issues
  • Develop dashboards and metrics to identify quality trends, failure modes and workflow health
  • Design backend services, APIs and data workflows connecting quality checks with evaluation, task creation and feedback
  • Work with research and quality teams to turn evolving review methods into scalable, efficient workflows
  • Take successful internal prototypes and develop them into reliable production tools
  • Investigate issues within live workflows and use findings to improve the platform and prevent recurring problems
The ideal candidate will have:
  • Strong software engineering fundamentals across frontend, backend and data systems
  • Strong Python skills alongside TypeScript/React or comparable modern web technologies
  • Experience building products or internal tools end-to-end, from understanding a workflow through to production
  • Good understanding of APIs, data models and production systems
  • The ability to turn ambiguous problems into useful interfaces, automation and measurable quality checks
  • Strong communication skills and an interest in working closely with research and quality teams
Experience with data annotation, evaluation, benchmarks, ML workflows, agent traces, graders, reward signals or RL training data would be particularly valuable. This is a great opportunity for someone who enjoys working at the intersection of software engineering, AI and data quality, with significant ownership and the opportunity to take experimental tooling into production.