Software Engineering Director, Agentic Evaluations
For our client, we are seeking a Software Engineering Director, Agentic Evaluations to join the team of a leader in the Telecommunications & Hardware space. This leader will own the strategy and technical direction for a core evaluation capability supporting customer-facing software agents. The role blends backend engineering depth, applied AI exposure, and people leadership to build reliable systems that can assess agent performance at scale. You will partner closely with engineering stakeholders to define architecture, reusable frameworks, and repeatable processes that improve the quality and consistency of agent integrations. The work will have direct impact on how the organization evaluates and advances its software offerings in a fast-moving technology environment.
Location: Remote
Compensation: $150,000 – $180,000 annually
Responsibilities:
Build and enhance evaluations for live agents Scope feasibility for evaluating software vendor agents Own the evaluation system architecture Design reusable evaluation primitives for multiple software categories Establish repeatable processes for agent integration Monitor new frameworks for evaluation improvements Mentor and grow a team of engineers
Qualifications:
10+ years in backend or full-stack programming 2+ years of direct engineering management experience Expert in backend programming languages such as Python, Java/Kotlin, or Go Experience creating evaluations for customer-facing agents Familiarity with OpenAI, Anthropic, or Google LLMs Daily use of coding agent tools like Codex or Pi BS/BA degree in a relevant field
Benefits:
Flexible work environment Opportunities for professional development Collaborative team culture Access to cutting-edge technology Focus on work-life balance Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.