{"schemaVersion":"jobsearcher.job.v1","id":"98ebf7ed82da3ec6fcb6b128","url":"https://jobsearcher.com/jobs/98ebf7ed82da3ec6fcb6b128","canonicalUrl":"https://jobsearcher.com/jobs/98ebf7ed82da3ec6fcb6b128","title":"Software Engineering Director, Agentic Evaluations","description":"For our client, we are seeking a Software Engineering Director, Agentic Evaluations to join the team of a leader in the Telecommunications & Hardware space.This leader will own the strategy and technical direction for a core evaluation capability supporting customer-facing software agents. The role blends backend engineering depth, applied AI exposure, and people leadership to build reliable systems that can assess agent performance at scale. You will partner closely with engineering stakeholders to define architecture, reusable frameworks, and repeatable processes that improve the quality and consistency of agent integrations. The work will have direct impact on how the organization evaluates and advances its software offerings in a fast-moving technology environment.Location: RemoteCompensation: $150,000 – $180,000 annuallyResponsibilities Build and enhance evaluations for live agents Scope feasibility for evaluating software vendor agents Own the evaluation system architecture Design reusable evaluation primitives for multiple software categories Establish repeatable processes for agent integration Monitor new frameworks for evaluation improvements Mentor and grow a team of engineersQualifications 10+ years in backend or full-stack programming 2+ years of direct engineering management experience Expert in backend programming languages such as Python, Java/Kotlin, or Go Experience creating evaluations for customer-facing agents Familiarity with OpenAI, Anthropic, or Google LLMs Daily use of coding agent tools like Codex or Pi BS/BA degree in a relevant fieldBenefits Flexible work environment Opportunities for professional development Collaborative team culture Access to cutting-edge technology Focus on work-life balanceOur client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.","company":"Ladders","rawCompany":"ladders","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-10-30T07:56:11.422Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"11-9041.00","title":"Architectural and Engineering Managers","slug":"architectural-and-engineering-managers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineering Director, Agentic Evaluations","description":"For our client, we are seeking a Software Engineering Director, Agentic Evaluations to join the team of a leader in the Telecommunications & Hardware space.This leader will own the strategy and technical direction for a core evaluation capability supporting customer-facing software agents. The role blends backend engineering depth, applied AI exposure, and people leadership to build reliable systems that can assess agent performance at scale. You will partner closely with engineering stakeholders to define architecture, reusable frameworks, and repeatable processes that improve the quality and consistency of agent integrations. The work will have direct impact on how the organization evaluates and advances its software offerings in a fast-moving technology environment.Location: RemoteCompensation: $150,000 – $180,000 annuallyResponsibilities Build and enhance evaluations for live agents Scope feasibility for evaluating software vendor agents Own the evaluation system architecture Design reusable evaluation primitives for multiple software categories Establish repeatable processes for agent integration Monitor new frameworks for evaluation improvements Mentor and grow a team of engineersQualifications 10+ years in backend or full-stack programming 2+ years of direct engineering management experience Expert in backend programming languages such as Python, Java/Kotlin, or Go Experience creating evaluations for customer-facing agents Familiarity with OpenAI, Anthropic, or Google LLMs Daily use of coding agent tools like Codex or Pi BS/BA degree in a relevant fieldBenefits Flexible work environment Opportunities for professional development Collaborative team culture Access to cutting-edge technology Focus on work-life balanceOur client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.","datePosted":"2026-10-30T07:56:11.422Z","dateModified":"2026-10-30T07:56:11.422Z","hiringOrganization":{"@type":"Organization","name":"Ladders","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"98ebf7ed82da3ec6fcb6b128"},"url":"https://jobsearcher.com/jobs/98ebf7ed82da3ec6fcb6b128"}}