Agentic AI QA Engineering Manager

Role: Agentic AI QA Engineering ManagerLocation: New York, NY – Onsite Role Duration: 12+ MonthsJob Description:Overview of Position:The QA Engineering Manager will lead User Acceptance Testing (UAT) and Quality Engineering for large, complex initiatives within an Agile environment for the Agency Team. This role is AI first by design, with a core mandate to evolve testing from manual and script-based automation into agentic, autonomous quality systems.The successful candidate will architect and scale LLM powered testing agents that transform intake forms, requirements, and user journeys into executable test assets—integrated into CI/CD pipelines and governed through robust risk and controls frameworks. This role will partner closely with product, engineering, design, and marketing teams to ensure exceptional customer experiences at scale.Job Responsibilities -Agentic QA & Test Automation LeadershipDesign and implement agent based QA systems that autonomously generate, execute, and maintain automated test scripts using inputs such as intake forms, user stories, and acceptance criteria.Lead the transition from traditional test automation to AI assisted and agentic testing models, including self healing tests, adaptive coverage, and intelligent test prioritization.Define the testing “agent architecture” (roles, handoffs, guardrails, human in the loop controls).Automation & CI/CD IntegrationDirect development of automated test frameworks for web, mobile, and API based applications.Partner with engineering teams to integrate AI generated and agent driven tests into CI/CD pipelines.Establish telemetry, metrics, and feedback loops so agents continuously improve test quality and coverage.Strategy, Collaboration & DeliveryCollaborate with senior leaders and product/program teams to define end to end test strategies tied to customer journeys and business outcomes.Translate business requirements into structured inputs optimized for autonomous test generation.Create, manage, and communicate prioritization of features, balancing user experience, business impact, and testing risk.Coordinate across cross functional teams to align requirements, dependencies, and delivery timelines.Governance, Risk & Continuous ImprovementEnsure all AI driven testing approaches comply with enterprise risk, control, and audit requirements.Establish guardrails, validation checkpoints, and escalation paths for agent generated outputs.Conduct root cause analysis on defects, test gaps, and automation failures—feeding insights back into agent behavior and system design.Drive continuous improvement in testing efficiency, effectiveness, and reliability.Agentic AI & Advanced Automation CapabilitiesExperience using LLMs or AI systems to generate test cases, test scripts, or QA artifacts.Ability to transform structured and semi structured inputs (intake forms, user stories, journeys) into executable automation assets.Understanding of agentic patterns such as:Multi agent collaborationTool using agentsHuman in the loop validationSelf healing or adaptive automationAbility to evaluate, select, and integrate AI tooling responsibly within enterprise constraints.Required Qualifications, Capabilities, And SkillsBachelor’s degree in a relevant field (e.g., Computer Science, Engineering, Business).5 to 10 years of experience in managing testing efforts within a large-scale Agile environment, particularly in financial services.Proven experience in developing and executing automated test cases for web and mobile applications used in marketing.Understanding of marketing and martech platformsStrong understanding of Agile methodologies and testing techniques.Proficiency in tools such as Workfront Jira, Visio, PowerPoint, and Excel.Familiarity with development languages (e.g., Java, Python) and test automation tools.Comprehensive understanding of risk and controls, audit requirements, and the ability to work effectively with diverse stakeholders across the organization.