{"schemaVersion":"jobsearcher.job.v1","id":"50c19d539808a3936690d70f","url":"https://jobsearcher.com/jobs/50c19d539808a3936690d70f","canonicalUrl":"https://jobsearcher.com/jobs/50c19d539808a3936690d70f","title":"Lead Software Engineer in Test – Agentic AI (Remote - US)","description":"Why join Nextech?\n\nWe are a leader in specialty healthcare technology solutions.\n\nWe’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.\n\nIf you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.\n\nWe are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact talent@nextech.com .\n\nJob Summary:\n\nThe Lead Software Engineer in Test – Agentic AI is responsible for leading quality engineering strategy and execution across next-generation AI-powered applications and distributed systems. This role drives the design of scalable automation frameworks, validates complex AI agent behaviors, and ensures high-quality delivery across UI, API, backend, and AI orchestration layers.\n\nAll activities must be performed in compliance with Equal Employment Opportunity (EEO) laws, HIPAA, ERISA, and all other applicable regulations.\nEssential Functions\n\nIn addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:\n\nDesign, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.\nLead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.\nValidate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.\nDevelop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.\nCollaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.\nBuild reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.\nDesign and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.\nEstablish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.\nLead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.\nMentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.\nMinimum Requirements\nBachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.\n8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.\nStrong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.\nHands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.\nExperience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.\nStrong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.\nSolid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.\nExperience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.\nExperience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.\nStrong analytical, debugging, troubleshooting, and problem-solving skills.\nExcellent organizational, communication, and stakeholder collaboration skills in Agile environments.\nExperience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).\nPreferred Qualifications\nExperience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.\nExperience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.\nKnowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.\nExperience with event-driven architectures, messaging systems, and distributed data platforms (including SQL Server).\nPrior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.\nWork Environment/Physical Demands\nRemote work\nActivities require a significant amount of work in front of a computer monitor.\nTotal Rewards:\nGenerous annual bonus opportunity\n401(k) with Employer Match\nFlexible Time Off: take time off when you need it without worrying about available hours\n11 paid holidays\nYour Day Your Way - Celebrate a day of cultural or social significance to you\nAccess to Linkedin Learning courses for professional development\nInsurance: Choice of Medical, Dental, and Vision plans\nHealth Savings Account with employer match\nFlexible Spending Account\n100% Company-Paid Parental leave (After 6 months with the company)\nCompany-Paid Life Insurance and Short/Long Term Disability Insurance\nNextech Luminary Peer Recognition Program\nEmployee Assistance Program with free counseling sessions available\nCorporate Discounts on Retail, Travel, and Entertainment\n\nWe may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.","company":"NexTech","rawCompany":"nextech","isRemote":true,"isActive":false,"createdAt":"2026-09-24T11:39:10.033Z","occupations":[{"code":"15-1253.00","title":"Software Quality Assurance Analysts and Testers","slug":"software-quality-assurance-analysts-and-testers"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"17-2112.02","title":"Validation Engineers","slug":"validation-engineers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Software Engineer in Test – Agentic AI (Remote - US)","description":"Why join Nextech?\n\nWe are a leader in specialty healthcare technology solutions.\n\nWe’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.\n\nIf you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.\n\nWe are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact talent@nextech.com .\n\nJob Summary:\n\nThe Lead Software Engineer in Test – Agentic AI is responsible for leading quality engineering strategy and execution across next-generation AI-powered applications and distributed systems. This role drives the design of scalable automation frameworks, validates complex AI agent behaviors, and ensures high-quality delivery across UI, API, backend, and AI orchestration layers.\n\nAll activities must be performed in compliance with Equal Employment Opportunity (EEO) laws, HIPAA, ERISA, and all other applicable regulations.\nEssential Functions\n\nIn addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:\n\nDesign, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.\nLead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.\nValidate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.\nDevelop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.\nCollaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.\nBuild reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.\nDesign and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.\nEstablish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.\nLead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.\nMentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.\nMinimum Requirements\nBachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.\n8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.\nStrong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.\nHands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.\nExperience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.\nStrong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.\nSolid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.\nExperience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.\nExperience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.\nStrong analytical, debugging, troubleshooting, and problem-solving skills.\nExcellent organizational, communication, and stakeholder collaboration skills in Agile environments.\nExperience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).\nPreferred Qualifications\nExperience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.\nExperience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.\nKnowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.\nExperience with event-driven architectures, messaging systems, and distributed data platforms (including SQL Server).\nPrior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.\nWork Environment/Physical Demands\nRemote work\nActivities require a significant amount of work in front of a computer monitor.\nTotal Rewards:\nGenerous annual bonus opportunity\n401(k) with Employer Match\nFlexible Time Off: take time off when you need it without worrying about available hours\n11 paid holidays\nYour Day Your Way - Celebrate a day of cultural or social significance to you\nAccess to Linkedin Learning courses for professional development\nInsurance: Choice of Medical, Dental, and Vision plans\nHealth Savings Account with employer match\nFlexible Spending Account\n100% Company-Paid Parental leave (After 6 months with the company)\nCompany-Paid Life Insurance and Short/Long Term Disability Insurance\nNextech Luminary Peer Recognition Program\nEmployee Assistance Program with free counseling sessions available\nCorporate Discounts on Retail, Travel, and Entertainment\n\nWe may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.","datePosted":"2026-09-24T11:39:10.033Z","dateModified":"2026-09-24T11:39:10.033Z","hiringOrganization":{"@type":"Organization","name":"NexTech","sameAs":"https://jobsearcher.com"},"jobLocationType":"TELECOMMUTE","applicantLocationRequirements":{"@type":"Country","name":"US"},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"50c19d539808a3936690d70f"},"url":"https://jobsearcher.com/jobs/50c19d539808a3936690d70f"}}