QA Engineer

Working with a forward-thinking technology partner, you'll join a team dedicated to delivering cutting-edge AI solutions that transform enterprise operations.The Role Define and execute test scenarios for Generative AI and Agentic AI workflows. Validate natural-language questions and AI-generated responses against agreed source-of-truth results. Test NL-to-SQL generation, query execution, validation, repair, and result interpretation. Validate AI agent workflows, tool/function calls, routing, retries, fallback behavior, and error handling. Test KPI threshold alerts, automated assessments, root-cause analysis, evidence, and recommended actions. Perform functional, integration, regression, API, data, and end-to-end testing.What You'll Need Experience validating enterprise Generative AI and Agentic AI solutions. Proficiency with AWS Bedrock and Databricks environments. Ability to test conversational AI, agent workflows, and NL-to-SQL functionality. Basic understanding of the US healthcare / Medicaid domain for contextual validation. Strong skills in validating AI responses across different roles/personas and entitlement scenarios. Experience with PHI/PII handling, role-based access, and security controls testing.What's On Offer Opportunity to work on innovative AI applications. Contribute to solutions impacting healthcare and Medicaid analytics. Engage with cutting-edge technologies like Generative AI and AWS Bedrock.Apply via Haystack today!