{"schemaVersion":"jobsearcher.job.v1","id":"19cc3e4dc45fae5a20aa73f3","url":"https://jobsearcher.com/jobs/19cc3e4dc45fae5a20aa73f3","canonicalUrl":"https://jobsearcher.com/jobs/19cc3e4dc45fae5a20aa73f3","title":"AI QA Engineer","description":"AI QA Engineer - Fully Remote (EU or UK) - Professional Level English requiredAbout the CompanyOur client is an innovative AI native technology company transforming the construction industry through an AI-powered cloud platform. As they continue to build an AI-native organisation, they are looking for an AI QA Engineer to help shape quality across their product.The RoleThis is a hands-on role combining QA automation, AI/LLM testing and non-functional testing. You’ll help define testing strategy, build automation and establish the frameworks needed to test increasingly sophisticated AI and agentic features.What you’ll doOwn quality strategy across functional, non-functional and AI testing.Build automated performance, load and stress testing using tools such as JMeter, k6 or Gatling.Develop and contribute to LLM/AI evaluation frameworks, assessing accuracy, hallucination, relevance, safety and other quality metrics.Test AI and agentic behaviours, including non-deterministic outputs, prompts, model regressions and guardrails.Champion shift-left and continuous testing across engineering and product.Establish quality metrics, observability and production quality signals.Use AI-assisted tools to improve testing efficiency and coverage.What you bringStrong QA foundations across test planning, functional, regression and exploratory testing.Practical experience or strong working knowledge of AI/LLM testing, including hallucination, consistency, safety and latency.Strong automation experience with Playwright, Cypress or similar, using TypeScript or Python.Hands-on experience with performance/load testing and CI/CD integration.Understanding of LLM evaluation, LLM-as-a-judge and frameworks such as DeepEval or RAGAS.Experience with API testing, microservices and cloud-native environments.A strong quality ownership mindset and ability to influence engineering and product teams.Professional level of English speaking Why Join?Help shape quality within an AI-native organisation.Have genuine influence over quality strategy and engineering practices.Work on AI technology transforming the construction industry.Build new frameworks and processes rather than simply inheriting them.Join a collaborative, high-growth environment with competitive compensation and flexible working.If you’re passionate about quality, excited by AI and want to help define the future of testing, we’d love to hear from you.","company":"Develop","rawCompany":"develop","city":"Jonesboro","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-08-22T12:05:01.835Z","occupations":[{"code":"15-1253.00","title":"Software Quality Assurance Analysts and Testers","slug":"software-quality-assurance-analysts-and-testers"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"17-2112.02","title":"Validation Engineers","slug":"validation-engineers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541990","title":"All Other Professional, Scientific, and Technical Services","slug":"all-other-professional-scientific-and-technical-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AI QA Engineer","description":"AI QA Engineer - Fully Remote (EU or UK) - Professional Level English requiredAbout the CompanyOur client is an innovative AI native technology company transforming the construction industry through an AI-powered cloud platform. As they continue to build an AI-native organisation, they are looking for an AI QA Engineer to help shape quality across their product.The RoleThis is a hands-on role combining QA automation, AI/LLM testing and non-functional testing. You’ll help define testing strategy, build automation and establish the frameworks needed to test increasingly sophisticated AI and agentic features.What you’ll doOwn quality strategy across functional, non-functional and AI testing.Build automated performance, load and stress testing using tools such as JMeter, k6 or Gatling.Develop and contribute to LLM/AI evaluation frameworks, assessing accuracy, hallucination, relevance, safety and other quality metrics.Test AI and agentic behaviours, including non-deterministic outputs, prompts, model regressions and guardrails.Champion shift-left and continuous testing across engineering and product.Establish quality metrics, observability and production quality signals.Use AI-assisted tools to improve testing efficiency and coverage.What you bringStrong QA foundations across test planning, functional, regression and exploratory testing.Practical experience or strong working knowledge of AI/LLM testing, including hallucination, consistency, safety and latency.Strong automation experience with Playwright, Cypress or similar, using TypeScript or Python.Hands-on experience with performance/load testing and CI/CD integration.Understanding of LLM evaluation, LLM-as-a-judge and frameworks such as DeepEval or RAGAS.Experience with API testing, microservices and cloud-native environments.A strong quality ownership mindset and ability to influence engineering and product teams.Professional level of English speaking Why Join?Help shape quality within an AI-native organisation.Have genuine influence over quality strategy and engineering practices.Work on AI technology transforming the construction industry.Build new frameworks and processes rather than simply inheriting them.Join a collaborative, high-growth environment with competitive compensation and flexible working.If you’re passionate about quality, excited by AI and want to help define the future of testing, we’d love to hear from you.","datePosted":"2026-08-22T12:05:01.835Z","dateModified":"2026-08-22T12:05:01.835Z","hiringOrganization":{"@type":"Organization","name":"Develop","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Jonesboro","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"19cc3e4dc45fae5a20aa73f3"},"url":"https://jobsearcher.com/jobs/19cc3e4dc45fae5a20aa73f3"}}