{"schemaVersion":"jobsearcher.job.v1","id":"b2886800a2e078520ced02cc","url":"https://jobsearcher.com/jobs/b2886800a2e078520ced02cc","canonicalUrl":"https://jobsearcher.com/jobs/b2886800a2e078520ced02cc","title":"QA Engineer","description":"QA Engineer (AI Platform) – RemoteJob Title: QA Engineer Work Mode: Remote Shift: 7:30 PM IST – 4:30 AM IST Experience: 3+ YearsAbout the RoleWe are looking for a proactive and hands-on QA Engineer to join our AI platform team.This is an early-stage role where you will work closely with the Principal QA Engineer, owning test coverage end-to-end and ensuring AI-generated outputs are reliable, accurate, and ready for real-world business use.Key ResponsibilitiesA. Core Testing & AutomationWrite and maintain automated test suites (unit, integration, end-to-end)Own test domains from design to execution and regression coverageBuild evaluation pipelines for AI/LLM outputs including prompt testing and quality scoringB. AI & Agent TestingTest agent orchestration systems and governance workflowsDetect model drift and prompt sensitivity issuesValidate AI-generated outputs for accuracy and reliabilityC. Platform & Integration TestingTest data ingestion pipelines across systems (CRM, email, documents, financial data)Validate file ingestion (Word, Excel, PowerPoint, PDF) including edge casesTest streaming responses, latency, and fallback mechanismsD. Data & System ValidationValidate knowledge graph outputs and data retrieval accuracyEnsure system performance under real enterprise data conditionsRequired Skills3+ years of QA Engineering experienceStrong programming skills in PythonHands-on experience with Playwright and VitestExperience testing AI/LLM-based applicationsStrong understanding of API testing, async systems, and workflowsAbility to independently own testing responsibilitiesStrong analytical and problem-solving skillsTech Stack ExposureAI/LLM: Anthropic Claude, OpenAI GPT, multi-model routingBackend: Python (FastAPI), async systemsData: Memgraph, Neo4j, Qdrant, PostgreSQL, RedisFrontend: React, Next.js, TypeScriptCloud: Google Cloud Platform, AzureDevOps: GitHub Actions, DockerTesting: Playwright, VitestNice to HaveExperience with LLM evaluation frameworks (LangSmith, PromptFlow, etc.)Exposure to agent-based systems or orchestration frameworksExperience in regulated industries (finance, healthcare, etc.)SalaryAs per industry standards","company":"Websenor","rawCompany":"websenor","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-10-16T14:08:17.367Z","occupations":[{"code":"15-1253.00","title":"Software Quality Assurance Analysts and Testers","slug":"software-quality-assurance-analysts-and-testers"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"17-2112.02","title":"Validation Engineers","slug":"validation-engineers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"QA Engineer","description":"QA Engineer (AI Platform) – RemoteJob Title: QA Engineer Work Mode: Remote Shift: 7:30 PM IST – 4:30 AM IST Experience: 3+ YearsAbout the RoleWe are looking for a proactive and hands-on QA Engineer to join our AI platform team.This is an early-stage role where you will work closely with the Principal QA Engineer, owning test coverage end-to-end and ensuring AI-generated outputs are reliable, accurate, and ready for real-world business use.Key ResponsibilitiesA. Core Testing & AutomationWrite and maintain automated test suites (unit, integration, end-to-end)Own test domains from design to execution and regression coverageBuild evaluation pipelines for AI/LLM outputs including prompt testing and quality scoringB. AI & Agent TestingTest agent orchestration systems and governance workflowsDetect model drift and prompt sensitivity issuesValidate AI-generated outputs for accuracy and reliabilityC. Platform & Integration TestingTest data ingestion pipelines across systems (CRM, email, documents, financial data)Validate file ingestion (Word, Excel, PowerPoint, PDF) including edge casesTest streaming responses, latency, and fallback mechanismsD. Data & System ValidationValidate knowledge graph outputs and data retrieval accuracyEnsure system performance under real enterprise data conditionsRequired Skills3+ years of QA Engineering experienceStrong programming skills in PythonHands-on experience with Playwright and VitestExperience testing AI/LLM-based applicationsStrong understanding of API testing, async systems, and workflowsAbility to independently own testing responsibilitiesStrong analytical and problem-solving skillsTech Stack ExposureAI/LLM: Anthropic Claude, OpenAI GPT, multi-model routingBackend: Python (FastAPI), async systemsData: Memgraph, Neo4j, Qdrant, PostgreSQL, RedisFrontend: React, Next.js, TypeScriptCloud: Google Cloud Platform, AzureDevOps: GitHub Actions, DockerTesting: Playwright, VitestNice to HaveExperience with LLM evaluation frameworks (LangSmith, PromptFlow, etc.)Exposure to agent-based systems or orchestration frameworksExperience in regulated industries (finance, healthcare, etc.)SalaryAs per industry standards","datePosted":"2026-10-16T14:08:17.367Z","dateModified":"2026-10-16T14:08:17.367Z","hiringOrganization":{"@type":"Organization","name":"Websenor","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b2886800a2e078520ced02cc"},"url":"https://jobsearcher.com/jobs/b2886800a2e078520ced02cc"}}