QA Engineer
QA Engineer (AI Platform) – Remote
Job Title:
QA Engineer Work Mode: Remote Shift: 7:30 PM IST – 4:30 AM IST Experience: 3+ YearsAbout the RoleWe are looking for a proactive and hands-on QA Engineer to join our AI platform team. This is an early-stage role where you will work closely with the Principal QA Engineer, owning test coverage end-to-end and ensuring AI-generated outputs are reliable, accurate, and ready for real-world business use.
Key Responsibilities:
- A. Core Testing & Automation
- Write and maintain automated test suites (unit, integration, end-to-end)
- Own test domains from design to execution and regression coverage
- Build evaluation pipelines for AI/LLM outputs including prompt testing and quality scoringB. AI & Agent TestingTest agent orchestration systems and governance workflows
- Detect model drift and prompt sensitivity issues
- Validate AI-generated outputs for accuracy and reliabilityC. Platform & Integration TestingTest data ingestion pipelines across systems (CRM, email, documents, financial data)
- Validate file ingestion (Word, Excel, PowerPoint, PDF) including edge cases
- Test streaming responses, latency, and fallback mechanismsD. Data & System Validation
- Validate knowledge graph outputs and data retrieval accuracy
- Ensure system performance under real enterprise data conditions
Required Skills:
- 3+ years of QA Engineering experience
- Strong programming skills in PythonHands-on experience with Playwright and Vitest
- Experience testing AI/LLM-based applications
- Strong understanding of API testing, async systems, and workflows
- Ability to independently own testing responsibilities
- Strong analytical and problem-solving skills
- Tech Stack ExposureAI/LLM: Anthropic Claude, OpenAI GPT, multi-model routing
- Backend: Python (FastAPI), async systems
- Data: Memgraph, Neo4j, Qdrant, PostgreSQL, Redis
- Frontend: React, Next.js, TypeScriptCloud: Google Cloud Platform, AzureDevOps: GitHub Actions, Docker
- Testing: Playwright, VitestNice to Have
- Experience with LLM evaluation frameworks (LangSmith, PromptFlow, etc.)Exposure to agent-based systems or orchestration frameworks
- Experience in regulated industries (finance, healthcare, etc.)SalaryAs per industry standards