QA Test Engineer

Job Role: QA Test Engineer Location: Alpharetta, GA, USA Duration: 12+ Month ContractMust have strong AI experienceEducation:Bachelor'sinComputerScience,Engineering,Data/InformationSystems,orequivalentpracticalexperience.JobDescription:TOP5SKILLSREQUIRED: -3+yearsinQAautomationorSDET-typework(adjustbylevel);1+yearexposuretoAI/LLMorML-drivenfeaturesisaplus. -StrongtestautomationinPythonand/orJava/TypeScript. -Weareaplatformteam,testingAPIsforhighperformance,automationwillbeprimaryfocus. -Strongcommunicationandanalyticalskills.ADDITIONALSKILLSREQUIRED: -Hands-onwithframeworks/toolssuchas:UI:Playwright/Cypress/SeleniumandAPI:pytest+requests,Postman/Newman,RESTAssured -CI/CDintegration:Git,GitHubActions/Jenkins/GitLabCI,testreporting,gating. -Testdesign:equivalencepartitioning,boundarytesting,risk-basedtesting,defecttriage.AI-SpecificTestingCompetencies(Key) -LLM/applicationbehaviortesting:validatingcorrectnesswhenoutputsareprobabilistic. -Evaluationstrategies:goldendatasets,scoringrubrics,human-in-the-loopreviews. -Non-determinismhandling:statisticalassertions,repeatedruns,variancethresholds. -Promptandregressionmanagement:versioningprompts,detectingpromptdrift,replaytests. -RAGtesting(ifapplicable):retrievalquality(recall/precision),groundingchecks,citationvalidation,docfreshness. -Safety&qualitychecks:hallucinationdetection,toxicity/PIIleakagechecks,policycompliancetests.Data&Observability -Abilitytocreateandmaintaintestdatasets(structured+unstructured),includingedgecases. -FamiliaritywithtelemetryforAIsystems:-loggingprompts/outputssafely,traceability,correlationIDs-toolslikeOpenTelemetry,ELK/Splunk,Datadog/Grafana(anyequivalent) -Understandingofdataprivacyconstraints(masking/redaction)andsecuretestdatapractices. -API/Microservices/Cloud -Comfortabletestingdistributedsystems:microservices,asyncworkflows,queues/events. -Basiccloudproficiency(AWS/Azure/GCP)andcontainerization(Docker,optionalKubernetes).Performance&ReliabilityTesting(AI-Aware) -Load/performancetestingforinferenceendpoints(latency,throughput,concurrency). -Cost-awaretesting(tokenusage,ratelimits,fallbacks). -Resiliencetests:retries,circuitbreakers,modeltimeouts,degraded-modebehavior.Nice-to-HaveDomainKnowledge -FamiliaritywithNLPconcepts(embeddings,contextwindows,temperature/top-p). -ExperiencewithAItooling:LangChain/LlamaIndex,evaluationtools,modelgateways. -Knowledgeofregulatory/securityneedsrelevanttothetelecomdomain. SoftSkills/WaysofWorking -Strongcommunication -abletoexplainAIqualityissuesclearlytoproductandengineering. -Comfortablepartneringwithdatascience/MLengineersandbackendteams. -Ownershipmindset:buildingreusabletestharnesses,improvingqualitymetrics,preventingregressions.