{"schemaVersion":"jobsearcher.job.v1","id":"0fdcd3ad4a94c9034e24f5e6","url":"https://jobsearcher.com/jobs/0fdcd3ad4a94c9034e24f5e6","canonicalUrl":"https://jobsearcher.com/jobs/0fdcd3ad4a94c9034e24f5e6","title":"QA Engineer","description":"DataServ/xFact is seeking a QA Engineer to serve as the subject matter expert for Quality Assurance. You will test automation for our enterprise web, mobile, and backend products, and Help evaluate and improve AI/LLM-powered features, including how they're tested, measured, and released. You'll ensure the quality and reliability of our products while helping define and execute the crucial testing and evaluation workflows for our AI-driven features.\r\nWhy you'll love us:\r\nWe care. We coach. We lead.We continue to use this approach in all we do for our culture. It's truly the people who make working here great. We are a collaborative environment and supportive of one another, providing flexibility when needed. As lifelong learners, promoting from within is a priority to provide our team members opportunities for internal mobility and growth. DataServ/xFact offer a competitive compensation plan including paid holidays, PTO, discretionary bonuses, 401K (with match), medical, dental, vision, life, STD, and LTD benefits along with many other inclusive benefits and perks!\r\nWho we are\r\nxFact and DataServ offer a collaborative, mission-driven workplace where technology supports real people and real outcomes. With nearly 40 years of experience and a growing footprint in the public sector, our teams work together to build practical, innovative solutions that matter. We value trust, clarity, and impact—and we give our employees the opportunity to do meaningful work, grow their skills, and contribute without unnecessary complexity.\r\nQualities we want in you\r\nteam player\r\nexcellent written and verbal communicator\r\ntech savvy\r\nstrategic thinker\r\nservice oriented\r\nmotivated\r\nself-disciplined\r\nprofessional\r\nflexible in a fast-paced environment\r\nworks independently with minimal supervision\r\nexhibits strong work ethics\r\ndetail oriented\r\nhandles demanding situations/timelines\r\norganized\r\nresponsible/dependable\r\nwilling to receive/provide feedback to improve performance\r\nsupportive\r\nstrong desire to support and mentor\r\nWhat you'll do:\r\nQuality Assurance & Test Automation\r\nTest Planning & Execution - Design, develop, and execute manual and automated test plans and test cases for enterprise features across web, mobile, and backend systems.\r\nRegression & Release Testing - Run regression suites before releases to ensure existing functionality remains stable as new features and models are deployed.\r\nDefect Management - Identify, document, prioritize, and track defects using tools like Jira, and collaborate with developers to drive timely resolution.\r\nCI/CD & Process Improvement - Integrate tests into CI/CD pipelines (e.g. GitLab CI) and participate in continuous improvement of QA processes, tools, and methodologies.\r\nAI & LLM Evaluation\r\nEvaluation Planning - Partner with Product Managers and Data Scientists to define scope, metrics, and goals for evaluating AI and LLM-powered features (e.g., accuracy, robustness, fairness, hallucination rate, safety).\r\nData Curation & Preparation - Coordinate collection, labeling, and preparation of datasets used for AI model testing and human-in-the-loop evaluations.\r\nEvaluation Execution & Coordination - Help organize evaluation sprints, red-teaming sessions, and feedback loops, acting as a point of contact between AI/ML, Product, QA, and external evaluators (if applicable).\r\nResults Analysis & Reporting - Compile and summarize evaluation results, providing clear, actionable feedback on model performance and readiness for production deployment.\r\nDocumentation & Traceability - Maintain detailed documentation of evaluation criteria, test data, prompts, and results, ensuring traceability and auditability for AI/LLM releases.\r\nAI for QA (Tooling & Enablement)\r\nUse LLMs and AI tools (e.g., ChatGPT, Copilot, AI testing platforms) to generate test ideas, draft test cases, and assist with log/defect analysis, then validate and refine these outputs.\r\nHelp evaluate and adopt AI-powered QA tools (e.g., self-healing locators, intelligent test selection, test impact analysis). Contribute to best practices and guardrails for using AI safely and effectively in QA and evaluation workflows.\r\nWhat we require\r\nEducation\r\nBachelor's degree in computer science, or related proessional experience in Quality Assurance\r\nExperience\r\n2+ years in Software Quality Assurance or a similar role.\r\nSkills\r\nExperience designing and executing manual and automated tests\r\nTools\r\nFamiliarity with test management tools (e.g., TestRail or similar),\r\nVersion control (e.g., Git).\r\nAdditional proficiencies we seek\r\nDemonstrates excellent written and verbal communication skills, in both collaborative team and customer-facing environments\r\nCandidates are required to complete a drug test and background check\r\nDataServ/xFact is an equal opportunity employer and does not discriminate in hiring or employment, in accordance with the requirements of all applicable laws, including race, color, religion, national origin, ancestry, age, gender, marital status, military status, sexual orientation, disability, or medical condition.\r\nJ-18808-Ljbffr","company":"Dataserv Integrations","rawCompany":"dataserv integrations","city":"Andover","state":"MA","isRemote":false,"isActive":false,"createdAt":"2026-07-04T01:33:20.309Z","occupations":[{"code":"15-1253.00","title":"Software Quality Assurance Analysts and Testers","slug":"software-quality-assurance-analysts-and-testers"},{"code":"19-4099.01","title":"Quality Control Analysts","slug":"quality-control-analysts"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"QA Engineer","description":"DataServ/xFact is seeking a QA Engineer to serve as the subject matter expert for Quality Assurance. You will test automation for our enterprise web, mobile, and backend products, and Help evaluate and improve AI/LLM-powered features, including how they're tested, measured, and released. You'll ensure the quality and reliability of our products while helping define and execute the crucial testing and evaluation workflows for our AI-driven features.\r\nWhy you'll love us:\r\nWe care. We coach. We lead.We continue to use this approach in all we do for our culture. It's truly the people who make working here great. We are a collaborative environment and supportive of one another, providing flexibility when needed. As lifelong learners, promoting from within is a priority to provide our team members opportunities for internal mobility and growth. DataServ/xFact offer a competitive compensation plan including paid holidays, PTO, discretionary bonuses, 401K (with match), medical, dental, vision, life, STD, and LTD benefits along with many other inclusive benefits and perks!\r\nWho we are\r\nxFact and DataServ offer a collaborative, mission-driven workplace where technology supports real people and real outcomes. With nearly 40 years of experience and a growing footprint in the public sector, our teams work together to build practical, innovative solutions that matter. We value trust, clarity, and impact—and we give our employees the opportunity to do meaningful work, grow their skills, and contribute without unnecessary complexity.\r\nQualities we want in you\r\nteam player\r\nexcellent written and verbal communicator\r\ntech savvy\r\nstrategic thinker\r\nservice oriented\r\nmotivated\r\nself-disciplined\r\nprofessional\r\nflexible in a fast-paced environment\r\nworks independently with minimal supervision\r\nexhibits strong work ethics\r\ndetail oriented\r\nhandles demanding situations/timelines\r\norganized\r\nresponsible/dependable\r\nwilling to receive/provide feedback to improve performance\r\nsupportive\r\nstrong desire to support and mentor\r\nWhat you'll do:\r\nQuality Assurance & Test Automation\r\nTest Planning & Execution - Design, develop, and execute manual and automated test plans and test cases for enterprise features across web, mobile, and backend systems.\r\nRegression & Release Testing - Run regression suites before releases to ensure existing functionality remains stable as new features and models are deployed.\r\nDefect Management - Identify, document, prioritize, and track defects using tools like Jira, and collaborate with developers to drive timely resolution.\r\nCI/CD & Process Improvement - Integrate tests into CI/CD pipelines (e.g. GitLab CI) and participate in continuous improvement of QA processes, tools, and methodologies.\r\nAI & LLM Evaluation\r\nEvaluation Planning - Partner with Product Managers and Data Scientists to define scope, metrics, and goals for evaluating AI and LLM-powered features (e.g., accuracy, robustness, fairness, hallucination rate, safety).\r\nData Curation & Preparation - Coordinate collection, labeling, and preparation of datasets used for AI model testing and human-in-the-loop evaluations.\r\nEvaluation Execution & Coordination - Help organize evaluation sprints, red-teaming sessions, and feedback loops, acting as a point of contact between AI/ML, Product, QA, and external evaluators (if applicable).\r\nResults Analysis & Reporting - Compile and summarize evaluation results, providing clear, actionable feedback on model performance and readiness for production deployment.\r\nDocumentation & Traceability - Maintain detailed documentation of evaluation criteria, test data, prompts, and results, ensuring traceability and auditability for AI/LLM releases.\r\nAI for QA (Tooling & Enablement)\r\nUse LLMs and AI tools (e.g., ChatGPT, Copilot, AI testing platforms) to generate test ideas, draft test cases, and assist with log/defect analysis, then validate and refine these outputs.\r\nHelp evaluate and adopt AI-powered QA tools (e.g., self-healing locators, intelligent test selection, test impact analysis). Contribute to best practices and guardrails for using AI safely and effectively in QA and evaluation workflows.\r\nWhat we require\r\nEducation\r\nBachelor's degree in computer science, or related proessional experience in Quality Assurance\r\nExperience\r\n2+ years in Software Quality Assurance or a similar role.\r\nSkills\r\nExperience designing and executing manual and automated tests\r\nTools\r\nFamiliarity with test management tools (e.g., TestRail or similar),\r\nVersion control (e.g., Git).\r\nAdditional proficiencies we seek\r\nDemonstrates excellent written and verbal communication skills, in both collaborative team and customer-facing environments\r\nCandidates are required to complete a drug test and background check\r\nDataServ/xFact is an equal opportunity employer and does not discriminate in hiring or employment, in accordance with the requirements of all applicable laws, including race, color, religion, national origin, ancestry, age, gender, marital status, military status, sexual orientation, disability, or medical condition.\r\nJ-18808-Ljbffr","datePosted":"2026-07-04T01:33:20.309Z","dateModified":"2026-07-04T01:33:20.309Z","hiringOrganization":{"@type":"Organization","name":"Dataserv Integrations","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Andover","addressRegion":"MA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0fdcd3ad4a94c9034e24f5e6"},"url":"https://jobsearcher.com/jobs/0fdcd3ad4a94c9034e24f5e6"}}