AI Quality Assurance Analyst

AI Quality Assurance AnalystDepartment: Systems ManagementEmployment Type: Full TimeLocation: Bloomington, MNReporting To: Head of Testing & SupportCompensation: $90,000 - $100,000 / yearDescriptionWe are seeking an AI Quality Assurance (QA) Analyst to support the testing, validation, and continuous improvement of AI-driven solutions within our mortgage platform. This role ensures that AI models, automation tools, and system integrations function accurately, compliantly, and efficiently across the loan lifecycle. The ideal candidate has experience in mortgage operations (e.g., underwriting, processing, or closing) combined with strong QA/testing skills and an interest in AI technologies.Responsibilities and DutiesValidate AI-driven outputs related to loan processing, underwriting, document recognition, and decisioning.Design and execute test cases for AI models, automation workflows, and system enhancements.Identify, document, track defects, inconsistencies, and performance issues.Perform regression, functional, and user acceptance testing (UAT) for mortgage systems.Collaborate with product, engineering, and data science teams to improve AI accuracy and reliability.Analyze AI model behavior and flag potential risks, biases, or compliance concerns.Ensure alignment with mortgage industry regulations and investor guidelines (e.g., Non-QM with the future agency).Support data validation efforts, including OCR (optical character recognition) and document classification tools.Monitor production performance and provide feedback for ongoing AI model training and optimization.Assist in developing QA standards and best practices for AI implementations.Education and Experience3+ years of experience in QA, software testing, or mortgage operationsStrong understanding of the mortgage lifecycle, including origination, processing, underwriting, and closingExperience with Loan Origination Systems (LOS), such as Vesta, LauraMac, or similar platforms2+ years of ServiceNow ticketing experience requiredFamiliarity with QA methodologies, including test planning, execution, and defect trackingStrong analytical and problem-solving skills with a high level of attention to detailAbility to analyze system behavior and validate expected versus actual resultsPreferred QualificationsExperience with AI/ML tools, automation platforms, or intelligent document processingUnderstanding of OCR, NLP, or decisioning enginesKnowledge of mortgage compliance and regulatory requirementsExperience with SQL, data validation, or basic scripting is a plusExposure to Agile or Scrum development environmentsAbility to work in a hybrid office setting in Bloomington, MNKey CompetenciesAI & QA Testing Expertise: Designs and executes test cases to validate AI models, automation workflows, and system functionality.Analytical & Critical Thinking: Evaluates AI outputs, identifies discrepancies, and assesses model behavior for accuracy and risk.Mortgage Domain Knowledge: Applies understanding of loan lifecycle, documentation, and regulatory requirements to testing scenarios.Attention to Detail & Data Validation: Ensures precision in testing, defect tracking, and validation of OCR and document classification outputs.Cross-Functional Collaboration: Works effectively with product, engineering, and data science teams to improve AI performance.How This Role Demonstrates Our ValuesIntegrity: Ensures AI-driven decisions and outputs are accurate, compliant, and aligned with regulatory and investor requirements.Collaboration: Partners with cross-functional teams to enhance AI solutions and support seamless system performance.Excellence: Maintains high standards in testing, validation, and continuous improvement of AI-driven processes.Critical Curiosity: Investigates AI behavior, identifies potential risks or biases, and seeks opportunities to improve model accuracy and efficiency.BenefitsCompetitive compensation package, including base salary and performance-based bonus opportunities401(k) plan with 100% company match up to 4%Comprehensive health coverage: medical, dental, vision, HSA, and FSA optionsGenerous paid time off: 20 days PTO, company holidays, and sick timePaid parental leaveCompany-paid life insurance and disability coverageEmployee Assistance Program (EAP): mental health, financial, and wellness supportProfessional development: tuition reimbursement and growth opportunitiesCommuter and transit benefitsVerus Mortgage Capital is an equal opportunity employer. All qualified applicants are welcomed to apply and will receive consideration for employment without unlawful discrimination because of a person's race, religious creed, color, national origin, citizenship status, ancestry, marital status, sex, age, or sexual orientation, or because of a person's disability or medical condition.J-18808-Ljbffr