Senior Engineer - AI QE

About Apexon:Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core competencies - in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences - to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients' toughest technology problems, and a commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents.We enable #HumanFirstDIGITALAI QE Senior Engineer - Job description:We are seeking an experienced AI Quality Engineering (QE) Architect & Governance Leader to drive end-to-end quality, automation, and governance for AI, ML, and GenAI solutions across mission-critical and highly regulated environments. This role combines deep expertise in automation, AI/ML technologies, and agentic workflows with strong leadership in governance, risk, and compliance-especially for Energy/Utilities/Nuclear domains.You will architect future-state AI QE frameworks, establish testing standards for LLMs and agents, automate validation pipelines, enforce model governance, and lead enterprise-wide assurance initiatives.Visa Status - US Green Card or CitizenCountry - USA, CanadaLocation - Onsite FPL West Palm Beach , FloridaCore Experience & Qualifications10-14 years as a Technology Architect, SDET, or QE Leader with strong coding skills in Python, TypeScript, or Java.Proven experience designing automation frameworks or developer tools for large engineering organizations.Hands-on expertise with Large Language Models (LLMs), prompt engineering, and safety evaluation techniques.Exposure to Agentic AI systems and orchestration tools such as LangGraph, AutoGen, CrewAI, or similar agent frameworks.Experience implementing Model Context Protocol (MCP) for real-time automation, autonomous workflows, or CI/CD integrations.Experience working in highly regulated industries-Energy, Utilities, Nuclear, Healthcare, BFSI, or similar.AI / ML Technologies* Practical experience with frameworks and ecosystems:LangChain, Hugging Face, GPT models, vector databases* Working knowledge of ML/DL libraries:Scikit-learn, TensorFlow, Keras, PyTorch, HuggingFace Transformers, OpenCV, NLTK and BART* Understanding of RAG architectures, embeddings, and semantic search (bonus).GenAI & AI Agent DevelopmentExpertise in designing, developing, validating, and deploying Generative AI solutions.Experience building AI agents, multi-agent workflows, or autonomous decision systems.Ability to define governance for:LLM drift detectionPrompt quality standardsAgent monitoring & observabilityData lineage & model versioningAutomation & Quality Engineering* Strong experience building test automation frameworks using Python, PyTest, Selenium, Playwright, and Requests.* Ability to create automated tests covering:FunctionalAPIIntegrationPerformanceSecurityAI/ML validation (LLM testing, model accuracy, hallucination detection)* Proficiency in API testing and validation of RESTful services.* Plus: Experience with performance/load testing tools K6 or JMeter.AI Governance & Compliance* Establish AI/ML quality standards, testing guidelines, and risk controls.* Define governance around:Data security & privacyModel evaluation KPIs (accuracy, bias, toxicity, hallucination rates)Regulatory alignment for Energy/Utility operationsContinuous monitoring & drift alerts* Experience working with IRB, compliance, or audit teams.Cloud, DevOps & CI/CD* Knowledge of deploying AI and automation solutions on AWS.* Experience implementing CI/CD pipelines for ML and LLM models:Model versioning & lifecycleRetraining workflowsAutomated evaluation gatesInfrastructure-as-code (IAC) familiarity* Experience implementing observability frameworks for AI/ML systems.SDLC & CollaborationStrong understanding of end-to-end SDLC and QE methodologies.Work closely with developers, product managers, data scientists, and business stakeholders.Ability to provide clear communication around test strategy, risks, coverage, and governance readiness.Skilled in defect triage, risk-based testing, and quality strategy leadership.Our Commitment to Diversity & Inclusion:Did you know that Apexon has been Certified by Great Place To Work, the global authority on workplace culture, in each of the four regions in which it operates: USA (for the seventh time in 2026), India (for the tenth consecutive time in 2026), the UK(for the fourth time in 2026) and Mexico (for the second time in 2026). Apexon is committed to being an equal opportunity employer and promoting diversity in the workplace. We take affirmative action to ensure equal employment opportunity for all qualified individuals. Apexon strictly prohibits discrimination and harassment of any kind and provides equal employment opportunities to employees and applicants without regard to gender, race, color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. You can read about our Job Applicant Privacy policy here Job Applicant Privacy Policy (apexon.com)Our Commitment to Environment:Actively contribute to Apexon's commitment to environmental responsibility by following sustainable practices and supporting ESG initiatives.Our Perks and Benefits:Our benefits and rewards program has been thoughtfully designed to recognize your skills and contributions, elevate your learning/upskilling experience and provide care and support for you and your loved ones. As an Apexon Associate, you get continuous skill-based development, opportunities for career advancement, and access to comprehensive health and well-being benefits and assistance.We also offer:oHealth Insurance with Dental & Visiono401K PlanoLife Insurance, STD & LTDoPaid Vacations & HolidaysoPaid Parental LeaveoFSA Dependent & Limited Purpose careJob Location :New York, United StatesLatest Digital InsightsKnowledge HubBLOGWhy Rapid Experimentation Is the New Enterprise SuperpowerSeventy percent of Fortune 500 companies from the year 2000...Success StoryLeading Retailer Elevates Digital Service Levels...Apexon delivers unified, automated QE framework for all...Success StoryA Leading Automotive SaaS Provider Revolutionizes Identity Management with...Apexon Enhances User Satisfaction 40% Increased System Resilience with Centralized Identity ManagementVideosAgentRiseTM on GCP: Agentic AI, Natively IntegratedApexon has built the #agentrise foundation on Google...Explore More InsightsWHITE PAPERThe Future of BFSI: Generative AI in Financial ServicesBuilding A Roadmap To SuccessBlogSave Custom MVC forms data onto Sitecore Experience Forms...Today in this blog, we will be going through how...ServicesTAKE THE QUALITY ENGINEERING SELF-ASSESSMENTHow can we help you?Please enable JavaScript in your browser to complete this form.Please enable JavaScript in your browser to complete this form.Layout Lead CaptchaMultiple Choice *Artificial IntelligenceData & AnalyticsDigital EngineeringExperienceName *FirstLastBusiness Email *Direct Phone NumberQuestion or Message *Custom Captcha *=Checkboxes* privacy policy and terms and conditions)" aria-errormessage="wpforms-24789-field_29_1-error" checked='checked'>By checking this box, I agree to receive SMS messages about [Message Type] from Apexon at the phone number provided above. The SMS frequency may vary. Data rates may apply. Text HELP to (408) 727-1100 for assistance. Reply STOP to opt out of receiving SMS messages (privacy policy and terms and conditions)Lead Source *Lead SourceSearch - Organic