QA (GEN AI or LLM)-W2

JOB : QA (GEN AI or LLM) Location: New York City NY- Onsite  Responsibilities• Work as part of a DBA fleet, on QE processes with heavy focus on execution of automation with various automation tools and techniques.• Develops test strategies and plans for Generative AI implementations.• Design and execute test cases to validate the functionality, performance, and reliability of Generative AI solutions.• Collaborate with stakeholders to identify testing requirements and priorities.• Identify and document defects, issues, and risks related to Generative AI implementations.• Work closely with developers and program managers to prioritize and resolve issues in a timely manner.• Develop and maintain automated test scripts and frameworks for efficient and effective testing.• Drive continuous improvement and best practices in testing methodologies and processes for Generative AI implementations.• Stay up to date with new testing approaches, tools, and test strategies Required Skills• 8+ years of proven work experience in Quality Engineering.• Integrate LLM automation tests into the continuous integration and continuous deployment pipelines. Hands-on experience in prompt engineering concepts.• Proven experience in developing and implementing automation frameworks for Large Language Models. Strong programming skills in languages such as Python, Java, or similar. Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG).• Knowledge of NLP (Natural Language Processing) concepts and techniques.• Familiarity with CI/CD pipelines and version control systems (e.g., Jenkins, Git).• Strong problem-solving and analytical skills.• Experience in automation technologies including Selenium, Junit, Gherkin, JMeter etc. and scripting languages including java.• Proficiency in usage of PostgreSQL and Vector databases(ReDis) or large datasets.• Team player with good communication skills to work effectively in a global team. Desired Skills• Working knowledge of cloud-based application architecture and principles.• Prior experience working in the Financial Services Industry• Familiarity with building large-scale AI products or platforms for NLP, or recommendation systems serving millions of users.• Familiarity with Graph or Network Theory and Graph ML, including relevant frameworks and libraries such as Deep Graph Learning (DGL) or NER, Levenshtein Distance Educational Qualification:• Minimum BS degree in Computer Science, Engineering or a related field     Thanks and RegardsAjita BishwakarmaPhone: 9712590275 *131Email: ajita@apetan.com Apetan Consulting LLC