Computational Linguist, Generative AI - Sr. Associate

Job DescriptionJoin a team building and evaluating next-generation conversational experiences powered by generative and agentic AI. You will help define how we measure quality, safety, and customer impact at scale. This role blends deep language expertise with rigorous data-driven evaluation. You will partner closely with engineers, analysts, and annotators to turn insights into measurable improvements. If you enjoy experimentation and clear standards, this is a chance to push what is possible.Job SummaryAs a Computational Linguist, Generative AI within the Chase Digital Assistant team, you will help us evaluate and strengthen large language model-powered customer experiences. You will move between qualitative language analysis and quantitative measurement to ensure our evaluations are transparent, repeatable, and ready to support release decisions. You will design and maintain taxonomies, rubrics, and documentation that make model behavior understandable and improvable. You will work with partners across product, engineering, analytics, and operations to translate requirements into durable evaluation systems. You will help us continuously improve model correctness, customer experience, and business outcomes.In this role, you will support the evolution from traditional conversational systems to large language model-driven workflows while maintaining strong traceability and governance. You will contribute to knowledge modeling, including ontology design and knowledge graph approaches, to improve semantic reasoning and data integration. You will help create practical guardrails for generative use cases and ensure measurement stays aligned with real customer needs. You will also help solve “cold start” challenges by supporting synthetic data approaches where appropriate. Your work will directly influence how reliably and responsibly we ship new capabilities.Job responsibilitiesServe as a subject matter expert across the product lifecycle, maintaining a strong understanding of the Chase Digital Assistant from both customer and technical perspectivesManage and evolve the intent and entity taxonomy, including taxonomy governance, versioning, traceability, and rollback practicesEvaluate model behavior through qualitative linguistic analysis and quantitative measurement, surfacing actionable insightsDesign scalable evaluation processes for large language model workflows, partnering with engineers, analysts, and annotatorsImplement and maintain metrics across model correctness, customer experience, AI assurance, and business outcomesIntroduce new guardrail metrics for generative and agentic AI use cases, and monitor them over timeOwn the evaluation artifact suite, including model descriptions, prompts, rubrics, judge prompts, guidelines, calibration data, and reliability measuresSupport integration of large language models with existing conversational architectures and event tracking systemsApply ontology design principles to improve semantic consistency and data integration aligned to business standardsDesign frameworks to incorporate knowledge graphs into classification and extraction approachesIdentify optimization opportunities that improve model performance, data quality, and feature coverageRequired Qualifications, Capabilities, And SkillsMaster’s degree in Computational Linguistics, Natural Language Processing, Linguistics, or a related fieldDemonstrated experience applying computational linguistics or natural language processing to chatbots or conversational AIHands-on experience evaluating generative and agentic AI systems and workflows (for example, AutoGen, LangGraph, CrewAI, Sierra, or similar)Strong linguistic foundation in discourse and pragmaticsAdvanced knowledge of conversational AI development, including training, design, and conversation analysisHands-on experience with large language model integration, prompt engineering, evaluation, and performance monitoringProficiency in Python, Git, Linux, and Bash scriptingWorking knowledge of common natural language processing and data science libraries (for example, pandas, NumPy, scikit-learn, NLTK)Experience with transformer-based models (for example, BERT- and GPT-style models), including fine-tuning and applied useComfort working with JSON Lines, CSV, and notebook-based workflowsExperience with taxonomies, ontologies, and knowledge graphs, plus familiarity with evaluation methods such as human comparison and red teamingPreferred Qualifications, Capabilities, And SkillsExperience designing hybrid conversational architectures that combine structured flows with large language model-driven experiencesFamiliarity with large language model safety, bias, and compliance considerationsDemonstrated success working effectively in a highly matrixed organizationKnowledge of current generative AI evaluation challenges, including subjective and preference-based tasksExperience with retrieval augmented generation pipelines and agent orchestration patternsExperience generating or validating synthetic data to address cold start and low-resource scenariosDomain experience supporting customer-facing financial products or customer service journeysABOUT USChase is a leading financial services firm, helping nearly half of America’s households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.Equal Opportunity Employer/Disability/VeteransAbout The TeamOur Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We’re proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions – all while ranking first in customer satisfaction.The CCB Data & Analytics team responsibly leverages data across Chase to build competitive advantages for the businesses while providing value and protection for customers. The team encompasses a variety of disciplines from data governance and strategy to reporting, data science and machine learning. We have a strong partnership with Technology, which provides cutting edge data and analytics infrastructure. The team powers Chase with insights to create the best customer and business outcomes.