AI Application/GenAI Engineer

Title: AI Application/GenAI Engineer Location: Pleasanton, California (hybrid work)Technical OverviewWe're seeking a highly skilled AI Application Engineer to lead the architecture and execution of advanced LLM-driven systems, including prompt engineering pipelines, evaluation frameworks, RAG workflows, and LangChain-based orchestration. In this role, you'll design and test prompts for style, tone, and accuracy, implement rigorous A/B and statistical evaluation frameworks, and deploy LLM-powered features into production.Core Responsibilities You'll work cross-functionally with ML engineers, product managers, and backend teams to deliver scalable, prompt-driven solutions for enterprise applications. Responsibilities include building retrieval-augmented generation (RAG) pipeline, developing prompt evaluation systems using PromptEval or similar tools, and orchestrating LLM workflows with LangChain. This role demands a blend of deep prompt engineering expertise, practical Python development skills, and a strong analytical mindset to optimize prompt performance and user experience in real-world systems.Required Expertise 3 - 6 years in AI/ML, NLP or GenAI roles. Advanced knowledge of prompt engineering strategies and heuristics. Proficient with LangChain (or similar), Python and API development. Solid experience building RAG pipelines with vector DBs. Strong analytical mindset with an A/B testing and evaluation-driven approach.