Software Engineer III (Lead IC – GenAI / RAG Systems)

Software Engineer III (Lead IC – GenAI / RAG Systems)San Bruno, CA - Hybrid (3 days onsite)Type: Contract (6 months, high potential for extension)Role OverviewWe are looking for a highly skilled Software Engineer III (Lead Individual Contributor) to productionize high-impact AI prototypes into scalable, production-grade systems. This role sits at the intersection of engineering and product, focusing on improving system efficiency, reliability, and developer workflows through advanced AI solutions.You will take ownership of transforming experimental tools into robust, production-ready architectures, while building strong evaluation frameworks and ensuring high-quality model outputs.Key ResponsibilitiesArchitect and productionize AI-powered systems, transitioning prototype tools into scalable production environmentsDesign and implement context retrieval systems (RAG) with optimized context construction strategiesBuild and own evaluation frameworks from scratch, focusing on precision, recall, cost, and model performanceDevelop and optimize embedding strategies (dense, sparse, hybrid) and re-ranking mechanismsBuild data pipelines to maintain real-time semantic indexing as underlying data evolvesDefine and enforce system requirements for accuracy, determinism, and reliabilityCollaborate cross-functionally with engineering, product, security, and privacy teams for successful launchesLead system design discussions, break down complex problems, and drive architecture decisionsDebug and analyze large-scale datasets using SQL to identify edge cases and improve model behaviorEnsure engineering excellence through code reviews, testing (integration, performance, stress), and system monitoringMentor engineers and contribute to technical roadmap and long-term system strategyRequired Skills & Experience8+ years of software engineering experience with strong fundamentals in data structures and algorithms3–5+ years of experience building context retrieval / RAG-based systems for LLM applicationsStrong experience with GenAI systems using pre-trained models (e.g., Gemini or equivalent), including fine-tuning via evaluationsDeep understanding of:Evaluation metrics (precision, recall, cost trade-offs)Semantic search and vector space modelsEmbedding strategies and ranking systemsProficiency in SQL for large-scale data analysis and debuggingExperience designing and building backend systems using Python or GoExperience with frontend technologies such as Angular, TypeScript, or JavaScriptFamiliarity with cloud platforms (e.g., GCP) and distributed systemsExperience with Docker, Kubernetes, or similar deployment frameworksPreferred QualificationsExperience building end-to-end AI applications such as chatbots or context-aware systems over large datasetsStrong background in system design and architecture for scalable AI systemsExperience working in cross-functional environments bridging product and engineeringPrior experience leading large-scale technical initiatives or acting as a technical SMEWhat You’ll BringAbility to independently own and drive complex systems from concept to productionStrong problem-solving skills with a data-driven approachExperience balancing short-term delivery with long-term scalabilityLeadership mindset as a Lead IC, influencing architecture and engineering directionThanks,Nandit