Senior Software Engineer, AI Infra & Platform
ABOUT THE ROLEOur client is a leading technology platform in the financial services space, combining proprietary AI, deep domain expertise, and enterprise-grade security to serve a broad range of client needs. They are trusted by some of the largest names in the industry and have been widely recognized for innovation and leadership in their category.They are seeking a Software Engineer, AI/ML (Infrastructure & Platform) to build the foundational systems powering their next generation of AI applications. This is a systems-focused role — you will design and build the platforms, abstractions, and infrastructure that enable teams to reliably develop, deploy, and scale AI systems, including agentic workflows, retrieval pipelines, and model integrations. Your work will directly enable product teams to move faster while ensuring AI systems are reliable, observable, secure, and cost-efficient.WHAT YOU'LL DODesign and implement platforms for LLM orchestration, tool execution, and agent workflows; develop shared services and abstractions used across multiple AI applicationsBuild and maintain the tools and skills that agents depend on — including APIs, workflows, and integrations — with clear interfaces for data retrieval, document processing, and external system actionsBuild reusable, composable abstractions for safe and scalable tool usage; ensure all tools are reliable, observable, and secure when interacting with sensitive dataBuild infrastructure for multi-step agentic systems: state management, tool routing, retries, failure handling, and reusable orchestration patternsDevelop evaluation frameworks and observability tooling — logging, tracing, and monitoring for model behavior and system performanceDesign for high availability, fault tolerance, and graceful degradation; optimize for latency, throughput, and cost across AI workloadsBuild scalable RAG pipelines, indexing systems, and data processing workflows for large-scale structured and unstructured dataCreate internal tools, SDKs, and platforms that enable engineers to integrate AI capabilities quickly and safely; standardize best practices around prompting, evaluation, and deploymentPartner with AI Applications engineers to support production use cases and translate product needs into scalable infrastructure solutionsREQUIREMENTSDegree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experienceStrong software engineering fundamentals: system design, distributed systems, and maintainable codeProven track record building and operating production systems at scaleProficiency in Python and TypeScript; comfortable working across a polyglot stackExperience building backend systems, APIs, or infrastructure platformsExperience with AI/ML systems in production, including LLM integrations or data pipelinesExperience designing or integrating systems with tool or skill abstractions — e.g. function calling, APIs, or capability layers used by AI systemsAbility to operate with high ownership in ambiguous, fast-moving environmentsPREFERRED QUALIFICATIONSExperience building AI platforms or infrastructure layers, not just AI applicationsHands-on experience with RAG systems and vector databases such as Pinecone, Weaviate, or pgvectorExperience with agent orchestration frameworks such as LangGraph, LangChain, or custom-built systemsExperience with evaluation and observability tooling for AI systemsCloud infrastructure experience — GCP (Cloud Run), AWS (ECS, Lambda), containerized or serverless deploymentsExperience with event-driven systems, queues, and async processing; MLOps and CI/CD pipelinesBackground in regulated domains such as FinTech, LegalTech, or HealthTechFamiliarity with data privacy and security techniques including PII handling and redaction