AI Developer Experience Engineer

Job SummaryCrosby is an AI-first legal platform focused on enhancing corporate legal services through advanced technology and workflows. As an AI Developer Experience Engineer, you will build internal systems to improve the developer experience for AI features, collaborating with engineers and data scientists to streamline workflows and enhance productivity. Responsibilities• Build AI developer tooling: Design and implement internal tools for prompt management, evaluation, experimentation, and model iteration. • Improve iteration speed: Create systems that enable rapid testing, debugging, and comparison of model outputs across different approaches. • Own evaluation infrastructure: Develop frameworks for benchmarking, regression testing, and monitoring AI system performance. • Streamline data workflows: Build pipelines and tooling to support data collection, labeling, and feedback loops for model improvement. • Support production systems: Partner with engineering teams to ensure AI features are reliable, observable, and easy to maintain in production. • Enable the team: Identify bottlenecks in the development process and build systems that increase developer velocity and confidence. QualificationsRequired• 3–7+ years of software engineering experience, ideally working on developer tools, infrastructure, or platform teams • Strong proficiency in Python and experience building backend systems and internal tooling • Hands-on experience working with LLMs, APIs (e.g., OpenAI, Anthropic), and modern AI workflows • Experience building systems for experimentation, evaluation, or data pipelines • Strong systems thinking with the ability to design tools that scale across teams • Highly pragmatic with a focus on improving developer velocity and real-world outcomes • Strong communicator who can work closely with engineers, researchers, and product teams • Proactive, resourceful, and excited about building foundational systems in a fast-moving environment CompanyCrosby is the AI law firm that helps companies execute contracts faster. Founded in 2024, the company is headquartered in New York, USA, with a team of 51-200 employees. The company is currently Growth Stage.