JOBSEARCHER

Software Engineer I - LLM Observability

LaddersDenver, COL6 LeadOctober 21st, 2026
For our client, we are seeking a Software Engineer I - LLM Observability to join the team of a leader in the Technical Services space. This role will focus on building AI observability capabilities that help customers understand system behavior from ingestion through visualization. You will contribute to the data model and infrastructure that support agent observation, with a strong emphasis on surfacing meaningful signals such as cost, errors, and workflow health. The position partners closely with product and design to create intuitive experiences, while also iterating on feedback to improve usability and outcomes across the platform.
Location: Remote - US based candidates only, no visa sponsorship available
Compensation: $218,891 – $245,946 annually
Responsibilities: Deliver AI observability capabilities from ingestion to visualizations Contribute to the data model and infrastructure for agent observation Build systems to analyze AI-specific signals like cost and errors Collaborate with product and design to ensure usability and workflow Share insights on AI system behavior across conversations Iterate through feedback loops and share learnings
Qualifications: 3+ years of software engineering experience Experience shipping customer-facing features at a SaaS company Full-stack proficiency in backend (Go/Python) and frontend (TypeScript/React) development Proven collaboration with product managers and designers Hands-on use of AI tools in engineering work Experience being on call, joining rotation after 90 days Ability to navigate ambiguity in a fast-paced environment Bonus: Experience with LLM or agent-powered features Bonus: Familiarity with observability tooling like Open TelemetryBenefits Generous equity with an employee-friendly stock program Transparent pay structure based on experience Unlimited PTO for time to recharge Distributed-first culture Home office, co-working, and internet stipend Full benefits coverage for employees and dependents Up to 16 weeks of paid parental leave Annual development allowance And much more...Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.