{"schemaVersion":"jobsearcher.job.v1","id":"8310c893a68d34e0e9b508ea","url":"https://jobsearcher.com/jobs/8310c893a68d34e0e9b508ea","canonicalUrl":"https://jobsearcher.com/jobs/8310c893a68d34e0e9b508ea","title":"Senior Data Infrastructure","description":"We are Judgment. We build infrastructure for Agent Behavior Monitoring (ABM): surfacing silent behavioral issues, understanding how agents behave in production, and turning interaction data into actionable signals.\nHundreds of teams building autonomous agents rely on Judgment to understand how their systems are behaving post-deployment. When something breaks, they’re not stuck in reactive incident triage. They can see which behaviors are trending, which configurations caused regressions, and what to actually fix.\nWe’ve raised $30M+ across two rounds in the past five months. Our investors include Lightspeed, SV Angel, Valor Equity Partners, Nova Global, Chris Manning, Michael Ovitz, Michael Abbott, Cory Levy, Kevin Hartz, and others.\nThe Role:\nWe are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent behavior analysis at production scale. This role is crucial for processing hundreds of thousands of traces per second, running LLM-based scoring and clustering in near-real time, and delivering the low-latency query performance that enables teams to understand agent behavior as it happens. We need someone who has built petabyte-scale data systems, knows how to squeeze performance out of OLAP databases, and can own the data infrastructure from ingestion through analytics.\nWhat You'll Do:\nDesign the streaming pipeline that scores and clusters 100k+ traces/s workload using LLM APIs in near-real time (Kafka + Spark/Ray).\nIdentify LLM API Serving bottleneck via looking at flamegraphs and raise RPS via smart batching/streaming, adaptive concurrency, and connection pooling.\nSpeedup Clickhouse Database query, reduce p95/p99 for queries with better schemas/partitions, projections/materialized views, and tiered storage.\nWhat We're Looking For:\nExperience building and tuning high-throughput Petabyte-scale data pipelines\nDeep knowledge of data infrastructure (Apache Spark, Ray, dbt, Airflow/Dagster)\nExperience with OLAP database engineering\nComfortable with cloud infrastructure and batch + streaming pipelines\nSenior-level ownership: you will own infrastructure roadmap, architecture design, set practices, identify bottlenecks, ship fixes.\nNice to have:\nExperience working with LLM Inference and Serving optimization techniques such as:\nSpeculative Decoding\nContinuous batching and dynamic batching strategies\nKV cache optimization and management\nQuantization techniques (INT8, INT4) for reduced memory footprint\nMulti-GPU serving and tensor parallelism\nTarget Profile:\nSenior+ Infrastructure Engineer from observability company (Datadog/Sentry/Honeycomb), trading company, RecSys/ML big tech (Netflix/Google/Meta), or AI labs.\nWhy Judgment?\nThe problem matters. Today’s agents hallucinate, drift, and break in production. We’re building the infrastructure that fixes this: the monitoring layer that makes agents self-improving.\nWork with the best. We’re a small, highly collaborative team that ships far above our size. We take pride in building a category-defining product and value engineers who are persistent, creative, and ownership-driven.\nGrow with us. Ideas win on merit, not hierarchy. You’ll work with people who stay curious, pathfind through ambiguity, and execute relentlessly. We look for people who are bold in their ideas, comfortable taking thoughtful risks, and motivated by solving hard problems. We reward impact, expect ownership, and are intentional about growing talent from within as we scale.\nWe take care of our people. Competitive salary and equity, full benefits, chef-cooked meals daily, gym access, and whatever tools or resources you need to do your best work.\nWe work in person in San Francisco.","company":"Judgment Labs","rawCompany":"judgment labs","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-04-14T10:43:59.372Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Infrastructure","description":"We are Judgment. We build infrastructure for Agent Behavior Monitoring (ABM): surfacing silent behavioral issues, understanding how agents behave in production, and turning interaction data into actionable signals.\nHundreds of teams building autonomous agents rely on Judgment to understand how their systems are behaving post-deployment. When something breaks, they’re not stuck in reactive incident triage. They can see which behaviors are trending, which configurations caused regressions, and what to actually fix.\nWe’ve raised $30M+ across two rounds in the past five months. Our investors include Lightspeed, SV Angel, Valor Equity Partners, Nova Global, Chris Manning, Michael Ovitz, Michael Abbott, Cory Levy, Kevin Hartz, and others.\nThe Role:\nWe are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent behavior analysis at production scale. This role is crucial for processing hundreds of thousands of traces per second, running LLM-based scoring and clustering in near-real time, and delivering the low-latency query performance that enables teams to understand agent behavior as it happens. We need someone who has built petabyte-scale data systems, knows how to squeeze performance out of OLAP databases, and can own the data infrastructure from ingestion through analytics.\nWhat You'll Do:\nDesign the streaming pipeline that scores and clusters 100k+ traces/s workload using LLM APIs in near-real time (Kafka + Spark/Ray).\nIdentify LLM API Serving bottleneck via looking at flamegraphs and raise RPS via smart batching/streaming, adaptive concurrency, and connection pooling.\nSpeedup Clickhouse Database query, reduce p95/p99 for queries with better schemas/partitions, projections/materialized views, and tiered storage.\nWhat We're Looking For:\nExperience building and tuning high-throughput Petabyte-scale data pipelines\nDeep knowledge of data infrastructure (Apache Spark, Ray, dbt, Airflow/Dagster)\nExperience with OLAP database engineering\nComfortable with cloud infrastructure and batch + streaming pipelines\nSenior-level ownership: you will own infrastructure roadmap, architecture design, set practices, identify bottlenecks, ship fixes.\nNice to have:\nExperience working with LLM Inference and Serving optimization techniques such as:\nSpeculative Decoding\nContinuous batching and dynamic batching strategies\nKV cache optimization and management\nQuantization techniques (INT8, INT4) for reduced memory footprint\nMulti-GPU serving and tensor parallelism\nTarget Profile:\nSenior+ Infrastructure Engineer from observability company (Datadog/Sentry/Honeycomb), trading company, RecSys/ML big tech (Netflix/Google/Meta), or AI labs.\nWhy Judgment?\nThe problem matters. Today’s agents hallucinate, drift, and break in production. We’re building the infrastructure that fixes this: the monitoring layer that makes agents self-improving.\nWork with the best. We’re a small, highly collaborative team that ships far above our size. We take pride in building a category-defining product and value engineers who are persistent, creative, and ownership-driven.\nGrow with us. Ideas win on merit, not hierarchy. You’ll work with people who stay curious, pathfind through ambiguity, and execute relentlessly. We look for people who are bold in their ideas, comfortable taking thoughtful risks, and motivated by solving hard problems. We reward impact, expect ownership, and are intentional about growing talent from within as we scale.\nWe take care of our people. Competitive salary and equity, full benefits, chef-cooked meals daily, gym access, and whatever tools or resources you need to do your best work.\nWe work in person in San Francisco.","datePosted":"2026-04-14T10:43:59.372Z","dateModified":"2026-04-14T10:43:59.372Z","hiringOrganization":{"@type":"Organization","name":"Judgment Labs","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"8310c893a68d34e0e9b508ea"},"url":"https://jobsearcher.com/jobs/8310c893a68d34e0e9b508ea"}}