Senior Data Infrastructure Engineer

San Franciscofull-timesenior

OtherData Infrastructure Engineer

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Judgment Labs builds infrastructure for Agent Behavior Monitoring (ABM). While traditional observability focuses on logging exceptions and latency, our ABM surfaces behavioral anomalies such as instruction drifts and context retrieval loss in scaled production environments.

Key Responsibilities

We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent behavior analysis at production scale.

Requirements Summary

6+ years of relevant industry experience building and operating high-throughput, petabyte-scale data pipelines in production. Experience collaborating with infrastructure, backend, and product partners to align on data flow and system design.

Technical Tools

airflowdatadogkafkasentrydatabase-designetlsystem-design

Judgment Labs builds infrastructure for Agent Behavior Monitoring (ABM). While traditional observability focuses on logging exceptions and latency, our ABM surfaces behavioral anomalies such as instruction drifts and context retrieval loss in scaled production environments.

Hundreds of teams building autonomous agents rely on Judgment to understand how their systems behave post-deployment. Instead of reactive incident triage, they cluster patterns across conversations and workflows, correlate regressions to specific interaction types, and pinpoint where reliability breaks down. We've raised $30M+ across two rounds in the past five months from investors including Lightspeed, SV Angel, and Valor Equity Partners.

Responsibilities

~1 min read

→
Experience building pipelines that call LLM APIs at scale: request batching, rate limit management, cost optimization.
→
Familiarity with ML workflow orchestration (Airflow, Dagster, Prefect).
→
Experience with embedding generation pipelines or vector search infrastructure.
→
Background in observability, log processing, or event stream platforms (Datadog, Honeycomb, Sentry).
→
Data quality monitoring and anomaly detection within pipelines

Agents can’t work without this. Today’s agents hallucinate, drift, and break in production. We’re building the infrastructure that fixes this: the monitoring layer that makes agents self-improving.
We’re wired to win. We're a team of less than 20 but we ship like 50+ on the daily. You'll be working with olympiad medalists, debate champions, and competitive athletes who bring that same intensity to company building.
Fast track to fonding. Our engineers interface directly with customers, ship code into their environments, and use their feedback to dictate what’s next on the roadmap. Everyone on the team is either an ex-founder or a founder-to-be.
We make sure our people do their best work. If you deserve a spot on the team, money will never get in the way of it. Full benefits, Equinox, and a private chef to take care of you. We sprint hard but we play hard, ask us about our Smash/Mario Kart tournaments.
We work in person in San Francisco.