Skip to content
Initialising environment000

03 / Products

Agent Failure Autopsy

Root cause for agent runs, on top of the tracing you already have.

Scroll to explore

01 / Problem

The problem.

A run fails, the trace is 400 spans long, and someone spends an afternoon guessing whether retrieval was wrong, a tool lied, the planner mis-delegated, or the model gave up. Failures get grouped by symptom instead of cause, so fixes land in the wrong place.

Tracing tools show the run; we name the culprit, and we report how often we are right.

02 / Deliverables

What you get.

  • 01One autopsy page per sampled failure: decisive step, agent, class, cause, replay result, confidence
  • 02Cause map regrouping all failures by confirmed cause
  • 03Ranked fix list with the share of failures each fix removes
  • 04Attribution accuracy report on your confirmed cases and on our labelled benchmark
  • 05Readout

03 / Steps

How it runs.

  1. Kickoff and export

  2. Full-trace check: inputs captured, not just outputs

  3. Normalise and cluster

  4. Attribution

  5. Counterfactual replay

  6. Readout

  7. Follow-up after fixes ship

04 / Coverage

What we attribute.

Failure classes we attribute, what happened in the run, and who fixes it
Failure classWhat happenedWho fixes it
Bad input trustedWrong or injected tool or retrieval content usedTool or data owner
Tool failure maskedAn errored or empty tool result treated as successTool owner
Wrong delegationTask sent to the wrong agent or briefRouting owner
Lost contextInformation truncated or dropped at a hand-offHarness owner
Specification gapAn underspecified task filled in wronglyPrompt owner
Premature terminationSuccess declared earlyVerification owner
Loop without progressRepeated steps, no change of stateHarness owner
Verification missThe checker passed a wrong resultVerification owner
Environment and infraRate limits, crashes, permissionsPlatform owner
Model errorWrong reasoning on correct inputsModel or prompt owner

Founding customers

We are taking two founding customers per product: a full engagement at no cost in exchange for a named logo and a case study. Write to us.

Write to us
Next product · 01Environment Audit