Recurring pattern
Context Neglect in refund request
The agent had account, policy, or contract evidence that should have changed the answer, but closed the work against that context.
Affected agent
Support Agent
Occurrences
2
Trend
increasing
Converted to evals
0 / 0
Recommended action
Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.
Promote to a regression eval →Why this is a pattern, not a one-off
Increasing — this failure recurred across 2 traces and is accelerating. Treat it as a workflow/prompt/policy fix, not 2 separate tickets.
Eligible customers get denied, sent backward, or asked to redo work the system already knows about.
Occurrences in this pattern (0)
Open as gap list →| Severity | Failure mode | Evidence | Trace |
|---|
Time window
2026-06-10T14:30:32.601Z/2026-06-11T05:47:22.905Z
Failure modes (0)
Shared evidence signals