Gaps

Gap Analysis

10 shown / 84 total
SeverityGap TypeProblemCustomer EvidenceAgentStatusPatternTrace
highContext IgnoredEvidence-Output Contradiction

Require the agent to apply retrieved policy exceptions before issuing a denial. Add a verification step that confirms all relevant policy exceptions have been checked.

Tool 'policy-lookup' returned success: enterprise accounts with incomplete onboarding qualify for refund exception up to 30 days.
Support Agent
task-refund-001
pending1xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Enterprise; renewal_status: duplicate_charge_detected; csm_note: billing exception promised; annual_value: $64,000
Support Agent
trace-gap-refund-enterprise-002
confirmed3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Enterprise; renewal_status: duplicate_charge_detected; csm_note: billing exception promised; annual_value: $64,000
Support Agent
trace-gap-refund-enterprise-002
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Enterprise; renewal_status: duplicate_charge_detected; csm_note: billing exception promised; annual_value: $64,000
Support Agent
trace-gap-refund-enterprise-002
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Enterprise; contract: export SLA credit applies after 4 business hours degraded export service; outage_duration: 2 days
Support Agent
trace-gap-credit-sla-001
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Business; integration_attempts: 3 failed; prior_note: support promised cancellation review; renewal_days_left: 12
Support Agent
trace-gap-cancel-context-001
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Enterprise; contract: export SLA credit applies after 4 business hours degraded export service; outage_duration: 2 days
Support Agent
trace-gap-credit-sla-001
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Business; integration_attempts: 3 failed; prior_note: support promised cancellation review; renewal_days_left: 12
Support Agent
trace-gap-cancel-context-001
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Enterprise; contract: export SLA credit applies after 4 business hours degraded export service; outage_duration: 2 days
Support Agent
trace-gap-credit-sla-001
pending3xRead trace
mediumContext IgnoredContext Neglect

Require the agent to reconcile retrieved account and policy context before closing or denying the customer request. Route exception-qualified cases to a human approval path.

lookup_account: plan: Business; integration_attempts: 3 failed; prior_note: support promised cancellation review; renewal_days_left: 12
Support Agent
trace-gap-cancel-context-001
pending3xRead trace