Regression inbox
Candidate-replay regressions from the last 30 days, grouped by root cause. Triage these before promoting a model — a candidate that prevents retries but introduces new failures isn't a win.
Acted before querying
3 regressions · 2 openCandidate takes a state-changing action before gathering enough account context.
Generated the export link before verifying the requester was on the account's compliance contact list; production checked first.
Applied the discount to all invoices without confirming the nonprofit status document was current; production validated the document first.
Initiated cancellation before the data export completed; production sequenced export → confirm → cancel. Only Sonnet 5 regression this window.
Premature deflection
2 regressions · 1 openCandidate hands the user off to support or their own IT instead of using an available tool.
Deflected to the customer's IT team after one failed password reset; identity.sso_mappings was available and would have resolved it.
Told the user to 'check their endpoint logs' without calling webhooks.recent_deliveries; production diagnosed a TLS cert mismatch in two turns.
Missing required evidence
2 regressions · 2 openCandidate submits requests without checking network- or policy-required attachments.
Submitted the carrier claim without the required photo attachments; bounced, where production attached photos on the first pass.
Skipped disputes.required_evidence and filed with rate-sheet only; rejected by the carrier network.
Over-eager refunds
2 regressions · 1 openCandidate issues refunds outside policy limits that production correctly declined.
Offered a full-year refund where policy caps at prorated 90 days; production quoted the correct proration.
Refunded both charges of the duplicate pair 'to be safe'; production refunded only the duplicate.