Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Editing text resets accumulated escalation severity · case 01
The announcement trace violates the stated escalation-ladder contract.
Editing text resets accumulated escalation severity · case 02
The announcement trace violates the stated escalation-ladder contract.
Editing text resets accumulated escalation severity · case 03
The announcement trace violates the stated escalation-ladder contract.
Editing text resets accumulated escalation severity · case 04
The announcement trace violates the stated escalation-ladder contract.
Editing text resets accumulated escalation severity · case 05
The announcement trace violates the stated escalation-ladder contract.
Snooze delay is anchored to current time instead of deadline · case 01
The announcement trace violates the stated escalation-ladder contract.
Snooze delay is anchored to current time instead of deadline · case 02
The announcement trace violates the stated escalation-ladder contract.
Snooze delay is anchored to current time instead of deadline · case 03
The announcement trace violates the stated escalation-ladder contract.
Snooze delay is anchored to current time instead of deadline · case 04
The announcement trace violates the stated escalation-ladder contract.
Snooze delay is anchored to current time instead of deadline · case 05
The announcement trace violates the stated escalation-ladder contract.
Reset leaves the prior escalation level intact · case 01
The announcement trace violates the stated escalation-ladder contract.
Reset leaves the prior escalation level intact · case 02
The announcement trace violates the stated escalation-ladder contract.
Reset leaves the prior escalation level intact · case 03
The announcement trace violates the stated escalation-ladder contract.
Reset leaves the prior escalation level intact · case 04
The announcement trace violates the stated escalation-ladder contract.
Reset leaves the prior escalation level intact · case 05
The announcement trace violates the stated escalation-ladder contract.
Stale timer rolls escalation time backward · case 01
The announcement trace violates the stated escalation-ladder contract.
Stale timer rolls escalation time backward · case 02
The announcement trace violates the stated escalation-ladder contract.
Stale timer rolls escalation time backward · case 03
The announcement trace violates the stated escalation-ladder contract.
Stale timer rolls escalation time backward · case 04
The announcement trace violates the stated escalation-ladder contract.
Stale timer rolls escalation time backward · case 05
The announcement trace violates the stated escalation-ladder contract.
Escalation at exact due time is delayed · case 01
The announcement trace violates the stated escalation-ladder contract.
Escalation at exact due time is delayed · case 02
The announcement trace violates the stated escalation-ladder contract.
Escalation at exact due time is delayed · case 03
The announcement trace violates the stated escalation-ladder contract.
Escalation at exact due time is delayed · case 04
The announcement trace violates the stated escalation-ladder contract.
Escalation at exact due time is delayed · case 05
The announcement trace violates the stated escalation-ladder contract.
Escalation skips an intermediate spoken severity · case 01
The announcement trace violates the stated escalation-ladder contract.
Escalation skips an intermediate spoken severity · case 02
The announcement trace violates the stated escalation-ladder contract.
Escalation skips an intermediate spoken severity · case 03
The announcement trace violates the stated escalation-ladder contract.
Escalation skips an intermediate spoken severity · case 04
The announcement trace violates the stated escalation-ladder contract.
Escalation skips an intermediate spoken severity · case 05
The announcement trace violates the stated escalation-ladder contract.
Escalation speaks deadline as message content · case 01
The announcement trace violates the stated escalation-ladder contract.
Escalation speaks deadline as message content · case 02
The announcement trace violates the stated escalation-ladder contract.
Escalation speaks deadline as message content · case 03
The announcement trace violates the stated escalation-ladder contract.
Escalation speaks deadline as message content · case 04
The announcement trace violates the stated escalation-ladder contract.
Escalation speaks deadline as message content · case 05
The announcement trace violates the stated escalation-ladder contract.
Final escalation continues scheduling speech · case 01
The announcement trace violates the stated escalation-ladder contract.
Final escalation continues scheduling speech · case 02
The announcement trace violates the stated escalation-ladder contract.
Final escalation continues scheduling speech · case 03
The announcement trace violates the stated escalation-ladder contract.
Final escalation continues scheduling speech · case 04
The announcement trace violates the stated escalation-ladder contract.
Final escalation continues scheduling speech · case 05
The announcement trace violates the stated escalation-ladder contract.
New speech turn adds budget left from previous turn · case 01
The announcement trace violates the stated speech-time-budget contract.
New speech turn adds budget left from previous turn · case 02
The announcement trace violates the stated speech-time-budget contract.
New speech turn adds budget left from previous turn · case 03
The announcement trace violates the stated speech-time-budget contract.
New speech turn adds budget left from previous turn · case 04
The announcement trace violates the stated speech-time-budget contract.
New speech turn adds budget left from previous turn · case 05
The announcement trace violates the stated speech-time-budget contract.
Utterance cost is replaced by text character length · case 01
The announcement trace violates the stated speech-time-budget contract.
Utterance cost is replaced by text character length · case 02
The announcement trace violates the stated speech-time-budget contract.
Utterance cost is replaced by text character length · case 03
The announcement trace violates the stated speech-time-budget contract.
Utterance cost is replaced by text character length · case 04
The announcement trace violates the stated speech-time-budget contract.
Utterance cost is replaced by text character length · case 05
The announcement trace violates the stated speech-time-budget contract.
Budget cap reduction fails to clamp available credit · case 01
The announcement trace violates the stated speech-time-budget contract.
Budget cap reduction fails to clamp available credit · case 02
The announcement trace violates the stated speech-time-budget contract.
Budget cap reduction fails to clamp available credit · case 03
The announcement trace violates the stated speech-time-budget contract.
Budget cap reduction fails to clamp available credit · case 04
The announcement trace violates the stated speech-time-budget contract.
Budget cap reduction fails to clamp available credit · case 05
The announcement trace violates the stated speech-time-budget contract.
Cancel identifies pending speech by cost rather than ID · case 01
The announcement trace violates the stated speech-time-budget contract.
Cancel identifies pending speech by cost rather than ID · case 02
The announcement trace violates the stated speech-time-budget contract.
Cancel identifies pending speech by cost rather than ID · case 03
The announcement trace violates the stated speech-time-budget contract.
Cancel identifies pending speech by cost rather than ID · case 04
The announcement trace violates the stated speech-time-budget contract.
Cancel identifies pending speech by cost rather than ID · case 05
The announcement trace violates the stated speech-time-budget contract.
Duplicate refund replenishes speech budget twice · case 01
The announcement trace violates the stated speech-time-budget contract.
Duplicate refund replenishes speech budget twice · case 02
The announcement trace violates the stated speech-time-budget contract.
Duplicate refund replenishes speech budget twice · case 03
The announcement trace violates the stated speech-time-budget contract.
Duplicate refund replenishes speech budget twice · case 04
The announcement trace violates the stated speech-time-budget contract.
Duplicate refund replenishes speech budget twice · case 05
The announcement trace violates the stated speech-time-budget contract.
Reset keeps old refund rights valid · case 01
The announcement trace violates the stated speech-time-budget contract.
Reset keeps old refund rights valid · case 02
The announcement trace violates the stated speech-time-budget contract.
Reset keeps old refund rights valid · case 03
The announcement trace violates the stated speech-time-budget contract.
Reset keeps old refund rights valid · case 04
The announcement trace violates the stated speech-time-budget contract.
Reset keeps old refund rights valid · case 05
The announcement trace violates the stated speech-time-budget contract.
An exact-budget utterance is incorrectly blocked · case 01
The announcement trace violates the stated speech-time-budget contract.
An exact-budget utterance is incorrectly blocked · case 02
The announcement trace violates the stated speech-time-budget contract.
An exact-budget utterance is incorrectly blocked · case 03
The announcement trace violates the stated speech-time-budget contract.
An exact-budget utterance is incorrectly blocked · case 04
The announcement trace violates the stated speech-time-budget contract.
An exact-budget utterance is incorrectly blocked · case 05
The announcement trace violates the stated speech-time-budget contract.
Bypass dispatch removes blocked head instead of fitting speech · case 01
The announcement trace violates the stated speech-time-budget contract.
Bypass dispatch removes blocked head instead of fitting speech · case 02
The announcement trace violates the stated speech-time-budget contract.
Bypass dispatch removes blocked head instead of fitting speech · case 03
The announcement trace violates the stated speech-time-budget contract.
Bypass dispatch removes blocked head instead of fitting speech · case 04
The announcement trace violates the stated speech-time-budget contract.
Bypass dispatch removes blocked head instead of fitting speech · case 05
The announcement trace violates the stated speech-time-budget contract.
Speaking charges the entire remaining turn budget · case 01
The announcement trace violates the stated speech-time-budget contract.
Speaking charges the entire remaining turn budget · case 02
The announcement trace violates the stated speech-time-budget contract.
Speaking charges the entire remaining turn budget · case 03
The announcement trace violates the stated speech-time-budget contract.
Speaking charges the entire remaining turn budget · case 04
The announcement trace violates the stated speech-time-budget contract.
Speaking charges the entire remaining turn budget · case 05
The announcement trace violates the stated speech-time-budget contract.
Refund ledger records remaining budget as utterance cost · case 01
The announcement trace violates the stated speech-time-budget contract.
Refund ledger records remaining budget as utterance cost · case 02
The announcement trace violates the stated speech-time-budget contract.
Refund ledger records remaining budget as utterance cost · case 03
The announcement trace violates the stated speech-time-budget contract.
Refund ledger records remaining budget as utterance cost · case 04
The announcement trace violates the stated speech-time-budget contract.
Refund ledger records remaining budget as utterance cost · case 05
The announcement trace violates the stated speech-time-budget contract.
Different validation codes on a field overwrite each other · case 01
The announcement trace violates the stated error-announcement-digest contract.
Different validation codes on a field overwrite each other · case 02
The announcement trace violates the stated error-announcement-digest contract.
Different validation codes on a field overwrite each other · case 03
The announcement trace violates the stated error-announcement-digest contract.
Different validation codes on a field overwrite each other · case 04
The announcement trace violates the stated error-announcement-digest contract.
Different validation codes on a field overwrite each other · case 05
The announcement trace violates the stated error-announcement-digest contract.
Resolving one error deletes all field errors · case 01
The announcement trace violates the stated error-announcement-digest contract.
Resolving one error deletes all field errors · case 02
The announcement trace violates the stated error-announcement-digest contract.
Resolving one error deletes all field errors · case 03
The announcement trace violates the stated error-announcement-digest contract.
Resolving one error deletes all field errors · case 04
The announcement trace violates the stated error-announcement-digest contract.
Resolving one error deletes all field errors · case 05
The announcement trace violates the stated error-announcement-digest contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗