Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Collection reset announces removed-item noise · case 01
The announcement trace violates the stated list-change-narration contract.
Collection reset announces removed-item noise · case 02
The announcement trace violates the stated list-change-narration contract.
Collection reset announces removed-item noise · case 03
The announcement trace violates the stated list-change-narration contract.
Collection reset announces removed-item noise · case 04
The announcement trace violates the stated list-change-narration contract.
Collection reset announces removed-item noise · case 05
The announcement trace violates the stated list-change-narration contract.
Collection count is based on last item index · case 01
The announcement trace violates the stated list-change-narration contract.
Collection count is based on last item index · case 02
The announcement trace violates the stated list-change-narration contract.
Collection count is based on last item index · case 03
The announcement trace violates the stated list-change-narration contract.
Collection count is based on last item index · case 04
The announcement trace violates the stated list-change-narration contract.
Collection count is based on last item index · case 05
The announcement trace violates the stated list-change-narration contract.
Repeated item ID creates duplicate spoken list item · case 01
The announcement trace violates the stated list-change-narration contract.
Repeated item ID creates duplicate spoken list item · case 02
The announcement trace violates the stated list-change-narration contract.
Repeated item ID creates duplicate spoken list item · case 03
The announcement trace violates the stated list-change-narration contract.
Repeated item ID creates duplicate spoken list item · case 04
The announcement trace violates the stated list-change-narration contract.
Repeated item ID creates duplicate spoken list item · case 05
The announcement trace violates the stated list-change-narration contract.
Announced insertion position uses zero-based index · case 01
The announcement trace violates the stated list-change-narration contract.
Announced insertion position uses zero-based index · case 02
The announcement trace violates the stated list-change-narration contract.
Announced insertion position uses zero-based index · case 03
The announcement trace violates the stated list-change-narration contract.
Announced insertion position uses zero-based index · case 04
The announcement trace violates the stated list-change-narration contract.
Announced insertion position uses zero-based index · case 05
The announcement trace violates the stated list-change-narration contract.
Removal announcement uses ID instead of prior spoken label · case 01
The announcement trace violates the stated list-change-narration contract.
Removal announcement uses ID instead of prior spoken label · case 02
The announcement trace violates the stated list-change-narration contract.
Removal announcement uses ID instead of prior spoken label · case 03
The announcement trace violates the stated list-change-narration contract.
Removal announcement uses ID instead of prior spoken label · case 04
The announcement trace violates the stated list-change-narration contract.
Removal announcement uses ID instead of prior spoken label · case 05
The announcement trace violates the stated list-change-narration contract.
Rename cue reverses old and new spoken labels · case 01
The announcement trace violates the stated list-change-narration contract.
Rename cue reverses old and new spoken labels · case 02
The announcement trace violates the stated list-change-narration contract.
Rename cue reverses old and new spoken labels · case 03
The announcement trace violates the stated list-change-narration contract.
Rename cue reverses old and new spoken labels · case 04
The announcement trace violates the stated list-change-narration contract.
Rename cue reverses old and new spoken labels · case 05
The announcement trace violates the stated list-change-narration contract.
Moved-item cue reports destination from before removal · case 01
The announcement trace violates the stated list-change-narration contract.
Moved-item cue reports destination from before removal · case 02
The announcement trace violates the stated list-change-narration contract.
Moved-item cue reports destination from before removal · case 03
The announcement trace violates the stated list-change-narration contract.
Moved-item cue reports destination from before removal · case 04
The announcement trace violates the stated list-change-narration contract.
Moved-item cue reports destination from before removal · case 05
The announcement trace violates the stated list-change-narration contract.
One batch counts text length instead of semantic changes · case 01
The announcement trace violates the stated list-change-narration contract.
One batch counts text length instead of semantic changes · case 02
The announcement trace violates the stated list-change-narration contract.
One batch counts text length instead of semantic changes · case 03
The announcement trace violates the stated list-change-narration contract.
One batch counts text length instead of semantic changes · case 04
The announcement trace violates the stated list-change-narration contract.
One batch counts text length instead of semantic changes · case 05
The announcement trace violates the stated list-change-narration contract.
Reopened speech bundle is still considered already delivered · case 01
The announcement trace violates the stated utterance-bundle contract.
Reopened speech bundle is still considered already delivered · case 02
The announcement trace violates the stated utterance-bundle contract.
Reopened speech bundle is still considered already delivered · case 03
The announcement trace violates the stated utterance-bundle contract.
Reopened speech bundle is still considered already delivered · case 04
The announcement trace violates the stated utterance-bundle contract.
Reopened speech bundle is still considered already delivered · case 05
The announcement trace violates the stated utterance-bundle contract.
Retracting one bundle erases unrelated delivery receipts · case 01
The announcement trace violates the stated utterance-bundle contract.
Retracting one bundle erases unrelated delivery receipts · case 02
The announcement trace violates the stated utterance-bundle contract.
Retracting one bundle erases unrelated delivery receipts · case 03
The announcement trace violates the stated utterance-bundle contract.
Retracting one bundle erases unrelated delivery receipts · case 04
The announcement trace violates the stated utterance-bundle contract.
Retracting one bundle erases unrelated delivery receipts · case 05
The announcement trace violates the stated utterance-bundle contract.
Immutable speech bundle accepts a late fragment · case 01
The announcement trace violates the stated utterance-bundle contract.
Immutable speech bundle accepts a late fragment · case 02
The announcement trace violates the stated utterance-bundle contract.
Immutable speech bundle accepts a late fragment · case 03
The announcement trace violates the stated utterance-bundle contract.
Immutable speech bundle accepts a late fragment · case 04
The announcement trace violates the stated utterance-bundle contract.
Immutable speech bundle accepts a late fragment · case 05
The announcement trace violates the stated utterance-bundle contract.
Correction replaces every segment in announcement bundle · case 01
The announcement trace violates the stated utterance-bundle contract.
Correction replaces every segment in announcement bundle · case 02
The announcement trace violates the stated utterance-bundle contract.
Correction replaces every segment in announcement bundle · case 03
The announcement trace violates the stated utterance-bundle contract.
Correction replaces every segment in announcement bundle · case 04
The announcement trace violates the stated utterance-bundle contract.
Correction replaces every segment in announcement bundle · case 05
The announcement trace violates the stated utterance-bundle contract.
Segment label rename overwrites its spoken value · case 01
The announcement trace violates the stated utterance-bundle contract.
Segment label rename overwrites its spoken value · case 02
The announcement trace violates the stated utterance-bundle contract.
Segment label rename overwrites its spoken value · case 03
The announcement trace violates the stated utterance-bundle contract.
Segment label rename overwrites its spoken value · case 04
The announcement trace violates the stated utterance-bundle contract.
Segment label rename overwrites its spoken value · case 05
The announcement trace violates the stated utterance-bundle contract.
Bundle segment limit retains last instead of first segments · case 01
The announcement trace violates the stated utterance-bundle contract.
Bundle segment limit retains last instead of first segments · case 02
The announcement trace violates the stated utterance-bundle contract.
Bundle segment limit retains last instead of first segments · case 03
The announcement trace violates the stated utterance-bundle contract.
Bundle segment limit retains last instead of first segments · case 04
The announcement trace violates the stated utterance-bundle contract.
Bundle segment limit retains last instead of first segments · case 05
The announcement trace violates the stated utterance-bundle contract.
Seal toggles immutability and a repeated call reopens bundle · case 01
The announcement trace violates the stated utterance-bundle contract.
Seal toggles immutability and a repeated call reopens bundle · case 02
The announcement trace violates the stated utterance-bundle contract.
Seal toggles immutability and a repeated call reopens bundle · case 03
The announcement trace violates the stated utterance-bundle contract.
Seal toggles immutability and a repeated call reopens bundle · case 04
The announcement trace violates the stated utterance-bundle contract.
Seal toggles immutability and a repeated call reopens bundle · case 05
The announcement trace violates the stated utterance-bundle contract.
Unsealed partial bundle is spoken · case 01
The announcement trace violates the stated utterance-bundle contract.
Unsealed partial bundle is spoken · case 02
The announcement trace violates the stated utterance-bundle contract.
Unsealed partial bundle is spoken · case 03
The announcement trace violates the stated utterance-bundle contract.
Unsealed partial bundle is spoken · case 04
The announcement trace violates the stated utterance-bundle contract.
Unsealed partial bundle is spoken · case 05
The announcement trace violates the stated utterance-bundle contract.
Bundle speech omits labels needed to distinguish values · case 01
The announcement trace violates the stated utterance-bundle contract.
Bundle speech omits labels needed to distinguish values · case 02
The announcement trace violates the stated utterance-bundle contract.
Bundle speech omits labels needed to distinguish values · case 03
The announcement trace violates the stated utterance-bundle contract.
Bundle speech omits labels needed to distinguish values · case 04
The announcement trace violates the stated utterance-bundle contract.
Bundle speech omits labels needed to distinguish values · case 05
The announcement trace violates the stated utterance-bundle contract.
Dispatched bundle remains retained for later modification · case 01
The announcement trace violates the stated utterance-bundle contract.
Dispatched bundle remains retained for later modification · case 02
The announcement trace violates the stated utterance-bundle contract.
Dispatched bundle remains retained for later modification · case 03
The announcement trace violates the stated utterance-bundle contract.
Dispatched bundle remains retained for later modification · case 04
The announcement trace violates the stated utterance-bundle contract.
Dispatched bundle remains retained for later modification · case 05
The announcement trace violates the stated utterance-bundle contract.
Speech-only mode waits for an impossible braille receipt · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Speech-only mode waits for an impossible braille receipt · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Speech-only mode waits for an impossible braille receipt · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Speech-only mode waits for an impossible braille receipt · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Speech-only mode waits for an impossible braille receipt · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Disabling braille affects pending deliveries but not future ones · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Disabling braille affects pending deliveries but not future ones · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Disabling braille affects pending deliveries but not future ones · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Disabling braille affects pending deliveries but not future ones · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Disabling braille affects pending deliveries but not future ones · case 05
The announcement trace violates the stated dual-channel-barrier contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗