Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Cancel removes unrelated pending speech · case 01
The announcement trace violates the stated deadline-scheduler contract.
Cancel removes unrelated pending speech · case 02
The announcement trace violates the stated deadline-scheduler contract.
Cancel removes unrelated pending speech · case 03
The announcement trace violates the stated deadline-scheduler contract.
Cancel removes unrelated pending speech · case 04
The announcement trace violates the stated deadline-scheduler contract.
Cancel removes unrelated pending speech · case 05
The announcement trace violates the stated deadline-scheduler contract.
Clock reset lets old scheduled speech escape · case 01
The announcement trace violates the stated deadline-scheduler contract.
Clock reset lets old scheduled speech escape · case 02
The announcement trace violates the stated deadline-scheduler contract.
Clock reset lets old scheduled speech escape · case 03
The announcement trace violates the stated deadline-scheduler contract.
Clock reset lets old scheduled speech escape · case 04
The announcement trace violates the stated deadline-scheduler contract.
Clock reset lets old scheduled speech escape · case 05
The announcement trace violates the stated deadline-scheduler contract.
Late timer moves announcement time backward · case 01
The announcement trace violates the stated deadline-scheduler contract.
Late timer moves announcement time backward · case 02
The announcement trace violates the stated deadline-scheduler contract.
Late timer moves announcement time backward · case 03
The announcement trace violates the stated deadline-scheduler contract.
Late timer moves announcement time backward · case 04
The announcement trace violates the stated deadline-scheduler contract.
Late timer moves announcement time backward · case 05
The announcement trace violates the stated deadline-scheduler contract.
Announcement speaks at its exclusive expiration instant · case 01
The announcement trace violates the stated deadline-scheduler contract.
Announcement speaks at its exclusive expiration instant · case 02
The announcement trace violates the stated deadline-scheduler contract.
Announcement speaks at its exclusive expiration instant · case 03
The announcement trace violates the stated deadline-scheduler contract.
Announcement speaks at its exclusive expiration instant · case 04
The announcement trace violates the stated deadline-scheduler contract.
Announcement speaks at its exclusive expiration instant · case 05
The announcement trace violates the stated deadline-scheduler contract.
Not-yet-ready speech enters dispatch candidates · case 01
The announcement trace violates the stated deadline-scheduler contract.
Not-yet-ready speech enters dispatch candidates · case 02
The announcement trace violates the stated deadline-scheduler contract.
Not-yet-ready speech enters dispatch candidates · case 03
The announcement trace violates the stated deadline-scheduler contract.
Not-yet-ready speech enters dispatch candidates · case 04
The announcement trace violates the stated deadline-scheduler contract.
Not-yet-ready speech enters dispatch candidates · case 05
The announcement trace violates the stated deadline-scheduler contract.
Scheduler selects the lowest announcement priority · case 01
The announcement trace violates the stated deadline-scheduler contract.
Scheduler selects the lowest announcement priority · case 02
The announcement trace violates the stated deadline-scheduler contract.
Scheduler selects the lowest announcement priority · case 03
The announcement trace violates the stated deadline-scheduler contract.
Scheduler selects the lowest announcement priority · case 04
The announcement trace violates the stated deadline-scheduler contract.
Scheduler selects the lowest announcement priority · case 05
The announcement trace violates the stated deadline-scheduler contract.
Dispatch reports queue metadata instead of spoken content · case 01
The announcement trace violates the stated deadline-scheduler contract.
Dispatch reports queue metadata instead of spoken content · case 02
The announcement trace violates the stated deadline-scheduler contract.
Dispatch reports queue metadata instead of spoken content · case 03
The announcement trace violates the stated deadline-scheduler contract.
Dispatch reports queue metadata instead of spoken content · case 04
The announcement trace violates the stated deadline-scheduler contract.
Dispatch reports queue metadata instead of spoken content · case 05
The announcement trace violates the stated deadline-scheduler contract.
Delivered announcement remains pending · case 01
The announcement trace violates the stated deadline-scheduler contract.
Delivered announcement remains pending · case 02
The announcement trace violates the stated deadline-scheduler contract.
Delivered announcement remains pending · case 03
The announcement trace violates the stated deadline-scheduler contract.
Delivered announcement remains pending · case 04
The announcement trace violates the stated deadline-scheduler contract.
Delivered announcement remains pending · case 05
The announcement trace violates the stated deadline-scheduler contract.
Empty nonprivate value is announced as structure alone · case 01
The announcement trace violates the stated speech-envelope contract.
Empty nonprivate value is announced as structure alone · case 02
The announcement trace violates the stated speech-envelope contract.
Empty nonprivate value is announced as structure alone · case 03
The announcement trace violates the stated speech-envelope contract.
Empty nonprivate value is announced as structure alone · case 04
The announcement trace violates the stated speech-envelope contract.
Empty nonprivate value is announced as structure alone · case 05
The announcement trace violates the stated speech-envelope contract.
Private announcement speaks its raw value · case 01
The announcement trace violates the stated speech-envelope contract.
Private announcement speaks its raw value · case 02
The announcement trace violates the stated speech-envelope contract.
Private announcement speaks its raw value · case 03
The announcement trace violates the stated speech-envelope contract.
Private announcement speaks its raw value · case 04
The announcement trace violates the stated speech-envelope contract.
Private announcement speaks its raw value · case 05
The announcement trace violates the stated speech-envelope contract.
Spoken field label follows its value · case 01
The announcement trace violates the stated speech-envelope contract.
Spoken field label follows its value · case 02
The announcement trace violates the stated speech-envelope contract.
Spoken field label follows its value · case 03
The announcement trace violates the stated speech-envelope contract.
Spoken field label follows its value · case 04
The announcement trace violates the stated speech-envelope contract.
Spoken field label follows its value · case 05
The announcement trace violates the stated speech-envelope contract.
Negated state is announced affirmatively · case 01
The announcement trace violates the stated speech-envelope contract.
Negated state is announced affirmatively · case 02
The announcement trace violates the stated speech-envelope contract.
Negated state is announced affirmatively · case 03
The announcement trace violates the stated speech-envelope contract.
Negated state is announced affirmatively · case 04
The announcement trace violates the stated speech-envelope contract.
Negated state is announced affirmatively · case 05
The announcement trace violates the stated speech-envelope contract.
Private value leaks its unit suffix · case 01
The announcement trace violates the stated speech-envelope contract.
Private value leaks its unit suffix · case 02
The announcement trace violates the stated speech-envelope contract.
Private value leaks its unit suffix · case 03
The announcement trace violates the stated speech-envelope contract.
Private value leaks its unit suffix · case 04
The announcement trace violates the stated speech-envelope contract.
Private value leaks its unit suffix · case 05
The announcement trace violates the stated speech-envelope contract.
Set announcement reports total before position · case 01
The announcement trace violates the stated speech-envelope contract.
Set announcement reports total before position · case 02
The announcement trace violates the stated speech-envelope contract.
Set announcement reports total before position · case 03
The announcement trace violates the stated speech-envelope contract.
Set announcement reports total before position · case 04
The announcement trace violates the stated speech-envelope contract.
Set announcement reports total before position · case 05
The announcement trace violates the stated speech-envelope contract.
Role annotation replaces the content · case 01
The announcement trace violates the stated speech-envelope contract.
Role annotation replaces the content · case 02
The announcement trace violates the stated speech-envelope contract.
Role annotation replaces the content · case 03
The announcement trace violates the stated speech-envelope contract.
Role annotation replaces the content · case 04
The announcement trace violates the stated speech-envelope contract.
Role annotation replaces the content · case 05
The announcement trace violates the stated speech-envelope contract.
Private announcement leaks descriptive detail · case 01
The announcement trace violates the stated speech-envelope contract.
Private announcement leaks descriptive detail · case 02
The announcement trace violates the stated speech-envelope contract.
Private announcement leaks descriptive detail · case 03
The announcement trace violates the stated speech-envelope contract.
Private announcement leaks descriptive detail · case 04
The announcement trace violates the stated speech-envelope contract.
Private announcement leaks descriptive detail · case 05
The announcement trace violates the stated speech-envelope contract.
Missing speech language is sent as an empty code · case 01
The announcement trace violates the stated speech-envelope contract.
Missing speech language is sent as an empty code · case 02
The announcement trace violates the stated speech-envelope contract.
Missing speech language is sent as an empty code · case 03
The announcement trace violates the stated speech-envelope contract.
Missing speech language is sent as an empty code · case 04
The announcement trace violates the stated speech-envelope contract.
Missing speech language is sent as an empty code · case 05
The announcement trace violates the stated speech-envelope contract.
Transport swaps language and speech fields · case 01
The announcement trace violates the stated speech-envelope contract.
Transport swaps language and speech fields · case 02
The announcement trace violates the stated speech-envelope contract.
Transport swaps language and speech fields · case 03
The announcement trace violates the stated speech-envelope contract.
Transport swaps language and speech fields · case 04
The announcement trace violates the stated speech-envelope contract.
Transport swaps language and speech fields · case 05
The announcement trace violates the stated speech-envelope contract.
New speech language inherits incompatible pronunciations · case 01
The announcement trace violates the stated locale-snapshot contract.
New speech language inherits incompatible pronunciations · case 02
The announcement trace violates the stated locale-snapshot contract.
New speech language inherits incompatible pronunciations · case 03
The announcement trace violates the stated locale-snapshot contract.
New speech language inherits incompatible pronunciations · case 04
The announcement trace violates the stated locale-snapshot contract.
New speech language inherits incompatible pronunciations · case 05
The announcement trace violates the stated locale-snapshot contract.
Voice change overwrites the speech language · case 01
The announcement trace violates the stated locale-snapshot contract.
Voice change overwrites the speech language · case 02
The announcement trace violates the stated locale-snapshot contract.
Voice change overwrites the speech language · case 03
The announcement trace violates the stated locale-snapshot contract.
Voice change overwrites the speech language · case 04
The announcement trace violates the stated locale-snapshot contract.
Voice change overwrites the speech language · case 05
The announcement trace violates the stated locale-snapshot contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗