Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Renamed task keeps speaking the prior label · case 01
The announcement trace violates the stated progress-narration contract.
Renamed task keeps speaking the prior label · case 02
The announcement trace violates the stated progress-narration contract.
Renamed task keeps speaking the prior label · case 03
The announcement trace violates the stated progress-narration contract.
Renamed task keeps speaking the prior label · case 04
The announcement trace violates the stated progress-narration contract.
Renamed task keeps speaking the prior label · case 05
The announcement trace violates the stated progress-narration contract.
Retry keeps the prior spoken milestone watermark · case 01
The announcement trace violates the stated progress-narration contract.
Retry keeps the prior spoken milestone watermark · case 02
The announcement trace violates the stated progress-narration contract.
Retry keeps the prior spoken milestone watermark · case 03
The announcement trace violates the stated progress-narration contract.
Retry keeps the prior spoken milestone watermark · case 04
The announcement trace violates the stated progress-narration contract.
Retry keeps the prior spoken milestone watermark · case 05
The announcement trace violates the stated progress-narration contract.
Failure cue leaves progress announcements enabled · case 01
The announcement trace violates the stated progress-narration contract.
Failure cue leaves progress announcements enabled · case 02
The announcement trace violates the stated progress-narration contract.
Failure cue leaves progress announcements enabled · case 03
The announcement trace violates the stated progress-narration contract.
Failure cue leaves progress announcements enabled · case 04
The announcement trace violates the stated progress-narration contract.
Failure cue leaves progress announcements enabled · case 05
The announcement trace violates the stated progress-narration contract.
Completed task repeats its completion announcement · case 01
The announcement trace violates the stated progress-narration contract.
Completed task repeats its completion announcement · case 02
The announcement trace violates the stated progress-narration contract.
Completed task repeats its completion announcement · case 03
The announcement trace violates the stated progress-narration contract.
Completed task repeats its completion announcement · case 04
The announcement trace violates the stated progress-narration contract.
Completed task repeats its completion announcement · case 05
The announcement trace violates the stated progress-narration contract.
Progress regression lowers the stored completed work · case 01
The announcement trace violates the stated progress-narration contract.
Progress regression lowers the stored completed work · case 02
The announcement trace violates the stated progress-narration contract.
Progress regression lowers the stored completed work · case 03
The announcement trace violates the stated progress-narration contract.
Progress regression lowers the stored completed work · case 04
The announcement trace violates the stated progress-narration contract.
Progress regression lowers the stored completed work · case 05
The announcement trace violates the stated progress-narration contract.
Unknown-total status announces an invented percentage · case 01
The announcement trace violates the stated progress-narration contract.
Unknown-total status announces an invented percentage · case 02
The announcement trace violates the stated progress-narration contract.
Unknown-total status announces an invented percentage · case 03
The announcement trace violates the stated progress-narration contract.
Unknown-total status announces an invented percentage · case 04
The announcement trace violates the stated progress-narration contract.
Unknown-total status announces an invented percentage · case 05
The announcement trace violates the stated progress-narration contract.
Progress percentage rounding crosses milestone early · case 01
The announcement trace violates the stated progress-narration contract.
Progress percentage rounding crosses milestone early · case 02
The announcement trace violates the stated progress-narration contract.
Progress percentage rounding crosses milestone early · case 03
The announcement trace violates the stated progress-narration contract.
Progress percentage rounding crosses milestone early · case 04
The announcement trace violates the stated progress-narration contract.
Progress percentage rounding crosses milestone early · case 05
The announcement trace violates the stated progress-narration contract.
Repeated progress speaks the same milestone again · case 01
The announcement trace violates the stated progress-narration contract.
Repeated progress speaks the same milestone again · case 02
The announcement trace violates the stated progress-narration contract.
Repeated progress speaks the same milestone again · case 03
The announcement trace violates the stated progress-narration contract.
Repeated progress speaks the same milestone again · case 04
The announcement trace violates the stated progress-narration contract.
Repeated progress speaks the same milestone again · case 05
The announcement trace violates the stated progress-narration contract.
History drops different utterances with the same text · case 01
The announcement trace violates the stated speech-history contract.
History drops different utterances with the same text · case 02
The announcement trace violates the stated speech-history contract.
History drops different utterances with the same text · case 03
The announcement trace violates the stated speech-history contract.
History drops different utterances with the same text · case 04
The announcement trace violates the stated speech-history contract.
History drops different utterances with the same text · case 05
The announcement trace violates the stated speech-history contract.
Latest delivered speech becomes oldest history item · case 01
The announcement trace violates the stated speech-history contract.
Latest delivered speech becomes oldest history item · case 02
The announcement trace violates the stated speech-history contract.
Latest delivered speech becomes oldest history item · case 03
The announcement trace violates the stated speech-history contract.
Latest delivered speech becomes oldest history item · case 04
The announcement trace violates the stated speech-history contract.
Latest delivered speech becomes oldest history item · case 05
The announcement trace violates the stated speech-history contract.
History limit keeps oldest rather than newest messages · case 01
The announcement trace violates the stated speech-history contract.
History limit keeps oldest rather than newest messages · case 02
The announcement trace violates the stated speech-history contract.
History limit keeps oldest rather than newest messages · case 03
The announcement trace violates the stated speech-history contract.
History limit keeps oldest rather than newest messages · case 04
The announcement trace violates the stated speech-history contract.
History limit keeps oldest rather than newest messages · case 05
The announcement trace violates the stated speech-history contract.
New speech does not reset replay navigation · case 01
The announcement trace violates the stated speech-history contract.
New speech does not reset replay navigation · case 02
The announcement trace violates the stated speech-history contract.
New speech does not reset replay navigation · case 03
The announcement trace violates the stated speech-history contract.
New speech does not reset replay navigation · case 04
The announcement trace violates the stated speech-history contract.
New speech does not reset replay navigation · case 05
The announcement trace violates the stated speech-history contract.
Delivered utterance ID is spoken instead of its text · case 01
The announcement trace violates the stated speech-history contract.
Delivered utterance ID is spoken instead of its text · case 02
The announcement trace violates the stated speech-history contract.
Delivered utterance ID is spoken instead of its text · case 03
The announcement trace violates the stated speech-history contract.
Delivered utterance ID is spoken instead of its text · case 04
The announcement trace violates the stated speech-history contract.
Delivered utterance ID is spoken instead of its text · case 05
The announcement trace violates the stated speech-history contract.
Replay emits the stored ID rather than text · case 01
The announcement trace violates the stated speech-history contract.
Replay emits the stored ID rather than text · case 02
The announcement trace violates the stated speech-history contract.
Replay emits the stored ID rather than text · case 03
The announcement trace violates the stated speech-history contract.
Replay emits the stored ID rather than text · case 04
The announcement trace violates the stated speech-history contract.
Replay emits the stored ID rather than text · case 05
The announcement trace violates the stated speech-history contract.
Previous command jumps directly to oldest speech · case 01
The announcement trace violates the stated speech-history contract.
Previous command jumps directly to oldest speech · case 02
The announcement trace violates the stated speech-history contract.
Previous command jumps directly to oldest speech · case 03
The announcement trace violates the stated speech-history contract.
Previous command jumps directly to oldest speech · case 04
The announcement trace violates the stated speech-history contract.
Previous command jumps directly to oldest speech · case 05
The announcement trace violates the stated speech-history contract.
Forget removes all replayable history · case 01
The announcement trace violates the stated speech-history contract.
Forget removes all replayable history · case 02
The announcement trace violates the stated speech-history contract.
Forget removes all replayable history · case 03
The announcement trace violates the stated speech-history contract.
Forget removes all replayable history · case 04
The announcement trace violates the stated speech-history contract.
Forget removes all replayable history · case 05
The announcement trace violates the stated speech-history contract.
Clear speech history also erases delivered-output record · case 01
The announcement trace violates the stated speech-history contract.
Clear speech history also erases delivered-output record · case 02
The announcement trace violates the stated speech-history contract.
Clear speech history also erases delivered-output record · case 03
The announcement trace violates the stated speech-history contract.
Clear speech history also erases delivered-output record · case 04
The announcement trace violates the stated speech-history contract.
Clear speech history also erases delivered-output record · case 05
The announcement trace violates the stated speech-history contract.
Reducing history limit trims newest speech · case 01
The announcement trace violates the stated speech-history contract.
Reducing history limit trims newest speech · case 02
The announcement trace violates the stated speech-history contract.
Reducing history limit trims newest speech · case 03
The announcement trace violates the stated speech-history contract.
Reducing history limit trims newest speech · case 04
The announcement trace violates the stated speech-history contract.
Reducing history limit trims newest speech · case 05
The announcement trace violates the stated speech-history contract.
Editing private speech reuses the previously authorized revision · case 01
The announcement trace violates the stated confirmation-gate contract.
Editing private speech reuses the previously authorized revision · case 02
The announcement trace violates the stated confirmation-gate contract.
Editing private speech reuses the previously authorized revision · case 03
The announcement trace violates the stated confirmation-gate contract.
Editing private speech reuses the previously authorized revision · case 04
The announcement trace violates the stated confirmation-gate contract.
Editing private speech reuses the previously authorized revision · case 05
The announcement trace violates the stated confirmation-gate contract.
Consent is bound to the first revision forever · case 01
The announcement trace violates the stated confirmation-gate contract.
Consent is bound to the first revision forever · case 02
The announcement trace violates the stated confirmation-gate contract.
Consent is bound to the first revision forever · case 03
The announcement trace violates the stated confirmation-gate contract.
Consent is bound to the first revision forever · case 04
The announcement trace violates the stated confirmation-gate contract.
Consent is bound to the first revision forever · case 05
The announcement trace violates the stated confirmation-gate contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗