Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Unbatched announcement is discarded · case 01
The announcement trace violates the stated announcement-transaction contract.
Unbatched announcement is discarded · case 02
The announcement trace violates the stated announcement-transaction contract.
Unbatched announcement is discarded · case 03
The announcement trace violates the stated announcement-transaction contract.
Unbatched announcement is discarded · case 04
The announcement trace violates the stated announcement-transaction contract.
Unbatched announcement is discarded · case 05
The announcement trace violates the stated announcement-transaction contract.
Commit removes the outer frame instead of the inner one · case 01
The announcement trace violates the stated announcement-transaction contract.
Commit removes the outer frame instead of the inner one · case 02
The announcement trace violates the stated announcement-transaction contract.
Commit removes the outer frame instead of the inner one · case 03
The announcement trace violates the stated announcement-transaction contract.
Commit removes the outer frame instead of the inner one · case 04
The announcement trace violates the stated announcement-transaction contract.
Commit removes the outer frame instead of the inner one · case 05
The announcement trace violates the stated announcement-transaction contract.
Nested commit overwrites prior parent announcements · case 01
The announcement trace violates the stated announcement-transaction contract.
Nested commit overwrites prior parent announcements · case 02
The announcement trace violates the stated announcement-transaction contract.
Nested commit overwrites prior parent announcements · case 03
The announcement trace violates the stated announcement-transaction contract.
Nested commit overwrites prior parent announcements · case 04
The announcement trace violates the stated announcement-transaction contract.
Nested commit overwrites prior parent announcements · case 05
The announcement trace violates the stated announcement-transaction contract.
Outermost commit reverses spoken message order · case 01
The announcement trace violates the stated announcement-transaction contract.
Outermost commit reverses spoken message order · case 02
The announcement trace violates the stated announcement-transaction contract.
Outermost commit reverses spoken message order · case 03
The announcement trace violates the stated announcement-transaction contract.
Outermost commit reverses spoken message order · case 04
The announcement trace violates the stated announcement-transaction contract.
Outermost commit reverses spoken message order · case 05
The announcement trace violates the stated announcement-transaction contract.
Rollback destroys every open announcement transaction · case 01
The announcement trace violates the stated announcement-transaction contract.
Rollback destroys every open announcement transaction · case 02
The announcement trace violates the stated announcement-transaction contract.
Rollback destroys every open announcement transaction · case 03
The announcement trace violates the stated announcement-transaction contract.
Rollback destroys every open announcement transaction · case 04
The announcement trace violates the stated announcement-transaction contract.
Rollback destroys every open announcement transaction · case 05
The announcement trace violates the stated announcement-transaction contract.
Staged correction edits the first message in the frame · case 01
The announcement trace violates the stated announcement-transaction contract.
Staged correction edits the first message in the frame · case 02
The announcement trace violates the stated announcement-transaction contract.
Staged correction edits the first message in the frame · case 03
The announcement trace violates the stated announcement-transaction contract.
Staged correction edits the first message in the frame · case 04
The announcement trace violates the stated announcement-transaction contract.
Staged correction edits the first message in the frame · case 05
The announcement trace violates the stated announcement-transaction contract.
Clear staging also erases already spoken history · case 01
The announcement trace violates the stated announcement-transaction contract.
Clear staging also erases already spoken history · case 02
The announcement trace violates the stated announcement-transaction contract.
Clear staging also erases already spoken history · case 03
The announcement trace violates the stated announcement-transaction contract.
Clear staging also erases already spoken history · case 04
The announcement trace violates the stated announcement-transaction contract.
Clear staging also erases already spoken history · case 05
The announcement trace violates the stated announcement-transaction contract.
Flush leaks uncommitted announcement text · case 01
The announcement trace violates the stated announcement-transaction contract.
Flush leaks uncommitted announcement text · case 02
The announcement trace violates the stated announcement-transaction contract.
Flush leaks uncommitted announcement text · case 03
The announcement trace violates the stated announcement-transaction contract.
Flush leaks uncommitted announcement text · case 04
The announcement trace violates the stated announcement-transaction contract.
Flush leaks uncommitted announcement text · case 05
The announcement trace violates the stated announcement-transaction contract.
Source re-registration reuses a stale lease · case 01
The announcement trace violates the stated context-lease contract.
Source re-registration reuses a stale lease · case 02
The announcement trace violates the stated context-lease contract.
Source re-registration reuses a stale lease · case 03
The announcement trace violates the stated context-lease contract.
Source re-registration reuses a stale lease · case 04
The announcement trace violates the stated context-lease contract.
Source re-registration reuses a stale lease · case 05
The announcement trace violates the stated context-lease contract.
Re-registration preserves text from the previous lease · case 01
The announcement trace violates the stated context-lease contract.
Re-registration preserves text from the previous lease · case 02
The announcement trace violates the stated context-lease contract.
Re-registration preserves text from the previous lease · case 03
The announcement trace violates the stated context-lease contract.
Re-registration preserves text from the previous lease · case 04
The announcement trace violates the stated context-lease contract.
Re-registration preserves text from the previous lease · case 05
The announcement trace violates the stated context-lease contract.
Old producer updates the replacement context · case 01
The announcement trace violates the stated context-lease contract.
Old producer updates the replacement context · case 02
The announcement trace violates the stated context-lease contract.
Old producer updates the replacement context · case 03
The announcement trace violates the stated context-lease contract.
Old producer updates the replacement context · case 04
The announcement trace violates the stated context-lease contract.
Old producer updates the replacement context · case 05
The announcement trace violates the stated context-lease contract.
Status updates concatenate instead of replace · case 01
The announcement trace violates the stated context-lease contract.
Status updates concatenate instead of replace · case 02
The announcement trace violates the stated context-lease contract.
Status updates concatenate instead of replace · case 03
The announcement trace violates the stated context-lease contract.
Status updates concatenate instead of replace · case 04
The announcement trace violates the stated context-lease contract.
Status updates concatenate instead of replace · case 05
The announcement trace violates the stated context-lease contract.
Queued announcement resolves text at drain time · case 01
The announcement trace violates the stated context-lease contract.
Queued announcement resolves text at drain time · case 02
The announcement trace violates the stated context-lease contract.
Queued announcement resolves text at drain time · case 03
The announcement trace violates the stated context-lease contract.
Queued announcement resolves text at drain time · case 04
The announcement trace violates the stated context-lease contract.
Queued announcement resolves text at drain time · case 05
The announcement trace violates the stated context-lease contract.
Removing a source leaves its lease valid · case 01
The announcement trace violates the stated context-lease contract.
Removing a source leaves its lease valid · case 02
The announcement trace violates the stated context-lease contract.
Removing a source leaves its lease valid · case 03
The announcement trace violates the stated context-lease contract.
Removing a source leaves its lease valid · case 04
The announcement trace violates the stated context-lease contract.
Removing a source leaves its lease valid · case 05
The announcement trace violates the stated context-lease contract.
Renamed source retains the old live alias · case 01
The announcement trace violates the stated context-lease contract.
Renamed source retains the old live alias · case 02
The announcement trace violates the stated context-lease contract.
Renamed source retains the old live alias · case 03
The announcement trace violates the stated context-lease contract.
Renamed source retains the old live alias · case 04
The announcement trace violates the stated context-lease contract.
Renamed source retains the old live alias · case 05
The announcement trace violates the stated context-lease contract.
Recreated source authorizes queued text from old lifetime · case 01
The announcement trace violates the stated context-lease contract.
Recreated source authorizes queued text from old lifetime · case 02
The announcement trace violates the stated context-lease contract.
Recreated source authorizes queued text from old lifetime · case 03
The announcement trace violates the stated context-lease contract.
Recreated source authorizes queued text from old lifetime · case 04
The announcement trace violates the stated context-lease contract.
Recreated source authorizes queued text from old lifetime · case 05
The announcement trace violates the stated context-lease contract.
Uninitialized source queues a blank audible utterance · case 01
The announcement trace violates the stated context-lease contract.
Uninitialized source queues a blank audible utterance · case 02
The announcement trace violates the stated context-lease contract.
Uninitialized source queues a blank audible utterance · case 03
The announcement trace violates the stated context-lease contract.
Uninitialized source queues a blank audible utterance · case 04
The announcement trace violates the stated context-lease contract.
Uninitialized source queues a blank audible utterance · case 05
The announcement trace violates the stated context-lease contract.
Draining replays queued announcements at the next drain · case 01
The announcement trace violates the stated context-lease contract.
Draining replays queued announcements at the next drain · case 02
The announcement trace violates the stated context-lease contract.
Draining replays queued announcements at the next drain · case 03
The announcement trace violates the stated context-lease contract.
Draining replays queued announcements at the next drain · case 04
The announcement trace violates the stated context-lease contract.
Draining replays queued announcements at the next drain · case 05
The announcement trace violates the stated context-lease contract.
Queued announcement loses FIFO order among equals · case 01
The announcement trace violates the stated deadline-scheduler contract.
Queued announcement loses FIFO order among equals · case 02
The announcement trace violates the stated deadline-scheduler contract.
Queued announcement loses FIFO order among equals · case 03
The announcement trace violates the stated deadline-scheduler contract.
Queued announcement loses FIFO order among equals · case 04
The announcement trace violates the stated deadline-scheduler contract.
Queued announcement loses FIFO order among equals · case 05
The announcement trace violates the stated deadline-scheduler contract.
Scheduler stores the announcement ID as spoken text · case 01
The announcement trace violates the stated deadline-scheduler contract.
Scheduler stores the announcement ID as spoken text · case 02
The announcement trace violates the stated deadline-scheduler contract.
Scheduler stores the announcement ID as spoken text · case 03
The announcement trace violates the stated deadline-scheduler contract.
Scheduler stores the announcement ID as spoken text · case 04
The announcement trace violates the stated deadline-scheduler contract.
Scheduler stores the announcement ID as spoken text · case 05
The announcement trace violates the stated deadline-scheduler contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗