Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Confirmed menu intent remains pending for a second execution · case 01
Confirmed menu intent remains pending for a second execution.
Confirmed menu intent remains pending for a second execution · case 02
Confirmed menu intent remains pending for a second execution.
Confirmed menu intent remains pending for a second execution · case 03
Confirmed menu intent remains pending for a second execution.
Confirmed menu intent remains pending for a second execution · case 04
Confirmed menu intent remains pending for a second execution.
Confirmed menu intent remains pending for a second execution · case 05
Confirmed menu intent remains pending for a second execution.
Changed document executes an obsolete menu confirmation · case 01
Changed document executes an obsolete menu confirmation.
Changed document executes an obsolete menu confirmation · case 02
Changed document executes an obsolete menu confirmation.
Changed document executes an obsolete menu confirmation · case 03
Changed document executes an obsolete menu confirmation.
Changed document executes an obsolete menu confirmation · case 04
Changed document executes an obsolete menu confirmation.
Changed document executes an obsolete menu confirmation · case 05
Changed document executes an obsolete menu confirmation.
Menu confirmation miscounts destructive effects in a mixed plan · case 01
Menu confirmation miscounts destructive effects in a mixed plan.
Menu confirmation miscounts destructive effects in a mixed plan · case 02
Menu confirmation miscounts destructive effects in a mixed plan.
Menu confirmation miscounts destructive effects in a mixed plan · case 03
Menu confirmation miscounts destructive effects in a mixed plan.
Menu confirmation miscounts destructive effects in a mixed plan · case 04
Menu confirmation miscounts destructive effects in a mixed plan.
Menu confirmation miscounts destructive effects in a mixed plan · case 05
Menu confirmation miscounts destructive effects in a mixed plan.
Menu confirmation returns to an already disposed source popup · case 01
Menu confirmation returns to an already disposed source popup.
Menu confirmation returns to an already disposed source popup · case 02
Menu confirmation returns to an already disposed source popup.
Menu confirmation returns to an already disposed source popup · case 03
Menu confirmation returns to an already disposed source popup.
Menu confirmation returns to an already disposed source popup · case 04
Menu confirmation returns to an already disposed source popup.
Menu confirmation returns to an already disposed source popup · case 05
Menu confirmation returns to an already disposed source popup.
Nested menu provider receives the full root row budget · case 01
Nested menu provider receives the full root row budget.
Nested menu provider receives the full root row budget · case 02
Nested menu provider receives the full root row budget.
Nested menu provider receives the full root row budget · case 03
Nested menu provider receives the full root row budget.
Nested menu provider receives the full root row budget · case 04
Nested menu provider receives the full root row budget.
Nested menu provider receives the full root row budget · case 05
Nested menu provider receives the full root row budget.
Nested provider depth allowance ignores consumed ancestors · case 01
Nested provider depth allowance ignores consumed ancestors.
Nested provider depth allowance ignores consumed ancestors · case 02
Nested provider depth allowance ignores consumed ancestors.
Nested provider depth allowance ignores consumed ancestors · case 03
Nested provider depth allowance ignores consumed ancestors.
Nested provider depth allowance ignores consumed ancestors · case 04
Nested provider depth allowance ignores consumed ancestors.
Nested provider depth allowance ignores consumed ancestors · case 05
Nested provider depth allowance ignores consumed ancestors.
Cached submenu commands bypass the menu presentation row budget · case 01
Cached submenu commands bypass the menu presentation row budget.
Cached submenu commands bypass the menu presentation row budget · case 02
Cached submenu commands bypass the menu presentation row budget.
Cached submenu commands bypass the menu presentation row budget · case 03
Cached submenu commands bypass the menu presentation row budget.
Cached submenu commands bypass the menu presentation row budget · case 04
Cached submenu commands bypass the menu presentation row budget.
Cached submenu commands bypass the menu presentation row budget · case 05
Cached submenu commands bypass the menu presentation row budget.
Budget-truncated submenu lacks a visible truncation state · case 01
Budget-truncated submenu lacks a visible truncation state.
Budget-truncated submenu lacks a visible truncation state · case 02
Budget-truncated submenu lacks a visible truncation state.
Budget-truncated submenu lacks a visible truncation state · case 03
Budget-truncated submenu lacks a visible truncation state.
Budget-truncated submenu lacks a visible truncation state · case 04
Budget-truncated submenu lacks a visible truncation state.
Budget-truncated submenu lacks a visible truncation state · case 05
Budget-truncated submenu lacks a visible truncation state.
Parallel submenu providers overbook a shared row reservation · case 01
Parallel submenu providers overbook a shared row reservation.
Parallel submenu providers overbook a shared row reservation · case 02
Parallel submenu providers overbook a shared row reservation.
Parallel submenu providers overbook a shared row reservation · case 03
Parallel submenu providers overbook a shared row reservation.
Parallel submenu providers overbook a shared row reservation · case 04
Parallel submenu providers overbook a shared row reservation.
Parallel submenu providers overbook a shared row reservation · case 05
Parallel submenu providers overbook a shared row reservation.
Completed submenu provider keeps its reserved capacity unavailable · case 01
Completed submenu provider keeps its reserved capacity unavailable.
Completed submenu provider keeps its reserved capacity unavailable · case 02
Completed submenu provider keeps its reserved capacity unavailable.
Completed submenu provider keeps its reserved capacity unavailable · case 03
Completed submenu provider keeps its reserved capacity unavailable.
Completed submenu provider keeps its reserved capacity unavailable · case 04
Completed submenu provider keeps its reserved capacity unavailable.
Completed submenu provider keeps its reserved capacity unavailable · case 05
Completed submenu provider keeps its reserved capacity unavailable.
Menu macro records a transient row ID instead of the semantic command · case 01
Menu macro records a transient row ID instead of the semantic command.
Menu macro records a transient row ID instead of the semantic command · case 02
Menu macro records a transient row ID instead of the semantic command.
Menu macro records a transient row ID instead of the semantic command · case 03
Menu macro records a transient row ID instead of the semantic command.
Menu macro records a transient row ID instead of the semantic command · case 04
Menu macro records a transient row ID instead of the semantic command.
Menu macro records a transient row ID instead of the semantic command · case 05
Menu macro records a transient row ID instead of the semantic command.
Failed menu action is appended to command macro playback · case 01
Failed menu action is appended to command macro playback.
Failed menu action is appended to command macro playback · case 02
Failed menu action is appended to command macro playback.
Failed menu action is appended to command macro playback · case 03
Failed menu action is appended to command macro playback.
Failed menu action is appended to command macro playback · case 04
Failed menu action is appended to command macro playback.
Failed menu action is appended to command macro playback · case 05
Failed menu action is appended to command macro playback.
Menu macro persists private invocation arguments · case 01
Menu macro persists private invocation arguments.
Menu macro persists private invocation arguments · case 02
Menu macro persists private invocation arguments.
Menu macro persists private invocation arguments · case 03
Menu macro persists private invocation arguments.
Menu macro persists private invocation arguments · case 04
Menu macro persists private invocation arguments.
Menu macro persists private invocation arguments · case 05
Menu macro persists private invocation arguments.
Menu macro playback reorders semantically dependent commands · case 01
Menu macro playback reorders semantically dependent commands.
Menu macro playback reorders semantically dependent commands · case 02
Menu macro playback reorders semantically dependent commands.
Menu macro playback reorders semantically dependent commands · case 03
Menu macro playback reorders semantically dependent commands.
Menu macro playback reorders semantically dependent commands · case 04
Menu macro playback reorders semantically dependent commands.
Menu macro playback reorders semantically dependent commands · case 05
Menu macro playback reorders semantically dependent commands.
Menu macro playback recursively records its own commands · case 01
Menu macro playback recursively records its own commands.
Menu macro playback recursively records its own commands · case 02
Menu macro playback recursively records its own commands.
Menu macro playback recursively records its own commands · case 03
Menu macro playback recursively records its own commands.
Menu macro playback recursively records its own commands · case 04
Menu macro playback recursively records its own commands.
Menu macro playback recursively records its own commands · case 05
Menu macro playback recursively records its own commands.
Menu macro stringifies typed command parameters · case 01
Menu macro stringifies typed command parameters.
Menu macro stringifies typed command parameters · case 02
Menu macro stringifies typed command parameters.
Menu macro stringifies typed command parameters · case 03
Menu macro stringifies typed command parameters.
Menu macro stringifies typed command parameters · case 04
Menu macro stringifies typed command parameters.
Menu macro stringifies typed command parameters · case 05
Menu macro stringifies typed command parameters.
Menu preview accumulates on the previous preview instead of base state · case 01
Menu preview accumulates on the previous preview instead of base state.
Menu preview accumulates on the previous preview instead of base state · case 02
Menu preview accumulates on the previous preview instead of base state.
Menu preview accumulates on the previous preview instead of base state · case 03
Menu preview accumulates on the previous preview instead of base state.
Menu preview accumulates on the previous preview instead of base state · case 04
Menu preview accumulates on the previous preview instead of base state.
Menu preview accumulates on the previous preview instead of base state · case 05
Menu preview accumulates on the previous preview instead of base state.
Cancelling a menu preview leaves provisional document changes · case 01
Cancelling a menu preview leaves provisional document changes.
Cancelling a menu preview leaves provisional document changes · case 02
Cancelling a menu preview leaves provisional document changes.
Cancelling a menu preview leaves provisional document changes · case 03
Cancelling a menu preview leaves provisional document changes.
Cancelling a menu preview leaves provisional document changes · case 04
Cancelling a menu preview leaves provisional document changes.
Cancelling a menu preview leaves provisional document changes · case 05
Cancelling a menu preview leaves provisional document changes.
Menu preview commit applies the command delta twice · case 01
Menu preview commit applies the command delta twice.
Menu preview commit applies the command delta twice · case 02
Menu preview commit applies the command delta twice.
Menu preview commit applies the command delta twice · case 03
Menu preview commit applies the command delta twice.
Menu preview commit applies the command delta twice · case 04
Menu preview commit applies the command delta twice.
Menu preview commit applies the command delta twice · case 05
Menu preview commit applies the command delta twice.
Menu preview cleanup removes overlays owned by another menu · case 01
Menu preview cleanup removes overlays owned by another menu.
Menu preview cleanup removes overlays owned by another menu · case 02
Menu preview cleanup removes overlays owned by another menu.
Menu preview cleanup removes overlays owned by another menu · case 03
Menu preview cleanup removes overlays owned by another menu.
Menu preview cleanup removes overlays owned by another menu · case 04
Menu preview cleanup removes overlays owned by another menu.
Menu preview cleanup removes overlays owned by another menu · case 05
Menu preview cleanup removes overlays owned by another menu.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗