Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Parameter submenu loses earlier parent command bindings · case 01
Parameter submenu loses earlier parent command bindings.
Parameter submenu loses earlier parent command bindings · case 02
Parameter submenu loses earlier parent command bindings.
Parameter submenu loses earlier parent command bindings · case 03
Parameter submenu loses earlier parent command bindings.
Parameter submenu loses earlier parent command bindings · case 04
Parameter submenu loses earlier parent command bindings.
Parameter submenu loses earlier parent command bindings · case 05
Parameter submenu loses earlier parent command bindings.
Parameter row dispatches itself instead of its parent menu command · case 01
Parameter row dispatches itself instead of its parent menu command.
Parameter row dispatches itself instead of its parent menu command · case 02
Parameter row dispatches itself instead of its parent menu command.
Parameter row dispatches itself instead of its parent menu command · case 03
Parameter row dispatches itself instead of its parent menu command.
Parameter row dispatches itself instead of its parent menu command · case 04
Parameter row dispatches itself instead of its parent menu command.
Parameter row dispatches itself instead of its parent menu command · case 05
Parameter row dispatches itself instead of its parent menu command.
Cancelling a parameter submenu commits unfinished arguments · case 01
Cancelling a parameter submenu commits unfinished arguments.
Cancelling a parameter submenu commits unfinished arguments · case 02
Cancelling a parameter submenu commits unfinished arguments.
Cancelling a parameter submenu commits unfinished arguments · case 03
Cancelling a parameter submenu commits unfinished arguments.
Cancelling a parameter submenu commits unfinished arguments · case 04
Cancelling a parameter submenu commits unfinished arguments.
Cancelling a parameter submenu commits unfinished arguments · case 05
Cancelling a parameter submenu commits unfinished arguments.
Parameter submenu enables commit with missing required bindings · case 01
Parameter submenu enables commit with missing required bindings.
Parameter submenu enables commit with missing required bindings · case 02
Parameter submenu enables commit with missing required bindings.
Parameter submenu enables commit with missing required bindings · case 03
Parameter submenu enables commit with missing required bindings.
Parameter submenu enables commit with missing required bindings · case 04
Parameter submenu enables commit with missing required bindings.
Parameter submenu enables commit with missing required bindings · case 05
Parameter submenu enables commit with missing required bindings.
Parameter menu binds the display label instead of typed value · case 01
Parameter menu binds the display label instead of typed value.
Parameter menu binds the display label instead of typed value · case 02
Parameter menu binds the display label instead of typed value.
Parameter menu binds the display label instead of typed value · case 03
Parameter menu binds the display label instead of typed value.
Parameter menu binds the display label instead of typed value · case 04
Parameter menu binds the display label instead of typed value.
Parameter menu binds the display label instead of typed value · case 05
Parameter menu binds the display label instead of typed value.
Parameter submenu completion skips its owning command menu · case 01
Parameter submenu completion skips its owning command menu.
Parameter submenu completion skips its owning command menu · case 02
Parameter submenu completion skips its owning command menu.
Parameter submenu completion skips its owning command menu · case 03
Parameter submenu completion skips its owning command menu.
Parameter submenu completion skips its owning command menu · case 04
Parameter submenu completion skips its owning command menu.
Parameter submenu completion skips its owning command menu · case 05
Parameter submenu completion skips its owning command menu.
Queued menu invocation rebinds its context at enqueue time · case 01
Queued menu invocation rebinds its context at enqueue time.
Queued menu invocation rebinds its context at enqueue time · case 02
Queued menu invocation rebinds its context at enqueue time.
Queued menu invocation rebinds its context at enqueue time · case 03
Queued menu invocation rebinds its context at enqueue time.
Queued menu invocation rebinds its context at enqueue time · case 04
Queued menu invocation rebinds its context at enqueue time.
Queued menu invocation rebinds its context at enqueue time · case 05
Queued menu invocation rebinds its context at enqueue time.
Menu command queue removes a different invocation than it executes · case 01
Menu command queue removes a different invocation than it executes.
Menu command queue removes a different invocation than it executes · case 02
Menu command queue removes a different invocation than it executes.
Menu command queue removes a different invocation than it executes · case 03
Menu command queue removes a different invocation than it executes.
Menu command queue removes a different invocation than it executes · case 04
Menu command queue removes a different invocation than it executes.
Menu command queue removes a different invocation than it executes · case 05
Menu command queue removes a different invocation than it executes.
Cancelling one queued menu transaction removes same-command siblings · case 01
Cancelling one queued menu transaction removes same-command siblings.
Cancelling one queued menu transaction removes same-command siblings · case 02
Cancelling one queued menu transaction removes same-command siblings.
Cancelling one queued menu transaction removes same-command siblings · case 03
Cancelling one queued menu transaction removes same-command siblings.
Cancelling one queued menu transaction removes same-command siblings · case 04
Cancelling one queued menu transaction removes same-command siblings.
Cancelling one queued menu transaction removes same-command siblings · case 05
Cancelling one queued menu transaction removes same-command siblings.
Busy document menu lane blocks unrelated document commands · case 01
Busy document menu lane blocks unrelated document commands.
Busy document menu lane blocks unrelated document commands · case 02
Busy document menu lane blocks unrelated document commands.
Busy document menu lane blocks unrelated document commands · case 03
Busy document menu lane blocks unrelated document commands.
Busy document menu lane blocks unrelated document commands · case 04
Busy document menu lane blocks unrelated document commands.
Busy document menu lane blocks unrelated document commands · case 05
Busy document menu lane blocks unrelated document commands.
Recoverable menu command failure discards remaining queued work · case 01
Recoverable menu command failure discards remaining queued work.
Recoverable menu command failure discards remaining queued work · case 02
Recoverable menu command failure discards remaining queued work.
Recoverable menu command failure discards remaining queued work · case 03
Recoverable menu command failure discards remaining queued work.
Recoverable menu command failure discards remaining queued work · case 04
Recoverable menu command failure discards remaining queued work.
Recoverable menu command failure discards remaining queued work · case 05
Recoverable menu command failure discards remaining queued work.
Closing popup cancels explicitly detached queued menu commands · case 01
Closing popup cancels explicitly detached queued menu commands.
Closing popup cancels explicitly detached queued menu commands · case 02
Closing popup cancels explicitly detached queued menu commands.
Closing popup cancels explicitly detached queued menu commands · case 03
Closing popup cancels explicitly detached queued menu commands.
Closing popup cancels explicitly detached queued menu commands · case 04
Closing popup cancels explicitly detached queued menu commands.
Closing popup cancels explicitly detached queued menu commands · case 05
Closing popup cancels explicitly detached queued menu commands.
One failed menu provider removes every provider section · case 01
One failed menu provider removes every provider section.
One failed menu provider removes every provider section · case 02
One failed menu provider removes every provider section.
One failed menu provider removes every provider section · case 03
One failed menu provider removes every provider section.
One failed menu provider removes every provider section · case 04
One failed menu provider removes every provider section.
One failed menu provider removes every provider section · case 05
One failed menu provider removes every provider section.
Menu provider failure ignores its declared offline fallback commands · case 01
Menu provider failure ignores its declared offline fallback commands.
Menu provider failure ignores its declared offline fallback commands · case 02
Menu provider failure ignores its declared offline fallback commands.
Menu provider failure ignores its declared offline fallback commands · case 03
Menu provider failure ignores its declared offline fallback commands.
Menu provider failure ignores its declared offline fallback commands · case 04
Menu provider failure ignores its declared offline fallback commands.
Menu provider failure ignores its declared offline fallback commands · case 05
Menu provider failure ignores its declared offline fallback commands.
Menu provider error is attributed to the root menu provider · case 01
Menu provider error is attributed to the root menu provider.
Menu provider error is attributed to the root menu provider · case 02
Menu provider error is attributed to the root menu provider.
Menu provider error is attributed to the root menu provider · case 03
Menu provider error is attributed to the root menu provider.
Menu provider error is attributed to the root menu provider · case 04
Menu provider error is attributed to the root menu provider.
Menu provider error is attributed to the root menu provider · case 05
Menu provider error is attributed to the root menu provider.
Recovering one menu provider clears unrelated provider errors · case 01
Recovering one menu provider clears unrelated provider errors.
Recovering one menu provider clears unrelated provider errors · case 02
Recovering one menu provider clears unrelated provider errors.
Recovering one menu provider clears unrelated provider errors · case 03
Recovering one menu provider clears unrelated provider errors.
Recovering one menu provider clears unrelated provider errors · case 04
Recovering one menu provider clears unrelated provider errors.
Recovering one menu provider clears unrelated provider errors · case 05
Recovering one menu provider clears unrelated provider errors.
Fatal malformed menu definition is replaced with unsafe stale content · case 01
Fatal malformed menu definition is replaced with unsafe stale content.
Fatal malformed menu definition is replaced with unsafe stale content · case 02
Fatal malformed menu definition is replaced with unsafe stale content.
Fatal malformed menu definition is replaced with unsafe stale content · case 03
Fatal malformed menu definition is replaced with unsafe stale content.
Fatal malformed menu definition is replaced with unsafe stale content · case 04
Fatal malformed menu definition is replaced with unsafe stale content.
Fatal malformed menu definition is replaced with unsafe stale content · case 05
Fatal malformed menu definition is replaced with unsafe stale content.
Menu retry control forgets consumed provider retry attempts · case 01
Menu retry control forgets consumed provider retry attempts.
Menu retry control forgets consumed provider retry attempts · case 02
Menu retry control forgets consumed provider retry attempts.
Menu retry control forgets consumed provider retry attempts · case 03
Menu retry control forgets consumed provider retry attempts.
Menu retry control forgets consumed provider retry attempts · case 04
Menu retry control forgets consumed provider retry attempts.
Menu retry control forgets consumed provider retry attempts · case 05
Menu retry control forgets consumed provider retry attempts.
Menu confirmation loses the captured invocation intent · case 01
Menu confirmation loses the captured invocation intent.
Menu confirmation loses the captured invocation intent · case 02
Menu confirmation loses the captured invocation intent.
Menu confirmation loses the captured invocation intent · case 03
Menu confirmation loses the captured invocation intent.
Menu confirmation loses the captured invocation intent · case 04
Menu confirmation loses the captured invocation intent.
Menu confirmation loses the captured invocation intent · case 05
Menu confirmation loses the captured invocation intent.
Cancelled menu confirmation leaves an executable pending intent · case 01
Cancelled menu confirmation leaves an executable pending intent.
Cancelled menu confirmation leaves an executable pending intent · case 02
Cancelled menu confirmation leaves an executable pending intent.
Cancelled menu confirmation leaves an executable pending intent · case 03
Cancelled menu confirmation leaves an executable pending intent.
Cancelled menu confirmation leaves an executable pending intent · case 04
Cancelled menu confirmation leaves an executable pending intent.
Cancelled menu confirmation leaves an executable pending intent · case 05
Cancelled menu confirmation leaves an executable pending intent.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗