Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Retryable submenu failure omits its retry affordance · case 01
Retryable submenu failure omits its retry affordance.
Retryable submenu failure omits its retry affordance · case 02
Retryable submenu failure omits its retry affordance.
Retryable submenu failure omits its retry affordance · case 03
Retryable submenu failure omits its retry affordance.
Retryable submenu failure omits its retry affordance · case 04
Retryable submenu failure omits its retry affordance.
Retryable submenu failure omits its retry affordance · case 05
Retryable submenu failure omits its retry affordance.
Failed menu refresh presents cached content as current · case 01
Failed menu refresh presents cached content as current.
Failed menu refresh presents cached content as current · case 02
Failed menu refresh presents cached content as current.
Failed menu refresh presents cached content as current · case 03
Failed menu refresh presents cached content as current.
Failed menu refresh presents cached content as current · case 04
Failed menu refresh presents cached content as current.
Failed menu refresh presents cached content as current · case 05
Failed menu refresh presents cached content as current.
Successful empty provider is confused with pending menu content · case 01
Successful empty provider is confused with pending menu content.
Successful empty provider is confused with pending menu content · case 02
Successful empty provider is confused with pending menu content.
Successful empty provider is confused with pending menu content · case 03
Successful empty provider is confused with pending menu content.
Successful empty provider is confused with pending menu content · case 04
Successful empty provider is confused with pending menu content.
Successful empty provider is confused with pending menu content · case 05
Successful empty provider is confused with pending menu content.
Provider error status row is treated as a menu command · case 01
Provider error status row is treated as a menu command.
Provider error status row is treated as a menu command · case 02
Provider error status row is treated as a menu command.
Provider error status row is treated as a menu command · case 03
Provider error status row is treated as a menu command.
Provider error status row is treated as a menu command · case 04
Provider error status row is treated as a menu command.
Provider error status row is treated as a menu command · case 05
Provider error status row is treated as a menu command.
Menu customization hides a required recovery command · case 01
Menu customization hides a required recovery command.
Menu customization hides a required recovery command · case 02
Menu customization hides a required recovery command.
Menu customization hides a required recovery command · case 03
Menu customization hides a required recovery command.
Menu customization hides a required recovery command · case 04
Menu customization hides a required recovery command.
Menu customization hides a required recovery command · case 05
Menu customization hides a required recovery command.
Menu display rename is applied to the wrong command ID · case 01
Menu display rename is applied to the wrong command ID.
Menu display rename is applied to the wrong command ID · case 02
Menu display rename is applied to the wrong command ID.
Menu display rename is applied to the wrong command ID · case 03
Menu display rename is applied to the wrong command ID.
Menu display rename is applied to the wrong command ID · case 04
Menu display rename is applied to the wrong command ID.
Menu display rename is applied to the wrong command ID · case 05
Menu display rename is applied to the wrong command ID.
Restoring one hidden menu command resets all hidden commands · case 01
Restoring one hidden menu command resets all hidden commands.
Restoring one hidden menu command resets all hidden commands · case 02
Restoring one hidden menu command resets all hidden commands.
Restoring one hidden menu command resets all hidden commands · case 03
Restoring one hidden menu command resets all hidden commands.
Restoring one hidden menu command resets all hidden commands · case 04
Restoring one hidden menu command resets all hidden commands.
Restoring one hidden menu command resets all hidden commands · case 05
Restoring one hidden menu command resets all hidden commands.
Resetting menu customizations deletes organization policy settings · case 01
Resetting menu customizations deletes organization policy settings.
Resetting menu customizations deletes organization policy settings · case 02
Resetting menu customizations deletes organization policy settings.
Resetting menu customizations deletes organization policy settings · case 03
Resetting menu customizations deletes organization policy settings.
Resetting menu customizations deletes organization policy settings · case 04
Resetting menu customizations deletes organization policy settings.
Resetting menu customizations deletes organization policy settings · case 05
Resetting menu customizations deletes organization policy settings.
Saved menu order makes newly installed commands unreachable · case 01
Saved menu order makes newly installed commands unreachable.
Saved menu order makes newly installed commands unreachable · case 02
Saved menu order makes newly installed commands unreachable.
Saved menu order makes newly installed commands unreachable · case 03
Saved menu order makes newly installed commands unreachable.
Saved menu order makes newly installed commands unreachable · case 04
Saved menu order makes newly installed commands unreachable.
Saved menu order makes newly installed commands unreachable · case 05
Saved menu order makes newly installed commands unreachable.
Retired command customization migrates onto stale menu entries · case 01
Retired command customization migrates onto stale menu entries.
Retired command customization migrates onto stale menu entries · case 02
Retired command customization migrates onto stale menu entries.
Retired command customization migrates onto stale menu entries · case 03
Retired command customization migrates onto stale menu entries.
Retired command customization migrates onto stale menu entries · case 04
Retired command customization migrates onto stale menu entries.
Retired command customization migrates onto stale menu entries · case 05
Retired command customization migrates onto stale menu entries.
Alias menu entry dispatches its presentation ID as a command · case 01
Alias menu entry dispatches its presentation ID as a command.
Alias menu entry dispatches its presentation ID as a command · case 02
Alias menu entry dispatches its presentation ID as a command.
Alias menu entry dispatches its presentation ID as a command · case 03
Alias menu entry dispatches its presentation ID as a command.
Alias menu entry dispatches its presentation ID as a command · case 04
Alias menu entry dispatches its presentation ID as a command.
Alias menu entry dispatches its presentation ID as a command · case 05
Alias menu entry dispatches its presentation ID as a command.
Alias-specific menu label is overwritten by target label · case 01
Alias-specific menu label is overwritten by target label.
Alias-specific menu label is overwritten by target label · case 02
Alias-specific menu label is overwritten by target label.
Alias-specific menu label is overwritten by target label · case 03
Alias-specific menu label is overwritten by target label.
Alias-specific menu label is overwritten by target label · case 04
Alias-specific menu label is overwritten by target label.
Alias-specific menu label is overwritten by target label · case 05
Alias-specific menu label is overwritten by target label.
Dangling alias menu entry is considered executable · case 01
Dangling alias menu entry is considered executable.
Dangling alias menu entry is considered executable · case 02
Dangling alias menu entry is considered executable.
Dangling alias menu entry is considered executable · case 03
Dangling alias menu entry is considered executable.
Dangling alias menu entry is considered executable · case 04
Dangling alias menu entry is considered executable.
Dangling alias menu entry is considered executable · case 05
Dangling alias menu entry is considered executable.
Self-referential menu alias is admitted into resolution · case 01
Self-referential menu alias is admitted into resolution.
Self-referential menu alias is admitted into resolution · case 02
Self-referential menu alias is admitted into resolution.
Self-referential menu alias is admitted into resolution · case 03
Self-referential menu alias is admitted into resolution.
Self-referential menu alias is admitted into resolution · case 04
Self-referential menu alias is admitted into resolution.
Self-referential menu alias is admitted into resolution · case 05
Self-referential menu alias is admitted into resolution.
Menu alias loses bound argument overrides · case 01
Menu alias loses bound argument overrides.
Menu alias loses bound argument overrides · case 02
Menu alias loses bound argument overrides.
Menu alias loses bound argument overrides · case 03
Menu alias loses bound argument overrides.
Menu alias loses bound argument overrides · case 04
Menu alias loses bound argument overrides.
Menu alias loses bound argument overrides · case 05
Menu alias loses bound argument overrides.
Alias submenu attaches to the target command parent · case 01
Alias submenu attaches to the target command parent.
Alias submenu attaches to the target command parent · case 02
Alias submenu attaches to the target command parent.
Alias submenu attaches to the target command parent · case 03
Alias submenu attaches to the target command parent.
Alias submenu attaches to the target command parent · case 04
Alias submenu attaches to the target command parent.
Alias submenu attaches to the target command parent · case 05
Alias submenu attaches to the target command parent.
Opening another menu drops existing provider lease holders · case 01
Opening another menu drops existing provider lease holders.
Opening another menu drops existing provider lease holders · case 02
Opening another menu drops existing provider lease holders.
Opening another menu drops existing provider lease holders · case 03
Opening another menu drops existing provider lease holders.
Opening another menu drops existing provider lease holders · case 04
Opening another menu drops existing provider lease holders.
Opening another menu drops existing provider lease holders · case 05
Opening another menu drops existing provider lease holders.
Closing one menu disposes a provider still used by another surface · case 01
Closing one menu disposes a provider still used by another surface.
Closing one menu disposes a provider still used by another surface · case 02
Closing one menu disposes a provider still used by another surface.
Closing one menu disposes a provider still used by another surface · case 03
Closing one menu disposes a provider still used by another surface.
Closing one menu disposes a provider still used by another surface · case 04
Closing one menu disposes a provider still used by another surface.
Closing one menu disposes a provider still used by another surface · case 05
Closing one menu disposes a provider still used by another surface.
Single remaining menu subscriber loses its shared provider · case 01
Single remaining menu subscriber loses its shared provider.
Single remaining menu subscriber loses its shared provider · case 02
Single remaining menu subscriber loses its shared provider.
Single remaining menu subscriber loses its shared provider · case 03
Single remaining menu subscriber loses its shared provider.
Single remaining menu subscriber loses its shared provider · case 04
Single remaining menu subscriber loses its shared provider.
Single remaining menu subscriber loses its shared provider · case 05
Single remaining menu subscriber loses its shared provider.
Hidden menu surface receives an unnecessary provider redraw · case 01
Hidden menu surface receives an unnecessary provider redraw.
Hidden menu surface receives an unnecessary provider redraw · case 02
Hidden menu surface receives an unnecessary provider redraw.
Hidden menu surface receives an unnecessary provider redraw · case 03
Hidden menu surface receives an unnecessary provider redraw.
Hidden menu surface receives an unnecessary provider redraw · case 04
Hidden menu surface receives an unnecessary provider redraw.
Hidden menu surface receives an unnecessary provider redraw · case 05
Hidden menu surface receives an unnecessary provider redraw.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗