Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Irreversible menu command is executed as a hover preview · case 01
Irreversible menu command is executed as a hover preview.
Irreversible menu command is executed as a hover preview · case 02
Irreversible menu command is executed as a hover preview.
Irreversible menu command is executed as a hover preview · case 03
Irreversible menu command is executed as a hover preview.
Irreversible menu command is executed as a hover preview · case 04
Irreversible menu command is executed as a hover preview.
Irreversible menu command is executed as a hover preview · case 05
Irreversible menu command is executed as a hover preview.
Pointer departure commits a provisional menu preview · case 01
Pointer departure commits a provisional menu preview.
Pointer departure commits a provisional menu preview · case 02
Pointer departure commits a provisional menu preview.
Pointer departure commits a provisional menu preview · case 03
Pointer departure commits a provisional menu preview.
Pointer departure commits a provisional menu preview · case 04
Pointer departure commits a provisional menu preview.
Pointer departure commits a provisional menu preview · case 05
Pointer departure commits a provisional menu preview.
Repeated row renders inflate menu impression counts · case 01
Repeated row renders inflate menu impression counts.
Repeated row renders inflate menu impression counts · case 02
Repeated row renders inflate menu impression counts.
Repeated row renders inflate menu impression counts · case 03
Repeated row renders inflate menu impression counts.
Repeated row renders inflate menu impression counts · case 04
Repeated row renders inflate menu impression counts.
Repeated row renders inflate menu impression counts · case 05
Repeated row renders inflate menu impression counts.
Menu metrics conflate invoked commands with successful execution · case 01
Menu metrics conflate invoked commands with successful execution.
Menu metrics conflate invoked commands with successful execution · case 02
Menu metrics conflate invoked commands with successful execution.
Menu metrics conflate invoked commands with successful execution · case 03
Menu metrics conflate invoked commands with successful execution.
Menu metrics conflate invoked commands with successful execution · case 04
Menu metrics conflate invoked commands with successful execution.
Menu metrics conflate invoked commands with successful execution · case 05
Menu metrics conflate invoked commands with successful execution.
Menu usage metrics merge repeated command labels from different branches · case 01
Menu usage metrics merge repeated command labels from different branches.
Menu usage metrics merge repeated command labels from different branches · case 02
Menu usage metrics merge repeated command labels from different branches.
Menu usage metrics merge repeated command labels from different branches · case 03
Menu usage metrics merge repeated command labels from different branches.
Menu usage metrics merge repeated command labels from different branches · case 04
Menu usage metrics merge repeated command labels from different branches.
Menu usage metrics merge repeated command labels from different branches · case 05
Menu usage metrics merge repeated command labels from different branches.
Menu dwell duration is reported as an absolute closing timestamp · case 01
Menu dwell duration is reported as an absolute closing timestamp.
Menu dwell duration is reported as an absolute closing timestamp · case 02
Menu dwell duration is reported as an absolute closing timestamp.
Menu dwell duration is reported as an absolute closing timestamp · case 03
Menu dwell duration is reported as an absolute closing timestamp.
Menu dwell duration is reported as an absolute closing timestamp · case 04
Menu dwell duration is reported as an absolute closing timestamp.
Menu dwell duration is reported as an absolute closing timestamp · case 05
Menu dwell duration is reported as an absolute closing timestamp.
Menu usage event leaks captured command arguments · case 01
Menu usage event leaks captured command arguments.
Menu usage event leaks captured command arguments · case 02
Menu usage event leaks captured command arguments.
Menu usage event leaks captured command arguments · case 03
Menu usage event leaks captured command arguments.
Menu usage event leaks captured command arguments · case 04
Menu usage event leaks captured command arguments.
Menu usage event leaks captured command arguments · case 05
Menu usage event leaks captured command arguments.
Submenu openings count as separate root menu sessions · case 01
Submenu openings count as separate root menu sessions.
Submenu openings count as separate root menu sessions · case 02
Submenu openings count as separate root menu sessions.
Submenu openings count as separate root menu sessions · case 03
Submenu openings count as separate root menu sessions.
Submenu openings count as separate root menu sessions · case 04
Submenu openings count as separate root menu sessions.
Submenu openings count as separate root menu sessions · case 05
Submenu openings count as separate root menu sessions.
Toast exposure timeout: pointer-enter from visible · case 01
The pointer-enter event leaves a notification in expired instead of hover-paused.
Toast exposure timeout: pointer-enter from visible · case 02
The pointer-enter event leaves a notification in expired instead of hover-paused.
Toast exposure timeout: pointer-enter from visible · case 03
The pointer-enter event leaves a notification in expired instead of hover-paused.
Toast exposure timeout: pointer-enter from visible · case 04
The pointer-enter event leaves a notification in expired instead of hover-paused.
Toast exposure timeout: pointer-enter from visible · case 05
The pointer-enter event leaves a notification in expired instead of hover-paused.
Toast exposure timeout: pointer-leave from hover-paused · case 01
The pointer-leave event leaves a notification in expired instead of visible.
Toast exposure timeout: pointer-leave from hover-paused · case 02
The pointer-leave event leaves a notification in expired instead of visible.
Toast exposure timeout: pointer-leave from hover-paused · case 03
The pointer-leave event leaves a notification in expired instead of visible.
Toast exposure timeout: pointer-leave from hover-paused · case 04
The pointer-leave event leaves a notification in expired instead of visible.
Toast exposure timeout: pointer-leave from hover-paused · case 05
The pointer-leave event leaves a notification in expired instead of visible.
Toast exposure timeout: page-hidden from visible · case 01
The page-hidden event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: page-hidden from visible · case 02
The page-hidden event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: page-hidden from visible · case 03
The page-hidden event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: page-hidden from visible · case 04
The page-hidden event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: page-hidden from visible · case 05
The page-hidden event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: page-visible from hidden-paused · case 01
The page-visible event leaves a notification in expired instead of visible.
Toast exposure timeout: page-visible from hidden-paused · case 02
The page-visible event leaves a notification in expired instead of visible.
Toast exposure timeout: page-visible from hidden-paused · case 03
The page-visible event leaves a notification in expired instead of visible.
Toast exposure timeout: page-visible from hidden-paused · case 04
The page-visible event leaves a notification in expired instead of visible.
Toast exposure timeout: page-visible from hidden-paused · case 05
The page-visible event leaves a notification in expired instead of visible.
Toast exposure timeout: page-hidden from hover-paused · case 01
The page-hidden event leaves a notification in hidden-paused instead of both-paused.
Toast exposure timeout: page-hidden from hover-paused · case 02
The page-hidden event leaves a notification in hidden-paused instead of both-paused.
Toast exposure timeout: page-hidden from hover-paused · case 03
The page-hidden event leaves a notification in hidden-paused instead of both-paused.
Toast exposure timeout: page-hidden from hover-paused · case 04
The page-hidden event leaves a notification in hidden-paused instead of both-paused.
Toast exposure timeout: page-hidden from hover-paused · case 05
The page-hidden event leaves a notification in hidden-paused instead of both-paused.
Toast exposure timeout: page-visible from both-paused · case 01
The page-visible event leaves a notification in visible instead of hover-paused.
Toast exposure timeout: page-visible from both-paused · case 02
The page-visible event leaves a notification in visible instead of hover-paused.
Toast exposure timeout: page-visible from both-paused · case 03
The page-visible event leaves a notification in visible instead of hover-paused.
Toast exposure timeout: page-visible from both-paused · case 04
The page-visible event leaves a notification in visible instead of hover-paused.
Toast exposure timeout: page-visible from both-paused · case 05
The page-visible event leaves a notification in visible instead of hover-paused.
Toast exposure timeout: pointer-leave from both-paused · case 01
The pointer-leave event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: pointer-leave from both-paused · case 02
The pointer-leave event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: pointer-leave from both-paused · case 03
The pointer-leave event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: pointer-leave from both-paused · case 04
The pointer-leave event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: pointer-leave from both-paused · case 05
The pointer-leave event leaves a notification in visible instead of hidden-paused.
Toast exposure timeout: budget-consumed from visible · case 01
The budget-consumed event leaves a notification in visible instead of expired.
Toast exposure timeout: budget-consumed from visible · case 02
The budget-consumed event leaves a notification in visible instead of expired.
Toast exposure timeout: budget-consumed from visible · case 03
The budget-consumed event leaves a notification in visible instead of expired.
Toast exposure timeout: budget-consumed from visible · case 04
The budget-consumed event leaves a notification in visible instead of expired.
Toast exposure timeout: budget-consumed from visible · case 05
The budget-consumed event leaves a notification in visible instead of expired.
Toast exposure timeout: late-pointer-enter from expired · case 01
The late-pointer-enter event leaves a notification in hover-paused instead of expired.
Toast exposure timeout: late-pointer-enter from expired · case 02
The late-pointer-enter event leaves a notification in hover-paused instead of expired.
Toast exposure timeout: late-pointer-enter from expired · case 03
The late-pointer-enter event leaves a notification in hover-paused instead of expired.
Toast exposure timeout: late-pointer-enter from expired · case 04
The late-pointer-enter event leaves a notification in hover-paused instead of expired.
Toast exposure timeout: late-pointer-enter from expired · case 05
The late-pointer-enter event leaves a notification in hover-paused instead of expired.
Toast exposure timeout: budget-callback from hidden-paused · case 01
The budget-callback event leaves a notification in expired instead of hidden-paused.
Toast exposure timeout: budget-callback from hidden-paused · case 02
The budget-callback event leaves a notification in expired instead of hidden-paused.
Toast exposure timeout: budget-callback from hidden-paused · case 03
The budget-callback event leaves a notification in expired instead of hidden-paused.
Toast exposure timeout: budget-callback from hidden-paused · case 04
The budget-callback event leaves a notification in expired instead of hidden-paused.
Toast exposure timeout: budget-callback from hidden-paused · case 05
The budget-callback event leaves a notification in expired instead of hidden-paused.
Notification undo affordance: undo-click from offered · case 01
The undo-click event leaves a notification in committed instead of undo-pending.
Notification undo affordance: undo-click from offered · case 02
The undo-click event leaves a notification in committed instead of undo-pending.
Notification undo affordance: undo-click from offered · case 03
The undo-click event leaves a notification in committed instead of undo-pending.
Notification undo affordance: undo-click from offered · case 04
The undo-click event leaves a notification in committed instead of undo-pending.
Notification undo affordance: undo-click from offered · case 05
The undo-click event leaves a notification in committed instead of undo-pending.
Notification undo affordance: undo-success from undo-pending · case 01
The undo-success event leaves a notification in committed instead of restored.
Notification undo affordance: undo-success from undo-pending · case 02
The undo-success event leaves a notification in committed instead of restored.
Notification undo affordance: undo-success from undo-pending · case 03
The undo-success event leaves a notification in committed instead of restored.
Notification undo affordance: undo-success from undo-pending · case 04
The undo-success event leaves a notification in committed instead of restored.
Notification undo affordance: undo-success from undo-pending · case 05
The undo-success event leaves a notification in committed instead of restored.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗