Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Menu group heading is attached after its commands · case 01
Menu group heading is attached after its commands.
Menu group heading is attached after its commands · case 02
Menu group heading is attached after its commands.
Menu group heading is attached after its commands · case 03
Menu group heading is attached after its commands.
Menu group heading is attached after its commands · case 04
Menu group heading is attached after its commands.
Menu group heading is attached after its commands · case 05
Menu group heading is attached after its commands.
Pinned menu sections stay below dynamic content · case 01
Pinned menu sections stay below dynamic content.
Pinned menu sections stay below dynamic content · case 02
Pinned menu sections stay below dynamic content.
Pinned menu sections stay below dynamic content · case 03
Pinned menu sections stay below dynamic content.
Pinned menu sections stay below dynamic content · case 04
Pinned menu sections stay below dynamic content.
Pinned menu sections stay below dynamic content · case 05
Pinned menu sections stay below dynamic content.
Provider-local menu section identifiers lose namespace ownership · case 01
Provider-local menu section identifiers lose namespace ownership.
Provider-local menu section identifiers lose namespace ownership · case 02
Provider-local menu section identifiers lose namespace ownership.
Provider-local menu section identifiers lose namespace ownership · case 03
Provider-local menu section identifiers lose namespace ownership.
Provider-local menu section identifiers lose namespace ownership · case 04
Provider-local menu section identifiers lose namespace ownership.
Provider-local menu section identifiers lose namespace ownership · case 05
Provider-local menu section identifiers lose namespace ownership.
Menu capacity counts group headers as commands · case 01
Menu capacity counts group headers as commands.
Menu capacity counts group headers as commands · case 02
Menu capacity counts group headers as commands.
Menu capacity counts group headers as commands · case 03
Menu capacity counts group headers as commands.
Menu capacity counts group headers as commands · case 04
Menu capacity counts group headers as commands.
Menu capacity counts group headers as commands · case 05
Menu capacity counts group headers as commands.
Menu extension command IDs collide across providers · case 01
Menu extension command IDs collide across providers.
Menu extension command IDs collide across providers · case 02
Menu extension command IDs collide across providers.
Menu extension command IDs collide across providers · case 03
Menu extension command IDs collide across providers.
Menu extension command IDs collide across providers · case 04
Menu extension command IDs collide across providers.
Menu extension command IDs collide across providers · case 05
Menu extension command IDs collide across providers.
Contribution priority is ordered by label instead of rank · case 01
Contribution priority is ordered by label instead of rank.
Contribution priority is ordered by label instead of rank · case 02
Contribution priority is ordered by label instead of rank.
Contribution priority is ordered by label instead of rank · case 03
Contribution priority is ordered by label instead of rank.
Contribution priority is ordered by label instead of rank · case 04
Contribution priority is ordered by label instead of rank.
Contribution priority is ordered by label instead of rank · case 05
Contribution priority is ordered by label instead of rank.
Unloading an extension removes unrelated menu commands · case 01
Unloading an extension removes unrelated menu commands.
Unloading an extension removes unrelated menu commands · case 02
Unloading an extension removes unrelated menu commands.
Unloading an extension removes unrelated menu commands · case 03
Unloading an extension removes unrelated menu commands.
Unloading an extension removes unrelated menu commands · case 04
Unloading an extension removes unrelated menu commands.
Unloading an extension removes unrelated menu commands · case 05
Unloading an extension removes unrelated menu commands.
Replacing one extension command overwrites a peer command · case 01
Replacing one extension command overwrites a peer command.
Replacing one extension command overwrites a peer command · case 02
Replacing one extension command overwrites a peer command.
Replacing one extension command overwrites a peer command · case 03
Replacing one extension command overwrites a peer command.
Replacing one extension command overwrites a peer command · case 04
Replacing one extension command overwrites a peer command.
Replacing one extension command overwrites a peer command · case 05
Replacing one extension command overwrites a peer command.
Disabled extension keeps contributing menu content · case 01
Disabled extension keeps contributing menu content.
Disabled extension keeps contributing menu content · case 02
Disabled extension keeps contributing menu content.
Disabled extension keeps contributing menu content · case 03
Disabled extension keeps contributing menu content.
Disabled extension keeps contributing menu content · case 04
Disabled extension keeps contributing menu content.
Disabled extension keeps contributing menu content · case 05
Disabled extension keeps contributing menu content.
Contribution revision is borrowed from another provider · case 01
Contribution revision is borrowed from another provider.
Contribution revision is borrowed from another provider · case 02
Contribution revision is borrowed from another provider.
Contribution revision is borrowed from another provider · case 03
Contribution revision is borrowed from another provider.
Contribution revision is borrowed from another provider · case 04
Contribution revision is borrowed from another provider.
Contribution revision is borrowed from another provider · case 05
Contribution revision is borrowed from another provider.
A valid zero-valued parent is interpreted as a menu root · case 01
A valid zero-valued parent is interpreted as a menu root.
A valid zero-valued parent is interpreted as a menu root · case 02
A valid zero-valued parent is interpreted as a menu root.
A valid zero-valued parent is interpreted as a menu root · case 03
A valid zero-valued parent is interpreted as a menu root.
A valid zero-valued parent is interpreted as a menu root · case 04
A valid zero-valued parent is interpreted as a menu root.
A valid zero-valued parent is interpreted as a menu root · case 05
A valid zero-valued parent is interpreted as a menu root.
Submenu child enumeration leaks sibling commands · case 01
Submenu child enumeration leaks sibling commands.
Submenu child enumeration leaks sibling commands · case 02
Submenu child enumeration leaks sibling commands.
Submenu child enumeration leaks sibling commands · case 03
Submenu child enumeration leaks sibling commands.
Submenu child enumeration leaks sibling commands · case 04
Submenu child enumeration leaks sibling commands.
Submenu child enumeration leaks sibling commands · case 05
Submenu child enumeration leaks sibling commands.
Split menu owner accepts a default command outside its direct child commands · case 01
Split menu owner accepts a default command outside its direct child commands.
Split menu owner accepts a default command outside its direct child commands · case 02
Split menu owner accepts a default command outside its direct child commands.
Split menu owner accepts a default command outside its direct child commands · case 03
Split menu owner accepts a default command outside its direct child commands.
Split menu owner accepts a default command outside its direct child commands · case 04
Split menu owner accepts a default command outside its direct child commands.
Split menu owner accepts a default command outside its direct child commands · case 05
Split menu owner accepts a default command outside its direct child commands.
A self-owning submenu bypasses cycle validation · case 01
A self-owning submenu bypasses cycle validation.
A self-owning submenu bypasses cycle validation · case 02
A self-owning submenu bypasses cycle validation.
A self-owning submenu bypasses cycle validation · case 03
A self-owning submenu bypasses cycle validation.
A self-owning submenu bypasses cycle validation · case 04
A self-owning submenu bypasses cycle validation.
A self-owning submenu bypasses cycle validation · case 05
A self-owning submenu bypasses cycle validation.
Menu validator rejects separate presentation rows for the same command · case 01
Menu validator rejects separate presentation rows for the same command.
Menu validator rejects separate presentation rows for the same command · case 02
Menu validator rejects separate presentation rows for the same command.
Menu validator rejects separate presentation rows for the same command · case 03
Menu validator rejects separate presentation rows for the same command.
Menu validator rejects separate presentation rows for the same command · case 04
Menu validator rejects separate presentation rows for the same command.
Menu validator rejects separate presentation rows for the same command · case 05
Menu validator rejects separate presentation rows for the same command.
Nested provider menu exceeds the remaining cascade depth budget · case 01
Nested provider menu exceeds the remaining cascade depth budget.
Nested provider menu exceeds the remaining cascade depth budget · case 02
Nested provider menu exceeds the remaining cascade depth budget.
Nested provider menu exceeds the remaining cascade depth budget · case 03
Nested provider menu exceeds the remaining cascade depth budget.
Nested provider menu exceeds the remaining cascade depth budget · case 04
Nested provider menu exceeds the remaining cascade depth budget.
Nested provider menu exceeds the remaining cascade depth budget · case 05
Nested provider menu exceeds the remaining cascade depth budget.
Root menu handler masks a nearer command handler · case 01
Root menu handler masks a nearer command handler.
Root menu handler masks a nearer command handler · case 02
Root menu handler masks a nearer command handler.
Root menu handler masks a nearer command handler · case 03
Root menu handler masks a nearer command handler.
Root menu handler masks a nearer command handler · case 04
Root menu handler masks a nearer command handler.
Root menu handler masks a nearer command handler · case 05
Root menu handler masks a nearer command handler.
Unsupported menu command is dispatched to an arbitrary owner · case 01
Unsupported menu command is dispatched to an arbitrary owner.
Unsupported menu command is dispatched to an arbitrary owner · case 02
Unsupported menu command is dispatched to an arbitrary owner.
Unsupported menu command is dispatched to an arbitrary owner · case 03
Unsupported menu command is dispatched to an arbitrary owner.
Unsupported menu command is dispatched to an arbitrary owner · case 04
Unsupported menu command is dispatched to an arbitrary owner.
Unsupported menu command is dispatched to an arbitrary owner · case 05
Unsupported menu command is dispatched to an arbitrary owner.
Command origin is rewritten while bubbling through menu owners · case 01
Command origin is rewritten while bubbling through menu owners.
Command origin is rewritten while bubbling through menu owners · case 02
Command origin is rewritten while bubbling through menu owners.
Command origin is rewritten while bubbling through menu owners · case 03
Command origin is rewritten while bubbling through menu owners.
Command origin is rewritten while bubbling through menu owners · case 04
Command origin is rewritten while bubbling through menu owners.
Command origin is rewritten while bubbling through menu owners · case 05
Command origin is rewritten while bubbling through menu owners.
Menu invocation arguments lose precedence to command defaults · case 01
Menu invocation arguments lose precedence to command defaults.
Menu invocation arguments lose precedence to command defaults · case 02
Menu invocation arguments lose precedence to command defaults.
Menu invocation arguments lose precedence to command defaults · case 03
Menu invocation arguments lose precedence to command defaults.
Menu invocation arguments lose precedence to command defaults · case 04
Menu invocation arguments lose precedence to command defaults.
Menu invocation arguments lose precedence to command defaults · case 05
Menu invocation arguments lose precedence to command defaults.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗