FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-33401

Menu patch silently appends content after its anchor disappeared · case 01

Menu patch silently appends content after its anchor disappeared.

Menu interactions● Open access↗
FA-33402

Menu patch silently appends content after its anchor disappeared · case 02

Menu patch silently appends content after its anchor disappeared.

Menu interactions◈ Members↗
FA-33403

Menu patch silently appends content after its anchor disappeared · case 03

Menu patch silently appends content after its anchor disappeared.

Menu interactions◈ Members↗
FA-33404

Menu patch silently appends content after its anchor disappeared · case 04

Menu patch silently appends content after its anchor disappeared.

Menu interactions◈ Members↗
FA-33405

Menu patch silently appends content after its anchor disappeared · case 05

Menu patch silently appends content after its anchor disappeared.

Menu interactions◈ Members↗
FA-33406

Failed provider menu patch leaks partial row mutations · case 01

Failed provider menu patch leaks partial row mutations.

Menu interactions● Open access↗
FA-33407

Failed provider menu patch leaks partial row mutations · case 02

Failed provider menu patch leaks partial row mutations.

Menu interactions◈ Members↗
FA-33408

Failed provider menu patch leaks partial row mutations · case 03

Failed provider menu patch leaks partial row mutations.

Menu interactions◈ Members↗
FA-33409

Failed provider menu patch leaks partial row mutations · case 04

Failed provider menu patch leaks partial row mutations.

Menu interactions◈ Members↗
FA-33410

Failed provider menu patch leaks partial row mutations · case 05

Failed provider menu patch leaks partial row mutations.

Menu interactions◈ Members↗
FA-33411

Changing submenu row kind retains obsolete command fields · case 01

Changing submenu row kind retains obsolete command fields.

Menu interactions● Open access↗
FA-33412

Changing submenu row kind retains obsolete command fields · case 02

Changing submenu row kind retains obsolete command fields.

Menu interactions◈ Members↗
FA-33413

Changing submenu row kind retains obsolete command fields · case 03

Changing submenu row kind retains obsolete command fields.

Menu interactions◈ Members↗
FA-33414

Changing submenu row kind retains obsolete command fields · case 04

Changing submenu row kind retains obsolete command fields.

Menu interactions◈ Members↗
FA-33415

Changing submenu row kind retains obsolete command fields · case 05

Changing submenu row kind retains obsolete command fields.

Menu interactions◈ Members↗
FA-33416

Menu patch revision advances once per operation instead of commit · case 01

Menu patch revision advances once per operation instead of commit.

Menu interactions● Open access↗
FA-33417

Menu patch revision advances once per operation instead of commit · case 02

Menu patch revision advances once per operation instead of commit.

Menu interactions◈ Members↗
FA-33418

Menu patch revision advances once per operation instead of commit · case 03

Menu patch revision advances once per operation instead of commit.

Menu interactions◈ Members↗
FA-33419

Menu patch revision advances once per operation instead of commit · case 04

Menu patch revision advances once per operation instead of commit.

Menu interactions◈ Members↗
FA-33420

Menu patch revision advances once per operation instead of commit · case 05

Menu patch revision advances once per operation instead of commit.

Menu interactions◈ Members↗
FA-33421

Before-anchor contribution is placed after its menu anchor · case 01

Before-anchor contribution is placed after its menu anchor.

Menu interactions● Open access↗
FA-33422

Before-anchor contribution is placed after its menu anchor · case 02

Before-anchor contribution is placed after its menu anchor.

Menu interactions◈ Members↗
FA-33423

Before-anchor contribution is placed after its menu anchor · case 03

Before-anchor contribution is placed after its menu anchor.

Menu interactions◈ Members↗
FA-33424

Before-anchor contribution is placed after its menu anchor · case 04

Before-anchor contribution is placed after its menu anchor.

Menu interactions◈ Members↗
FA-33425

Before-anchor contribution is placed after its menu anchor · case 05

Before-anchor contribution is placed after its menu anchor.

Menu interactions◈ Members↗
FA-33426

Unresolved menu contribution anchor ignores the default slot · case 01

Unresolved menu contribution anchor ignores the default slot.

Menu interactions● Open access↗
FA-33427

Unresolved menu contribution anchor ignores the default slot · case 02

Unresolved menu contribution anchor ignores the default slot.

Menu interactions◈ Members↗
FA-33428

Unresolved menu contribution anchor ignores the default slot · case 03

Unresolved menu contribution anchor ignores the default slot.

Menu interactions◈ Members↗
FA-33429

Unresolved menu contribution anchor ignores the default slot · case 04

Unresolved menu contribution anchor ignores the default slot.

Menu interactions◈ Members↗
FA-33430

Unresolved menu contribution anchor ignores the default slot · case 05

Unresolved menu contribution anchor ignores the default slot.

Menu interactions◈ Members↗
FA-33431

Menu contribution anchor loses provider namespace identity · case 01

Menu contribution anchor loses provider namespace identity.

Menu interactions● Open access↗
FA-33432

Menu contribution anchor loses provider namespace identity · case 02

Menu contribution anchor loses provider namespace identity.

Menu interactions◈ Members↗
FA-33433

Menu contribution anchor loses provider namespace identity · case 03

Menu contribution anchor loses provider namespace identity.

Menu interactions◈ Members↗
FA-33434

Menu contribution anchor loses provider namespace identity · case 04

Menu contribution anchor loses provider namespace identity.

Menu interactions◈ Members↗
FA-33435

Menu contribution anchor loses provider namespace identity · case 05

Menu contribution anchor loses provider namespace identity.

Menu interactions◈ Members↗
FA-33436

Conflicting menu placement hints ignore before-anchor precedence · case 01

Conflicting menu placement hints ignore before-anchor precedence.

Menu interactions● Open access↗
FA-33437

Conflicting menu placement hints ignore before-anchor precedence · case 02

Conflicting menu placement hints ignore before-anchor precedence.

Menu interactions◈ Members↗
FA-33438

Conflicting menu placement hints ignore before-anchor precedence · case 03

Conflicting menu placement hints ignore before-anchor precedence.

Menu interactions◈ Members↗
FA-33439

Conflicting menu placement hints ignore before-anchor precedence · case 04

Conflicting menu placement hints ignore before-anchor precedence.

Menu interactions◈ Members↗
FA-33440

Conflicting menu placement hints ignore before-anchor precedence · case 05

Conflicting menu placement hints ignore before-anchor precedence.

Menu interactions◈ Members↗
FA-33441

Sequential anchor insertion reverses contributed menu rows · case 01

Sequential anchor insertion reverses contributed menu rows.

Menu interactions● Open access↗
FA-33442

Sequential anchor insertion reverses contributed menu rows · case 02

Sequential anchor insertion reverses contributed menu rows.

Menu interactions◈ Members↗
FA-33443

Sequential anchor insertion reverses contributed menu rows · case 03

Sequential anchor insertion reverses contributed menu rows.

Menu interactions◈ Members↗
FA-33444

Sequential anchor insertion reverses contributed menu rows · case 04

Sequential anchor insertion reverses contributed menu rows.

Menu interactions◈ Members↗
FA-33445

Sequential anchor insertion reverses contributed menu rows · case 05

Sequential anchor insertion reverses contributed menu rows.

Menu interactions◈ Members↗
FA-33446

Menu contribution accepts itself as its placement anchor · case 01

Menu contribution accepts itself as its placement anchor.

Menu interactions● Open access↗
FA-33447

Menu contribution accepts itself as its placement anchor · case 02

Menu contribution accepts itself as its placement anchor.

Menu interactions◈ Members↗
FA-33448

Menu contribution accepts itself as its placement anchor · case 03

Menu contribution accepts itself as its placement anchor.

Menu interactions◈ Members↗
FA-33449

Menu contribution accepts itself as its placement anchor · case 04

Menu contribution accepts itself as its placement anchor.

Menu interactions◈ Members↗
FA-33450

Menu contribution accepts itself as its placement anchor · case 05

Menu contribution accepts itself as its placement anchor.

Menu interactions◈ Members↗
FA-33451

No-op menu open transition emits duplicate opened events · case 01

No-op menu open transition emits duplicate opened events.

Menu interactions● Open access↗
FA-33452

No-op menu open transition emits duplicate opened events · case 02

No-op menu open transition emits duplicate opened events.

Menu interactions◈ Members↗
FA-33453

No-op menu open transition emits duplicate opened events · case 03

No-op menu open transition emits duplicate opened events.

Menu interactions◈ Members↗
FA-33454

No-op menu open transition emits duplicate opened events · case 04

No-op menu open transition emits duplicate opened events.

Menu interactions◈ Members↗
FA-33455

No-op menu open transition emits duplicate opened events · case 05

No-op menu open transition emits duplicate opened events.

Menu interactions◈ Members↗
FA-33456

Menu close notification replaces a command close reason with dismissal · case 01

Menu close notification replaces a command close reason with dismissal.

Menu interactions● Open access↗
FA-33457

Menu close notification replaces a command close reason with dismissal · case 02

Menu close notification replaces a command close reason with dismissal.

Menu interactions◈ Members↗
FA-33458

Menu close notification replaces a command close reason with dismissal · case 03

Menu close notification replaces a command close reason with dismissal.

Menu interactions◈ Members↗
FA-33459

Menu close notification replaces a command close reason with dismissal · case 04

Menu close notification replaces a command close reason with dismissal.

Menu interactions◈ Members↗
FA-33460

Menu close notification replaces a command close reason with dismissal · case 05

Menu close notification replaces a command close reason with dismissal.

Menu interactions◈ Members↗
FA-33461

Parent menu close notification precedes its owned descendants · case 01

Parent menu close notification precedes its owned descendants.

Menu interactions● Open access↗
FA-33462

Parent menu close notification precedes its owned descendants · case 02

Parent menu close notification precedes its owned descendants.

Menu interactions◈ Members↗
FA-33463

Parent menu close notification precedes its owned descendants · case 03

Parent menu close notification precedes its owned descendants.

Menu interactions◈ Members↗
FA-33464

Parent menu close notification precedes its owned descendants · case 04

Parent menu close notification precedes its owned descendants.

Menu interactions◈ Members↗
FA-33465

Parent menu close notification precedes its owned descendants · case 05

Parent menu close notification precedes its owned descendants.

Menu interactions◈ Members↗
FA-33466

Vetoed menu opening emits an opened or closed notification · case 01

Vetoed menu opening emits an opened or closed notification.

Menu interactions● Open access↗
FA-33467

Vetoed menu opening emits an opened or closed notification · case 02

Vetoed menu opening emits an opened or closed notification.

Menu interactions◈ Members↗
FA-33468

Vetoed menu opening emits an opened or closed notification · case 03

Vetoed menu opening emits an opened or closed notification.

Menu interactions◈ Members↗
FA-33469

Vetoed menu opening emits an opened or closed notification · case 04

Vetoed menu opening emits an opened or closed notification.

Menu interactions◈ Members↗
FA-33470

Vetoed menu opening emits an opened or closed notification · case 05

Vetoed menu opening emits an opened or closed notification.

Menu interactions◈ Members↗
FA-33471

Menu lifecycle event attributes a child transition to the root owner · case 01

Menu lifecycle event attributes a child transition to the root owner.

Menu interactions● Open access↗
FA-33472

Menu lifecycle event attributes a child transition to the root owner · case 02

Menu lifecycle event attributes a child transition to the root owner.

Menu interactions◈ Members↗
FA-33473

Menu lifecycle event attributes a child transition to the root owner · case 03

Menu lifecycle event attributes a child transition to the root owner.

Menu interactions◈ Members↗
FA-33474

Menu lifecycle event attributes a child transition to the root owner · case 04

Menu lifecycle event attributes a child transition to the root owner.

Menu interactions◈ Members↗
FA-33475

Menu lifecycle event attributes a child transition to the root owner · case 05

Menu lifecycle event attributes a child transition to the root owner.

Menu interactions◈ Members↗
FA-33476

Owner removal reuses the previous menu close reason · case 01

Owner removal reuses the previous menu close reason.

Menu interactions● Open access↗
FA-33477

Owner removal reuses the previous menu close reason · case 02

Owner removal reuses the previous menu close reason.

Menu interactions◈ Members↗
FA-33478

Owner removal reuses the previous menu close reason · case 03

Owner removal reuses the previous menu close reason.

Menu interactions◈ Members↗
FA-33479

Owner removal reuses the previous menu close reason · case 04

Owner removal reuses the previous menu close reason.

Menu interactions◈ Members↗
FA-33480

Owner removal reuses the previous menu close reason · case 05

Owner removal reuses the previous menu close reason.

Menu interactions◈ Members↗
FA-33481

Branch-scoped menu command closes the entire menu session · case 01

Branch-scoped menu command closes the entire menu session.

Menu interactions● Open access↗
FA-33482

Branch-scoped menu command closes the entire menu session · case 02

Branch-scoped menu command closes the entire menu session.

Menu interactions◈ Members↗
FA-33483

Branch-scoped menu command closes the entire menu session · case 03

Branch-scoped menu command closes the entire menu session.

Menu interactions◈ Members↗
FA-33484

Branch-scoped menu command closes the entire menu session · case 04

Branch-scoped menu command closes the entire menu session.

Menu interactions◈ Members↗
FA-33485

Branch-scoped menu command closes the entire menu session · case 05

Branch-scoped menu command closes the entire menu session.

Menu interactions◈ Members↗
FA-33486

Vetoed menu dismissal still removes the popup · case 01

Vetoed menu dismissal still removes the popup.

Menu interactions● Open access↗
FA-33487

Vetoed menu dismissal still removes the popup · case 02

Vetoed menu dismissal still removes the popup.

Menu interactions◈ Members↗
FA-33488

Vetoed menu dismissal still removes the popup · case 03

Vetoed menu dismissal still removes the popup.

Menu interactions◈ Members↗
FA-33489

Vetoed menu dismissal still removes the popup · case 04

Vetoed menu dismissal still removes the popup.

Menu interactions◈ Members↗
FA-33490

Vetoed menu dismissal still removes the popup · case 05

Vetoed menu dismissal still removes the popup.

Menu interactions◈ Members↗
FA-33491

Dismissal veto leaves a menu attached to a removed owner · case 01

Dismissal veto leaves a menu attached to a removed owner.

Menu interactions● Open access↗
FA-33492

Dismissal veto leaves a menu attached to a removed owner · case 02

Dismissal veto leaves a menu attached to a removed owner.

Menu interactions◈ Members↗
FA-33493

Dismissal veto leaves a menu attached to a removed owner · case 03

Dismissal veto leaves a menu attached to a removed owner.

Menu interactions◈ Members↗
FA-33494

Dismissal veto leaves a menu attached to a removed owner · case 04

Dismissal veto leaves a menu attached to a removed owner.

Menu interactions◈ Members↗
FA-33495

Dismissal veto leaves a menu attached to a removed owner · case 05

Dismissal veto leaves a menu attached to a removed owner.

Menu interactions◈ Members↗
FA-33496

Simultaneous menu dismissal reasons use arrival order instead of policy · case 01

Simultaneous menu dismissal reasons use arrival order instead of policy.

Menu interactions● Open access↗
FA-33497

Simultaneous menu dismissal reasons use arrival order instead of policy · case 02

Simultaneous menu dismissal reasons use arrival order instead of policy.

Menu interactions◈ Members↗
FA-33498

Simultaneous menu dismissal reasons use arrival order instead of policy · case 03

Simultaneous menu dismissal reasons use arrival order instead of policy.

Menu interactions◈ Members↗
FA-33499

Simultaneous menu dismissal reasons use arrival order instead of policy · case 04

Simultaneous menu dismissal reasons use arrival order instead of policy.

Menu interactions◈ Members↗
FA-33500

Simultaneous menu dismissal reasons use arrival order instead of policy · case 05

Simultaneous menu dismissal reasons use arrival order instead of policy.

Menu interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗