FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-32601

Cancelled menu command continues through ancestor handlers · case 01

Cancelled menu command continues through ancestor handlers.

Menu interactions● Open access↗
FA-32602

Cancelled menu command continues through ancestor handlers · case 02

Cancelled menu command continues through ancestor handlers.

Menu interactions◈ Members↗
FA-32603

Cancelled menu command continues through ancestor handlers · case 03

Cancelled menu command continues through ancestor handlers.

Menu interactions◈ Members↗
FA-32604

Cancelled menu command continues through ancestor handlers · case 04

Cancelled menu command continues through ancestor handlers.

Menu interactions◈ Members↗
FA-32605

Cancelled menu command continues through ancestor handlers · case 05

Cancelled menu command continues through ancestor handlers.

Menu interactions◈ Members↗
FA-32606

Menu command result conflates execution owner and invocation origin · case 01

Menu command result conflates execution owner and invocation origin.

Menu interactions● Open access↗
FA-32607

Menu command result conflates execution owner and invocation origin · case 02

Menu command result conflates execution owner and invocation origin.

Menu interactions◈ Members↗
FA-32608

Menu command result conflates execution owner and invocation origin · case 03

Menu command result conflates execution owner and invocation origin.

Menu interactions◈ Members↗
FA-32609

Menu command result conflates execution owner and invocation origin · case 04

Menu command result conflates execution owner and invocation origin.

Menu interactions◈ Members↗
FA-32610

Menu command result conflates execution owner and invocation origin · case 05

Menu command result conflates execution owner and invocation origin.

Menu interactions◈ Members↗
FA-32611

Menu command preparation ignores authorization · case 01

Menu command preparation ignores authorization.

Menu interactions● Open access↗
FA-32612

Menu command preparation ignores authorization · case 02

Menu command preparation ignores authorization.

Menu interactions◈ Members↗
FA-32613

Menu command preparation ignores authorization · case 03

Menu command preparation ignores authorization.

Menu interactions◈ Members↗
FA-32614

Menu command preparation ignores authorization · case 04

Menu command preparation ignores authorization.

Menu interactions◈ Members↗
FA-32615

Menu command preparation ignores authorization · case 05

Menu command preparation ignores authorization.

Menu interactions◈ Members↗
FA-32616

A prepared menu transaction launches twice while pending · case 01

A prepared menu transaction launches twice while pending.

Menu interactions● Open access↗
FA-32617

A prepared menu transaction launches twice while pending · case 02

A prepared menu transaction launches twice while pending.

Menu interactions◈ Members↗
FA-32618

A prepared menu transaction launches twice while pending · case 03

A prepared menu transaction launches twice while pending.

Menu interactions◈ Members↗
FA-32619

A prepared menu transaction launches twice while pending · case 04

A prepared menu transaction launches twice while pending.

Menu interactions◈ Members↗
FA-32620

A prepared menu transaction launches twice while pending · case 05

A prepared menu transaction launches twice while pending.

Menu interactions◈ Members↗
FA-32621

Failed menu command closes a success-only popup · case 01

Failed menu command closes a success-only popup.

Menu interactions● Open access↗
FA-32622

Failed menu command closes a success-only popup · case 02

Failed menu command closes a success-only popup.

Menu interactions◈ Members↗
FA-32623

Failed menu command closes a success-only popup · case 03

Failed menu command closes a success-only popup.

Menu interactions◈ Members↗
FA-32624

Failed menu command closes a success-only popup · case 04

Failed menu command closes a success-only popup.

Menu interactions◈ Members↗
FA-32625

Failed menu command closes a success-only popup · case 05

Failed menu command closes a success-only popup.

Menu interactions◈ Members↗
FA-32626

Recoverable menu command failure loses retry state · case 01

Recoverable menu command failure loses retry state.

Menu interactions● Open access↗
FA-32627

Recoverable menu command failure loses retry state · case 02

Recoverable menu command failure loses retry state.

Menu interactions◈ Members↗
FA-32628

Recoverable menu command failure loses retry state · case 03

Recoverable menu command failure loses retry state.

Menu interactions◈ Members↗
FA-32629

Recoverable menu command failure loses retry state · case 04

Recoverable menu command failure loses retry state.

Menu interactions◈ Members↗
FA-32630

Recoverable menu command failure loses retry state · case 05

Recoverable menu command failure loses retry state.

Menu interactions◈ Members↗
FA-32631

Menu command retry forgets its captured context · case 01

Menu command retry forgets its captured context.

Menu interactions● Open access↗
FA-32632

Menu command retry forgets its captured context · case 02

Menu command retry forgets its captured context.

Menu interactions◈ Members↗
FA-32633

Menu command retry forgets its captured context · case 03

Menu command retry forgets its captured context.

Menu interactions◈ Members↗
FA-32634

Menu command retry forgets its captured context · case 04

Menu command retry forgets its captured context.

Menu interactions◈ Members↗
FA-32635

Menu command retry forgets its captured context · case 05

Menu command retry forgets its captured context.

Menu interactions◈ Members↗
FA-32636

Old menu command completion clears a newer pending action · case 01

Old menu command completion clears a newer pending action.

Menu interactions● Open access↗
FA-32637

Old menu command completion clears a newer pending action · case 02

Old menu command completion clears a newer pending action.

Menu interactions◈ Members↗
FA-32638

Old menu command completion clears a newer pending action · case 03

Old menu command completion clears a newer pending action.

Menu interactions◈ Members↗
FA-32639

Old menu command completion clears a newer pending action · case 04

Old menu command completion clears a newer pending action.

Menu interactions◈ Members↗
FA-32640

Old menu command completion clears a newer pending action · case 05

Old menu command completion clears a newer pending action.

Menu interactions◈ Members↗
FA-32641

Secondary drag termination unexpectedly opens a context menu · case 01

Secondary drag termination unexpectedly opens a context menu.

Menu interactions● Open access↗
FA-32642

Secondary drag termination unexpectedly opens a context menu · case 02

Secondary drag termination unexpectedly opens a context menu.

Menu interactions◈ Members↗
FA-32643

Secondary drag termination unexpectedly opens a context menu · case 03

Secondary drag termination unexpectedly opens a context menu.

Menu interactions◈ Members↗
FA-32644

Secondary drag termination unexpectedly opens a context menu · case 04

Secondary drag termination unexpectedly opens a context menu.

Menu interactions◈ Members↗
FA-32645

Secondary drag termination unexpectedly opens a context menu · case 05

Secondary drag termination unexpectedly opens a context menu.

Menu interactions◈ Members↗
FA-32646

Pen barrel context trigger rejects combined button state · case 01

Pen barrel context trigger rejects combined button state.

Menu interactions● Open access↗
FA-32647

Pen barrel context trigger rejects combined button state · case 02

Pen barrel context trigger rejects combined button state.

Menu interactions◈ Members↗
FA-32648

Pen barrel context trigger rejects combined button state · case 03

Pen barrel context trigger rejects combined button state.

Menu interactions◈ Members↗
FA-32649

Pen barrel context trigger rejects combined button state · case 04

Pen barrel context trigger rejects combined button state.

Menu interactions◈ Members↗
FA-32650

Pen barrel context trigger rejects combined button state · case 05

Pen barrel context trigger rejects combined button state.

Menu interactions◈ Members↗
FA-32651

Moved long press is still interpreted as a menu invocation · case 01

Moved long press is still interpreted as a menu invocation.

Menu interactions● Open access↗
FA-32652

Moved long press is still interpreted as a menu invocation · case 02

Moved long press is still interpreted as a menu invocation.

Menu interactions◈ Members↗
FA-32653

Moved long press is still interpreted as a menu invocation · case 03

Moved long press is still interpreted as a menu invocation.

Menu interactions◈ Members↗
FA-32654

Moved long press is still interpreted as a menu invocation · case 04

Moved long press is still interpreted as a menu invocation.

Menu interactions◈ Members↗
FA-32655

Moved long press is still interpreted as a menu invocation · case 05

Moved long press is still interpreted as a menu invocation.

Menu interactions◈ Members↗
FA-32656

Cancelled context hold fires when the pointer is released · case 01

Cancelled context hold fires when the pointer is released.

Menu interactions● Open access↗
FA-32657

Cancelled context hold fires when the pointer is released · case 02

Cancelled context hold fires when the pointer is released.

Menu interactions◈ Members↗
FA-32658

Cancelled context hold fires when the pointer is released · case 03

Cancelled context hold fires when the pointer is released.

Menu interactions◈ Members↗
FA-32659

Cancelled context hold fires when the pointer is released · case 04

Cancelled context hold fires when the pointer is released.

Menu interactions◈ Members↗
FA-32660

Cancelled context hold fires when the pointer is released · case 05

Cancelled context hold fires when the pointer is released.

Menu interactions◈ Members↗
FA-32661

Native and synthetic context events open duplicate popups · case 01

Native and synthetic context events open duplicate popups.

Menu interactions● Open access↗
FA-32662

Native and synthetic context events open duplicate popups · case 02

Native and synthetic context events open duplicate popups.

Menu interactions◈ Members↗
FA-32663

Native and synthetic context events open duplicate popups · case 03

Native and synthetic context events open duplicate popups.

Menu interactions◈ Members↗
FA-32664

Native and synthetic context events open duplicate popups · case 04

Native and synthetic context events open duplicate popups.

Menu interactions◈ Members↗
FA-32665

Native and synthetic context events open duplicate popups · case 05

Native and synthetic context events open duplicate popups.

Menu interactions◈ Members↗
FA-32666

Context event suppresses native fallback without a custom menu · case 01

Context event suppresses native fallback without a custom menu.

Menu interactions● Open access↗
FA-32667

Context event suppresses native fallback without a custom menu · case 02

Context event suppresses native fallback without a custom menu.

Menu interactions◈ Members↗
FA-32668

Context event suppresses native fallback without a custom menu · case 03

Context event suppresses native fallback without a custom menu.

Menu interactions◈ Members↗
FA-32669

Context event suppresses native fallback without a custom menu · case 04

Context event suppresses native fallback without a custom menu.

Menu interactions◈ Members↗
FA-32670

Context event suppresses native fallback without a custom menu · case 05

Context event suppresses native fallback without a custom menu.

Menu interactions◈ Members↗
FA-32671

Left-opening submenu intent tests movement in the wrong direction · case 01

Left-opening submenu intent tests movement in the wrong direction.

Menu interactions● Open access↗
FA-32672

Left-opening submenu intent tests movement in the wrong direction · case 02

Left-opening submenu intent tests movement in the wrong direction.

Menu interactions◈ Members↗
FA-32673

Left-opening submenu intent tests movement in the wrong direction · case 03

Left-opening submenu intent tests movement in the wrong direction.

Menu interactions◈ Members↗
FA-32674

Left-opening submenu intent tests movement in the wrong direction · case 04

Left-opening submenu intent tests movement in the wrong direction.

Menu interactions◈ Members↗
FA-32675

Left-opening submenu intent tests movement in the wrong direction · case 05

Left-opening submenu intent tests movement in the wrong direction.

Menu interactions◈ Members↗
FA-32676

Expired submenu intent keeps sibling menus blocked · case 01

Expired submenu intent keeps sibling menus blocked.

Menu interactions● Open access↗
FA-32677

Expired submenu intent keeps sibling menus blocked · case 02

Expired submenu intent keeps sibling menus blocked.

Menu interactions◈ Members↗
FA-32678

Expired submenu intent keeps sibling menus blocked · case 03

Expired submenu intent keeps sibling menus blocked.

Menu interactions◈ Members↗
FA-32679

Expired submenu intent keeps sibling menus blocked · case 04

Expired submenu intent keeps sibling menus blocked.

Menu interactions◈ Members↗
FA-32680

Expired submenu intent keeps sibling menus blocked · case 05

Expired submenu intent keeps sibling menus blocked.

Menu interactions◈ Members↗
FA-32681

Pointer intent accepts points outside the submenu vertical band · case 01

Pointer intent accepts points outside the submenu vertical band.

Menu interactions● Open access↗
FA-32682

Pointer intent accepts points outside the submenu vertical band · case 02

Pointer intent accepts points outside the submenu vertical band.

Menu interactions◈ Members↗
FA-32683

Pointer intent accepts points outside the submenu vertical band · case 03

Pointer intent accepts points outside the submenu vertical band.

Menu interactions◈ Members↗
FA-32684

Pointer intent accepts points outside the submenu vertical band · case 04

Pointer intent accepts points outside the submenu vertical band.

Menu interactions◈ Members↗
FA-32685

Pointer intent accepts points outside the submenu vertical band · case 05

Pointer intent accepts points outside the submenu vertical band.

Menu interactions◈ Members↗
FA-32686

Another pointer renews an active submenu intent corridor · case 01

Another pointer renews an active submenu intent corridor.

Menu interactions● Open access↗
FA-32687

Another pointer renews an active submenu intent corridor · case 02

Another pointer renews an active submenu intent corridor.

Menu interactions◈ Members↗
FA-32688

Another pointer renews an active submenu intent corridor · case 03

Another pointer renews an active submenu intent corridor.

Menu interactions◈ Members↗
FA-32689

Another pointer renews an active submenu intent corridor · case 04

Another pointer renews an active submenu intent corridor.

Menu interactions◈ Members↗
FA-32690

Another pointer renews an active submenu intent corridor · case 05

Another pointer renews an active submenu intent corridor.

Menu interactions◈ Members↗
FA-32691

Submenu intent deadline drifts forward on every move · case 01

Submenu intent deadline drifts forward on every move.

Menu interactions● Open access↗
FA-32692

Submenu intent deadline drifts forward on every move · case 02

Submenu intent deadline drifts forward on every move.

Menu interactions◈ Members↗
FA-32693

Submenu intent deadline drifts forward on every move · case 03

Submenu intent deadline drifts forward on every move.

Menu interactions◈ Members↗
FA-32694

Submenu intent deadline drifts forward on every move · case 04

Submenu intent deadline drifts forward on every move.

Menu interactions◈ Members↗
FA-32695

Submenu intent deadline drifts forward on every move · case 05

Submenu intent deadline drifts forward on every move.

Menu interactions◈ Members↗
FA-32696

Moving away from a submenu extends its pointer grace period · case 01

Moving away from a submenu extends its pointer grace period.

Menu interactions● Open access↗
FA-32697

Moving away from a submenu extends its pointer grace period · case 02

Moving away from a submenu extends its pointer grace period.

Menu interactions◈ Members↗
FA-32698

Moving away from a submenu extends its pointer grace period · case 03

Moving away from a submenu extends its pointer grace period.

Menu interactions◈ Members↗
FA-32699

Moving away from a submenu extends its pointer grace period · case 04

Moving away from a submenu extends its pointer grace period.

Menu interactions◈ Members↗
FA-32700

Moving away from a submenu extends its pointer grace period · case 05

Moving away from a submenu extends its pointer grace period.

Menu interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗