FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-33501

Menu ownership transfer cancels an intentionally retained command · case 01

Menu ownership transfer cancels an intentionally retained command.

Menu interactions● Open access↗
FA-33502

Menu ownership transfer cancels an intentionally retained command · case 02

Menu ownership transfer cancels an intentionally retained command.

Menu interactions◈ Members↗
FA-33503

Menu ownership transfer cancels an intentionally retained command · case 03

Menu ownership transfer cancels an intentionally retained command.

Menu interactions◈ Members↗
FA-33504

Menu ownership transfer cancels an intentionally retained command · case 04

Menu ownership transfer cancels an intentionally retained command.

Menu interactions◈ Members↗
FA-33505

Menu ownership transfer cancels an intentionally retained command · case 05

Menu ownership transfer cancels an intentionally retained command.

Menu interactions◈ Members↗
FA-33506

Scoped context menu dismissal crosses its declared root boundary · case 01

Scoped context menu dismissal crosses its declared root boundary.

Menu interactions● Open access↗
FA-33507

Scoped context menu dismissal crosses its declared root boundary · case 02

Scoped context menu dismissal crosses its declared root boundary.

Menu interactions◈ Members↗
FA-33508

Scoped context menu dismissal crosses its declared root boundary · case 03

Scoped context menu dismissal crosses its declared root boundary.

Menu interactions◈ Members↗
FA-33509

Scoped context menu dismissal crosses its declared root boundary · case 04

Scoped context menu dismissal crosses its declared root boundary.

Menu interactions◈ Members↗
FA-33510

Scoped context menu dismissal crosses its declared root boundary · case 05

Scoped context menu dismissal crosses its declared root boundary.

Menu interactions◈ Members↗
FA-33511

Batch menu advertises commands supported by only one target · case 01

Batch menu advertises commands supported by only one target.

Menu interactions● Open access↗
FA-33512

Batch menu advertises commands supported by only one target · case 02

Batch menu advertises commands supported by only one target.

Menu interactions◈ Members↗
FA-33513

Batch menu advertises commands supported by only one target · case 03

Batch menu advertises commands supported by only one target.

Menu interactions◈ Members↗
FA-33514

Batch menu advertises commands supported by only one target · case 04

Batch menu advertises commands supported by only one target.

Menu interactions◈ Members↗
FA-33515

Batch menu advertises commands supported by only one target · case 05

Batch menu advertises commands supported by only one target.

Menu interactions◈ Members↗
FA-33516

Batch menu planner reorders supported document targets · case 01

Batch menu planner reorders supported document targets.

Menu interactions● Open access↗
FA-33517

Batch menu planner reorders supported document targets · case 02

Batch menu planner reorders supported document targets.

Menu interactions◈ Members↗
FA-33518

Batch menu planner reorders supported document targets · case 03

Batch menu planner reorders supported document targets.

Menu interactions◈ Members↗
FA-33519

Batch menu planner reorders supported document targets · case 04

Batch menu planner reorders supported document targets.

Menu interactions◈ Members↗
FA-33520

Batch menu planner reorders supported document targets · case 05

Batch menu planner reorders supported document targets.

Menu interactions◈ Members↗
FA-33521

Batch menu plan conflates no-op targets with runnable targets · case 01

Batch menu plan conflates no-op targets with runnable targets.

Menu interactions● Open access↗
FA-33522

Batch menu plan conflates no-op targets with runnable targets · case 02

Batch menu plan conflates no-op targets with runnable targets.

Menu interactions◈ Members↗
FA-33523

Batch menu plan conflates no-op targets with runnable targets · case 03

Batch menu plan conflates no-op targets with runnable targets.

Menu interactions◈ Members↗
FA-33524

Batch menu plan conflates no-op targets with runnable targets · case 04

Batch menu plan conflates no-op targets with runnable targets.

Menu interactions◈ Members↗
FA-33525

Batch menu plan conflates no-op targets with runnable targets · case 05

Batch menu plan conflates no-op targets with runnable targets.

Menu interactions◈ Members↗
FA-33526

Batch context menu executes duplicate document targets · case 01

Batch context menu executes duplicate document targets.

Menu interactions● Open access↗
FA-33527

Batch context menu executes duplicate document targets · case 02

Batch context menu executes duplicate document targets.

Menu interactions◈ Members↗
FA-33528

Batch context menu executes duplicate document targets · case 03

Batch context menu executes duplicate document targets.

Menu interactions◈ Members↗
FA-33529

Batch context menu executes duplicate document targets · case 04

Batch context menu executes duplicate document targets.

Menu interactions◈ Members↗
FA-33530

Batch context menu executes duplicate document targets · case 05

Batch context menu executes duplicate document targets.

Menu interactions◈ Members↗
FA-33531

Atomic batch menu command proceeds on a supported subset · case 01

Atomic batch menu command proceeds on a supported subset.

Menu interactions● Open access↗
FA-33532

Atomic batch menu command proceeds on a supported subset · case 02

Atomic batch menu command proceeds on a supported subset.

Menu interactions◈ Members↗
FA-33533

Atomic batch menu command proceeds on a supported subset · case 03

Atomic batch menu command proceeds on a supported subset.

Menu interactions◈ Members↗
FA-33534

Atomic batch menu command proceeds on a supported subset · case 04

Atomic batch menu command proceeds on a supported subset.

Menu interactions◈ Members↗
FA-33535

Atomic batch menu command proceeds on a supported subset · case 05

Atomic batch menu command proceeds on a supported subset.

Menu interactions◈ Members↗
FA-33536

Batch menu preview misstates requested versus runnable object counts · case 01

Batch menu preview misstates requested versus runnable object counts.

Menu interactions● Open access↗
FA-33537

Batch menu preview misstates requested versus runnable object counts · case 02

Batch menu preview misstates requested versus runnable object counts.

Menu interactions◈ Members↗
FA-33538

Batch menu preview misstates requested versus runnable object counts · case 03

Batch menu preview misstates requested versus runnable object counts.

Menu interactions◈ Members↗
FA-33539

Batch menu preview misstates requested versus runnable object counts · case 04

Batch menu preview misstates requested versus runnable object counts.

Menu interactions◈ Members↗
FA-33540

Batch menu preview misstates requested versus runnable object counts · case 05

Batch menu preview misstates requested versus runnable object counts.

Menu interactions◈ Members↗
FA-33541

Restored menu cascade skips a missing owner and reopens its orphan descendant · case 01

Restored menu cascade skips a missing owner and reopens its orphan descendant.

Menu interactions● Open access↗
FA-33542

Restored menu cascade skips a missing owner and reopens its orphan descendant · case 02

Restored menu cascade skips a missing owner and reopens its orphan descendant.

Menu interactions◈ Members↗
FA-33543

Restored menu cascade skips a missing owner and reopens its orphan descendant · case 03

Restored menu cascade skips a missing owner and reopens its orphan descendant.

Menu interactions◈ Members↗
FA-33544

Restored menu cascade skips a missing owner and reopens its orphan descendant · case 04

Restored menu cascade skips a missing owner and reopens its orphan descendant.

Menu interactions◈ Members↗
FA-33545

Restored menu cascade skips a missing owner and reopens its orphan descendant · case 05

Restored menu cascade skips a missing owner and reopens its orphan descendant.

Menu interactions◈ Members↗
FA-33546

Restored cascade opens descendants of an unresolved lazy submenu · case 01

Restored cascade opens descendants of an unresolved lazy submenu.

Menu interactions● Open access↗
FA-33547

Restored cascade opens descendants of an unresolved lazy submenu · case 02

Restored cascade opens descendants of an unresolved lazy submenu.

Menu interactions◈ Members↗
FA-33548

Restored cascade opens descendants of an unresolved lazy submenu · case 03

Restored cascade opens descendants of an unresolved lazy submenu.

Menu interactions◈ Members↗
FA-33549

Restored cascade opens descendants of an unresolved lazy submenu · case 04

Restored cascade opens descendants of an unresolved lazy submenu.

Menu interactions◈ Members↗
FA-33550

Restored cascade opens descendants of an unresolved lazy submenu · case 05

Restored cascade opens descendants of an unresolved lazy submenu.

Menu interactions◈ Members↗
FA-33551

Menu restore follows a child that was moved to a different submenu owner · case 01

Menu restore follows a child that was moved to a different submenu owner.

Menu interactions● Open access↗
FA-33552

Menu restore follows a child that was moved to a different submenu owner · case 02

Menu restore follows a child that was moved to a different submenu owner.

Menu interactions◈ Members↗
FA-33553

Menu restore follows a child that was moved to a different submenu owner · case 03

Menu restore follows a child that was moved to a different submenu owner.

Menu interactions◈ Members↗
FA-33554

Menu restore follows a child that was moved to a different submenu owner · case 04

Menu restore follows a child that was moved to a different submenu owner.

Menu interactions◈ Members↗
FA-33555

Menu restore follows a child that was moved to a different submenu owner · case 05

Menu restore follows a child that was moved to a different submenu owner.

Menu interactions◈ Members↗
FA-33556

Restored menu passes through an unavailable intermediate owner · case 01

Restored menu passes through an unavailable intermediate owner.

Menu interactions● Open access↗
FA-33557

Restored menu passes through an unavailable intermediate owner · case 02

Restored menu passes through an unavailable intermediate owner.

Menu interactions◈ Members↗
FA-33558

Restored menu passes through an unavailable intermediate owner · case 03

Restored menu passes through an unavailable intermediate owner.

Menu interactions◈ Members↗
FA-33559

Restored menu passes through an unavailable intermediate owner · case 04

Restored menu passes through an unavailable intermediate owner.

Menu interactions◈ Members↗
FA-33560

Restored menu passes through an unavailable intermediate owner · case 05

Restored menu passes through an unavailable intermediate owner.

Menu interactions◈ Members↗
FA-33561

Restoring independent menu windows merges their identical root definitions · case 01

Restoring independent menu windows merges their identical root definitions.

Menu interactions● Open access↗
FA-33562

Restoring independent menu windows merges their identical root definitions · case 02

Restoring independent menu windows merges their identical root definitions.

Menu interactions◈ Members↗
FA-33563

Restoring independent menu windows merges their identical root definitions · case 03

Restoring independent menu windows merges their identical root definitions.

Menu interactions◈ Members↗
FA-33564

Restoring independent menu windows merges their identical root definitions · case 04

Restoring independent menu windows merges their identical root definitions.

Menu interactions◈ Members↗
FA-33565

Restoring independent menu windows merges their identical root definitions · case 05

Restoring independent menu windows merges their identical root definitions.

Menu interactions◈ Members↗
FA-33566

Menu restore remaps only the root and leaves obsolete descendant presentation IDs · case 01

Menu restore remaps only the root and leaves obsolete descendant presentation IDs.

Menu interactions● Open access↗
FA-33567

Menu restore remaps only the root and leaves obsolete descendant presentation IDs · case 02

Menu restore remaps only the root and leaves obsolete descendant presentation IDs.

Menu interactions◈ Members↗
FA-33568

Menu restore remaps only the root and leaves obsolete descendant presentation IDs · case 03

Menu restore remaps only the root and leaves obsolete descendant presentation IDs.

Menu interactions◈ Members↗
FA-33569

Menu restore remaps only the root and leaves obsolete descendant presentation IDs · case 04

Menu restore remaps only the root and leaves obsolete descendant presentation IDs.

Menu interactions◈ Members↗
FA-33570

Menu restore remaps only the root and leaves obsolete descendant presentation IDs · case 05

Menu restore remaps only the root and leaves obsolete descendant presentation IDs.

Menu interactions◈ Members↗
FA-33571

Primary split-menu action opens the submenu while invoking its default command · case 01

Primary split-menu action opens the submenu while invoking its default command.

Menu interactions● Open access↗
FA-33572

Primary split-menu action opens the submenu while invoking its default command · case 02

Primary split-menu action opens the submenu while invoking its default command.

Menu interactions◈ Members↗
FA-33573

Primary split-menu action opens the submenu while invoking its default command · case 03

Primary split-menu action opens the submenu while invoking its default command.

Menu interactions◈ Members↗
FA-33574

Primary split-menu action opens the submenu while invoking its default command · case 04

Primary split-menu action opens the submenu while invoking its default command.

Menu interactions◈ Members↗
FA-33575

Primary split-menu action opens the submenu while invoking its default command · case 05

Primary split-menu action opens the submenu while invoking its default command.

Menu interactions◈ Members↗
FA-33576

Secondary split-menu zone invokes the default instead of only showing alternatives · case 01

Secondary split-menu zone invokes the default instead of only showing alternatives.

Menu interactions● Open access↗
FA-33577

Secondary split-menu zone invokes the default instead of only showing alternatives · case 02

Secondary split-menu zone invokes the default instead of only showing alternatives.

Menu interactions◈ Members↗
FA-33578

Secondary split-menu zone invokes the default instead of only showing alternatives · case 03

Secondary split-menu zone invokes the default instead of only showing alternatives.

Menu interactions◈ Members↗
FA-33579

Secondary split-menu zone invokes the default instead of only showing alternatives · case 04

Secondary split-menu zone invokes the default instead of only showing alternatives.

Menu interactions◈ Members↗
FA-33580

Secondary split-menu zone invokes the default instead of only showing alternatives · case 05

Secondary split-menu zone invokes the default instead of only showing alternatives.

Menu interactions◈ Members↗
FA-33581

Split-menu divider hit is assigned to the primary command zone · case 01

Split-menu divider hit is assigned to the primary command zone.

Menu interactions● Open access↗
FA-33582

Split-menu divider hit is assigned to the primary command zone · case 02

Split-menu divider hit is assigned to the primary command zone.

Menu interactions◈ Members↗
FA-33583

Split-menu divider hit is assigned to the primary command zone · case 03

Split-menu divider hit is assigned to the primary command zone.

Menu interactions◈ Members↗
FA-33584

Split-menu divider hit is assigned to the primary command zone · case 04

Split-menu divider hit is assigned to the primary command zone.

Menu interactions◈ Members↗
FA-33585

Split-menu divider hit is assigned to the primary command zone · case 05

Split-menu divider hit is assigned to the primary command zone.

Menu interactions◈ Members↗
FA-33586

Split-menu default availability is inferred from unrelated alternatives · case 01

Split-menu default availability is inferred from unrelated alternatives.

Menu interactions● Open access↗
FA-33587

Split-menu default availability is inferred from unrelated alternatives · case 02

Split-menu default availability is inferred from unrelated alternatives.

Menu interactions◈ Members↗
FA-33588

Split-menu default availability is inferred from unrelated alternatives · case 03

Split-menu default availability is inferred from unrelated alternatives.

Menu interactions◈ Members↗
FA-33589

Split-menu default availability is inferred from unrelated alternatives · case 04

Split-menu default availability is inferred from unrelated alternatives.

Menu interactions◈ Members↗
FA-33590

Split-menu default availability is inferred from unrelated alternatives · case 05

Split-menu default availability is inferred from unrelated alternatives.

Menu interactions◈ Members↗
FA-33591

Changing split-menu default rewrites the owning submenu label · case 01

Changing split-menu default rewrites the owning submenu label.

Menu interactions● Open access↗
FA-33592

Changing split-menu default rewrites the owning submenu label · case 02

Changing split-menu default rewrites the owning submenu label.

Menu interactions◈ Members↗
FA-33593

Changing split-menu default rewrites the owning submenu label · case 03

Changing split-menu default rewrites the owning submenu label.

Menu interactions◈ Members↗
FA-33594

Changing split-menu default rewrites the owning submenu label · case 04

Changing split-menu default rewrites the owning submenu label.

Menu interactions◈ Members↗
FA-33595

Changing split-menu default rewrites the owning submenu label · case 05

Changing split-menu default rewrites the owning submenu label.

Menu interactions◈ Members↗
FA-33596

Split-menu primary zone with no default guesses an arbitrary alternative command · case 01

Split-menu primary zone with no default guesses an arbitrary alternative command.

Menu interactions● Open access↗
FA-33597

Split-menu primary zone with no default guesses an arbitrary alternative command · case 02

Split-menu primary zone with no default guesses an arbitrary alternative command.

Menu interactions◈ Members↗
FA-33598

Split-menu primary zone with no default guesses an arbitrary alternative command · case 03

Split-menu primary zone with no default guesses an arbitrary alternative command.

Menu interactions◈ Members↗
FA-33599

Split-menu primary zone with no default guesses an arbitrary alternative command · case 04

Split-menu primary zone with no default guesses an arbitrary alternative command.

Menu interactions◈ Members↗
FA-33600

Split-menu primary zone with no default guesses an arbitrary alternative command · case 05

Split-menu primary zone with no default guesses an arbitrary alternative command.

Menu interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗