FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-32801

Context menu resolution crosses a document ownership boundary · case 01

Context menu resolution crosses a document ownership boundary.

Menu interactions● Open access↗
FA-32802

Context menu resolution crosses a document ownership boundary · case 02

Context menu resolution crosses a document ownership boundary.

Menu interactions◈ Members↗
FA-32803

Context menu resolution crosses a document ownership boundary · case 03

Context menu resolution crosses a document ownership boundary.

Menu interactions◈ Members↗
FA-32804

Context menu resolution crosses a document ownership boundary · case 04

Context menu resolution crosses a document ownership boundary.

Menu interactions◈ Members↗
FA-32805

Context menu resolution crosses a document ownership boundary · case 05

Context menu resolution crosses a document ownership boundary.

Menu interactions◈ Members↗
FA-32806

Detached context target retains an actionable menu owner · case 01

Detached context target retains an actionable menu owner.

Menu interactions● Open access↗
FA-32807

Detached context target retains an actionable menu owner · case 02

Detached context target retains an actionable menu owner.

Menu interactions◈ Members↗
FA-32808

Detached context target retains an actionable menu owner · case 03

Detached context target retains an actionable menu owner.

Menu interactions◈ Members↗
FA-32809

Detached context target retains an actionable menu owner · case 04

Detached context target retains an actionable menu owner.

Menu interactions◈ Members↗
FA-32810

Detached context target retains an actionable menu owner · case 05

Detached context target retains an actionable menu owner.

Menu interactions◈ Members↗
FA-32811

Falsy valid context owner falls through to document menu · case 01

Falsy valid context owner falls through to document menu.

Menu interactions● Open access↗
FA-32812

Falsy valid context owner falls through to document menu · case 02

Falsy valid context owner falls through to document menu.

Menu interactions◈ Members↗
FA-32813

Falsy valid context owner falls through to document menu · case 03

Falsy valid context owner falls through to document menu.

Menu interactions◈ Members↗
FA-32814

Falsy valid context owner falls through to document menu · case 04

Falsy valid context owner falls through to document menu.

Menu interactions◈ Members↗
FA-32815

Falsy valid context owner falls through to document menu · case 05

Falsy valid context owner falls through to document menu.

Menu interactions◈ Members↗
FA-32816

Captured context gesture uses a transient visual hit target · case 01

Captured context gesture uses a transient visual hit target.

Menu interactions● Open access↗
FA-32817

Captured context gesture uses a transient visual hit target · case 02

Captured context gesture uses a transient visual hit target.

Menu interactions◈ Members↗
FA-32818

Captured context gesture uses a transient visual hit target · case 03

Captured context gesture uses a transient visual hit target.

Menu interactions◈ Members↗
FA-32819

Captured context gesture uses a transient visual hit target · case 04

Captured context gesture uses a transient visual hit target.

Menu interactions◈ Members↗
FA-32820

Captured context gesture uses a transient visual hit target · case 05

Captured context gesture uses a transient visual hit target.

Menu interactions◈ Members↗
FA-32821

Menu teardown leaks its own event subscriptions · case 01

Menu teardown leaks its own event subscriptions.

Menu interactions● Open access↗
FA-32822

Menu teardown leaks its own event subscriptions · case 02

Menu teardown leaks its own event subscriptions.

Menu interactions◈ Members↗
FA-32823

Menu teardown leaks its own event subscriptions · case 03

Menu teardown leaks its own event subscriptions.

Menu interactions◈ Members↗
FA-32824

Menu teardown leaks its own event subscriptions · case 04

Menu teardown leaks its own event subscriptions.

Menu interactions◈ Members↗
FA-32825

Menu teardown leaks its own event subscriptions · case 05

Menu teardown leaks its own event subscriptions.

Menu interactions◈ Members↗
FA-32826

Menu teardown treats timer handle zero as absent · case 01

Menu teardown treats timer handle zero as absent.

Menu interactions● Open access↗
FA-32827

Menu teardown treats timer handle zero as absent · case 02

Menu teardown treats timer handle zero as absent.

Menu interactions◈ Members↗
FA-32828

Menu teardown treats timer handle zero as absent · case 03

Menu teardown treats timer handle zero as absent.

Menu interactions◈ Members↗
FA-32829

Menu teardown treats timer handle zero as absent · case 04

Menu teardown treats timer handle zero as absent.

Menu interactions◈ Members↗
FA-32830

Menu teardown treats timer handle zero as absent · case 05

Menu teardown treats timer handle zero as absent.

Menu interactions◈ Members↗
FA-32831

Disposed submenu retains provider rows or loading state · case 01

Disposed submenu retains provider rows or loading state.

Menu interactions● Open access↗
FA-32832

Disposed submenu retains provider rows or loading state · case 02

Disposed submenu retains provider rows or loading state.

Menu interactions◈ Members↗
FA-32833

Disposed submenu retains provider rows or loading state · case 03

Disposed submenu retains provider rows or loading state.

Menu interactions◈ Members↗
FA-32834

Disposed submenu retains provider rows or loading state · case 04

Disposed submenu retains provider rows or loading state.

Menu interactions◈ Members↗
FA-32835

Disposed submenu retains provider rows or loading state · case 05

Disposed submenu retains provider rows or loading state.

Menu interactions◈ Members↗
FA-32836

Repeated popup teardown consumes another menu anchor lease · case 01

Repeated popup teardown consumes another menu anchor lease.

Menu interactions● Open access↗
FA-32837

Repeated popup teardown consumes another menu anchor lease · case 02

Repeated popup teardown consumes another menu anchor lease.

Menu interactions◈ Members↗
FA-32838

Repeated popup teardown consumes another menu anchor lease · case 03

Repeated popup teardown consumes another menu anchor lease.

Menu interactions◈ Members↗
FA-32839

Repeated popup teardown consumes another menu anchor lease · case 04

Repeated popup teardown consumes another menu anchor lease.

Menu interactions◈ Members↗
FA-32840

Repeated popup teardown consumes another menu anchor lease · case 05

Repeated popup teardown consumes another menu anchor lease.

Menu interactions◈ Members↗
FA-32841

Popup cleanup reverses registration order instead of menu ancestor depth · case 01

Popup cleanup reverses registration order instead of menu ancestor depth.

Menu interactions● Open access↗
FA-32842

Popup cleanup reverses registration order instead of menu ancestor depth · case 02

Popup cleanup reverses registration order instead of menu ancestor depth.

Menu interactions◈ Members↗
FA-32843

Popup cleanup reverses registration order instead of menu ancestor depth · case 03

Popup cleanup reverses registration order instead of menu ancestor depth.

Menu interactions◈ Members↗
FA-32844

Popup cleanup reverses registration order instead of menu ancestor depth · case 04

Popup cleanup reverses registration order instead of menu ancestor depth.

Menu interactions◈ Members↗
FA-32845

Popup cleanup reverses registration order instead of menu ancestor depth · case 05

Popup cleanup reverses registration order instead of menu ancestor depth.

Menu interactions◈ Members↗
FA-32846

Disposed context menu retains a stale anchor reference · case 01

Disposed context menu retains a stale anchor reference.

Menu interactions● Open access↗
FA-32847

Disposed context menu retains a stale anchor reference · case 02

Disposed context menu retains a stale anchor reference.

Menu interactions◈ Members↗
FA-32848

Disposed context menu retains a stale anchor reference · case 03

Disposed context menu retains a stale anchor reference.

Menu interactions◈ Members↗
FA-32849

Disposed context menu retains a stale anchor reference · case 04

Disposed context menu retains a stale anchor reference.

Menu interactions◈ Members↗
FA-32850

Disposed context menu retains a stale anchor reference · case 05

Disposed context menu retains a stale anchor reference.

Menu interactions◈ Members↗
FA-32851

Refresh preserves menu commands that the provider removed · case 01

Refresh preserves menu commands that the provider removed.

Menu interactions● Open access↗
FA-32852

Refresh preserves menu commands that the provider removed · case 02

Refresh preserves menu commands that the provider removed.

Menu interactions◈ Members↗
FA-32853

Refresh preserves menu commands that the provider removed · case 03

Refresh preserves menu commands that the provider removed.

Menu interactions◈ Members↗
FA-32854

Refresh preserves menu commands that the provider removed · case 04

Refresh preserves menu commands that the provider removed.

Menu interactions◈ Members↗
FA-32855

Refresh preserves menu commands that the provider removed · case 05

Refresh preserves menu commands that the provider removed.

Menu interactions◈ Members↗
FA-32856

Menu refresh restores obsolete provider order · case 01

Menu refresh restores obsolete provider order.

Menu interactions● Open access↗
FA-32857

Menu refresh restores obsolete provider order · case 02

Menu refresh restores obsolete provider order.

Menu interactions◈ Members↗
FA-32858

Menu refresh restores obsolete provider order · case 03

Menu refresh restores obsolete provider order.

Menu interactions◈ Members↗
FA-32859

Menu refresh restores obsolete provider order · case 04

Menu refresh restores obsolete provider order.

Menu interactions◈ Members↗
FA-32860

Menu refresh restores obsolete provider order · case 05

Menu refresh restores obsolete provider order.

Menu interactions◈ Members↗
FA-32861

Menu refresh carries annotations for deleted commands · case 01

Menu refresh carries annotations for deleted commands.

Menu interactions● Open access↗
FA-32862

Menu refresh carries annotations for deleted commands · case 02

Menu refresh carries annotations for deleted commands.

Menu interactions◈ Members↗
FA-32863

Menu refresh carries annotations for deleted commands · case 03

Menu refresh carries annotations for deleted commands.

Menu interactions◈ Members↗
FA-32864

Menu refresh carries annotations for deleted commands · case 04

Menu refresh carries annotations for deleted commands.

Menu interactions◈ Members↗
FA-32865

Menu refresh carries annotations for deleted commands · case 05

Menu refresh carries annotations for deleted commands.

Menu interactions◈ Members↗
FA-32866

Equal-version menu snapshots unnecessarily replace live content · case 01

Equal-version menu snapshots unnecessarily replace live content.

Menu interactions● Open access↗
FA-32867

Equal-version menu snapshots unnecessarily replace live content · case 02

Equal-version menu snapshots unnecessarily replace live content.

Menu interactions◈ Members↗
FA-32868

Equal-version menu snapshots unnecessarily replace live content · case 03

Equal-version menu snapshots unnecessarily replace live content.

Menu interactions◈ Members↗
FA-32869

Equal-version menu snapshots unnecessarily replace live content · case 04

Equal-version menu snapshots unnecessarily replace live content.

Menu interactions◈ Members↗
FA-32870

Equal-version menu snapshots unnecessarily replace live content · case 05

Equal-version menu snapshots unnecessarily replace live content.

Menu interactions◈ Members↗
FA-32871

Menu refresh keeps a cascade whose child was reparented · case 01

Menu refresh keeps a cascade whose child was reparented.

Menu interactions● Open access↗
FA-32872

Menu refresh keeps a cascade whose child was reparented · case 02

Menu refresh keeps a cascade whose child was reparented.

Menu interactions◈ Members↗
FA-32873

Menu refresh keeps a cascade whose child was reparented · case 03

Menu refresh keeps a cascade whose child was reparented.

Menu interactions◈ Members↗
FA-32874

Menu refresh keeps a cascade whose child was reparented · case 04

Menu refresh keeps a cascade whose child was reparented.

Menu interactions◈ Members↗
FA-32875

Menu refresh keeps a cascade whose child was reparented · case 05

Menu refresh keeps a cascade whose child was reparented.

Menu interactions◈ Members↗
FA-32876

Menu refresh pins a submenu to the old row index · case 01

Menu refresh pins a submenu to the old row index.

Menu interactions● Open access↗
FA-32877

Menu refresh pins a submenu to the old row index · case 02

Menu refresh pins a submenu to the old row index.

Menu interactions◈ Members↗
FA-32878

Menu refresh pins a submenu to the old row index · case 03

Menu refresh pins a submenu to the old row index.

Menu interactions◈ Members↗
FA-32879

Menu refresh pins a submenu to the old row index · case 04

Menu refresh pins a submenu to the old row index.

Menu interactions◈ Members↗
FA-32880

Menu refresh pins a submenu to the old row index · case 05

Menu refresh pins a submenu to the old row index.

Menu interactions◈ Members↗
FA-32881

Menu command positional arguments reverse bound and runtime order · case 01

Menu command positional arguments reverse bound and runtime order.

Menu interactions● Open access↗
FA-32882

Menu command positional arguments reverse bound and runtime order · case 02

Menu command positional arguments reverse bound and runtime order.

Menu interactions◈ Members↗
FA-32883

Menu command positional arguments reverse bound and runtime order · case 03

Menu command positional arguments reverse bound and runtime order.

Menu interactions◈ Members↗
FA-32884

Menu command positional arguments reverse bound and runtime order · case 04

Menu command positional arguments reverse bound and runtime order.

Menu interactions◈ Members↗
FA-32885

Menu command positional arguments reverse bound and runtime order · case 05

Menu command positional arguments reverse bound and runtime order.

Menu interactions◈ Members↗
FA-32886

Context menu caller overrides protected command arguments · case 01

Context menu caller overrides protected command arguments.

Menu interactions● Open access↗
FA-32887

Context menu caller overrides protected command arguments · case 02

Context menu caller overrides protected command arguments.

Menu interactions◈ Members↗
FA-32888

Context menu caller overrides protected command arguments · case 03

Context menu caller overrides protected command arguments.

Menu interactions◈ Members↗
FA-32889

Context menu caller overrides protected command arguments · case 04

Context menu caller overrides protected command arguments.

Menu interactions◈ Members↗
FA-32890

Context menu caller overrides protected command arguments · case 05

Context menu caller overrides protected command arguments.

Menu interactions◈ Members↗
FA-32891

Explicit empty menu argument is replaced by an ambient default · case 01

Explicit empty menu argument is replaced by an ambient default.

Menu interactions● Open access↗
FA-32892

Explicit empty menu argument is replaced by an ambient default · case 02

Explicit empty menu argument is replaced by an ambient default.

Menu interactions◈ Members↗
FA-32893

Explicit empty menu argument is replaced by an ambient default · case 03

Explicit empty menu argument is replaced by an ambient default.

Menu interactions◈ Members↗
FA-32894

Explicit empty menu argument is replaced by an ambient default · case 04

Explicit empty menu argument is replaced by an ambient default.

Menu interactions◈ Members↗
FA-32895

Explicit empty menu argument is replaced by an ambient default · case 05

Explicit empty menu argument is replaced by an ambient default.

Menu interactions◈ Members↗
FA-32896

Menu command omits required argument presence validation · case 01

Menu command omits required argument presence validation.

Menu interactions● Open access↗
FA-32897

Menu command omits required argument presence validation · case 02

Menu command omits required argument presence validation.

Menu interactions◈ Members↗
FA-32898

Menu command omits required argument presence validation · case 03

Menu command omits required argument presence validation.

Menu interactions◈ Members↗
FA-32899

Menu command omits required argument presence validation · case 04

Menu command omits required argument presence validation.

Menu interactions◈ Members↗
FA-32900

Menu command omits required argument presence validation · case 05

Menu command omits required argument presence validation.

Menu interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗