FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-32901

Menu argument binding loses a parameter namespace boundary · case 01

Menu argument binding loses a parameter namespace boundary.

Menu interactions● Open access↗
FA-32902

Menu argument binding loses a parameter namespace boundary · case 02

Menu argument binding loses a parameter namespace boundary.

Menu interactions◈ Members↗
FA-32903

Menu argument binding loses a parameter namespace boundary · case 03

Menu argument binding loses a parameter namespace boundary.

Menu interactions◈ Members↗
FA-32904

Menu argument binding loses a parameter namespace boundary · case 04

Menu argument binding loses a parameter namespace boundary.

Menu interactions◈ Members↗
FA-32905

Menu argument binding loses a parameter namespace boundary · case 05

Menu argument binding loses a parameter namespace boundary.

Menu interactions◈ Members↗
FA-32906

Menu command argument binding truncates a captured document batch · case 01

Menu command argument binding truncates a captured document batch.

Menu interactions● Open access↗
FA-32907

Menu command argument binding truncates a captured document batch · case 02

Menu command argument binding truncates a captured document batch.

Menu interactions◈ Members↗
FA-32908

Menu command argument binding truncates a captured document batch · case 03

Menu command argument binding truncates a captured document batch.

Menu interactions◈ Members↗
FA-32909

Menu command argument binding truncates a captured document batch · case 04

Menu command argument binding truncates a captured document batch.

Menu interactions◈ Members↗
FA-32910

Menu command argument binding truncates a captured document batch · case 05

Menu command argument binding truncates a captured document batch.

Menu interactions◈ Members↗
FA-32911

Menu batch command overlooks its upper cardinality limit · case 01

Menu batch command overlooks its upper cardinality limit.

Menu interactions● Open access↗
FA-32912

Menu batch command overlooks its upper cardinality limit · case 02

Menu batch command overlooks its upper cardinality limit.

Menu interactions◈ Members↗
FA-32913

Menu batch command overlooks its upper cardinality limit · case 03

Menu batch command overlooks its upper cardinality limit.

Menu interactions◈ Members↗
FA-32914

Menu batch command overlooks its upper cardinality limit · case 04

Menu batch command overlooks its upper cardinality limit.

Menu interactions◈ Members↗
FA-32915

Menu batch command overlooks its upper cardinality limit · case 05

Menu batch command overlooks its upper cardinality limit.

Menu interactions◈ Members↗
FA-32916

Menu command accepts a mixed unsupported document batch · case 01

Menu command accepts a mixed unsupported document batch.

Menu interactions● Open access↗
FA-32917

Menu command accepts a mixed unsupported document batch · case 02

Menu command accepts a mixed unsupported document batch.

Menu interactions◈ Members↗
FA-32918

Menu command accepts a mixed unsupported document batch · case 03

Menu command accepts a mixed unsupported document batch.

Menu interactions◈ Members↗
FA-32919

Menu command accepts a mixed unsupported document batch · case 04

Menu command accepts a mixed unsupported document batch.

Menu interactions◈ Members↗
FA-32920

Menu command accepts a mixed unsupported document batch · case 05

Menu command accepts a mixed unsupported document batch.

Menu interactions◈ Members↗
FA-32921

Vacuous target validation enables an empty context command · case 01

Vacuous target validation enables an empty context command.

Menu interactions● Open access↗
FA-32922

Vacuous target validation enables an empty context command · case 02

Vacuous target validation enables an empty context command.

Menu interactions◈ Members↗
FA-32923

Vacuous target validation enables an empty context command · case 03

Vacuous target validation enables an empty context command.

Menu interactions◈ Members↗
FA-32924

Vacuous target validation enables an empty context command · case 04

Vacuous target validation enables an empty context command.

Menu interactions◈ Members↗
FA-32925

Vacuous target validation enables an empty context command · case 05

Vacuous target validation enables an empty context command.

Menu interactions◈ Members↗
FA-32926

Busy menu command remains available because its document is idle · case 01

Busy menu command remains available because its document is idle.

Menu interactions● Open access↗
FA-32927

Busy menu command remains available because its document is idle · case 02

Busy menu command remains available because its document is idle.

Menu interactions◈ Members↗
FA-32928

Busy menu command remains available because its document is idle · case 03

Busy menu command remains available because its document is idle.

Menu interactions◈ Members↗
FA-32929

Busy menu command remains available because its document is idle · case 04

Busy menu command remains available because its document is idle.

Menu interactions◈ Members↗
FA-32930

Busy menu command remains available because its document is idle · case 05

Busy menu command remains available because its document is idle.

Menu interactions◈ Members↗
FA-32931

Menu availability explanation reports a lower-priority denial · case 01

Menu availability explanation reports a lower-priority denial.

Menu interactions● Open access↗
FA-32932

Menu availability explanation reports a lower-priority denial · case 02

Menu availability explanation reports a lower-priority denial.

Menu interactions◈ Members↗
FA-32933

Menu availability explanation reports a lower-priority denial · case 03

Menu availability explanation reports a lower-priority denial.

Menu interactions◈ Members↗
FA-32934

Menu availability explanation reports a lower-priority denial · case 04

Menu availability explanation reports a lower-priority denial.

Menu interactions◈ Members↗
FA-32935

Menu availability explanation reports a lower-priority denial · case 05

Menu availability explanation reports a lower-priority denial.

Menu interactions◈ Members↗
FA-32936

Expired menu capability remains available at its boundary · case 01

Expired menu capability remains available at its boundary.

Menu interactions● Open access↗
FA-32937

Expired menu capability remains available at its boundary · case 02

Expired menu capability remains available at its boundary.

Menu interactions◈ Members↗
FA-32938

Expired menu capability remains available at its boundary · case 03

Expired menu capability remains available at its boundary.

Menu interactions◈ Members↗
FA-32939

Expired menu capability remains available at its boundary · case 04

Expired menu capability remains available at its boundary.

Menu interactions◈ Members↗
FA-32940

Expired menu capability remains available at its boundary · case 05

Expired menu capability remains available at its boundary.

Menu interactions◈ Members↗
FA-32941

Filtered submenu results lose their ancestor menu headings · case 01

Filtered submenu results lose their ancestor menu headings.

Menu interactions● Open access↗
FA-32942

Filtered submenu results lose their ancestor menu headings · case 02

Filtered submenu results lose their ancestor menu headings.

Menu interactions◈ Members↗
FA-32943

Filtered submenu results lose their ancestor menu headings · case 03

Filtered submenu results lose their ancestor menu headings.

Menu interactions◈ Members↗
FA-32944

Filtered submenu results lose their ancestor menu headings · case 04

Filtered submenu results lose their ancestor menu headings.

Menu interactions◈ Members↗
FA-32945

Filtered submenu results lose their ancestor menu headings · case 05

Filtered submenu results lose their ancestor menu headings.

Menu interactions◈ Members↗
FA-32946

Filtered result counter includes menu headings · case 01

Filtered result counter includes menu headings.

Menu interactions● Open access↗
FA-32947

Filtered result counter includes menu headings · case 02

Filtered result counter includes menu headings.

Menu interactions◈ Members↗
FA-32948

Filtered result counter includes menu headings · case 03

Filtered result counter includes menu headings.

Menu interactions◈ Members↗
FA-32949

Filtered result counter includes menu headings · case 04

Filtered result counter includes menu headings.

Menu interactions◈ Members↗
FA-32950

Filtered result counter includes menu headings · case 05

Filtered result counter includes menu headings.

Menu interactions◈ Members↗
FA-32951

Menu filter removes informative unavailable command results · case 01

Menu filter removes informative unavailable command results.

Menu interactions● Open access↗
FA-32952

Menu filter removes informative unavailable command results · case 02

Menu filter removes informative unavailable command results.

Menu interactions◈ Members↗
FA-32953

Menu filter removes informative unavailable command results · case 03

Menu filter removes informative unavailable command results.

Menu interactions◈ Members↗
FA-32954

Menu filter removes informative unavailable command results · case 04

Menu filter removes informative unavailable command results.

Menu interactions◈ Members↗
FA-32955

Menu filter removes informative unavailable command results · case 05

Menu filter removes informative unavailable command results.

Menu interactions◈ Members↗
FA-32956

Filtered menu retains headings for groups with no surviving commands · case 01

Filtered menu retains headings for groups with no surviving commands.

Menu interactions● Open access↗
FA-32957

Filtered menu retains headings for groups with no surviving commands · case 02

Filtered menu retains headings for groups with no surviving commands.

Menu interactions◈ Members↗
FA-32958

Filtered menu retains headings for groups with no surviving commands · case 03

Filtered menu retains headings for groups with no surviving commands.

Menu interactions◈ Members↗
FA-32959

Filtered menu retains headings for groups with no surviving commands · case 04

Filtered menu retains headings for groups with no surviving commands.

Menu interactions◈ Members↗
FA-32960

Filtered menu retains headings for groups with no surviving commands · case 05

Filtered menu retains headings for groups with no surviving commands.

Menu interactions◈ Members↗
FA-32961

Clearing menu filter restores only the last filtered projection · case 01

Clearing menu filter restores only the last filtered projection.

Menu interactions● Open access↗
FA-32962

Clearing menu filter restores only the last filtered projection · case 02

Clearing menu filter restores only the last filtered projection.

Menu interactions◈ Members↗
FA-32963

Clearing menu filter restores only the last filtered projection · case 03

Clearing menu filter restores only the last filtered projection.

Menu interactions◈ Members↗
FA-32964

Clearing menu filter restores only the last filtered projection · case 04

Clearing menu filter restores only the last filtered projection.

Menu interactions◈ Members↗
FA-32965

Clearing menu filter restores only the last filtered projection · case 05

Clearing menu filter restores only the last filtered projection.

Menu interactions◈ Members↗
FA-32966

Submenu owner disappears when only a descendant matches · case 01

Submenu owner disappears when only a descendant matches.

Menu interactions● Open access↗
FA-32967

Submenu owner disappears when only a descendant matches · case 02

Submenu owner disappears when only a descendant matches.

Menu interactions◈ Members↗
FA-32968

Submenu owner disappears when only a descendant matches · case 03

Submenu owner disappears when only a descendant matches.

Menu interactions◈ Members↗
FA-32969

Submenu owner disappears when only a descendant matches · case 04

Submenu owner disappears when only a descendant matches.

Menu interactions◈ Members↗
FA-32970

Submenu owner disappears when only a descendant matches · case 05

Submenu owner disappears when only a descendant matches.

Menu interactions◈ Members↗
FA-32971

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu · case 01

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu.

Menu interactions● Open access↗
FA-32972

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu · case 02

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu.

Menu interactions◈ Members↗
FA-32973

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu · case 03

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu.

Menu interactions◈ Members↗
FA-32974

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu · case 04

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu.

Menu interactions◈ Members↗
FA-32975

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu · case 05

Menu ancestor breadcrumb dispatches a document action instead of reopening its menu.

Menu interactions◈ Members↗
FA-32976

Menu ancestor popup identifies the child definition instead of its owning menu row · case 01

Menu ancestor popup identifies the child definition instead of its owning menu row.

Menu interactions● Open access↗
FA-32977

Menu ancestor popup identifies the child definition instead of its owning menu row · case 02

Menu ancestor popup identifies the child definition instead of its owning menu row.

Menu interactions◈ Members↗
FA-32978

Menu ancestor popup identifies the child definition instead of its owning menu row · case 03

Menu ancestor popup identifies the child definition instead of its owning menu row.

Menu interactions◈ Members↗
FA-32979

Menu ancestor popup identifies the child definition instead of its owning menu row · case 04

Menu ancestor popup identifies the child definition instead of its owning menu row.

Menu interactions◈ Members↗
FA-32980

Menu ancestor popup identifies the child definition instead of its owning menu row · case 05

Menu ancestor popup identifies the child definition instead of its owning menu row.

Menu interactions◈ Members↗
FA-32981

Breadcrumb command uses its parent label as its own display text · case 01

Breadcrumb command uses its parent label as its own display text.

Menu interactions● Open access↗
FA-32982

Breadcrumb command uses its parent label as its own display text · case 02

Breadcrumb command uses its parent label as its own display text.

Menu interactions◈ Members↗
FA-32983

Breadcrumb command uses its parent label as its own display text · case 03

Breadcrumb command uses its parent label as its own display text.

Menu interactions◈ Members↗
FA-32984

Breadcrumb command uses its parent label as its own display text · case 04

Breadcrumb command uses its parent label as its own display text.

Menu interactions◈ Members↗
FA-32985

Breadcrumb command uses its parent label as its own display text · case 05

Breadcrumb command uses its parent label as its own display text.

Menu interactions◈ Members↗
FA-32986

Breadcrumb overflow menu loses full reopen paths for omitted menu levels · case 01

Breadcrumb overflow menu loses full reopen paths for omitted menu levels.

Menu interactions● Open access↗
FA-32987

Breadcrumb overflow menu loses full reopen paths for omitted menu levels · case 02

Breadcrumb overflow menu loses full reopen paths for omitted menu levels.

Menu interactions◈ Members↗
FA-32988

Breadcrumb overflow menu loses full reopen paths for omitted menu levels · case 03

Breadcrumb overflow menu loses full reopen paths for omitted menu levels.

Menu interactions◈ Members↗
FA-32989

Breadcrumb overflow menu loses full reopen paths for omitted menu levels · case 04

Breadcrumb overflow menu loses full reopen paths for omitted menu levels.

Menu interactions◈ Members↗
FA-32990

Breadcrumb overflow menu loses full reopen paths for omitted menu levels · case 05

Breadcrumb overflow menu loses full reopen paths for omitted menu levels.

Menu interactions◈ Members↗
FA-32991

Identical breadcrumb labels collapse distinct ancestor menu IDs · case 01

Identical breadcrumb labels collapse distinct ancestor menu IDs.

Menu interactions● Open access↗
FA-32992

Identical breadcrumb labels collapse distinct ancestor menu IDs · case 02

Identical breadcrumb labels collapse distinct ancestor menu IDs.

Menu interactions◈ Members↗
FA-32993

Identical breadcrumb labels collapse distinct ancestor menu IDs · case 03

Identical breadcrumb labels collapse distinct ancestor menu IDs.

Menu interactions◈ Members↗
FA-32994

Identical breadcrumb labels collapse distinct ancestor menu IDs · case 04

Identical breadcrumb labels collapse distinct ancestor menu IDs.

Menu interactions◈ Members↗
FA-32995

Identical breadcrumb labels collapse distinct ancestor menu IDs · case 05

Identical breadcrumb labels collapse distinct ancestor menu IDs.

Menu interactions◈ Members↗
FA-32996

Breadcrumb menu jump removes the target ancestor itself · case 01

Breadcrumb menu jump removes the target ancestor itself.

Menu interactions● Open access↗
FA-32997

Breadcrumb menu jump removes the target ancestor itself · case 02

Breadcrumb menu jump removes the target ancestor itself.

Menu interactions◈ Members↗
FA-32998

Breadcrumb menu jump removes the target ancestor itself · case 03

Breadcrumb menu jump removes the target ancestor itself.

Menu interactions◈ Members↗
FA-32999

Breadcrumb menu jump removes the target ancestor itself · case 04

Breadcrumb menu jump removes the target ancestor itself.

Menu interactions◈ Members↗
FA-33000

Breadcrumb menu jump removes the target ancestor itself · case 05

Breadcrumb menu jump removes the target ancestor itself.

Menu interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗