FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-22901

External text autofill in autocomplete: ambiguous autofill label silently selects its first identity · case 01

The ambiguous completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22902

External text autofill in autocomplete: ambiguous autofill label silently selects its first identity · case 02

The ambiguous completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22903

External text autofill in autocomplete: ambiguous autofill label silently selects its first identity · case 03

The ambiguous completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22904

External text autofill in autocomplete: ambiguous autofill label silently selects its first identity · case 04

The ambiguous completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22905

External text autofill in autocomplete: ambiguous autofill label silently selects its first identity · case 05

The ambiguous completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22906

External text autofill in autocomplete: fuzzy autocomplete match becomes a committed autofill value · case 01

The exact completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22907

External text autofill in autocomplete: fuzzy autocomplete match becomes a committed autofill value · case 02

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22908

External text autofill in autocomplete: fuzzy autocomplete match becomes a committed autofill value · case 03

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22909

External text autofill in autocomplete: fuzzy autocomplete match becomes a committed autofill value · case 04

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22910

External text autofill in autocomplete: fuzzy autocomplete match becomes a committed autofill value · case 05

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22911

External text autofill in autocomplete: unresolved external text retains the unrelated previous identity · case 01

The unresolved completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22912

External text autofill in autocomplete: unresolved external text retains the unrelated previous identity · case 02

The unresolved completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22913

External text autofill in autocomplete: unresolved external text retains the unrelated previous identity · case 03

The unresolved completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22914

External text autofill in autocomplete: unresolved external text retains the unrelated previous identity · case 04

The unresolved completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22915

External text autofill in autocomplete: unresolved external text retains the unrelated previous identity · case 05

The unresolved completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22916

External text autofill in autocomplete: external autofill preserves a ghost suffix from previous typing · case 01

The ghost completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22917

External text autofill in autocomplete: external autofill preserves a ghost suffix from previous typing · case 02

The ghost completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22918

External text autofill in autocomplete: external autofill preserves a ghost suffix from previous typing · case 03

The ghost completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22919

External text autofill in autocomplete: external autofill preserves a ghost suffix from previous typing · case 04

The ghost completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22920

External text autofill in autocomplete: external autofill preserves a ghost suffix from previous typing · case 05

The ghost completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22921

External text autofill in autocomplete: external exact match is displayed with the old query instead of autofilled label · case 01

The exact-display completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22922

External text autofill in autocomplete: external exact match is displayed with the old query instead of autofilled label · case 02

The exact-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22923

External text autofill in autocomplete: external exact match is displayed with the old query instead of autofilled label · case 03

The exact-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22924

External text autofill in autocomplete: external exact match is displayed with the old query instead of autofilled label · case 04

The exact-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22925

External text autofill in autocomplete: external exact match is displayed with the old query instead of autofilled label · case 05

The exact-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22926

External text autofill in autocomplete: external replacement does not schedule suggestions for new text · case 01

The query-trigger completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22927

External text autofill in autocomplete: external replacement does not schedule suggestions for new text · case 02

The query-trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22928

External text autofill in autocomplete: external replacement does not schedule suggestions for new text · case 03

The query-trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22929

External text autofill in autocomplete: external replacement does not schedule suggestions for new text · case 04

The query-trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22930

External text autofill in autocomplete: external replacement does not schedule suggestions for new text · case 05

The query-trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22931

External text autofill in autocomplete: external autofill resets the existing interaction history · case 01

The touched completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22932

External text autofill in autocomplete: external autofill resets the existing interaction history · case 02

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22933

External text autofill in autocomplete: external autofill resets the existing interaction history · case 03

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22934

External text autofill in autocomplete: external autofill resets the existing interaction history · case 04

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22935

External text autofill in autocomplete: external autofill resets the existing interaction history · case 05

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22936

External text autofill in autocomplete: external text reconciliation falsely treats prior hover as an exact-match witness · case 01

The hover-witness completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22937

External text autofill in autocomplete: external text reconciliation falsely treats prior hover as an exact-match witness · case 02

The hover-witness completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22938

External text autofill in autocomplete: external text reconciliation falsely treats prior hover as an exact-match witness · case 03

The hover-witness completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22939

External text autofill in autocomplete: external text reconciliation falsely treats prior hover as an exact-match witness · case 04

The hover-witness completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22940

External text autofill in autocomplete: external text reconciliation falsely treats prior hover as an exact-match witness · case 05

The hover-witness completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22941

Mention suggestion insertion: mention acceptance replaces the whole input instead of the trigger span · case 01

The text completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22942

Mention suggestion insertion: mention acceptance replaces the whole input instead of the trigger span · case 02

The text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22943

Mention suggestion insertion: mention acceptance replaces the whole input instead of the trigger span · case 03

The text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22944

Mention suggestion insertion: mention acceptance replaces the whole input instead of the trigger span · case 04

The text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22945

Mention suggestion insertion: mention acceptance replaces the whole input instead of the trigger span · case 05

The text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22946

Mention suggestion insertion: mention metadata stores visible name instead of entity identifier · case 01

The identity completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22947

Mention suggestion insertion: mention metadata stores visible name instead of entity identifier · case 02

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22948

Mention suggestion insertion: mention metadata stores visible name instead of entity identifier · case 03

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22949

Mention suggestion insertion: mention metadata stores visible name instead of entity identifier · case 04

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22950

Mention suggestion insertion: mention metadata stores visible name instead of entity identifier · case 05

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22951

Mention suggestion insertion: mention display doubles the trigger prefix · case 01

The trigger completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22952

Mention suggestion insertion: mention display doubles the trigger prefix · case 02

The trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22953

Mention suggestion insertion: mention display doubles the trigger prefix · case 03

The trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22954

Mention suggestion insertion: mention display doubles the trigger prefix · case 04

The trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22955

Mention suggestion insertion: mention display doubles the trigger prefix · case 05

The trigger completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22956

Mention suggestion insertion: mention request includes its trigger in the search fragment · case 01

The query completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22957

Mention suggestion insertion: mention request includes its trigger in the search fragment · case 02

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22958

Mention suggestion insertion: mention request includes its trigger in the search fragment · case 03

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22959

Mention suggestion insertion: mention request includes its trigger in the search fragment · case 04

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22960

Mention suggestion insertion: mention request includes its trigger in the search fragment · case 05

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22961

Mention suggestion insertion: mention insertion duplicates an existing separator · case 01

The delimiter completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22962

Mention suggestion insertion: mention insertion duplicates an existing separator · case 02

The delimiter completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22963

Mention suggestion insertion: mention insertion duplicates an existing separator · case 03

The delimiter completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22964

Mention suggestion insertion: mention insertion duplicates an existing separator · case 04

The delimiter completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22965

Mention suggestion insertion: mention insertion duplicates an existing separator · case 05

The delimiter completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22966

Mention suggestion insertion: mention caret omits the trigger width · case 01

The caret completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22967

Mention suggestion insertion: mention caret omits the trigger width · case 02

The caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22968

Mention suggestion insertion: mention caret omits the trigger width · case 03

The caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22969

Mention suggestion insertion: mention caret omits the trigger width · case 04

The caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22970

Mention suggestion insertion: mention caret omits the trigger width · case 05

The caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22971

Mention suggestion insertion: saved mention annotation includes following prose · case 01

The span completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22972

Mention suggestion insertion: saved mention annotation includes following prose · case 02

The span completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22973

Mention suggestion insertion: saved mention annotation includes following prose · case 03

The span completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22974

Mention suggestion insertion: saved mention annotation includes following prose · case 04

The span completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22975

Mention suggestion insertion: saved mention annotation includes following prose · case 05

The span completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22976

Mention suggestion insertion: mention response can target a superseded trigger span · case 01

The stale completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22977

Mention suggestion insertion: mention response can target a superseded trigger span · case 02

The stale completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22978

Mention suggestion insertion: mention response can target a superseded trigger span · case 03

The stale completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22979

Mention suggestion insertion: mention response can target a superseded trigger span · case 04

The stale completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22980

Mention suggestion insertion: mention response can target a superseded trigger span · case 05

The stale completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22981

Mention suggestion insertion: mention replacement removes prose following the trigger query · case 01

The tail completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22982

Mention suggestion insertion: mention replacement removes prose following the trigger query · case 02

The tail completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22983

Mention suggestion insertion: mention replacement removes prose following the trigger query · case 03

The tail completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22984

Mention suggestion insertion: mention replacement removes prose following the trigger query · case 04

The tail completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22985

Mention suggestion insertion: mention replacement removes prose following the trigger query · case 05

The tail completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22986

Mention suggestion insertion: mention lookup is accidentally sent to another trigger provider · case 01

The descriptor completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22987

Mention suggestion insertion: mention lookup is accidentally sent to another trigger provider · case 02

The descriptor completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22988

Mention suggestion insertion: mention lookup is accidentally sent to another trigger provider · case 03

The descriptor completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22989

Mention suggestion insertion: mention lookup is accidentally sent to another trigger provider · case 04

The descriptor completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22990

Mention suggestion insertion: mention lookup is accidentally sent to another trigger provider · case 05

The descriptor completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22991

Hierarchical path autocomplete: path request uses the entire typed path as the child scope · case 01

The lookup-parent completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22992

Hierarchical path autocomplete: path request uses the entire typed path as the child scope · case 02

The lookup-parent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22993

Hierarchical path autocomplete: path request uses the entire typed path as the child scope · case 03

The lookup-parent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22994

Hierarchical path autocomplete: path request uses the entire typed path as the child scope · case 04

The lookup-parent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22995

Hierarchical path autocomplete: path request uses the entire typed path as the child scope · case 05

The lookup-parent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22996

Hierarchical path autocomplete: path suggestion matching includes all ancestor segments · case 01

The lookup-query completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22997

Hierarchical path autocomplete: path suggestion matching includes all ancestor segments · case 02

The lookup-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22998

Hierarchical path autocomplete: path suggestion matching includes all ancestor segments · case 03

The lookup-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22999

Hierarchical path autocomplete: path suggestion matching includes all ancestor segments · case 04

The lookup-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23000

Hierarchical path autocomplete: path suggestion matching includes all ancestor segments · case 05

The lookup-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗