FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-7901

Roving tabindex navigation: Arrow navigation stops at an endpoint instead of wrapping · case 01

Arrow navigation stops at an endpoint instead of wrapping.

Keyboard accessibility● Open access↗
FA-7902

Roving tabindex navigation: Arrow navigation stops at an endpoint instead of wrapping · case 02

Arrow navigation stops at an endpoint instead of wrapping.

Keyboard accessibility◈ Members↗
FA-7903

Roving tabindex navigation: Arrow navigation stops at an endpoint instead of wrapping · case 03

Arrow navigation stops at an endpoint instead of wrapping.

Keyboard accessibility◈ Members↗
FA-7904

Roving tabindex navigation: Arrow navigation stops at an endpoint instead of wrapping · case 04

Arrow navigation stops at an endpoint instead of wrapping.

Keyboard accessibility◈ Members↗
FA-7905

Roving tabindex navigation: Arrow navigation stops at an endpoint instead of wrapping · case 05

Arrow navigation stops at an endpoint instead of wrapping.

Keyboard accessibility◈ Members↗
FA-7906

Text selection replacement: An IME composition is overwritten before commitment · case 01

An IME composition is overwritten before commitment.

Text editing● Open access↗
FA-7907

Text selection replacement: An IME composition is overwritten before commitment · case 02

An IME composition is overwritten before commitment.

Text editing◈ Members↗
FA-7908

Text selection replacement: An IME composition is overwritten before commitment · case 03

An IME composition is overwritten before commitment.

Text editing◈ Members↗
FA-7909

Text selection replacement: An IME composition is overwritten before commitment · case 04

An IME composition is overwritten before commitment.

Text editing◈ Members↗
FA-7910

Text selection replacement: An IME composition is overwritten before commitment · case 05

An IME composition is overwritten before commitment.

Text editing◈ Members↗
FA-7911

Text selection replacement: Backward selections start replacement at the anchor · case 01

Backward selections start replacement at the anchor.

Text editing● Open access↗
FA-7912

Text selection replacement: Backward selections start replacement at the anchor · case 02

Backward selections start replacement at the anchor.

Text editing◈ Members↗
FA-7913

Text selection replacement: Backward selections start replacement at the anchor · case 03

Backward selections start replacement at the anchor.

Text editing◈ Members↗
FA-7914

Text selection replacement: Backward selections start replacement at the anchor · case 04

Backward selections start replacement at the anchor.

Text editing◈ Members↗
FA-7915

Text selection replacement: Backward selections start replacement at the anchor · case 05

Backward selections start replacement at the anchor.

Text editing◈ Members↗
FA-7916

Text selection replacement: Backward selections retain selected suffix text · case 01

Backward selections retain selected suffix text.

Text editing● Open access↗
FA-7917

Text selection replacement: Backward selections retain selected suffix text · case 02

Backward selections retain selected suffix text.

Text editing◈ Members↗
FA-7918

Text selection replacement: Backward selections retain selected suffix text · case 03

Backward selections retain selected suffix text.

Text editing◈ Members↗
FA-7919

Text selection replacement: Backward selections retain selected suffix text · case 04

Backward selections retain selected suffix text.

Text editing◈ Members↗
FA-7920

Text selection replacement: Backward selections retain selected suffix text · case 05

Backward selections retain selected suffix text.

Text editing◈ Members↗
FA-7921

Text selection replacement: Selected text remains after the inserted replacement · case 01

Selected text remains after the inserted replacement.

Text editing● Open access↗
FA-7922

Text selection replacement: Selected text remains after the inserted replacement · case 02

Selected text remains after the inserted replacement.

Text editing◈ Members↗
FA-7923

Text selection replacement: Selected text remains after the inserted replacement · case 03

Selected text remains after the inserted replacement.

Text editing◈ Members↗
FA-7924

Text selection replacement: Selected text remains after the inserted replacement · case 04

Selected text remains after the inserted replacement.

Text editing◈ Members↗
FA-7925

Text selection replacement: Selected text remains after the inserted replacement · case 05

Selected text remains after the inserted replacement.

Text editing◈ Members↗
FA-7926

Text selection replacement: The caret is positioned using the deleted range length · case 01

The caret is positioned using the deleted range length.

Text editing● Open access↗
FA-7927

Text selection replacement: The caret is positioned using the deleted range length · case 02

The caret is positioned using the deleted range length.

Text editing◈ Members↗
FA-7928

Text selection replacement: The caret is positioned using the deleted range length · case 03

The caret is positioned using the deleted range length.

Text editing◈ Members↗
FA-7929

Text selection replacement: The caret is positioned using the deleted range length · case 04

The caret is positioned using the deleted range length.

Text editing◈ Members↗
FA-7930

Text selection replacement: The caret is positioned using the deleted range length · case 05

The caret is positioned using the deleted range length.

Text editing◈ Members↗
FA-7931

Hierarchical checkbox state: Selecting a subtree erases selections outside it · case 01

Selecting a subtree erases selections outside it.

Selection controls● Open access↗
FA-7932

Hierarchical checkbox state: Selecting a subtree erases selections outside it · case 02

Selecting a subtree erases selections outside it.

Selection controls◈ Members↗
FA-7933

Hierarchical checkbox state: Selecting a subtree erases selections outside it · case 03

Selecting a subtree erases selections outside it.

Selection controls◈ Members↗
FA-7934

Hierarchical checkbox state: Selecting a subtree erases selections outside it · case 04

Selecting a subtree erases selections outside it.

Selection controls◈ Members↗
FA-7935

Hierarchical checkbox state: Selecting a subtree erases selections outside it · case 05

Selecting a subtree erases selections outside it.

Selection controls◈ Members↗
FA-7936

Hierarchical checkbox state: Clearing a subtree also clears independent selections · case 01

Clearing a subtree also clears independent selections.

Selection controls● Open access↗
FA-7937

Hierarchical checkbox state: Clearing a subtree also clears independent selections · case 02

Clearing a subtree also clears independent selections.

Selection controls◈ Members↗
FA-7938

Hierarchical checkbox state: Clearing a subtree also clears independent selections · case 03

Clearing a subtree also clears independent selections.

Selection controls◈ Members↗
FA-7939

Hierarchical checkbox state: Clearing a subtree also clears independent selections · case 04

Clearing a subtree also clears independent selections.

Selection controls◈ Members↗
FA-7940

Hierarchical checkbox state: Clearing a subtree also clears independent selections · case 05

Clearing a subtree also clears independent selections.

Selection controls◈ Members↗
FA-7941

Hierarchical checkbox state: Clicking a checked child cannot deselect it · case 01

Clicking a checked child cannot deselect it.

Selection controls● Open access↗
FA-7942

Hierarchical checkbox state: Clicking a checked child cannot deselect it · case 02

Clicking a checked child cannot deselect it.

Selection controls◈ Members↗
FA-7943

Hierarchical checkbox state: Clicking a checked child cannot deselect it · case 03

Clicking a checked child cannot deselect it.

Selection controls◈ Members↗
FA-7944

Hierarchical checkbox state: Clicking a checked child cannot deselect it · case 04

Clicking a checked child cannot deselect it.

Selection controls◈ Members↗
FA-7945

Hierarchical checkbox state: Clicking a checked child cannot deselect it · case 05

Clicking a checked child cannot deselect it.

Selection controls◈ Members↗
FA-7946

Hierarchical checkbox state: Outside selections contaminate the parent indicator · case 01

Outside selections contaminate the parent indicator.

Selection controls● Open access↗
FA-7947

Hierarchical checkbox state: Outside selections contaminate the parent indicator · case 02

Outside selections contaminate the parent indicator.

Selection controls◈ Members↗
FA-7948

Hierarchical checkbox state: Outside selections contaminate the parent indicator · case 03

Outside selections contaminate the parent indicator.

Selection controls◈ Members↗
FA-7949

Hierarchical checkbox state: Outside selections contaminate the parent indicator · case 04

Outside selections contaminate the parent indicator.

Selection controls◈ Members↗
FA-7950

Hierarchical checkbox state: Outside selections contaminate the parent indicator · case 05

Outside selections contaminate the parent indicator.

Selection controls◈ Members↗
FA-7951

Hierarchical checkbox state: Partially selected parents are announced as fully checked · case 01

Partially selected parents are announced as fully checked.

Selection controls● Open access↗
FA-7952

Hierarchical checkbox state: Partially selected parents are announced as fully checked · case 02

Partially selected parents are announced as fully checked.

Selection controls◈ Members↗
FA-7953

Hierarchical checkbox state: Partially selected parents are announced as fully checked · case 03

Partially selected parents are announced as fully checked.

Selection controls◈ Members↗
FA-7954

Hierarchical checkbox state: Partially selected parents are announced as fully checked · case 04

Partially selected parents are announced as fully checked.

Selection controls◈ Members↗
FA-7955

Hierarchical checkbox state: Partially selected parents are announced as fully checked · case 05

Partially selected parents are announced as fully checked.

Selection controls◈ Members↗
FA-7956

Anchored range selection: Clicking a removed item clears a valid selection · case 01

Clicking a removed item clears a valid selection.

Selection controls● Open access↗
FA-7957

Anchored range selection: Clicking a removed item clears a valid selection · case 02

Clicking a removed item clears a valid selection.

Selection controls◈ Members↗
FA-7958

Anchored range selection: Clicking a removed item clears a valid selection · case 03

Clicking a removed item clears a valid selection.

Selection controls◈ Members↗
FA-7959

Anchored range selection: Clicking a removed item clears a valid selection · case 04

Clicking a removed item clears a valid selection.

Selection controls◈ Members↗
FA-7960

Anchored range selection: Clicking a removed item clears a valid selection · case 05

Clicking a removed item clears a valid selection.

Selection controls◈ Members↗
FA-7961

Anchored range selection: An ordinary click unexpectedly extends from the old anchor · case 01

An ordinary click unexpectedly extends from the old anchor.

Selection controls● Open access↗
FA-7962

Anchored range selection: An ordinary click unexpectedly extends from the old anchor · case 02

An ordinary click unexpectedly extends from the old anchor.

Selection controls◈ Members↗
FA-7963

Anchored range selection: An ordinary click unexpectedly extends from the old anchor · case 03

An ordinary click unexpectedly extends from the old anchor.

Selection controls◈ Members↗
FA-7964

Anchored range selection: An ordinary click unexpectedly extends from the old anchor · case 04

An ordinary click unexpectedly extends from the old anchor.

Selection controls◈ Members↗
FA-7965

Anchored range selection: An ordinary click unexpectedly extends from the old anchor · case 05

An ordinary click unexpectedly extends from the old anchor.

Selection controls◈ Members↗
FA-7966

Anchored range selection: Backward shift selection produces an empty range · case 01

Backward shift selection produces an empty range.

Selection controls● Open access↗
FA-7967

Anchored range selection: Backward shift selection produces an empty range · case 02

Backward shift selection produces an empty range.

Selection controls◈ Members↗
FA-7968

Anchored range selection: Backward shift selection produces an empty range · case 03

Backward shift selection produces an empty range.

Selection controls◈ Members↗
FA-7969

Anchored range selection: Backward shift selection produces an empty range · case 04

Backward shift selection produces an empty range.

Selection controls◈ Members↗
FA-7970

Anchored range selection: Backward shift selection produces an empty range · case 05

Backward shift selection produces an empty range.

Selection controls◈ Members↗
FA-7971

Anchored range selection: The clicked endpoint is excluded from range selection · case 01

The clicked endpoint is excluded from range selection.

Selection controls● Open access↗
FA-7972

Anchored range selection: The clicked endpoint is excluded from range selection · case 02

The clicked endpoint is excluded from range selection.

Selection controls◈ Members↗
FA-7973

Anchored range selection: The clicked endpoint is excluded from range selection · case 03

The clicked endpoint is excluded from range selection.

Selection controls◈ Members↗
FA-7974

Anchored range selection: The clicked endpoint is excluded from range selection · case 04

The clicked endpoint is excluded from range selection.

Selection controls◈ Members↗
FA-7975

Anchored range selection: The clicked endpoint is excluded from range selection · case 05

The clicked endpoint is excluded from range selection.

Selection controls◈ Members↗
FA-7976

Anchored range selection: Modifier range selection erases prior independent selections · case 01

Modifier range selection erases prior independent selections.

Selection controls● Open access↗
FA-7977

Anchored range selection: Modifier range selection erases prior independent selections · case 02

Modifier range selection erases prior independent selections.

Selection controls◈ Members↗
FA-7978

Anchored range selection: Modifier range selection erases prior independent selections · case 03

Modifier range selection erases prior independent selections.

Selection controls◈ Members↗
FA-7979

Anchored range selection: Modifier range selection erases prior independent selections · case 04

Modifier range selection erases prior independent selections.

Selection controls◈ Members↗
FA-7980

Anchored range selection: Modifier range selection erases prior independent selections · case 05

Modifier range selection erases prior independent selections.

Selection controls◈ Members↗
FA-7981

Form dirty-field bookkeeping: Typing rewrites the baseline instead of the draft · case 01

Typing rewrites the baseline instead of the draft.

Form lifecycle● Open access↗
FA-7982

Form dirty-field bookkeeping: Typing rewrites the baseline instead of the draft · case 02

Typing rewrites the baseline instead of the draft.

Form lifecycle◈ Members↗
FA-7983

Form dirty-field bookkeeping: Typing rewrites the baseline instead of the draft · case 03

Typing rewrites the baseline instead of the draft.

Form lifecycle◈ Members↗
FA-7984

Form dirty-field bookkeeping: Typing rewrites the baseline instead of the draft · case 04

Typing rewrites the baseline instead of the draft.

Form lifecycle◈ Members↗
FA-7985

Form dirty-field bookkeeping: Typing rewrites the baseline instead of the draft · case 05

Typing rewrites the baseline instead of the draft.

Form lifecycle◈ Members↗
FA-7986

Form dirty-field bookkeeping: Reset accepts unsaved edits as the new baseline · case 01

Reset accepts unsaved edits as the new baseline.

Form lifecycle● Open access↗
FA-7987

Form dirty-field bookkeeping: Reset accepts unsaved edits as the new baseline · case 02

Reset accepts unsaved edits as the new baseline.

Form lifecycle◈ Members↗
FA-7988

Form dirty-field bookkeeping: Reset accepts unsaved edits as the new baseline · case 03

Reset accepts unsaved edits as the new baseline.

Form lifecycle◈ Members↗
FA-7989

Form dirty-field bookkeeping: Reset accepts unsaved edits as the new baseline · case 04

Reset accepts unsaved edits as the new baseline.

Form lifecycle◈ Members↗
FA-7990

Form dirty-field bookkeeping: Reset accepts unsaved edits as the new baseline · case 05

Reset accepts unsaved edits as the new baseline.

Form lifecycle◈ Members↗
FA-7991

Form dirty-field bookkeeping: Saving restores stale initial values · case 01

Saving restores stale initial values.

Form lifecycle● Open access↗
FA-7992

Form dirty-field bookkeeping: Saving restores stale initial values · case 02

Saving restores stale initial values.

Form lifecycle◈ Members↗
FA-7993

Form dirty-field bookkeeping: Saving restores stale initial values · case 03

Saving restores stale initial values.

Form lifecycle◈ Members↗
FA-7994

Form dirty-field bookkeeping: Saving restores stale initial values · case 04

Saving restores stale initial values.

Form lifecycle◈ Members↗
FA-7995

Form dirty-field bookkeeping: Saving restores stale initial values · case 05

Saving restores stale initial values.

Form lifecycle◈ Members↗
FA-7996

Form dirty-field bookkeeping: Removing a field leaves a phantom dirty baseline entry · case 01

Removing a field leaves a phantom dirty baseline entry.

Form lifecycle● Open access↗
FA-7997

Form dirty-field bookkeeping: Removing a field leaves a phantom dirty baseline entry · case 02

Removing a field leaves a phantom dirty baseline entry.

Form lifecycle◈ Members↗
FA-7998

Form dirty-field bookkeeping: Removing a field leaves a phantom dirty baseline entry · case 03

Removing a field leaves a phantom dirty baseline entry.

Form lifecycle◈ Members↗
FA-7999

Form dirty-field bookkeeping: Removing a field leaves a phantom dirty baseline entry · case 04

Removing a field leaves a phantom dirty baseline entry.

Form lifecycle◈ Members↗
FA-8000

Form dirty-field bookkeeping: Removing a field leaves a phantom dirty baseline entry · case 05

Removing a field leaves a phantom dirty baseline entry.

Form lifecycle◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗