FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-53901

Hyperlink destinations lose their fragment identity · case 01

Hyperlink destinations lose their fragment identity.

Accessibility interaction semantics● Open access↗
FA-53902

Hyperlink destinations lose their fragment identity · case 02

Hyperlink destinations lose their fragment identity.

Accessibility interaction semantics◈ Members↗
FA-53903

Hyperlink destinations lose their fragment identity · case 03

Hyperlink destinations lose their fragment identity.

Accessibility interaction semantics◈ Members↗
FA-53904

Hyperlink destinations lose their fragment identity · case 04

Hyperlink destinations lose their fragment identity.

Accessibility interaction semantics◈ Members↗
FA-53905

Hyperlink destinations lose their fragment identity · case 05

Hyperlink destinations lose their fragment identity.

Accessibility interaction semantics◈ Members↗
FA-53906

A singleton semantic reading flow is dropped as already complete · case 01

A singleton semantic reading flow is dropped as already complete.

Accessibility interaction semantics● Open access↗
FA-53907

A singleton semantic reading flow is dropped as already complete · case 02

A singleton semantic reading flow is dropped as already complete.

Accessibility interaction semantics◈ Members↗
FA-53908

A singleton semantic reading flow is dropped as already complete · case 03

A singleton semantic reading flow is dropped as already complete.

Accessibility interaction semantics◈ Members↗
FA-53909

A singleton semantic reading flow is dropped as already complete · case 04

A singleton semantic reading flow is dropped as already complete.

Accessibility interaction semantics◈ Members↗
FA-53910

A singleton semantic reading flow is dropped as already complete · case 05

A singleton semantic reading flow is dropped as already complete.

Accessibility interaction semantics◈ Members↗
FA-53911

Excluded semantic objects enter reading flow · case 01

Excluded semantic objects enter reading flow.

Accessibility interaction semantics● Open access↗
FA-53912

Excluded semantic objects enter reading flow · case 02

Excluded semantic objects enter reading flow.

Accessibility interaction semantics◈ Members↗
FA-53913

Excluded semantic objects enter reading flow · case 03

Excluded semantic objects enter reading flow.

Accessibility interaction semantics◈ Members↗
FA-53914

Excluded semantic objects enter reading flow · case 04

Excluded semantic objects enter reading flow.

Accessibility interaction semantics◈ Members↗
FA-53915

Excluded semantic objects enter reading flow · case 05

Excluded semantic objects enter reading flow.

Accessibility interaction semantics◈ Members↗
FA-53916

Reading flow reaches nonexisting semantic targets · case 01

Reading flow reaches nonexisting semantic targets.

Accessibility interaction semantics● Open access↗
FA-53917

Reading flow reaches nonexisting semantic targets · case 02

Reading flow reaches nonexisting semantic targets.

Accessibility interaction semantics◈ Members↗
FA-53918

Reading flow reaches nonexisting semantic targets · case 03

Reading flow reaches nonexisting semantic targets.

Accessibility interaction semantics◈ Members↗
FA-53919

Reading flow reaches nonexisting semantic targets · case 04

Reading flow reaches nonexisting semantic targets.

Accessibility interaction semantics◈ Members↗
FA-53920

Reading flow reaches nonexisting semantic targets · case 05

Reading flow reaches nonexisting semantic targets.

Accessibility interaction semantics◈ Members↗
FA-53921

Later reading-flow declarations replace the first override · case 01

Later reading-flow declarations replace the first override.

Accessibility interaction semantics● Open access↗
FA-53922

Later reading-flow declarations replace the first override · case 02

Later reading-flow declarations replace the first override.

Accessibility interaction semantics◈ Members↗
FA-53923

Later reading-flow declarations replace the first override · case 03

Later reading-flow declarations replace the first override.

Accessibility interaction semantics◈ Members↗
FA-53924

Later reading-flow declarations replace the first override · case 04

Later reading-flow declarations replace the first override.

Accessibility interaction semantics◈ Members↗
FA-53925

Later reading-flow declarations replace the first override · case 05

Later reading-flow declarations replace the first override.

Accessibility interaction semantics◈ Members↗
FA-53926

Reading-flow start ignores the requested semantic object · case 01

Reading-flow start ignores the requested semantic object.

Accessibility interaction semantics● Open access↗
FA-53927

Reading-flow start ignores the requested semantic object · case 02

Reading-flow start ignores the requested semantic object.

Accessibility interaction semantics◈ Members↗
FA-53928

Reading-flow start ignores the requested semantic object · case 03

Reading-flow start ignores the requested semantic object.

Accessibility interaction semantics◈ Members↗
FA-53929

Reading-flow start ignores the requested semantic object · case 04

Reading-flow start ignores the requested semantic object.

Accessibility interaction semantics◈ Members↗
FA-53930

Reading-flow start ignores the requested semantic object · case 05

Reading-flow start ignores the requested semantic object.

Accessibility interaction semantics◈ Members↗
FA-53931

Unlinked reading flow uses lexical order · case 01

Unlinked reading flow uses lexical order.

Accessibility interaction semantics● Open access↗
FA-53932

Unlinked reading flow uses lexical order · case 02

Unlinked reading flow uses lexical order.

Accessibility interaction semantics◈ Members↗
FA-53933

Unlinked reading flow uses lexical order · case 03

Unlinked reading flow uses lexical order.

Accessibility interaction semantics◈ Members↗
FA-53934

Unlinked reading flow uses lexical order · case 04

Unlinked reading flow uses lexical order.

Accessibility interaction semantics◈ Members↗
FA-53935

Unlinked reading flow uses lexical order · case 05

Unlinked reading flow uses lexical order.

Accessibility interaction semantics◈ Members↗
FA-53936

Starting late drops earlier objects from reading order · case 01

Starting late drops earlier objects from reading order.

Accessibility interaction semantics● Open access↗
FA-53937

Starting late drops earlier objects from reading order · case 02

Starting late drops earlier objects from reading order.

Accessibility interaction semantics◈ Members↗
FA-53938

Starting late drops earlier objects from reading order · case 03

Starting late drops earlier objects from reading order.

Accessibility interaction semantics◈ Members↗
FA-53939

Starting late drops earlier objects from reading order · case 04

Starting late drops earlier objects from reading order.

Accessibility interaction semantics◈ Members↗
FA-53940

Starting late drops earlier objects from reading order · case 05

Starting late drops earlier objects from reading order.

Accessibility interaction semantics◈ Members↗
FA-53941

Empty but valid object identifiers terminate reading flow · case 01

Empty but valid object identifiers terminate reading flow.

Accessibility interaction semantics● Open access↗
FA-53942

Empty but valid object identifiers terminate reading flow · case 02

Empty but valid object identifiers terminate reading flow.

Accessibility interaction semantics◈ Members↗
FA-53943

Empty but valid object identifiers terminate reading flow · case 03

Empty but valid object identifiers terminate reading flow.

Accessibility interaction semantics◈ Members↗
FA-53944

Empty but valid object identifiers terminate reading flow · case 04

Empty but valid object identifiers terminate reading flow.

Accessibility interaction semantics◈ Members↗
FA-53945

Empty but valid object identifiers terminate reading flow · case 05

Empty but valid object identifiers terminate reading flow.

Accessibility interaction semantics◈ Members↗
FA-53946

A reading-flow cycle truncates unrelated remaining objects · case 01

A reading-flow cycle truncates unrelated remaining objects.

Accessibility interaction semantics● Open access↗
FA-53947

A reading-flow cycle truncates unrelated remaining objects · case 02

A reading-flow cycle truncates unrelated remaining objects.

Accessibility interaction semantics◈ Members↗
FA-53948

A reading-flow cycle truncates unrelated remaining objects · case 03

A reading-flow cycle truncates unrelated remaining objects.

Accessibility interaction semantics◈ Members↗
FA-53949

A reading-flow cycle truncates unrelated remaining objects · case 04

A reading-flow cycle truncates unrelated remaining objects.

Accessibility interaction semantics◈ Members↗
FA-53950

A reading-flow cycle truncates unrelated remaining objects · case 05

A reading-flow cycle truncates unrelated remaining objects.

Accessibility interaction semantics◈ Members↗
FA-53951

Current semantic object is omitted from traversal output · case 01

Current semantic object is omitted from traversal output.

Accessibility interaction semantics● Open access↗
FA-53952

Current semantic object is omitted from traversal output · case 02

Current semantic object is omitted from traversal output.

Accessibility interaction semantics◈ Members↗
FA-53953

Current semantic object is omitted from traversal output · case 03

Current semantic object is omitted from traversal output.

Accessibility interaction semantics◈ Members↗
FA-53954

Current semantic object is omitted from traversal output · case 04

Current semantic object is omitted from traversal output.

Accessibility interaction semantics◈ Members↗
FA-53955

Current semantic object is omitted from traversal output · case 05

Current semantic object is omitted from traversal output.

Accessibility interaction semantics◈ Members↗
FA-53956

Outdated semantic property updates overwrite current values · case 01

Outdated semantic property updates overwrite current values.

Accessibility interaction semantics● Open access↗
FA-53957

Outdated semantic property updates overwrite current values · case 02

Outdated semantic property updates overwrite current values.

Accessibility interaction semantics◈ Members↗
FA-53958

Outdated semantic property updates overwrite current values · case 03

Outdated semantic property updates overwrite current values.

Accessibility interaction semantics◈ Members↗
FA-53959

Outdated semantic property updates overwrite current values · case 04

Outdated semantic property updates overwrite current values.

Accessibility interaction semantics◈ Members↗
FA-53960

Outdated semantic property updates overwrite current values · case 05

Outdated semantic property updates overwrite current values.

Accessibility interaction semantics◈ Members↗
FA-53961

Nonadvancing accessibility revisions are accepted · case 01

Nonadvancing accessibility revisions are accepted.

Accessibility interaction semantics● Open access↗
FA-53962

Nonadvancing accessibility revisions are accepted · case 02

Nonadvancing accessibility revisions are accepted.

Accessibility interaction semantics◈ Members↗
FA-53963

Nonadvancing accessibility revisions are accepted · case 03

Nonadvancing accessibility revisions are accepted.

Accessibility interaction semantics◈ Members↗
FA-53964

Nonadvancing accessibility revisions are accepted · case 04

Nonadvancing accessibility revisions are accepted.

Accessibility interaction semantics◈ Members↗
FA-53965

Nonadvancing accessibility revisions are accepted · case 05

Nonadvancing accessibility revisions are accepted.

Accessibility interaction semantics◈ Members↗
FA-53966

Patch updates alter stable accessibility object identifiers · case 01

Patch updates alter stable accessibility object identifiers.

Accessibility interaction semantics● Open access↗
FA-53967

Patch updates alter stable accessibility object identifiers · case 02

Patch updates alter stable accessibility object identifiers.

Accessibility interaction semantics◈ Members↗
FA-53968

Patch updates alter stable accessibility object identifiers · case 03

Patch updates alter stable accessibility object identifiers.

Accessibility interaction semantics◈ Members↗
FA-53969

Patch updates alter stable accessibility object identifiers · case 04

Patch updates alter stable accessibility object identifiers.

Accessibility interaction semantics◈ Members↗
FA-53970

Patch updates alter stable accessibility object identifiers · case 05

Patch updates alter stable accessibility object identifiers.

Accessibility interaction semantics◈ Members↗
FA-53971

A property-only patch changes the object interface role · case 01

A property-only patch changes the object interface role.

Accessibility interaction semantics● Open access↗
FA-53972

A property-only patch changes the object interface role · case 02

A property-only patch changes the object interface role.

Accessibility interaction semantics◈ Members↗
FA-53973

A property-only patch changes the object interface role · case 03

A property-only patch changes the object interface role.

Accessibility interaction semantics◈ Members↗
FA-53974

A property-only patch changes the object interface role · case 04

A property-only patch changes the object interface role.

Accessibility interaction semantics◈ Members↗
FA-53975

A property-only patch changes the object interface role · case 05

A property-only patch changes the object interface role.

Accessibility interaction semantics◈ Members↗
FA-53976

Unknown accessibility keys bypass atomic patch rejection · case 01

Unknown accessibility keys bypass atomic patch rejection.

Accessibility interaction semantics● Open access↗
FA-53977

Unknown accessibility keys bypass atomic patch rejection · case 02

Unknown accessibility keys bypass atomic patch rejection.

Accessibility interaction semantics◈ Members↗
FA-53978

Unknown accessibility keys bypass atomic patch rejection · case 03

Unknown accessibility keys bypass atomic patch rejection.

Accessibility interaction semantics◈ Members↗
FA-53979

Unknown accessibility keys bypass atomic patch rejection · case 04

Unknown accessibility keys bypass atomic patch rejection.

Accessibility interaction semantics◈ Members↗
FA-53980

Unknown accessibility keys bypass atomic patch rejection · case 05

Unknown accessibility keys bypass atomic patch rejection.

Accessibility interaction semantics◈ Members↗
FA-53981

Nontext semantic values enter the string property bridge · case 01

Nontext semantic values enter the string property bridge.

Accessibility interaction semantics● Open access↗
FA-53982

Nontext semantic values enter the string property bridge · case 02

Nontext semantic values enter the string property bridge.

Accessibility interaction semantics◈ Members↗
FA-53983

Nontext semantic values enter the string property bridge · case 03

Nontext semantic values enter the string property bridge.

Accessibility interaction semantics◈ Members↗
FA-53984

Nontext semantic values enter the string property bridge · case 04

Nontext semantic values enter the string property bridge.

Accessibility interaction semantics◈ Members↗
FA-53985

Nontext semantic values enter the string property bridge · case 05

Nontext semantic values enter the string property bridge.

Accessibility interaction semantics◈ Members↗
FA-53986

Removed semantic properties remain as explicit nulls · case 01

Removed semantic properties remain as explicit nulls.

Accessibility interaction semantics● Open access↗
FA-53987

Removed semantic properties remain as explicit nulls · case 02

Removed semantic properties remain as explicit nulls.

Accessibility interaction semantics◈ Members↗
FA-53988

Removed semantic properties remain as explicit nulls · case 03

Removed semantic properties remain as explicit nulls.

Accessibility interaction semantics◈ Members↗
FA-53989

Removed semantic properties remain as explicit nulls · case 04

Removed semantic properties remain as explicit nulls.

Accessibility interaction semantics◈ Members↗
FA-53990

Removed semantic properties remain as explicit nulls · case 05

Removed semantic properties remain as explicit nulls.

Accessibility interaction semantics◈ Members↗
FA-53991

Intentional empty semantic properties are discarded · case 01

Intentional empty semantic properties are discarded.

Accessibility interaction semantics● Open access↗
FA-53992

Intentional empty semantic properties are discarded · case 02

Intentional empty semantic properties are discarded.

Accessibility interaction semantics◈ Members↗
FA-53993

Intentional empty semantic properties are discarded · case 03

Intentional empty semantic properties are discarded.

Accessibility interaction semantics◈ Members↗
FA-53994

Intentional empty semantic properties are discarded · case 04

Intentional empty semantic properties are discarded.

Accessibility interaction semantics◈ Members↗
FA-53995

Intentional empty semantic properties are discarded · case 05

Intentional empty semantic properties are discarded.

Accessibility interaction semantics◈ Members↗
FA-53996

An empty semantic patch fails to advance revision · case 01

An empty semantic patch fails to advance revision.

Accessibility interaction semantics● Open access↗
FA-53997

An empty semantic patch fails to advance revision · case 02

An empty semantic patch fails to advance revision.

Accessibility interaction semantics◈ Members↗
FA-53998

An empty semantic patch fails to advance revision · case 03

An empty semantic patch fails to advance revision.

Accessibility interaction semantics◈ Members↗
FA-53999

An empty semantic patch fails to advance revision · case 04

An empty semantic patch fails to advance revision.

Accessibility interaction semantics◈ Members↗
FA-54000

An empty semantic patch fails to advance revision · case 05

An empty semantic patch fails to advance revision.

Accessibility interaction semantics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗