FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-53801

New attribute runs start with an empty interval · case 01

New attribute runs start with an empty interval.

Accessibility interaction semantics● Open access↗
FA-53802

New attribute runs start with an empty interval · case 02

New attribute runs start with an empty interval.

Accessibility interaction semantics◈ Members↗
FA-53803

New attribute runs start with an empty interval · case 03

New attribute runs start with an empty interval.

Accessibility interaction semantics◈ Members↗
FA-53804

New attribute runs start with an empty interval · case 04

New attribute runs start with an empty interval.

Accessibility interaction semantics◈ Members↗
FA-53805

New attribute runs start with an empty interval · case 05

New attribute runs start with an empty interval.

Accessibility interaction semantics◈ Members↗
FA-53806

Unexposed inline objects enter accessible text · case 01

Unexposed inline objects enter accessible text.

Accessibility interaction semantics● Open access↗
FA-53807

Unexposed inline objects enter accessible text · case 02

Unexposed inline objects enter accessible text.

Accessibility interaction semantics◈ Members↗
FA-53808

Unexposed inline objects enter accessible text · case 03

Unexposed inline objects enter accessible text.

Accessibility interaction semantics◈ Members↗
FA-53809

Unexposed inline objects enter accessible text · case 04

Unexposed inline objects enter accessible text.

Accessibility interaction semantics◈ Members↗
FA-53810

Unexposed inline objects enter accessible text · case 05

Unexposed inline objects enter accessible text.

Accessibility interaction semantics◈ Members↗
FA-53811

Decorative text tokens consume accessibility offsets · case 01

Decorative text tokens consume accessibility offsets.

Accessibility interaction semantics● Open access↗
FA-53812

Decorative text tokens consume accessibility offsets · case 02

Decorative text tokens consume accessibility offsets.

Accessibility interaction semantics◈ Members↗
FA-53813

Decorative text tokens consume accessibility offsets · case 03

Decorative text tokens consume accessibility offsets.

Accessibility interaction semantics◈ Members↗
FA-53814

Decorative text tokens consume accessibility offsets · case 04

Decorative text tokens consume accessibility offsets.

Accessibility interaction semantics◈ Members↗
FA-53815

Decorative text tokens consume accessibility offsets · case 05

Decorative text tokens consume accessibility offsets.

Accessibility interaction semantics◈ Members↗
FA-53816

Literal text is trimmed while constructing object offsets · case 01

Literal text is trimmed while constructing object offsets.

Accessibility interaction semantics● Open access↗
FA-53817

Literal text is trimmed while constructing object offsets · case 02

Literal text is trimmed while constructing object offsets.

Accessibility interaction semantics◈ Members↗
FA-53818

Literal text is trimmed while constructing object offsets · case 03

Literal text is trimmed while constructing object offsets.

Accessibility interaction semantics◈ Members↗
FA-53819

Literal text is trimmed while constructing object offsets · case 04

Literal text is trimmed while constructing object offsets.

Accessibility interaction semantics◈ Members↗
FA-53820

Literal text is trimmed while constructing object offsets · case 05

Literal text is trimmed while constructing object offsets.

Accessibility interaction semantics◈ Members↗
FA-53821

Accessible line break tokens disappear from text · case 01

Accessible line break tokens disappear from text.

Accessibility interaction semantics● Open access↗
FA-53822

Accessible line break tokens disappear from text · case 02

Accessible line break tokens disappear from text.

Accessibility interaction semantics◈ Members↗
FA-53823

Accessible line break tokens disappear from text · case 03

Accessible line break tokens disappear from text.

Accessibility interaction semantics◈ Members↗
FA-53824

Accessible line break tokens disappear from text · case 04

Accessible line break tokens disappear from text.

Accessibility interaction semantics◈ Members↗
FA-53825

Accessible line break tokens disappear from text · case 05

Accessible line break tokens disappear from text.

Accessibility interaction semantics◈ Members↗
FA-53826

Object alternatives replace markers even when disabled · case 01

Object alternatives replace markers even when disabled.

Accessibility interaction semantics● Open access↗
FA-53827

Object alternatives replace markers even when disabled · case 02

Object alternatives replace markers even when disabled.

Accessibility interaction semantics◈ Members↗
FA-53828

Object alternatives replace markers even when disabled · case 03

Object alternatives replace markers even when disabled.

Accessibility interaction semantics◈ Members↗
FA-53829

Object alternatives replace markers even when disabled · case 04

Object alternatives replace markers even when disabled.

Accessibility interaction semantics◈ Members↗
FA-53830

Object alternatives replace markers even when disabled · case 05

Object alternatives replace markers even when disabled.

Accessibility interaction semantics◈ Members↗
FA-53831

Empty alternative erases an embedded object position · case 01

Empty alternative erases an embedded object position.

Accessibility interaction semantics● Open access↗
FA-53832

Empty alternative erases an embedded object position · case 02

Empty alternative erases an embedded object position.

Accessibility interaction semantics◈ Members↗
FA-53833

Empty alternative erases an embedded object position · case 03

Empty alternative erases an embedded object position.

Accessibility interaction semantics◈ Members↗
FA-53834

Empty alternative erases an embedded object position · case 04

Empty alternative erases an embedded object position.

Accessibility interaction semantics◈ Members↗
FA-53835

Empty alternative erases an embedded object position · case 05

Empty alternative erases an embedded object position.

Accessibility interaction semantics◈ Members↗
FA-53836

Object starts are measured after the replacement is appended · case 01

Object starts are measured after the replacement is appended.

Accessibility interaction semantics● Open access↗
FA-53837

Object starts are measured after the replacement is appended · case 02

Object starts are measured after the replacement is appended.

Accessibility interaction semantics◈ Members↗
FA-53838

Object starts are measured after the replacement is appended · case 03

Object starts are measured after the replacement is appended.

Accessibility interaction semantics◈ Members↗
FA-53839

Object starts are measured after the replacement is appended · case 04

Object starts are measured after the replacement is appended.

Accessibility interaction semantics◈ Members↗
FA-53840

Object starts are measured after the replacement is appended · case 05

Object starts are measured after the replacement is appended.

Accessibility interaction semantics◈ Members↗
FA-53841

Alternative text spans retain a one-character object extent · case 01

Alternative text spans retain a one-character object extent.

Accessibility interaction semantics● Open access↗
FA-53842

Alternative text spans retain a one-character object extent · case 02

Alternative text spans retain a one-character object extent.

Accessibility interaction semantics◈ Members↗
FA-53843

Alternative text spans retain a one-character object extent · case 03

Alternative text spans retain a one-character object extent.

Accessibility interaction semantics◈ Members↗
FA-53844

Alternative text spans retain a one-character object extent · case 04

Alternative text spans retain a one-character object extent.

Accessibility interaction semantics◈ Members↗
FA-53845

Alternative text spans retain a one-character object extent · case 05

Alternative text spans retain a one-character object extent.

Accessibility interaction semantics◈ Members↗
FA-53846

Inline object IDs use filtered output ordinals · case 01

Inline object IDs use filtered output ordinals.

Accessibility interaction semantics● Open access↗
FA-53847

Inline object IDs use filtered output ordinals · case 02

Inline object IDs use filtered output ordinals.

Accessibility interaction semantics◈ Members↗
FA-53848

Inline object IDs use filtered output ordinals · case 03

Inline object IDs use filtered output ordinals.

Accessibility interaction semantics◈ Members↗
FA-53849

Inline object IDs use filtered output ordinals · case 04

Inline object IDs use filtered output ordinals.

Accessibility interaction semantics◈ Members↗
FA-53850

Inline object IDs use filtered output ordinals · case 05

Inline object IDs use filtered output ordinals.

Accessibility interaction semantics◈ Members↗
FA-53851

Object mappings lose authored alternative text · case 01

Object mappings lose authored alternative text.

Accessibility interaction semantics● Open access↗
FA-53852

Object mappings lose authored alternative text · case 02

Object mappings lose authored alternative text.

Accessibility interaction semantics◈ Members↗
FA-53853

Object mappings lose authored alternative text · case 03

Object mappings lose authored alternative text.

Accessibility interaction semantics◈ Members↗
FA-53854

Object mappings lose authored alternative text · case 04

Object mappings lose authored alternative text.

Accessibility interaction semantics◈ Members↗
FA-53855

Object mappings lose authored alternative text · case 05

Object mappings lose authored alternative text.

Accessibility interaction semantics◈ Members↗
FA-53856

Disabled hyperlinks remain reachable through text interfaces · case 01

Disabled hyperlinks remain reachable through text interfaces.

Accessibility interaction semantics● Open access↗
FA-53857

Disabled hyperlinks remain reachable through text interfaces · case 02

Disabled hyperlinks remain reachable through text interfaces.

Accessibility interaction semantics◈ Members↗
FA-53858

Disabled hyperlinks remain reachable through text interfaces · case 03

Disabled hyperlinks remain reachable through text interfaces.

Accessibility interaction semantics◈ Members↗
FA-53859

Disabled hyperlinks remain reachable through text interfaces · case 04

Disabled hyperlinks remain reachable through text interfaces.

Accessibility interaction semantics◈ Members↗
FA-53860

Disabled hyperlinks remain reachable through text interfaces · case 05

Disabled hyperlinks remain reachable through text interfaces.

Accessibility interaction semantics◈ Members↗
FA-53861

Empty hyperlink targets are represented as valid links · case 01

Empty hyperlink targets are represented as valid links.

Accessibility interaction semantics● Open access↗
FA-53862

Empty hyperlink targets are represented as valid links · case 02

Empty hyperlink targets are represented as valid links.

Accessibility interaction semantics◈ Members↗
FA-53863

Empty hyperlink targets are represented as valid links · case 03

Empty hyperlink targets are represented as valid links.

Accessibility interaction semantics◈ Members↗
FA-53864

Empty hyperlink targets are represented as valid links · case 04

Empty hyperlink targets are represented as valid links.

Accessibility interaction semantics◈ Members↗
FA-53865

Empty hyperlink targets are represented as valid links · case 05

Empty hyperlink targets are represented as valid links.

Accessibility interaction semantics◈ Members↗
FA-53866

Hyperlink offsets begin before document text · case 01

Hyperlink offsets begin before document text.

Accessibility interaction semantics● Open access↗
FA-53867

Hyperlink offsets begin before document text · case 02

Hyperlink offsets begin before document text.

Accessibility interaction semantics◈ Members↗
FA-53868

Hyperlink offsets begin before document text · case 03

Hyperlink offsets begin before document text.

Accessibility interaction semantics◈ Members↗
FA-53869

Hyperlink offsets begin before document text · case 04

Hyperlink offsets begin before document text.

Accessibility interaction semantics◈ Members↗
FA-53870

Hyperlink offsets begin before document text · case 05

Hyperlink offsets begin before document text.

Accessibility interaction semantics◈ Members↗
FA-53871

Hyperlink spans exceed document extent · case 01

Hyperlink spans exceed document extent.

Accessibility interaction semantics● Open access↗
FA-53872

Hyperlink spans exceed document extent · case 02

Hyperlink spans exceed document extent.

Accessibility interaction semantics◈ Members↗
FA-53873

Hyperlink spans exceed document extent · case 03

Hyperlink spans exceed document extent.

Accessibility interaction semantics◈ Members↗
FA-53874

Hyperlink spans exceed document extent · case 04

Hyperlink spans exceed document extent.

Accessibility interaction semantics◈ Members↗
FA-53875

Hyperlink spans exceed document extent · case 05

Hyperlink spans exceed document extent.

Accessibility interaction semantics◈ Members↗
FA-53876

Zero-length hyperlink spans pollute indexed link counts · case 01

Zero-length hyperlink spans pollute indexed link counts.

Accessibility interaction semantics● Open access↗
FA-53877

Zero-length hyperlink spans pollute indexed link counts · case 02

Zero-length hyperlink spans pollute indexed link counts.

Accessibility interaction semantics◈ Members↗
FA-53878

Zero-length hyperlink spans pollute indexed link counts · case 03

Zero-length hyperlink spans pollute indexed link counts.

Accessibility interaction semantics◈ Members↗
FA-53879

Zero-length hyperlink spans pollute indexed link counts · case 04

Zero-length hyperlink spans pollute indexed link counts.

Accessibility interaction semantics◈ Members↗
FA-53880

Zero-length hyperlink spans pollute indexed link counts · case 05

Zero-length hyperlink spans pollute indexed link counts.

Accessibility interaction semantics◈ Members↗
FA-53881

Hyperlink indices follow backend delivery order · case 01

Hyperlink indices follow backend delivery order.

Accessibility interaction semantics● Open access↗
FA-53882

Hyperlink indices follow backend delivery order · case 02

Hyperlink indices follow backend delivery order.

Accessibility interaction semantics◈ Members↗
FA-53883

Hyperlink indices follow backend delivery order · case 03

Hyperlink indices follow backend delivery order.

Accessibility interaction semantics◈ Members↗
FA-53884

Hyperlink indices follow backend delivery order · case 04

Hyperlink indices follow backend delivery order.

Accessibility interaction semantics◈ Members↗
FA-53885

Hyperlink indices follow backend delivery order · case 05

Hyperlink indices follow backend delivery order.

Accessibility interaction semantics◈ Members↗
FA-53886

A wide hyperlink masks a narrower coincident text link · case 01

A wide hyperlink masks a narrower coincident text link.

Accessibility interaction semantics● Open access↗
FA-53887

A wide hyperlink masks a narrower coincident text link · case 02

A wide hyperlink masks a narrower coincident text link.

Accessibility interaction semantics◈ Members↗
FA-53888

A wide hyperlink masks a narrower coincident text link · case 03

A wide hyperlink masks a narrower coincident text link.

Accessibility interaction semantics◈ Members↗
FA-53889

A wide hyperlink masks a narrower coincident text link · case 04

A wide hyperlink masks a narrower coincident text link.

Accessibility interaction semantics◈ Members↗
FA-53890

A wide hyperlink masks a narrower coincident text link · case 05

A wide hyperlink masks a narrower coincident text link.

Accessibility interaction semantics◈ Members↗
FA-53891

Repeated hyperlink IDs yield multiple indexed descriptors · case 01

Repeated hyperlink IDs yield multiple indexed descriptors.

Accessibility interaction semantics● Open access↗
FA-53892

Repeated hyperlink IDs yield multiple indexed descriptors · case 02

Repeated hyperlink IDs yield multiple indexed descriptors.

Accessibility interaction semantics◈ Members↗
FA-53893

Repeated hyperlink IDs yield multiple indexed descriptors · case 03

Repeated hyperlink IDs yield multiple indexed descriptors.

Accessibility interaction semantics◈ Members↗
FA-53894

Repeated hyperlink IDs yield multiple indexed descriptors · case 04

Repeated hyperlink IDs yield multiple indexed descriptors.

Accessibility interaction semantics◈ Members↗
FA-53895

Repeated hyperlink IDs yield multiple indexed descriptors · case 05

Repeated hyperlink IDs yield multiple indexed descriptors.

Accessibility interaction semantics◈ Members↗
FA-53896

Text position at a link end still resolves to that link · case 01

Text position at a link end still resolves to that link.

Accessibility interaction semantics● Open access↗
FA-53897

Text position at a link end still resolves to that link · case 02

Text position at a link end still resolves to that link.

Accessibility interaction semantics◈ Members↗
FA-53898

Text position at a link end still resolves to that link · case 03

Text position at a link end still resolves to that link.

Accessibility interaction semantics◈ Members↗
FA-53899

Text position at a link end still resolves to that link · case 04

Text position at a link end still resolves to that link.

Accessibility interaction semantics◈ Members↗
FA-53900

Text position at a link end still resolves to that link · case 05

Text position at a link end still resolves to that link.

Accessibility interaction semantics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗