FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-54701

Line starts are excluded from visual line membership · case 01

Line starts are excluded from visual line membership.

Accessibility interaction semantics● Open access↗
FA-54702

Line starts are excluded from visual line membership · case 02

Line starts are excluded from visual line membership.

Accessibility interaction semantics◈ Members↗
FA-54703

Line starts are excluded from visual line membership · case 03

Line starts are excluded from visual line membership.

Accessibility interaction semantics◈ Members↗
FA-54704

Line starts are excluded from visual line membership · case 04

Line starts are excluded from visual line membership.

Accessibility interaction semantics◈ Members↗
FA-54705

Line starts are excluded from visual line membership · case 05

Line starts are excluded from visual line membership.

Accessibility interaction semantics◈ Members↗
FA-54706

Forward queries include a previous line end in a gap · case 01

Forward queries include a previous line end in a gap.

Accessibility interaction semantics● Open access↗
FA-54707

Forward queries include a previous line end in a gap · case 02

Forward queries include a previous line end in a gap.

Accessibility interaction semantics◈ Members↗
FA-54708

Forward queries include a previous line end in a gap · case 03

Forward queries include a previous line end in a gap.

Accessibility interaction semantics◈ Members↗
FA-54709

Forward queries include a previous line end in a gap · case 04

Forward queries include a previous line end in a gap.

Accessibility interaction semantics◈ Members↗
FA-54710

Forward queries include a previous line end in a gap · case 05

Forward queries include a previous line end in a gap.

Accessibility interaction semantics◈ Members↗
FA-54711

A caret at document end has no visual line · case 01

A caret at document end has no visual line.

Accessibility interaction semantics● Open access↗
FA-54712

A caret at document end has no visual line · case 02

A caret at document end has no visual line.

Accessibility interaction semantics◈ Members↗
FA-54713

A caret at document end has no visual line · case 03

A caret at document end has no visual line.

Accessibility interaction semantics◈ Members↗
FA-54714

A caret at document end has no visual line · case 04

A caret at document end has no visual line.

Accessibility interaction semantics◈ Members↗
FA-54715

A caret at document end has no visual line · case 05

A caret at document end has no visual line.

Accessibility interaction semantics◈ Members↗
FA-54716

Backward affinity selects the following visual line · case 01

Backward affinity selects the following visual line.

Accessibility interaction semantics● Open access↗
FA-54717

Backward affinity selects the following visual line · case 02

Backward affinity selects the following visual line.

Accessibility interaction semantics◈ Members↗
FA-54718

Backward affinity selects the following visual line · case 03

Backward affinity selects the following visual line.

Accessibility interaction semantics◈ Members↗
FA-54719

Backward affinity selects the following visual line · case 04

Backward affinity selects the following visual line.

Accessibility interaction semantics◈ Members↗
FA-54720

Backward affinity selects the following visual line · case 05

Backward affinity selects the following visual line.

Accessibility interaction semantics◈ Members↗
FA-54721

Empty documents omit their sole visual caret line · case 01

Empty documents omit their sole visual caret line.

Accessibility interaction semantics● Open access↗
FA-54722

Empty documents omit their sole visual caret line · case 02

Empty documents omit their sole visual caret line.

Accessibility interaction semantics◈ Members↗
FA-54723

Empty documents omit their sole visual caret line · case 03

Empty documents omit their sole visual caret line.

Accessibility interaction semantics◈ Members↗
FA-54724

Empty documents omit their sole visual caret line · case 04

Empty documents omit their sole visual caret line.

Accessibility interaction semantics◈ Members↗
FA-54725

Empty documents omit their sole visual caret line · case 05

Empty documents omit their sole visual caret line.

Accessibility interaction semantics◈ Members↗
FA-54726

Visual line content omits its final codepoint · case 01

Visual line content omits its final codepoint.

Accessibility interaction semantics● Open access↗
FA-54727

Visual line content omits its final codepoint · case 02

Visual line content omits its final codepoint.

Accessibility interaction semantics◈ Members↗
FA-54728

Visual line content omits its final codepoint · case 03

Visual line content omits its final codepoint.

Accessibility interaction semantics◈ Members↗
FA-54729

Visual line content omits its final codepoint · case 04

Visual line content omits its final codepoint.

Accessibility interaction semantics◈ Members↗
FA-54730

Visual line content omits its final codepoint · case 05

Visual line content omits its final codepoint.

Accessibility interaction semantics◈ Members↗
FA-54731

Visual wrapping is reported as a hard text newline · case 01

Visual wrapping is reported as a hard text newline.

Accessibility interaction semantics● Open access↗
FA-54732

Visual wrapping is reported as a hard text newline · case 02

Visual wrapping is reported as a hard text newline.

Accessibility interaction semantics◈ Members↗
FA-54733

Visual wrapping is reported as a hard text newline · case 03

Visual wrapping is reported as a hard text newline.

Accessibility interaction semantics◈ Members↗
FA-54734

Visual wrapping is reported as a hard text newline · case 04

Visual wrapping is reported as a hard text newline.

Accessibility interaction semantics◈ Members↗
FA-54735

Visual wrapping is reported as a hard text newline · case 05

Visual wrapping is reported as a hard text newline.

Accessibility interaction semantics◈ Members↗
FA-54736

Visual line indices are one-based in a zero-based API · case 01

Visual line indices are one-based in a zero-based API.

Accessibility interaction semantics● Open access↗
FA-54737

Visual line indices are one-based in a zero-based API · case 02

Visual line indices are one-based in a zero-based API.

Accessibility interaction semantics◈ Members↗
FA-54738

Visual line indices are one-based in a zero-based API · case 03

Visual line indices are one-based in a zero-based API.

Accessibility interaction semantics◈ Members↗
FA-54739

Visual line indices are one-based in a zero-based API · case 04

Visual line indices are one-based in a zero-based API.

Accessibility interaction semantics◈ Members↗
FA-54740

Visual line indices are one-based in a zero-based API · case 05

Visual line indices are one-based in a zero-based API.

Accessibility interaction semantics◈ Members↗
FA-54741

Document title loses priority to its URL basename · case 01

Document title loses priority to its URL basename.

Accessibility interaction semantics● Open access↗
FA-54742

Document title loses priority to its URL basename · case 02

Document title loses priority to its URL basename.

Accessibility interaction semantics◈ Members↗
FA-54743

Document title loses priority to its URL basename · case 03

Document title loses priority to its URL basename.

Accessibility interaction semantics◈ Members↗
FA-54744

Document title loses priority to its URL basename · case 04

Document title loses priority to its URL basename.

Accessibility interaction semantics◈ Members↗
FA-54745

Document title loses priority to its URL basename · case 05

Document title loses priority to its URL basename.

Accessibility interaction semantics◈ Members↗
FA-54746

Private document addresses leak into semantic metadata · case 01

Private document addresses leak into semantic metadata.

Accessibility interaction semantics● Open access↗
FA-54747

Private document addresses leak into semantic metadata · case 02

Private document addresses leak into semantic metadata.

Accessibility interaction semantics◈ Members↗
FA-54748

Private document addresses leak into semantic metadata · case 03

Private document addresses leak into semantic metadata.

Accessibility interaction semantics◈ Members↗
FA-54749

Private document addresses leak into semantic metadata · case 04

Private document addresses leak into semantic metadata.

Accessibility interaction semantics◈ Members↗
FA-54750

Private document addresses leak into semantic metadata · case 05

Private document addresses leak into semantic metadata.

Accessibility interaction semantics◈ Members↗
FA-54751

URL query secrets enter the fallback document name · case 01

URL query secrets enter the fallback document name.

Accessibility interaction semantics● Open access↗
FA-54752

URL query secrets enter the fallback document name · case 02

URL query secrets enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54753

URL query secrets enter the fallback document name · case 03

URL query secrets enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54754

URL query secrets enter the fallback document name · case 04

URL query secrets enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54755

URL query secrets enter the fallback document name · case 05

URL query secrets enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54756

Fragment identifiers enter the fallback document name · case 01

Fragment identifiers enter the fallback document name.

Accessibility interaction semantics● Open access↗
FA-54757

Fragment identifiers enter the fallback document name · case 02

Fragment identifiers enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54758

Fragment identifiers enter the fallback document name · case 03

Fragment identifiers enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54759

Fragment identifiers enter the fallback document name · case 04

Fragment identifiers enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54760

Fragment identifiers enter the fallback document name · case 05

Fragment identifiers enter the fallback document name.

Accessibility interaction semantics◈ Members↗
FA-54761

Platform language tags retain underscore separators · case 01

Platform language tags retain underscore separators.

Accessibility interaction semantics● Open access↗
FA-54762

Platform language tags retain underscore separators · case 02

Platform language tags retain underscore separators.

Accessibility interaction semantics◈ Members↗
FA-54763

Platform language tags retain underscore separators · case 03

Platform language tags retain underscore separators.

Accessibility interaction semantics◈ Members↗
FA-54764

Platform language tags retain underscore separators · case 04

Platform language tags retain underscore separators.

Accessibility interaction semantics◈ Members↗
FA-54765

Platform language tags retain underscore separators · case 05

Platform language tags retain underscore separators.

Accessibility interaction semantics◈ Members↗
FA-54766

Content type metadata includes MIME parameter text · case 01

Content type metadata includes MIME parameter text.

Accessibility interaction semantics● Open access↗
FA-54767

Content type metadata includes MIME parameter text · case 02

Content type metadata includes MIME parameter text.

Accessibility interaction semantics◈ Members↗
FA-54768

Content type metadata includes MIME parameter text · case 03

Content type metadata includes MIME parameter text.

Accessibility interaction semantics◈ Members↗
FA-54769

Content type metadata includes MIME parameter text · case 04

Content type metadata includes MIME parameter text.

Accessibility interaction semantics◈ Members↗
FA-54770

Content type metadata includes MIME parameter text · case 05

Content type metadata includes MIME parameter text.

Accessibility interaction semantics◈ Members↗
FA-54771

Completed documents retain stale progress percentages · case 01

Completed documents retain stale progress percentages.

Accessibility interaction semantics● Open access↗
FA-54772

Completed documents retain stale progress percentages · case 02

Completed documents retain stale progress percentages.

Accessibility interaction semantics◈ Members↗
FA-54773

Completed documents retain stale progress percentages · case 03

Completed documents retain stale progress percentages.

Accessibility interaction semantics◈ Members↗
FA-54774

Completed documents retain stale progress percentages · case 04

Completed documents retain stale progress percentages.

Accessibility interaction semantics◈ Members↗
FA-54775

Completed documents retain stale progress percentages · case 05

Completed documents retain stale progress percentages.

Accessibility interaction semantics◈ Members↗
FA-54776

Incomplete document loads report completion at one hundred percent · case 01

Incomplete document loads report completion at one hundred percent.

Accessibility interaction semantics● Open access↗
FA-54777

Incomplete document loads report completion at one hundred percent · case 02

Incomplete document loads report completion at one hundred percent.

Accessibility interaction semantics◈ Members↗
FA-54778

Incomplete document loads report completion at one hundred percent · case 03

Incomplete document loads report completion at one hundred percent.

Accessibility interaction semantics◈ Members↗
FA-54779

Incomplete document loads report completion at one hundred percent · case 04

Incomplete document loads report completion at one hundred percent.

Accessibility interaction semantics◈ Members↗
FA-54780

Incomplete document loads report completion at one hundred percent · case 05

Incomplete document loads report completion at one hundred percent.

Accessibility interaction semantics◈ Members↗
FA-54781

Any nonempty security status is reported as verified · case 01

Any nonempty security status is reported as verified.

Accessibility interaction semantics● Open access↗
FA-54782

Any nonempty security status is reported as verified · case 02

Any nonempty security status is reported as verified.

Accessibility interaction semantics◈ Members↗
FA-54783

Any nonempty security status is reported as verified · case 03

Any nonempty security status is reported as verified.

Accessibility interaction semantics◈ Members↗
FA-54784

Any nonempty security status is reported as verified · case 04

Any nonempty security status is reported as verified.

Accessibility interaction semantics◈ Members↗
FA-54785

Any nonempty security status is reported as verified · case 05

Any nonempty security status is reported as verified.

Accessibility interaction semantics◈ Members↗
FA-54786

Private documents advertise a forbidden copy action · case 01

Private documents advertise a forbidden copy action.

Accessibility interaction semantics● Open access↗
FA-54787

Private documents advertise a forbidden copy action · case 02

Private documents advertise a forbidden copy action.

Accessibility interaction semantics◈ Members↗
FA-54788

Private documents advertise a forbidden copy action · case 03

Private documents advertise a forbidden copy action.

Accessibility interaction semantics◈ Members↗
FA-54789

Private documents advertise a forbidden copy action · case 04

Private documents advertise a forbidden copy action.

Accessibility interaction semantics◈ Members↗
FA-54790

Private documents advertise a forbidden copy action · case 05

Private documents advertise a forbidden copy action.

Accessibility interaction semantics◈ Members↗
FA-54791

Screen hit coordinates are not translated into the native window · case 01

Screen hit coordinates are not translated into the native window.

Accessibility interaction semantics● Open access↗
FA-54792

Screen hit coordinates are not translated into the native window · case 02

Screen hit coordinates are not translated into the native window.

Accessibility interaction semantics◈ Members↗
FA-54793

Screen hit coordinates are not translated into the native window · case 03

Screen hit coordinates are not translated into the native window.

Accessibility interaction semantics◈ Members↗
FA-54794

Screen hit coordinates are not translated into the native window · case 04

Screen hit coordinates are not translated into the native window.

Accessibility interaction semantics◈ Members↗
FA-54795

Screen hit coordinates are not translated into the native window · case 05

Screen hit coordinates are not translated into the native window.

Accessibility interaction semantics◈ Members↗
FA-54796

Semantic hit testing forgets document scroll displacement · case 01

Semantic hit testing forgets document scroll displacement.

Accessibility interaction semantics● Open access↗
FA-54797

Semantic hit testing forgets document scroll displacement · case 02

Semantic hit testing forgets document scroll displacement.

Accessibility interaction semantics◈ Members↗
FA-54798

Semantic hit testing forgets document scroll displacement · case 03

Semantic hit testing forgets document scroll displacement.

Accessibility interaction semantics◈ Members↗
FA-54799

Semantic hit testing forgets document scroll displacement · case 04

Semantic hit testing forgets document scroll displacement.

Accessibility interaction semantics◈ Members↗
FA-54800

Semantic hit testing forgets document scroll displacement · case 05

Semantic hit testing forgets document scroll displacement.

Accessibility interaction semantics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗