FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-22801

Undoable autocomplete acceptance: undo leaves caret at the completed-label end · case 01

The undo-caret completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22802

Undoable autocomplete acceptance: undo leaves caret at the completed-label end · case 02

The undo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22803

Undoable autocomplete acceptance: undo leaves caret at the completed-label end · case 03

The undo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22804

Undoable autocomplete acceptance: undo leaves caret at the completed-label end · case 04

The undo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22805

Undoable autocomplete acceptance: undo leaves caret at the completed-label end · case 05

The undo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22806

Undoable autocomplete acceptance: redo appends completion text onto the old prefix · case 01

The redo-text completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22807

Undoable autocomplete acceptance: redo appends completion text onto the old prefix · case 02

The redo-text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22808

Undoable autocomplete acceptance: redo appends completion text onto the old prefix · case 03

The redo-text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22809

Undoable autocomplete acceptance: redo appends completion text onto the old prefix · case 04

The redo-text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22810

Undoable autocomplete acceptance: redo appends completion text onto the old prefix · case 05

The redo-text completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22811

Undoable autocomplete acceptance: redo restores label without restoring selected identity · case 01

The redo-value completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22812

Undoable autocomplete acceptance: redo restores label without restoring selected identity · case 02

The redo-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22813

Undoable autocomplete acceptance: redo restores label without restoring selected identity · case 03

The redo-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22814

Undoable autocomplete acceptance: redo restores label without restoring selected identity · case 04

The redo-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22815

Undoable autocomplete acceptance: redo restores label without restoring selected identity · case 05

The redo-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22816

Undoable autocomplete acceptance: redo restores the pre-completion caret position · case 01

The redo-caret completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22817

Undoable autocomplete acceptance: redo restores the pre-completion caret position · case 02

The redo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22818

Undoable autocomplete acceptance: redo restores the pre-completion caret position · case 03

The redo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22819

Undoable autocomplete acceptance: redo restores the pre-completion caret position · case 04

The redo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22820

Undoable autocomplete acceptance: redo restores the pre-completion caret position · case 05

The redo-caret completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22821

Undoable autocomplete acceptance: typing after undo preserves an invalid redo completion · case 01

The edit completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22822

Undoable autocomplete acceptance: typing after undo preserves an invalid redo completion · case 02

The edit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22823

Undoable autocomplete acceptance: typing after undo preserves an invalid redo completion · case 03

The edit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22824

Undoable autocomplete acceptance: typing after undo preserves an invalid redo completion · case 04

The edit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22825

Undoable autocomplete acceptance: typing after undo preserves an invalid redo completion · case 05

The edit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22826

Undoable autocomplete acceptance: one acceptance pushes separate text and identity undo entries · case 01

The transaction completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22827

Undoable autocomplete acceptance: one acceptance pushes separate text and identity undo entries · case 02

The transaction completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22828

Undoable autocomplete acceptance: one acceptance pushes separate text and identity undo entries · case 03

The transaction completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22829

Undoable autocomplete acceptance: one acceptance pushes separate text and identity undo entries · case 04

The transaction completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22830

Undoable autocomplete acceptance: one acceptance pushes separate text and identity undo entries · case 05

The transaction completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22831

Undoable autocomplete acceptance: hovering a suggestion creates a completion undo transaction · case 01

The hover completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22832

Undoable autocomplete acceptance: hovering a suggestion creates a completion undo transaction · case 02

The hover completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22833

Undoable autocomplete acceptance: hovering a suggestion creates a completion undo transaction · case 03

The hover completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22834

Undoable autocomplete acceptance: hovering a suggestion creates a completion undo transaction · case 04

The hover completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22835

Undoable autocomplete acceptance: hovering a suggestion creates a completion undo transaction · case 05

The hover completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22836

Undoable autocomplete acceptance: redo eligibility survives a divergent draft edit · case 01

The redo-divergence completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22837

Undoable autocomplete acceptance: redo eligibility survives a divergent draft edit · case 02

The redo-divergence completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22838

Undoable autocomplete acceptance: redo eligibility survives a divergent draft edit · case 03

The redo-divergence completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22839

Undoable autocomplete acceptance: redo eligibility survives a divergent draft edit · case 04

The redo-divergence completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22840

Undoable autocomplete acceptance: redo eligibility survives a divergent draft edit · case 05

The redo-divergence completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22841

Selected suggestion label resolution: label response updates whichever option is now selected · case 01

The identity completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22842

Selected suggestion label resolution: label response updates whichever option is now selected · case 02

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22843

Selected suggestion label resolution: label response updates whichever option is now selected · case 03

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22844

Selected suggestion label resolution: label response updates whichever option is now selected · case 04

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22845

Selected suggestion label resolution: label response updates whichever option is now selected · case 05

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22846

Selected suggestion label resolution: older selection label response is admitted after reselection · case 01

The epoch completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22847

Selected suggestion label resolution: older selection label response is admitted after reselection · case 02

The epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22848

Selected suggestion label resolution: older selection label response is admitted after reselection · case 03

The epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22849

Selected suggestion label resolution: older selection label response is admitted after reselection · case 04

The epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22850

Selected suggestion label resolution: older selection label response is admitted after reselection · case 05

The epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22851

Selected suggestion label resolution: unresolved label clears the selected stable identifier · case 01

The value completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22852

Selected suggestion label resolution: unresolved label clears the selected stable identifier · case 02

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22853

Selected suggestion label resolution: unresolved label clears the selected stable identifier · case 03

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22854

Selected suggestion label resolution: unresolved label clears the selected stable identifier · case 04

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22855

Selected suggestion label resolution: unresolved label clears the selected stable identifier · case 05

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22856

Selected suggestion label resolution: selected-label lookup injects its identifier into search text · case 01

The query completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22857

Selected suggestion label resolution: selected-label lookup injects its identifier into search text · case 02

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22858

Selected suggestion label resolution: selected-label lookup injects its identifier into search text · case 03

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22859

Selected suggestion label resolution: selected-label lookup injects its identifier into search text · case 04

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22860

Selected suggestion label resolution: selected-label lookup injects its identifier into search text · case 05

The query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22861

Selected suggestion label resolution: successful empty label is replaced with an error fallback · case 01

The empty-label completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22862

Selected suggestion label resolution: successful empty label is replaced with an error fallback · case 02

The empty-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22863

Selected suggestion label resolution: successful empty label is replaced with an error fallback · case 03

The empty-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22864

Selected suggestion label resolution: successful empty label is replaced with an error fallback · case 04

The empty-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22865

Selected suggestion label resolution: successful empty label is replaced with an error fallback · case 05

The empty-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22866

Selected suggestion label resolution: failed label resolution presents the raw selected identifier · case 01

The failure completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22867

Selected suggestion label resolution: failed label resolution presents the raw selected identifier · case 02

The failure completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22868

Selected suggestion label resolution: failed label resolution presents the raw selected identifier · case 03

The failure completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22869

Selected suggestion label resolution: failed label resolution presents the raw selected identifier · case 04

The failure completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22870

Selected suggestion label resolution: failed label resolution presents the raw selected identifier · case 05

The failure completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22871

Selected suggestion label resolution: selected-label spinner remains after successful resolution · case 01

The pending completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22872

Selected suggestion label resolution: selected-label spinner remains after successful resolution · case 02

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22873

Selected suggestion label resolution: selected-label spinner remains after successful resolution · case 03

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22874

Selected suggestion label resolution: selected-label spinner remains after successful resolution · case 04

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22875

Selected suggestion label resolution: selected-label spinner remains after successful resolution · case 05

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22876

Selected suggestion label resolution: label lookup request is keyed by current query instead of selection · case 01

The request completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22877

Selected suggestion label resolution: label lookup request is keyed by current query instead of selection · case 02

The request completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22878

Selected suggestion label resolution: label lookup request is keyed by current query instead of selection · case 03

The request completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22879

Selected suggestion label resolution: label lookup request is keyed by current query instead of selection · case 04

The request completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22880

Selected suggestion label resolution: label lookup request is keyed by current query instead of selection · case 05

The request completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22881

Selected suggestion label resolution: successful label lookup preserves the previous resolution failure · case 01

The clear-error completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22882

Selected suggestion label resolution: successful label lookup preserves the previous resolution failure · case 02

The clear-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22883

Selected suggestion label resolution: successful label lookup preserves the previous resolution failure · case 03

The clear-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22884

Selected suggestion label resolution: successful label lookup preserves the previous resolution failure · case 04

The clear-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22885

Selected suggestion label resolution: successful label lookup preserves the previous resolution failure · case 05

The clear-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22886

Selected suggestion label resolution: label lookup result is inserted as a query suggestion · case 01

The separate-rows completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22887

Selected suggestion label resolution: label lookup result is inserted as a query suggestion · case 02

The separate-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22888

Selected suggestion label resolution: label lookup result is inserted as a query suggestion · case 03

The separate-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22889

Selected suggestion label resolution: label lookup result is inserted as a query suggestion · case 04

The separate-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22890

Selected suggestion label resolution: label lookup result is inserted as a query suggestion · case 05

The separate-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22891

External text autofill in autocomplete: external autofill leaves the prior search fragment as the draft · case 01

The draft completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22892

External text autofill in autocomplete: external autofill leaves the prior search fragment as the draft · case 02

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22893

External text autofill in autocomplete: external autofill leaves the prior search fragment as the draft · case 03

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22894

External text autofill in autocomplete: external autofill leaves the prior search fragment as the draft · case 04

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22895

External text autofill in autocomplete: external autofill leaves the prior search fragment as the draft · case 05

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22896

External text autofill in autocomplete: autofill label lookup ignores suggestion eligibility · case 01

The matches completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22897

External text autofill in autocomplete: autofill label lookup ignores suggestion eligibility · case 02

The matches completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22898

External text autofill in autocomplete: autofill label lookup ignores suggestion eligibility · case 03

The matches completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22899

External text autofill in autocomplete: autofill label lookup ignores suggestion eligibility · case 04

The matches completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22900

External text autofill in autocomplete: autofill label lookup ignores suggestion eligibility · case 05

The matches completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗