FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-8001

Form dirty-field bookkeeping: Newly introduced fields are omitted from dirty tracking · case 01

Newly introduced fields are omitted from dirty tracking.

Form lifecycle● Open access↗
FA-8002

Form dirty-field bookkeeping: Newly introduced fields are omitted from dirty tracking · case 02

Newly introduced fields are omitted from dirty tracking.

Form lifecycle◈ Members↗
FA-8003

Form dirty-field bookkeeping: Newly introduced fields are omitted from dirty tracking · case 03

Newly introduced fields are omitted from dirty tracking.

Form lifecycle◈ Members↗
FA-8004

Form dirty-field bookkeeping: Newly introduced fields are omitted from dirty tracking · case 04

Newly introduced fields are omitted from dirty tracking.

Form lifecycle◈ Members↗
FA-8005

Form dirty-field bookkeeping: Newly introduced fields are omitted from dirty tracking · case 05

Newly introduced fields are omitted from dirty tracking.

Form lifecycle◈ Members↗
FA-8006

Validation message disclosure: Disabled fields expose stale validation errors · case 01

Disabled fields expose stale validation errors.

Form validation● Open access↗
FA-8007

Validation message disclosure: Disabled fields expose stale validation errors · case 02

Disabled fields expose stale validation errors.

Form validation◈ Members↗
FA-8008

Validation message disclosure: Disabled fields expose stale validation errors · case 03

Disabled fields expose stale validation errors.

Form validation◈ Members↗
FA-8009

Validation message disclosure: Disabled fields expose stale validation errors · case 04

Disabled fields expose stale validation errors.

Form validation◈ Members↗
FA-8010

Validation message disclosure: Disabled fields expose stale validation errors · case 05

Disabled fields expose stale validation errors.

Form validation◈ Members↗
FA-8011

Validation message disclosure: Validation in progress presents stale results as final · case 01

Validation in progress presents stale results as final.

Form validation● Open access↗
FA-8012

Validation message disclosure: Validation in progress presents stale results as final · case 02

Validation in progress presents stale results as final.

Form validation◈ Members↗
FA-8013

Validation message disclosure: Validation in progress presents stale results as final · case 03

Validation in progress presents stale results as final.

Form validation◈ Members↗
FA-8014

Validation message disclosure: Validation in progress presents stale results as final · case 04

Validation in progress presents stale results as final.

Form validation◈ Members↗
FA-8015

Validation message disclosure: Validation in progress presents stale results as final · case 05

Validation in progress presents stale results as final.

Form validation◈ Members↗
FA-8016

Validation message disclosure: An explicit empty error is treated as successful validation · case 01

An explicit empty error is treated as successful validation.

Form validation● Open access↗
FA-8017

Validation message disclosure: An explicit empty error is treated as successful validation · case 02

An explicit empty error is treated as successful validation.

Form validation◈ Members↗
FA-8018

Validation message disclosure: An explicit empty error is treated as successful validation · case 03

An explicit empty error is treated as successful validation.

Form validation◈ Members↗
FA-8019

Validation message disclosure: An explicit empty error is treated as successful validation · case 04

An explicit empty error is treated as successful validation.

Form validation◈ Members↗
FA-8020

Validation message disclosure: An explicit empty error is treated as successful validation · case 05

An explicit empty error is treated as successful validation.

Form validation◈ Members↗
FA-8021

Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 01

Submitting fails to reveal untouched invalid fields.

Form validation● Open access↗
FA-8022

Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 02

Submitting fails to reveal untouched invalid fields.

Form validation◈ Members↗
FA-8023

Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 03

Submitting fails to reveal untouched invalid fields.

Form validation◈ Members↗
FA-8024

Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 04

Submitting fails to reveal untouched invalid fields.

Form validation◈ Members↗
FA-8025

Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 05

Submitting fails to reveal untouched invalid fields.

Form validation◈ Members↗
FA-8026

Validation message disclosure: Pristine invalid fields expose errors before interaction · case 01

Pristine invalid fields expose errors before interaction.

Form validation● Open access↗
FA-8027

Validation message disclosure: Pristine invalid fields expose errors before interaction · case 02

Pristine invalid fields expose errors before interaction.

Form validation◈ Members↗
FA-8028

Validation message disclosure: Pristine invalid fields expose errors before interaction · case 03

Pristine invalid fields expose errors before interaction.

Form validation◈ Members↗
FA-8029

Validation message disclosure: Pristine invalid fields expose errors before interaction · case 04

Pristine invalid fields expose errors before interaction.

Form validation◈ Members↗
FA-8030

Validation message disclosure: Pristine invalid fields expose errors before interaction · case 05

Pristine invalid fields expose errors before interaction.

Form validation◈ Members↗
FA-8031

Undo stack transitions: An unchanged edit creates an undo step and destroys redo · case 01

An unchanged edit creates an undo step and destroys redo.

Undo and history● Open access↗
FA-8032

Undo stack transitions: An unchanged edit creates an undo step and destroys redo · case 02

An unchanged edit creates an undo step and destroys redo.

Undo and history◈ Members↗
FA-8033

Undo stack transitions: An unchanged edit creates an undo step and destroys redo · case 03

An unchanged edit creates an undo step and destroys redo.

Undo and history◈ Members↗
FA-8034

Undo stack transitions: An unchanged edit creates an undo step and destroys redo · case 04

An unchanged edit creates an undo step and destroys redo.

Undo and history◈ Members↗
FA-8035

Undo stack transitions: An unchanged edit creates an undo step and destroys redo · case 05

An unchanged edit creates an undo step and destroys redo.

Undo and history◈ Members↗
FA-8036

Undo stack transitions: Editing after undo retains an invalid redo branch · case 01

Editing after undo retains an invalid redo branch.

Undo and history● Open access↗
FA-8037

Undo stack transitions: Editing after undo retains an invalid redo branch · case 02

Editing after undo retains an invalid redo branch.

Undo and history◈ Members↗
FA-8038

Undo stack transitions: Editing after undo retains an invalid redo branch · case 03

Editing after undo retains an invalid redo branch.

Undo and history◈ Members↗
FA-8039

Undo stack transitions: Editing after undo retains an invalid redo branch · case 04

Editing after undo retains an invalid redo branch.

Undo and history◈ Members↗
FA-8040

Undo stack transitions: Editing after undo retains an invalid redo branch · case 05

Editing after undo retains an invalid redo branch.

Undo and history◈ Members↗
FA-8041

Undo stack transitions: Undo leaves the restored state on the undo stack · case 01

Undo leaves the restored state on the undo stack.

Undo and history● Open access↗
FA-8042

Undo stack transitions: Undo leaves the restored state on the undo stack · case 02

Undo leaves the restored state on the undo stack.

Undo and history◈ Members↗
FA-8043

Undo stack transitions: Undo leaves the restored state on the undo stack · case 03

Undo leaves the restored state on the undo stack.

Undo and history◈ Members↗
FA-8044

Undo stack transitions: Undo leaves the restored state on the undo stack · case 04

Undo leaves the restored state on the undo stack.

Undo and history◈ Members↗
FA-8045

Undo stack transitions: Undo leaves the restored state on the undo stack · case 05

Undo leaves the restored state on the undo stack.

Undo and history◈ Members↗
FA-8046

Undo stack transitions: Undo appends redo states in the wrong order · case 01

Undo appends redo states in the wrong order.

Undo and history● Open access↗
FA-8047

Undo stack transitions: Undo appends redo states in the wrong order · case 02

Undo appends redo states in the wrong order.

Undo and history◈ Members↗
FA-8048

Undo stack transitions: Undo appends redo states in the wrong order · case 03

Undo appends redo states in the wrong order.

Undo and history◈ Members↗
FA-8049

Undo stack transitions: Undo appends redo states in the wrong order · case 04

Undo appends redo states in the wrong order.

Undo and history◈ Members↗
FA-8050

Undo stack transitions: Undo appends redo states in the wrong order · case 05

Undo appends redo states in the wrong order.

Undo and history◈ Members↗
FA-8051

Undo stack transitions: Redo omits the state needed for a subsequent undo · case 01

Redo omits the state needed for a subsequent undo.

Undo and history● Open access↗
FA-8052

Undo stack transitions: Redo omits the state needed for a subsequent undo · case 02

Redo omits the state needed for a subsequent undo.

Undo and history◈ Members↗
FA-8053

Undo stack transitions: Redo omits the state needed for a subsequent undo · case 03

Redo omits the state needed for a subsequent undo.

Undo and history◈ Members↗
FA-8054

Undo stack transitions: Redo omits the state needed for a subsequent undo · case 04

Redo omits the state needed for a subsequent undo.

Undo and history◈ Members↗
FA-8055

Undo stack transitions: Redo omits the state needed for a subsequent undo · case 05

Redo omits the state needed for a subsequent undo.

Undo and history◈ Members↗
FA-8056

Browser-style history transitions: Push preserves a forward branch after navigating back · case 01

Push preserves a forward branch after navigating back.

Client navigation● Open access↗
FA-8057

Browser-style history transitions: Push preserves a forward branch after navigating back · case 02

Push preserves a forward branch after navigating back.

Client navigation◈ Members↗
FA-8058

Browser-style history transitions: Push preserves a forward branch after navigating back · case 03

Push preserves a forward branch after navigating back.

Client navigation◈ Members↗
FA-8059

Browser-style history transitions: Push preserves a forward branch after navigating back · case 04

Push preserves a forward branch after navigating back.

Client navigation◈ Members↗
FA-8060

Browser-style history transitions: Push preserves a forward branch after navigating back · case 05

Push preserves a forward branch after navigating back.

Client navigation◈ Members↗
FA-8061

Browser-style history transitions: A pushed page is not selected as the current location · case 01

A pushed page is not selected as the current location.

Client navigation● Open access↗
FA-8062

Browser-style history transitions: A pushed page is not selected as the current location · case 02

A pushed page is not selected as the current location.

Client navigation◈ Members↗
FA-8063

Browser-style history transitions: A pushed page is not selected as the current location · case 03

A pushed page is not selected as the current location.

Client navigation◈ Members↗
FA-8064

Browser-style history transitions: A pushed page is not selected as the current location · case 04

A pushed page is not selected as the current location.

Client navigation◈ Members↗
FA-8065

Browser-style history transitions: A pushed page is not selected as the current location · case 05

A pushed page is not selected as the current location.

Client navigation◈ Members↗
FA-8066

Browser-style history transitions: Replace adds a history entry instead of updating current · case 01

Replace adds a history entry instead of updating current.

Client navigation● Open access↗
FA-8067

Browser-style history transitions: Replace adds a history entry instead of updating current · case 02

Replace adds a history entry instead of updating current.

Client navigation◈ Members↗
FA-8068

Browser-style history transitions: Replace adds a history entry instead of updating current · case 03

Replace adds a history entry instead of updating current.

Client navigation◈ Members↗
FA-8069

Browser-style history transitions: Replace adds a history entry instead of updating current · case 04

Replace adds a history entry instead of updating current.

Client navigation◈ Members↗
FA-8070

Browser-style history transitions: Replace adds a history entry instead of updating current · case 05

Replace adds a history entry instead of updating current.

Client navigation◈ Members↗
FA-8071

Browser-style history transitions: Back navigates before the first entry · case 01

Back navigates before the first entry.

Client navigation● Open access↗
FA-8072

Browser-style history transitions: Back navigates before the first entry · case 02

Back navigates before the first entry.

Client navigation◈ Members↗
FA-8073

Browser-style history transitions: Back navigates before the first entry · case 03

Back navigates before the first entry.

Client navigation◈ Members↗
FA-8074

Browser-style history transitions: Back navigates before the first entry · case 04

Back navigates before the first entry.

Client navigation◈ Members↗
FA-8075

Browser-style history transitions: Back navigates before the first entry · case 05

Back navigates before the first entry.

Client navigation◈ Members↗
FA-8076

Browser-style history transitions: Forward navigates beyond the last entry · case 01

Forward navigates beyond the last entry.

Client navigation● Open access↗
FA-8077

Browser-style history transitions: Forward navigates beyond the last entry · case 02

Forward navigates beyond the last entry.

Client navigation◈ Members↗
FA-8078

Browser-style history transitions: Forward navigates beyond the last entry · case 03

Forward navigates beyond the last entry.

Client navigation◈ Members↗
FA-8079

Browser-style history transitions: Forward navigates beyond the last entry · case 04

Forward navigates beyond the last entry.

Client navigation◈ Members↗
FA-8080

Browser-style history transitions: Forward navigates beyond the last entry · case 05

Forward navigates beyond the last entry.

Client navigation◈ Members↗
FA-8081

Accordion open-panel state: Removed panels retain their expanded state · case 01

Removed panels retain their expanded state.

Disclosure widgets● Open access↗
FA-8082

Accordion open-panel state: Removed panels retain their expanded state · case 02

Removed panels retain their expanded state.

Disclosure widgets◈ Members↗
FA-8083

Accordion open-panel state: Removed panels retain their expanded state · case 03

Removed panels retain their expanded state.

Disclosure widgets◈ Members↗
FA-8084

Accordion open-panel state: Removed panels retain their expanded state · case 04

Removed panels retain their expanded state.

Disclosure widgets◈ Members↗
FA-8085

Accordion open-panel state: Removed panels retain their expanded state · case 05

Removed panels retain their expanded state.

Disclosure widgets◈ Members↗
FA-8086

Accordion open-panel state: An unknown panel clears other open panels · case 01

An unknown panel clears other open panels.

Disclosure widgets● Open access↗
FA-8087

Accordion open-panel state: An unknown panel clears other open panels · case 02

An unknown panel clears other open panels.

Disclosure widgets◈ Members↗
FA-8088

Accordion open-panel state: An unknown panel clears other open panels · case 03

An unknown panel clears other open panels.

Disclosure widgets◈ Members↗
FA-8089

Accordion open-panel state: An unknown panel clears other open panels · case 04

An unknown panel clears other open panels.

Disclosure widgets◈ Members↗
FA-8090

Accordion open-panel state: An unknown panel clears other open panels · case 05

An unknown panel clears other open panels.

Disclosure widgets◈ Members↗
FA-8091

Accordion open-panel state: Noncollapsible panels close on repeated activation · case 01

Noncollapsible panels close on repeated activation.

Disclosure widgets● Open access↗
FA-8092

Accordion open-panel state: Noncollapsible panels close on repeated activation · case 02

Noncollapsible panels close on repeated activation.

Disclosure widgets◈ Members↗
FA-8093

Accordion open-panel state: Noncollapsible panels close on repeated activation · case 03

Noncollapsible panels close on repeated activation.

Disclosure widgets◈ Members↗
FA-8094

Accordion open-panel state: Noncollapsible panels close on repeated activation · case 04

Noncollapsible panels close on repeated activation.

Disclosure widgets◈ Members↗
FA-8095

Accordion open-panel state: Noncollapsible panels close on repeated activation · case 05

Noncollapsible panels close on repeated activation.

Disclosure widgets◈ Members↗
FA-8096

Accordion open-panel state: Opening a second panel in multiple mode closes the first · case 01

Opening a second panel in multiple mode closes the first.

Disclosure widgets● Open access↗
FA-8097

Accordion open-panel state: Opening a second panel in multiple mode closes the first · case 02

Opening a second panel in multiple mode closes the first.

Disclosure widgets◈ Members↗
FA-8098

Accordion open-panel state: Opening a second panel in multiple mode closes the first · case 03

Opening a second panel in multiple mode closes the first.

Disclosure widgets◈ Members↗
FA-8099

Accordion open-panel state: Opening a second panel in multiple mode closes the first · case 04

Opening a second panel in multiple mode closes the first.

Disclosure widgets◈ Members↗
FA-8100

Accordion open-panel state: Opening a second panel in multiple mode closes the first · case 05

Opening a second panel in multiple mode closes the first.

Disclosure widgets◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗