FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-8101

Accordion open-panel state: Single-open accordions accumulate expanded panels · case 01

Single-open accordions accumulate expanded panels.

Disclosure widgets● Open access↗
FA-8102

Accordion open-panel state: Single-open accordions accumulate expanded panels · case 02

Single-open accordions accumulate expanded panels.

Disclosure widgets◈ Members↗
FA-8103

Accordion open-panel state: Single-open accordions accumulate expanded panels · case 03

Single-open accordions accumulate expanded panels.

Disclosure widgets◈ Members↗
FA-8104

Accordion open-panel state: Single-open accordions accumulate expanded panels · case 04

Single-open accordions accumulate expanded panels.

Disclosure widgets◈ Members↗
FA-8105

Accordion open-panel state: Single-open accordions accumulate expanded panels · case 05

Single-open accordions accumulate expanded panels.

Disclosure widgets◈ Members↗
FA-8106

Menu item activation: Disabled menu commands still invoke actions · case 01

Disabled menu commands still invoke actions.

Menu interactions● Open access↗
FA-8107

Menu item activation: Disabled menu commands still invoke actions · case 02

Disabled menu commands still invoke actions.

Menu interactions◈ Members↗
FA-8108

Menu item activation: Disabled menu commands still invoke actions · case 03

Disabled menu commands still invoke actions.

Menu interactions◈ Members↗
FA-8109

Menu item activation: Disabled menu commands still invoke actions · case 04

Disabled menu commands still invoke actions.

Menu interactions◈ Members↗
FA-8110

Menu item activation: Disabled menu commands still invoke actions · case 05

Disabled menu commands still invoke actions.

Menu interactions◈ Members↗
FA-8111

Menu item activation: Keyboard activation is not equivalent to clicking · case 01

Keyboard activation is not equivalent to clicking.

Menu interactions● Open access↗
FA-8112

Menu item activation: Keyboard activation is not equivalent to clicking · case 02

Keyboard activation is not equivalent to clicking.

Menu interactions◈ Members↗
FA-8113

Menu item activation: Keyboard activation is not equivalent to clicking · case 03

Keyboard activation is not equivalent to clicking.

Menu interactions◈ Members↗
FA-8114

Menu item activation: Keyboard activation is not equivalent to clicking · case 04

Keyboard activation is not equivalent to clicking.

Menu interactions◈ Members↗
FA-8115

Menu item activation: Keyboard activation is not equivalent to clicking · case 05

Keyboard activation is not equivalent to clicking.

Menu interactions◈ Members↗
FA-8116

Menu item activation: Submenu activation runs a leaf command and closes its parent · case 01

Submenu activation runs a leaf command and closes its parent.

Menu interactions● Open access↗
FA-8117

Menu item activation: Submenu activation runs a leaf command and closes its parent · case 02

Submenu activation runs a leaf command and closes its parent.

Menu interactions◈ Members↗
FA-8118

Menu item activation: Submenu activation runs a leaf command and closes its parent · case 03

Submenu activation runs a leaf command and closes its parent.

Menu interactions◈ Members↗
FA-8119

Menu item activation: Submenu activation runs a leaf command and closes its parent · case 04

Submenu activation runs a leaf command and closes its parent.

Menu interactions◈ Members↗
FA-8120

Menu item activation: Submenu activation runs a leaf command and closes its parent · case 05

Submenu activation runs a leaf command and closes its parent.

Menu interactions◈ Members↗
FA-8121

Menu item activation: Checked menu checkboxes cannot toggle off · case 01

Checked menu checkboxes cannot toggle off.

Menu interactions● Open access↗
FA-8122

Menu item activation: Checked menu checkboxes cannot toggle off · case 02

Checked menu checkboxes cannot toggle off.

Menu interactions◈ Members↗
FA-8123

Menu item activation: Checked menu checkboxes cannot toggle off · case 03

Checked menu checkboxes cannot toggle off.

Menu interactions◈ Members↗
FA-8124

Menu item activation: Checked menu checkboxes cannot toggle off · case 04

Checked menu checkboxes cannot toggle off.

Menu interactions◈ Members↗
FA-8125

Menu item activation: Checked menu checkboxes cannot toggle off · case 05

Checked menu checkboxes cannot toggle off.

Menu interactions◈ Members↗
FA-8126

Menu item activation: Reactivating a selected menu radio clears its selection · case 01

Reactivating a selected menu radio clears its selection.

Menu interactions● Open access↗
FA-8127

Menu item activation: Reactivating a selected menu radio clears its selection · case 02

Reactivating a selected menu radio clears its selection.

Menu interactions◈ Members↗
FA-8128

Menu item activation: Reactivating a selected menu radio clears its selection · case 03

Reactivating a selected menu radio clears its selection.

Menu interactions◈ Members↗
FA-8129

Menu item activation: Reactivating a selected menu radio clears its selection · case 04

Reactivating a selected menu radio clears its selection.

Menu interactions◈ Members↗
FA-8130

Menu item activation: Reactivating a selected menu radio clears its selection · case 05

Reactivating a selected menu radio clears its selection.

Menu interactions◈ Members↗
FA-8131

Combobox keyboard commit: Escape destroys an already committed value · case 01

Escape destroys an already committed value.

Autocomplete interactions● Open access↗
FA-8132

Combobox keyboard commit: Escape destroys an already committed value · case 02

Escape destroys an already committed value.

Autocomplete interactions◈ Members↗
FA-8133

Combobox keyboard commit: Escape destroys an already committed value · case 03

Escape destroys an already committed value.

Autocomplete interactions◈ Members↗
FA-8134

Combobox keyboard commit: Escape destroys an already committed value · case 04

Escape destroys an already committed value.

Autocomplete interactions◈ Members↗
FA-8135

Combobox keyboard commit: Escape destroys an already committed value · case 05

Escape destroys an already committed value.

Autocomplete interactions◈ Members↗
FA-8136

Combobox keyboard commit: Enter commits a stale active suggestion while the popup is closed · case 01

Enter commits a stale active suggestion while the popup is closed.

Autocomplete interactions● Open access↗
FA-8137

Combobox keyboard commit: Enter commits a stale active suggestion while the popup is closed · case 02

Enter commits a stale active suggestion while the popup is closed.

Autocomplete interactions◈ Members↗
FA-8138

Combobox keyboard commit: Enter commits a stale active suggestion while the popup is closed · case 03

Enter commits a stale active suggestion while the popup is closed.

Autocomplete interactions◈ Members↗
FA-8139

Combobox keyboard commit: Enter commits a stale active suggestion while the popup is closed · case 04

Enter commits a stale active suggestion while the popup is closed.

Autocomplete interactions◈ Members↗
FA-8140

Combobox keyboard commit: Enter commits a stale active suggestion while the popup is closed · case 05

Enter commits a stale active suggestion while the popup is closed.

Autocomplete interactions◈ Members↗
FA-8141

Combobox keyboard commit: Tab unexpectedly commits an unconfirmed suggestion · case 01

Tab unexpectedly commits an unconfirmed suggestion.

Autocomplete interactions● Open access↗
FA-8142

Combobox keyboard commit: Tab unexpectedly commits an unconfirmed suggestion · case 02

Tab unexpectedly commits an unconfirmed suggestion.

Autocomplete interactions◈ Members↗
FA-8143

Combobox keyboard commit: Tab unexpectedly commits an unconfirmed suggestion · case 03

Tab unexpectedly commits an unconfirmed suggestion.

Autocomplete interactions◈ Members↗
FA-8144

Combobox keyboard commit: Tab unexpectedly commits an unconfirmed suggestion · case 04

Tab unexpectedly commits an unconfirmed suggestion.

Autocomplete interactions◈ Members↗
FA-8145

Combobox keyboard commit: Tab unexpectedly commits an unconfirmed suggestion · case 05

Tab unexpectedly commits an unconfirmed suggestion.

Autocomplete interactions◈ Members↗
FA-8146

Combobox keyboard commit: Clear erases query text but retains the submitted value · case 01

Clear erases query text but retains the submitted value.

Autocomplete interactions● Open access↗
FA-8147

Combobox keyboard commit: Clear erases query text but retains the submitted value · case 02

Clear erases query text but retains the submitted value.

Autocomplete interactions◈ Members↗
FA-8148

Combobox keyboard commit: Clear erases query text but retains the submitted value · case 03

Clear erases query text but retains the submitted value.

Autocomplete interactions◈ Members↗
FA-8149

Combobox keyboard commit: Clear erases query text but retains the submitted value · case 04

Clear erases query text but retains the submitted value.

Autocomplete interactions◈ Members↗
FA-8150

Combobox keyboard commit: Clear erases query text but retains the submitted value · case 05

Clear erases query text but retains the submitted value.

Autocomplete interactions◈ Members↗
FA-8151

Combobox keyboard commit: Typing does not reveal available suggestions · case 01

Typing does not reveal available suggestions.

Autocomplete interactions● Open access↗
FA-8152

Combobox keyboard commit: Typing does not reveal available suggestions · case 02

Typing does not reveal available suggestions.

Autocomplete interactions◈ Members↗
FA-8153

Combobox keyboard commit: Typing does not reveal available suggestions · case 03

Typing does not reveal available suggestions.

Autocomplete interactions◈ Members↗
FA-8154

Combobox keyboard commit: Typing does not reveal available suggestions · case 04

Typing does not reveal available suggestions.

Autocomplete interactions◈ Members↗
FA-8155

Combobox keyboard commit: Typing does not reveal available suggestions · case 05

Typing does not reveal available suggestions.

Autocomplete interactions◈ Members↗
FA-8156

Tooltip trigger and dismissal: Disabling a trigger leaves its tooltip visible · case 01

Disabling a trigger leaves its tooltip visible.

Disclosure widgets● Open access↗
FA-8157

Tooltip trigger and dismissal: Disabling a trigger leaves its tooltip visible · case 02

Disabling a trigger leaves its tooltip visible.

Disclosure widgets◈ Members↗
FA-8158

Tooltip trigger and dismissal: Disabling a trigger leaves its tooltip visible · case 03

Disabling a trigger leaves its tooltip visible.

Disclosure widgets◈ Members↗
FA-8159

Tooltip trigger and dismissal: Disabling a trigger leaves its tooltip visible · case 04

Disabling a trigger leaves its tooltip visible.

Disclosure widgets◈ Members↗
FA-8160

Tooltip trigger and dismissal: Disabling a trigger leaves its tooltip visible · case 05

Disabling a trigger leaves its tooltip visible.

Disclosure widgets◈ Members↗
FA-8161

Tooltip trigger and dismissal: Escape cannot dismiss a visible tooltip · case 01

Escape cannot dismiss a visible tooltip.

Disclosure widgets● Open access↗
FA-8162

Tooltip trigger and dismissal: Escape cannot dismiss a visible tooltip · case 02

Escape cannot dismiss a visible tooltip.

Disclosure widgets◈ Members↗
FA-8163

Tooltip trigger and dismissal: Escape cannot dismiss a visible tooltip · case 03

Escape cannot dismiss a visible tooltip.

Disclosure widgets◈ Members↗
FA-8164

Tooltip trigger and dismissal: Escape cannot dismiss a visible tooltip · case 04

Escape cannot dismiss a visible tooltip.

Disclosure widgets◈ Members↗
FA-8165

Tooltip trigger and dismissal: Escape cannot dismiss a visible tooltip · case 05

Escape cannot dismiss a visible tooltip.

Disclosure widgets◈ Members↗
FA-8166

Tooltip trigger and dismissal: Keyboard focus does not reveal tooltip content · case 01

Keyboard focus does not reveal tooltip content.

Disclosure widgets● Open access↗
FA-8167

Tooltip trigger and dismissal: Keyboard focus does not reveal tooltip content · case 02

Keyboard focus does not reveal tooltip content.

Disclosure widgets◈ Members↗
FA-8168

Tooltip trigger and dismissal: Keyboard focus does not reveal tooltip content · case 03

Keyboard focus does not reveal tooltip content.

Disclosure widgets◈ Members↗
FA-8169

Tooltip trigger and dismissal: Keyboard focus does not reveal tooltip content · case 04

Keyboard focus does not reveal tooltip content.

Disclosure widgets◈ Members↗
FA-8170

Tooltip trigger and dismissal: Keyboard focus does not reveal tooltip content · case 05

Keyboard focus does not reveal tooltip content.

Disclosure widgets◈ Members↗
FA-8171

Tooltip trigger and dismissal: Blur hides a tooltip that remains pointer-hovered · case 01

Blur hides a tooltip that remains pointer-hovered.

Disclosure widgets● Open access↗
FA-8172

Tooltip trigger and dismissal: Blur hides a tooltip that remains pointer-hovered · case 02

Blur hides a tooltip that remains pointer-hovered.

Disclosure widgets◈ Members↗
FA-8173

Tooltip trigger and dismissal: Blur hides a tooltip that remains pointer-hovered · case 03

Blur hides a tooltip that remains pointer-hovered.

Disclosure widgets◈ Members↗
FA-8174

Tooltip trigger and dismissal: Blur hides a tooltip that remains pointer-hovered · case 04

Blur hides a tooltip that remains pointer-hovered.

Disclosure widgets◈ Members↗
FA-8175

Tooltip trigger and dismissal: Blur hides a tooltip that remains pointer-hovered · case 05

Blur hides a tooltip that remains pointer-hovered.

Disclosure widgets◈ Members↗
FA-8176

Tooltip trigger and dismissal: Pointer leave hides a tooltip still needed by keyboard focus · case 01

Pointer leave hides a tooltip still needed by keyboard focus.

Disclosure widgets● Open access↗
FA-8177

Tooltip trigger and dismissal: Pointer leave hides a tooltip still needed by keyboard focus · case 02

Pointer leave hides a tooltip still needed by keyboard focus.

Disclosure widgets◈ Members↗
FA-8178

Tooltip trigger and dismissal: Pointer leave hides a tooltip still needed by keyboard focus · case 03

Pointer leave hides a tooltip still needed by keyboard focus.

Disclosure widgets◈ Members↗
FA-8179

Tooltip trigger and dismissal: Pointer leave hides a tooltip still needed by keyboard focus · case 04

Pointer leave hides a tooltip still needed by keyboard focus.

Disclosure widgets◈ Members↗
FA-8180

Tooltip trigger and dismissal: Pointer leave hides a tooltip still needed by keyboard focus · case 05

Pointer leave hides a tooltip still needed by keyboard focus.

Disclosure widgets◈ Members↗
FA-8181

Popover outside-interaction handling: A prevented event still dismisses an overlay · case 01

A prevented event still dismisses an overlay.

Overlay interactions● Open access↗
FA-8182

Popover outside-interaction handling: A prevented event still dismisses an overlay · case 02

A prevented event still dismisses an overlay.

Overlay interactions◈ Members↗
FA-8183

Popover outside-interaction handling: A prevented event still dismisses an overlay · case 03

A prevented event still dismisses an overlay.

Overlay interactions◈ Members↗
FA-8184

Popover outside-interaction handling: A prevented event still dismisses an overlay · case 04

A prevented event still dismisses an overlay.

Overlay interactions◈ Members↗
FA-8185

Popover outside-interaction handling: A prevented event still dismisses an overlay · case 05

A prevented event still dismisses an overlay.

Overlay interactions◈ Members↗
FA-8186

Popover outside-interaction handling: Escape fails to dismiss the overlay · case 01

Escape fails to dismiss the overlay.

Overlay interactions● Open access↗
FA-8187

Popover outside-interaction handling: Escape fails to dismiss the overlay · case 02

Escape fails to dismiss the overlay.

Overlay interactions◈ Members↗
FA-8188

Popover outside-interaction handling: Escape fails to dismiss the overlay · case 03

Escape fails to dismiss the overlay.

Overlay interactions◈ Members↗
FA-8189

Popover outside-interaction handling: Escape fails to dismiss the overlay · case 04

Escape fails to dismiss the overlay.

Overlay interactions◈ Members↗
FA-8190

Popover outside-interaction handling: Escape fails to dismiss the overlay · case 05

Escape fails to dismiss the overlay.

Overlay interactions◈ Members↗
FA-8191

Popover outside-interaction handling: Unrelated events dismiss the overlay · case 01

Unrelated events dismiss the overlay.

Overlay interactions● Open access↗
FA-8192

Popover outside-interaction handling: Unrelated events dismiss the overlay · case 02

Unrelated events dismiss the overlay.

Overlay interactions◈ Members↗
FA-8193

Popover outside-interaction handling: Unrelated events dismiss the overlay · case 03

Unrelated events dismiss the overlay.

Overlay interactions◈ Members↗
FA-8194

Popover outside-interaction handling: Unrelated events dismiss the overlay · case 04

Unrelated events dismiss the overlay.

Overlay interactions◈ Members↗
FA-8195

Popover outside-interaction handling: Unrelated events dismiss the overlay · case 05

Unrelated events dismiss the overlay.

Overlay interactions◈ Members↗
FA-8196

Popover outside-interaction handling: Trigger interaction can close but cannot open · case 01

Trigger interaction can close but cannot open.

Overlay interactions● Open access↗
FA-8197

Popover outside-interaction handling: Trigger interaction can close but cannot open · case 02

Trigger interaction can close but cannot open.

Overlay interactions◈ Members↗
FA-8198

Popover outside-interaction handling: Trigger interaction can close but cannot open · case 03

Trigger interaction can close but cannot open.

Overlay interactions◈ Members↗
FA-8199

Popover outside-interaction handling: Trigger interaction can close but cannot open · case 04

Trigger interaction can close but cannot open.

Overlay interactions◈ Members↗
FA-8200

Popover outside-interaction handling: Trigger interaction can close but cannot open · case 05

Trigger interaction can close but cannot open.

Overlay interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗