FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-33001

Overflow computation forgets actual overflow-trigger width · case 01

Overflow computation forgets actual overflow-trigger width.

Menu interactions● Open access↗
FA-33002

Overflow computation forgets actual overflow-trigger width · case 02

Overflow computation forgets actual overflow-trigger width.

Menu interactions◈ Members↗
FA-33003

Overflow computation forgets actual overflow-trigger width · case 03

Overflow computation forgets actual overflow-trigger width.

Menu interactions◈ Members↗
FA-33004

Overflow computation forgets actual overflow-trigger width · case 04

Overflow computation forgets actual overflow-trigger width.

Menu interactions◈ Members↗
FA-33005

Overflow computation forgets actual overflow-trigger width · case 05

Overflow computation forgets actual overflow-trigger width.

Menu interactions◈ Members↗
FA-33006

Overflow menu treats individually fitting items as jointly fitting · case 01

Overflow menu treats individually fitting items as jointly fitting.

Menu interactions● Open access↗
FA-33007

Overflow menu treats individually fitting items as jointly fitting · case 02

Overflow menu treats individually fitting items as jointly fitting.

Menu interactions◈ Members↗
FA-33008

Overflow menu treats individually fitting items as jointly fitting · case 03

Overflow menu treats individually fitting items as jointly fitting.

Menu interactions◈ Members↗
FA-33009

Overflow menu treats individually fitting items as jointly fitting · case 04

Overflow menu treats individually fitting items as jointly fitting.

Menu interactions◈ Members↗
FA-33010

Overflow menu treats individually fitting items as jointly fitting · case 05

Overflow menu treats individually fitting items as jointly fitting.

Menu interactions◈ Members↗
FA-33011

Overflow popup drops the first overflowed menu command · case 01

Overflow popup drops the first overflowed menu command.

Menu interactions● Open access↗
FA-33012

Overflow popup drops the first overflowed menu command · case 02

Overflow popup drops the first overflowed menu command.

Menu interactions◈ Members↗
FA-33013

Overflow popup drops the first overflowed menu command · case 03

Overflow popup drops the first overflowed menu command.

Menu interactions◈ Members↗
FA-33014

Overflow popup drops the first overflowed menu command · case 04

Overflow popup drops the first overflowed menu command.

Menu interactions◈ Members↗
FA-33015

Overflow popup drops the first overflowed menu command · case 05

Overflow popup drops the first overflowed menu command.

Menu interactions◈ Members↗
FA-33016

Exactly fitting menu group is unnecessarily moved to overflow · case 01

Exactly fitting menu group is unnecessarily moved to overflow.

Menu interactions● Open access↗
FA-33017

Exactly fitting menu group is unnecessarily moved to overflow · case 02

Exactly fitting menu group is unnecessarily moved to overflow.

Menu interactions◈ Members↗
FA-33018

Exactly fitting menu group is unnecessarily moved to overflow · case 03

Exactly fitting menu group is unnecessarily moved to overflow.

Menu interactions◈ Members↗
FA-33019

Exactly fitting menu group is unnecessarily moved to overflow · case 04

Exactly fitting menu group is unnecessarily moved to overflow.

Menu interactions◈ Members↗
FA-33020

Exactly fitting menu group is unnecessarily moved to overflow · case 05

Exactly fitting menu group is unnecessarily moved to overflow.

Menu interactions◈ Members↗
FA-33021

Restored overflow commands lose their original source order · case 01

Restored overflow commands lose their original source order.

Menu interactions● Open access↗
FA-33022

Restored overflow commands lose their original source order · case 02

Restored overflow commands lose their original source order.

Menu interactions◈ Members↗
FA-33023

Restored overflow commands lose their original source order · case 03

Restored overflow commands lose their original source order.

Menu interactions◈ Members↗
FA-33024

Restored overflow commands lose their original source order · case 04

Restored overflow commands lose their original source order.

Menu interactions◈ Members↗
FA-33025

Restored overflow commands lose their original source order · case 05

Restored overflow commands lose their original source order.

Menu interactions◈ Members↗
FA-33026

Empty overflow popup leaves an unnecessary menu trigger · case 01

Empty overflow popup leaves an unnecessary menu trigger.

Menu interactions● Open access↗
FA-33027

Empty overflow popup leaves an unnecessary menu trigger · case 02

Empty overflow popup leaves an unnecessary menu trigger.

Menu interactions◈ Members↗
FA-33028

Empty overflow popup leaves an unnecessary menu trigger · case 03

Empty overflow popup leaves an unnecessary menu trigger.

Menu interactions◈ Members↗
FA-33029

Empty overflow popup leaves an unnecessary menu trigger · case 04

Empty overflow popup leaves an unnecessary menu trigger.

Menu interactions◈ Members↗
FA-33030

Empty overflow popup leaves an unnecessary menu trigger · case 05

Empty overflow popup leaves an unnecessary menu trigger.

Menu interactions◈ Members↗
FA-33031

Recent menu merges different context-bound uses of one command · case 01

Recent menu merges different context-bound uses of one command.

Menu interactions● Open access↗
FA-33032

Recent menu merges different context-bound uses of one command · case 02

Recent menu merges different context-bound uses of one command.

Menu interactions◈ Members↗
FA-33033

Recent menu merges different context-bound uses of one command · case 03

Recent menu merges different context-bound uses of one command.

Menu interactions◈ Members↗
FA-33034

Recent menu merges different context-bound uses of one command · case 04

Recent menu merges different context-bound uses of one command.

Menu interactions◈ Members↗
FA-33035

Recent menu merges different context-bound uses of one command · case 05

Recent menu merges different context-bound uses of one command.

Menu interactions◈ Members↗
FA-33036

Recent menu promotion leaves duplicate history entries · case 01

Recent menu promotion leaves duplicate history entries.

Menu interactions● Open access↗
FA-33037

Recent menu promotion leaves duplicate history entries · case 02

Recent menu promotion leaves duplicate history entries.

Menu interactions◈ Members↗
FA-33038

Recent menu promotion leaves duplicate history entries · case 03

Recent menu promotion leaves duplicate history entries.

Menu interactions◈ Members↗
FA-33039

Recent menu promotion leaves duplicate history entries · case 04

Recent menu promotion leaves duplicate history entries.

Menu interactions◈ Members↗
FA-33040

Recent menu promotion leaves duplicate history entries · case 05

Recent menu promotion leaves duplicate history entries.

Menu interactions◈ Members↗
FA-33041

Recent command menu ranks frequent old commands above newer invocations · case 01

Recent command menu ranks frequent old commands above newer invocations.

Menu interactions● Open access↗
FA-33042

Recent command menu ranks frequent old commands above newer invocations · case 02

Recent command menu ranks frequent old commands above newer invocations.

Menu interactions◈ Members↗
FA-33043

Recent command menu ranks frequent old commands above newer invocations · case 03

Recent command menu ranks frequent old commands above newer invocations.

Menu interactions◈ Members↗
FA-33044

Recent command menu ranks frequent old commands above newer invocations · case 04

Recent command menu ranks frequent old commands above newer invocations.

Menu interactions◈ Members↗
FA-33045

Recent command menu ranks frequent old commands above newer invocations · case 05

Recent command menu ranks frequent old commands above newer invocations.

Menu interactions◈ Members↗
FA-33046

Recent menu exposes commands removed from the registry · case 01

Recent menu exposes commands removed from the registry.

Menu interactions● Open access↗
FA-33047

Recent menu exposes commands removed from the registry · case 02

Recent menu exposes commands removed from the registry.

Menu interactions◈ Members↗
FA-33048

Recent menu exposes commands removed from the registry · case 03

Recent menu exposes commands removed from the registry.

Menu interactions◈ Members↗
FA-33049

Recent menu exposes commands removed from the registry · case 04

Recent menu exposes commands removed from the registry.

Menu interactions◈ Members↗
FA-33050

Recent menu exposes commands removed from the registry · case 05

Recent menu exposes commands removed from the registry.

Menu interactions◈ Members↗
FA-33051

Recent menu capacity retains oldest entries instead of newest · case 01

Recent menu capacity retains oldest entries instead of newest.

Menu interactions● Open access↗
FA-33052

Recent menu capacity retains oldest entries instead of newest · case 02

Recent menu capacity retains oldest entries instead of newest.

Menu interactions◈ Members↗
FA-33053

Recent menu capacity retains oldest entries instead of newest · case 03

Recent menu capacity retains oldest entries instead of newest.

Menu interactions◈ Members↗
FA-33054

Recent menu capacity retains oldest entries instead of newest · case 04

Recent menu capacity retains oldest entries instead of newest.

Menu interactions◈ Members↗
FA-33055

Recent menu capacity retains oldest entries instead of newest · case 05

Recent menu capacity retains oldest entries instead of newest.

Menu interactions◈ Members↗
FA-33056

Private context command appears in the persistent recent menu · case 01

Private context command appears in the persistent recent menu.

Menu interactions● Open access↗
FA-33057

Private context command appears in the persistent recent menu · case 02

Private context command appears in the persistent recent menu.

Menu interactions◈ Members↗
FA-33058

Private context command appears in the persistent recent menu · case 03

Private context command appears in the persistent recent menu.

Menu interactions◈ Members↗
FA-33059

Private context command appears in the persistent recent menu · case 04

Private context command appears in the persistent recent menu.

Menu interactions◈ Members↗
FA-33060

Private context command appears in the persistent recent menu · case 05

Private context command appears in the persistent recent menu.

Menu interactions◈ Members↗
FA-33061

Uncommitted menu action produces an undo receipt · case 01

Uncommitted menu action produces an undo receipt.

Menu interactions● Open access↗
FA-33062

Uncommitted menu action produces an undo receipt · case 02

Uncommitted menu action produces an undo receipt.

Menu interactions◈ Members↗
FA-33063

Uncommitted menu action produces an undo receipt · case 03

Uncommitted menu action produces an undo receipt.

Menu interactions◈ Members↗
FA-33064

Uncommitted menu action produces an undo receipt · case 04

Uncommitted menu action produces an undo receipt.

Menu interactions◈ Members↗
FA-33065

Uncommitted menu action produces an undo receipt · case 05

Uncommitted menu action produces an undo receipt.

Menu interactions◈ Members↗
FA-33066

Menu command rollback executes effects in forward order · case 01

Menu command rollback executes effects in forward order.

Menu interactions● Open access↗
FA-33067

Menu command rollback executes effects in forward order · case 02

Menu command rollback executes effects in forward order.

Menu interactions◈ Members↗
FA-33068

Menu command rollback executes effects in forward order · case 03

Menu command rollback executes effects in forward order.

Menu interactions◈ Members↗
FA-33069

Menu command rollback executes effects in forward order · case 04

Menu command rollback executes effects in forward order.

Menu interactions◈ Members↗
FA-33070

Menu command rollback executes effects in forward order · case 05

Menu command rollback executes effects in forward order.

Menu interactions◈ Members↗
FA-33071

Menu undo receipt captures another action on the same document · case 01

Menu undo receipt captures another action on the same document.

Menu interactions● Open access↗
FA-33072

Menu undo receipt captures another action on the same document · case 02

Menu undo receipt captures another action on the same document.

Menu interactions◈ Members↗
FA-33073

Menu undo receipt captures another action on the same document · case 03

Menu undo receipt captures another action on the same document.

Menu interactions◈ Members↗
FA-33074

Menu undo receipt captures another action on the same document · case 04

Menu undo receipt captures another action on the same document.

Menu interactions◈ Members↗
FA-33075

Menu undo receipt captures another action on the same document · case 05

Menu undo receipt captures another action on the same document.

Menu interactions◈ Members↗
FA-33076

Undo menu label changes retroactively after command relabeling · case 01

Undo menu label changes retroactively after command relabeling.

Menu interactions● Open access↗
FA-33077

Undo menu label changes retroactively after command relabeling · case 02

Undo menu label changes retroactively after command relabeling.

Menu interactions◈ Members↗
FA-33078

Undo menu label changes retroactively after command relabeling · case 03

Undo menu label changes retroactively after command relabeling.

Menu interactions◈ Members↗
FA-33079

Undo menu label changes retroactively after command relabeling · case 04

Undo menu label changes retroactively after command relabeling.

Menu interactions◈ Members↗
FA-33080

Undo menu label changes retroactively after command relabeling · case 05

Undo menu label changes retroactively after command relabeling.

Menu interactions◈ Members↗
FA-33081

No-op menu action adds a meaningless undo entry · case 01

No-op menu action adds a meaningless undo entry.

Menu interactions● Open access↗
FA-33082

No-op menu action adds a meaningless undo entry · case 02

No-op menu action adds a meaningless undo entry.

Menu interactions◈ Members↗
FA-33083

No-op menu action adds a meaningless undo entry · case 03

No-op menu action adds a meaningless undo entry.

Menu interactions◈ Members↗
FA-33084

No-op menu action adds a meaningless undo entry · case 04

No-op menu action adds a meaningless undo entry.

Menu interactions◈ Members↗
FA-33085

No-op menu action adds a meaningless undo entry · case 05

No-op menu action adds a meaningless undo entry.

Menu interactions◈ Members↗
FA-33086

Menu history merges identical commands from different context targets · case 01

Menu history merges identical commands from different context targets.

Menu interactions● Open access↗
FA-33087

Menu history merges identical commands from different context targets · case 02

Menu history merges identical commands from different context targets.

Menu interactions◈ Members↗
FA-33088

Menu history merges identical commands from different context targets · case 03

Menu history merges identical commands from different context targets.

Menu interactions◈ Members↗
FA-33089

Menu history merges identical commands from different context targets · case 04

Menu history merges identical commands from different context targets.

Menu interactions◈ Members↗
FA-33090

Menu history merges identical commands from different context targets · case 05

Menu history merges identical commands from different context targets.

Menu interactions◈ Members↗
FA-33091

Initial lazy submenu shows an empty list while content is pending · case 01

Initial lazy submenu shows an empty list while content is pending.

Menu interactions● Open access↗
FA-33092

Initial lazy submenu shows an empty list while content is pending · case 02

Initial lazy submenu shows an empty list while content is pending.

Menu interactions◈ Members↗
FA-33093

Initial lazy submenu shows an empty list while content is pending · case 03

Initial lazy submenu shows an empty list while content is pending.

Menu interactions◈ Members↗
FA-33094

Initial lazy submenu shows an empty list while content is pending · case 04

Initial lazy submenu shows an empty list while content is pending.

Menu interactions◈ Members↗
FA-33095

Initial lazy submenu shows an empty list while content is pending · case 05

Initial lazy submenu shows an empty list while content is pending.

Menu interactions◈ Members↗
FA-33096

Refreshing submenu discards usable existing commands · case 01

Refreshing submenu discards usable existing commands.

Menu interactions● Open access↗
FA-33097

Refreshing submenu discards usable existing commands · case 02

Refreshing submenu discards usable existing commands.

Menu interactions◈ Members↗
FA-33098

Refreshing submenu discards usable existing commands · case 03

Refreshing submenu discards usable existing commands.

Menu interactions◈ Members↗
FA-33099

Refreshing submenu discards usable existing commands · case 04

Refreshing submenu discards usable existing commands.

Menu interactions◈ Members↗
FA-33100

Refreshing submenu discards usable existing commands · case 05

Refreshing submenu discards usable existing commands.

Menu interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗