FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-9001

Composition-aware keyboard commands: Shift-Tab moves focus forward · case 01

Shift-Tab moves focus forward.

Text editing● Open access↗
FA-9002

Composition-aware keyboard commands: Shift-Tab moves focus forward · case 02

Shift-Tab moves focus forward.

Text editing◈ Members↗
FA-9003

Composition-aware keyboard commands: Shift-Tab moves focus forward · case 03

Shift-Tab moves focus forward.

Text editing◈ Members↗
FA-9004

Composition-aware keyboard commands: Shift-Tab moves focus forward · case 04

Shift-Tab moves focus forward.

Text editing◈ Members↗
FA-9005

Composition-aware keyboard commands: Shift-Tab moves focus forward · case 05

Shift-Tab moves focus forward.

Text editing◈ Members↗
FA-9006

Scoped keyboard shortcut dispatch: Already-consumed key events dispatch another command · case 01

Already-consumed key events dispatch another command.

Keyboard interactions● Open access↗
FA-9007

Scoped keyboard shortcut dispatch: Already-consumed key events dispatch another command · case 02

Already-consumed key events dispatch another command.

Keyboard interactions◈ Members↗
FA-9008

Scoped keyboard shortcut dispatch: Already-consumed key events dispatch another command · case 03

Already-consumed key events dispatch another command.

Keyboard interactions◈ Members↗
FA-9009

Scoped keyboard shortcut dispatch: Already-consumed key events dispatch another command · case 04

Already-consumed key events dispatch another command.

Keyboard interactions◈ Members↗
FA-9010

Scoped keyboard shortcut dispatch: Already-consumed key events dispatch another command · case 05

Already-consumed key events dispatch another command.

Keyboard interactions◈ Members↗
FA-9011

Scoped keyboard shortcut dispatch: Held shortcut keys repeatedly dispatch one-shot actions · case 01

Held shortcut keys repeatedly dispatch one-shot actions.

Keyboard interactions● Open access↗
FA-9012

Scoped keyboard shortcut dispatch: Held shortcut keys repeatedly dispatch one-shot actions · case 02

Held shortcut keys repeatedly dispatch one-shot actions.

Keyboard interactions◈ Members↗
FA-9013

Scoped keyboard shortcut dispatch: Held shortcut keys repeatedly dispatch one-shot actions · case 03

Held shortcut keys repeatedly dispatch one-shot actions.

Keyboard interactions◈ Members↗
FA-9014

Scoped keyboard shortcut dispatch: Held shortcut keys repeatedly dispatch one-shot actions · case 04

Held shortcut keys repeatedly dispatch one-shot actions.

Keyboard interactions◈ Members↗
FA-9015

Scoped keyboard shortcut dispatch: Held shortcut keys repeatedly dispatch one-shot actions · case 05

Held shortcut keys repeatedly dispatch one-shot actions.

Keyboard interactions◈ Members↗
FA-9016

Scoped keyboard shortcut dispatch: Global undo intercepts editing inside text fields · case 01

Global undo intercepts editing inside text fields.

Keyboard interactions● Open access↗
FA-9017

Scoped keyboard shortcut dispatch: Global undo intercepts editing inside text fields · case 02

Global undo intercepts editing inside text fields.

Keyboard interactions◈ Members↗
FA-9018

Scoped keyboard shortcut dispatch: Global undo intercepts editing inside text fields · case 03

Global undo intercepts editing inside text fields.

Keyboard interactions◈ Members↗
FA-9019

Scoped keyboard shortcut dispatch: Global undo intercepts editing inside text fields · case 04

Global undo intercepts editing inside text fields.

Keyboard interactions◈ Members↗
FA-9020

Scoped keyboard shortcut dispatch: Global undo intercepts editing inside text fields · case 05

Global undo intercepts editing inside text fields.

Keyboard interactions◈ Members↗
FA-9021

Scoped keyboard shortcut dispatch: Mac command shortcuts require Control instead of Command · case 01

Mac command shortcuts require Control instead of Command.

Keyboard interactions● Open access↗
FA-9022

Scoped keyboard shortcut dispatch: Mac command shortcuts require Control instead of Command · case 02

Mac command shortcuts require Control instead of Command.

Keyboard interactions◈ Members↗
FA-9023

Scoped keyboard shortcut dispatch: Mac command shortcuts require Control instead of Command · case 03

Mac command shortcuts require Control instead of Command.

Keyboard interactions◈ Members↗
FA-9024

Scoped keyboard shortcut dispatch: Mac command shortcuts require Control instead of Command · case 04

Mac command shortcuts require Control instead of Command.

Keyboard interactions◈ Members↗
FA-9025

Scoped keyboard shortcut dispatch: Mac command shortcuts require Control instead of Command · case 05

Mac command shortcuts require Control instead of Command.

Keyboard interactions◈ Members↗
FA-9026

Scoped keyboard shortcut dispatch: Shift-Undo dispatches undo instead of redo · case 01

Shift-Undo dispatches undo instead of redo.

Keyboard interactions● Open access↗
FA-9027

Scoped keyboard shortcut dispatch: Shift-Undo dispatches undo instead of redo · case 02

Shift-Undo dispatches undo instead of redo.

Keyboard interactions◈ Members↗
FA-9028

Scoped keyboard shortcut dispatch: Shift-Undo dispatches undo instead of redo · case 03

Shift-Undo dispatches undo instead of redo.

Keyboard interactions◈ Members↗
FA-9029

Scoped keyboard shortcut dispatch: Shift-Undo dispatches undo instead of redo · case 04

Shift-Undo dispatches undo instead of redo.

Keyboard interactions◈ Members↗
FA-9030

Scoped keyboard shortcut dispatch: Shift-Undo dispatches undo instead of redo · case 05

Shift-Undo dispatches undo instead of redo.

Keyboard interactions◈ Members↗
FA-9031

Adjacent typing undo coalescing: Unchanged input creates an undo record · case 01

Unchanged input creates an undo record.

Undo and history● Open access↗
FA-9032

Adjacent typing undo coalescing: Unchanged input creates an undo record · case 02

Unchanged input creates an undo record.

Undo and history◈ Members↗
FA-9033

Adjacent typing undo coalescing: Unchanged input creates an undo record · case 03

Unchanged input creates an undo record.

Undo and history◈ Members↗
FA-9034

Adjacent typing undo coalescing: Unchanged input creates an undo record · case 04

Unchanged input creates an undo record.

Undo and history◈ Members↗
FA-9035

Adjacent typing undo coalescing: Unchanged input creates an undo record · case 05

Unchanged input creates an undo record.

Undo and history◈ Members↗
FA-9036

Adjacent typing undo coalescing: Deletion transactions merge as if they were adjacent typing · case 01

Deletion transactions merge as if they were adjacent typing.

Undo and history● Open access↗
FA-9037

Adjacent typing undo coalescing: Deletion transactions merge as if they were adjacent typing · case 02

Deletion transactions merge as if they were adjacent typing.

Undo and history◈ Members↗
FA-9038

Adjacent typing undo coalescing: Deletion transactions merge as if they were adjacent typing · case 03

Deletion transactions merge as if they were adjacent typing.

Undo and history◈ Members↗
FA-9039

Adjacent typing undo coalescing: Deletion transactions merge as if they were adjacent typing · case 04

Deletion transactions merge as if they were adjacent typing.

Undo and history◈ Members↗
FA-9040

Adjacent typing undo coalescing: Deletion transactions merge as if they were adjacent typing · case 05

Deletion transactions merge as if they were adjacent typing.

Undo and history◈ Members↗
FA-9041

Adjacent typing undo coalescing: Typing at a moved caret merges with a distant edit · case 01

Typing at a moved caret merges with a distant edit.

Undo and history● Open access↗
FA-9042

Adjacent typing undo coalescing: Typing at a moved caret merges with a distant edit · case 02

Typing at a moved caret merges with a distant edit.

Undo and history◈ Members↗
FA-9043

Adjacent typing undo coalescing: Typing at a moved caret merges with a distant edit · case 03

Typing at a moved caret merges with a distant edit.

Undo and history◈ Members↗
FA-9044

Adjacent typing undo coalescing: Typing at a moved caret merges with a distant edit · case 04

Typing at a moved caret merges with a distant edit.

Undo and history◈ Members↗
FA-9045

Adjacent typing undo coalescing: Typing at a moved caret merges with a distant edit · case 05

Typing at a moved caret merges with a distant edit.

Undo and history◈ Members↗
FA-9046

Adjacent typing undo coalescing: Explicit undo boundaries fail to split typing groups · case 01

Explicit undo boundaries fail to split typing groups.

Undo and history● Open access↗
FA-9047

Adjacent typing undo coalescing: Explicit undo boundaries fail to split typing groups · case 02

Explicit undo boundaries fail to split typing groups.

Undo and history◈ Members↗
FA-9048

Adjacent typing undo coalescing: Explicit undo boundaries fail to split typing groups · case 03

Explicit undo boundaries fail to split typing groups.

Undo and history◈ Members↗
FA-9049

Adjacent typing undo coalescing: Explicit undo boundaries fail to split typing groups · case 04

Explicit undo boundaries fail to split typing groups.

Undo and history◈ Members↗
FA-9050

Adjacent typing undo coalescing: Explicit undo boundaries fail to split typing groups · case 05

Explicit undo boundaries fail to split typing groups.

Undo and history◈ Members↗
FA-9051

Adjacent typing undo coalescing: Coalescing loses the text preceding the first grouped edit · case 01

Coalescing loses the text preceding the first grouped edit.

Undo and history● Open access↗
FA-9052

Adjacent typing undo coalescing: Coalescing loses the text preceding the first grouped edit · case 02

Coalescing loses the text preceding the first grouped edit.

Undo and history◈ Members↗
FA-9053

Adjacent typing undo coalescing: Coalescing loses the text preceding the first grouped edit · case 03

Coalescing loses the text preceding the first grouped edit.

Undo and history◈ Members↗
FA-9054

Adjacent typing undo coalescing: Coalescing loses the text preceding the first grouped edit · case 04

Coalescing loses the text preceding the first grouped edit.

Undo and history◈ Members↗
FA-9055

Adjacent typing undo coalescing: Coalescing loses the text preceding the first grouped edit · case 05

Coalescing loses the text preceding the first grouped edit.

Undo and history◈ Members↗
FA-9056

Gesture axis locking and cancellation: Cancelled gestures continue delivering movement · case 01

Cancelled gestures continue delivering movement.

Direct manipulation● Open access↗
FA-9057

Gesture axis locking and cancellation: Cancelled gestures continue delivering movement · case 02

Cancelled gestures continue delivering movement.

Direct manipulation◈ Members↗
FA-9058

Gesture axis locking and cancellation: Cancelled gestures continue delivering movement · case 03

Cancelled gestures continue delivering movement.

Direct manipulation◈ Members↗
FA-9059

Gesture axis locking and cancellation: Cancelled gestures continue delivering movement · case 04

Cancelled gestures continue delivering movement.

Direct manipulation◈ Members↗
FA-9060

Gesture axis locking and cancellation: Cancelled gestures continue delivering movement · case 05

Cancelled gestures continue delivering movement.

Direct manipulation◈ Members↗
FA-9061

Gesture axis locking and cancellation: Negative-direction drags never cross the gesture threshold · case 01

Negative-direction drags never cross the gesture threshold.

Direct manipulation● Open access↗
FA-9062

Gesture axis locking and cancellation: Negative-direction drags never cross the gesture threshold · case 02

Negative-direction drags never cross the gesture threshold.

Direct manipulation◈ Members↗
FA-9063

Gesture axis locking and cancellation: Negative-direction drags never cross the gesture threshold · case 03

Negative-direction drags never cross the gesture threshold.

Direct manipulation◈ Members↗
FA-9064

Gesture axis locking and cancellation: Negative-direction drags never cross the gesture threshold · case 04

Negative-direction drags never cross the gesture threshold.

Direct manipulation◈ Members↗
FA-9065

Gesture axis locking and cancellation: Negative-direction drags never cross the gesture threshold · case 05

Negative-direction drags never cross the gesture threshold.

Direct manipulation◈ Members↗
FA-9066

Gesture axis locking and cancellation: Motion exactly at the activation threshold is ignored · case 01

Motion exactly at the activation threshold is ignored.

Direct manipulation● Open access↗
FA-9067

Gesture axis locking and cancellation: Motion exactly at the activation threshold is ignored · case 02

Motion exactly at the activation threshold is ignored.

Direct manipulation◈ Members↗
FA-9068

Gesture axis locking and cancellation: Motion exactly at the activation threshold is ignored · case 03

Motion exactly at the activation threshold is ignored.

Direct manipulation◈ Members↗
FA-9069

Gesture axis locking and cancellation: Motion exactly at the activation threshold is ignored · case 04

Motion exactly at the activation threshold is ignored.

Direct manipulation◈ Members↗
FA-9070

Gesture axis locking and cancellation: Motion exactly at the activation threshold is ignored · case 05

Motion exactly at the activation threshold is ignored.

Direct manipulation◈ Members↗
FA-9071

Gesture axis locking and cancellation: Axis choice depends on signed direction rather than magnitude · case 01

Axis choice depends on signed direction rather than magnitude.

Direct manipulation● Open access↗
FA-9072

Gesture axis locking and cancellation: Axis choice depends on signed direction rather than magnitude · case 02

Axis choice depends on signed direction rather than magnitude.

Direct manipulation◈ Members↗
FA-9073

Gesture axis locking and cancellation: Axis choice depends on signed direction rather than magnitude · case 03

Axis choice depends on signed direction rather than magnitude.

Direct manipulation◈ Members↗
FA-9074

Gesture axis locking and cancellation: Axis choice depends on signed direction rather than magnitude · case 04

Axis choice depends on signed direction rather than magnitude.

Direct manipulation◈ Members↗
FA-9075

Gesture axis locking and cancellation: Axis choice depends on signed direction rather than magnitude · case 05

Axis choice depends on signed direction rather than magnitude.

Direct manipulation◈ Members↗
FA-9076

Gesture axis locking and cancellation: Established gesture locks switch axes mid-drag · case 01

Established gesture locks switch axes mid-drag.

Direct manipulation● Open access↗
FA-9077

Gesture axis locking and cancellation: Established gesture locks switch axes mid-drag · case 02

Established gesture locks switch axes mid-drag.

Direct manipulation◈ Members↗
FA-9078

Gesture axis locking and cancellation: Established gesture locks switch axes mid-drag · case 03

Established gesture locks switch axes mid-drag.

Direct manipulation◈ Members↗
FA-9079

Gesture axis locking and cancellation: Established gesture locks switch axes mid-drag · case 04

Established gesture locks switch axes mid-drag.

Direct manipulation◈ Members↗
FA-9080

Gesture axis locking and cancellation: Established gesture locks switch axes mid-drag · case 05

Established gesture locks switch axes mid-drag.

Direct manipulation◈ Members↗
FA-9081

Incremental rebuild decision: Missing outputs are accepted as cached · case 01

Missing outputs are accepted as cached.

Build systems● Open access↗
FA-9082

Incremental rebuild decision: Missing outputs are accepted as cached · case 02

Missing outputs are accepted as cached.

Build systems◈ Members↗
FA-9083

Incremental rebuild decision: Missing outputs are accepted as cached · case 03

Missing outputs are accepted as cached.

Build systems◈ Members↗
FA-9084

Incremental rebuild decision: Missing outputs are accepted as cached · case 04

Missing outputs are accepted as cached.

Build systems◈ Members↗
FA-9085

Incremental rebuild decision: Missing outputs are accepted as cached · case 05

Missing outputs are accepted as cached.

Build systems◈ Members↗
FA-9086

Incremental rebuild decision: Content changes with unchanged metadata are missed · case 01

Content changes with unchanged metadata are missed.

Build systems● Open access↗
FA-9087

Incremental rebuild decision: Content changes with unchanged metadata are missed · case 02

Content changes with unchanged metadata are missed.

Build systems◈ Members↗
FA-9088

Incremental rebuild decision: Content changes with unchanged metadata are missed · case 03

Content changes with unchanged metadata are missed.

Build systems◈ Members↗
FA-9089

Incremental rebuild decision: Content changes with unchanged metadata are missed · case 04

Content changes with unchanged metadata are missed.

Build systems◈ Members↗
FA-9090

Incremental rebuild decision: Content changes with unchanged metadata are missed · case 05

Content changes with unchanged metadata are missed.

Build systems◈ Members↗
FA-9091

Incremental rebuild decision: Compiler identity is absent from invalidation · case 01

Compiler identity is absent from invalidation.

Build systems● Open access↗
FA-9092

Incremental rebuild decision: Compiler identity is absent from invalidation · case 02

Compiler identity is absent from invalidation.

Build systems◈ Members↗
FA-9093

Incremental rebuild decision: Compiler identity is absent from invalidation · case 03

Compiler identity is absent from invalidation.

Build systems◈ Members↗
FA-9094

Incremental rebuild decision: Compiler identity is absent from invalidation · case 04

Compiler identity is absent from invalidation.

Build systems◈ Members↗
FA-9095

Incremental rebuild decision: Compiler identity is absent from invalidation · case 05

Compiler identity is absent from invalidation.

Build systems◈ Members↗
FA-9096

Incremental rebuild decision: Recipe changes reuse obsolete outputs · case 01

Recipe changes reuse obsolete outputs.

Build systems● Open access↗
FA-9097

Incremental rebuild decision: Recipe changes reuse obsolete outputs · case 02

Recipe changes reuse obsolete outputs.

Build systems◈ Members↗
FA-9098

Incremental rebuild decision: Recipe changes reuse obsolete outputs · case 03

Recipe changes reuse obsolete outputs.

Build systems◈ Members↗
FA-9099

Incremental rebuild decision: Recipe changes reuse obsolete outputs · case 04

Recipe changes reuse obsolete outputs.

Build systems◈ Members↗
FA-9100

Incremental rebuild decision: Recipe changes reuse obsolete outputs · case 05

Recipe changes reuse obsolete outputs.

Build systems◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗