FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-9101

Incremental rebuild decision: Failed prerequisites leave cached outputs eligible · case 01

Failed prerequisites leave cached outputs eligible.

Build systems● Open access↗
FA-9102

Incremental rebuild decision: Failed prerequisites leave cached outputs eligible · case 02

Failed prerequisites leave cached outputs eligible.

Build systems◈ Members↗
FA-9103

Incremental rebuild decision: Failed prerequisites leave cached outputs eligible · case 03

Failed prerequisites leave cached outputs eligible.

Build systems◈ Members↗
FA-9104

Incremental rebuild decision: Failed prerequisites leave cached outputs eligible · case 04

Failed prerequisites leave cached outputs eligible.

Build systems◈ Members↗
FA-9105

Incremental rebuild decision: Failed prerequisites leave cached outputs eligible · case 05

Failed prerequisites leave cached outputs eligible.

Build systems◈ Members↗
FA-9106

Hermetic action fingerprint: Different compilers collide in the action key · case 01

Different compilers collide in the action key.

Build systems● Open access↗
FA-9107

Hermetic action fingerprint: Different compilers collide in the action key · case 02

Different compilers collide in the action key.

Build systems◈ Members↗
FA-9108

Hermetic action fingerprint: Different compilers collide in the action key · case 03

Different compilers collide in the action key.

Build systems◈ Members↗
FA-9109

Hermetic action fingerprint: Different compilers collide in the action key · case 04

Different compilers collide in the action key.

Build systems◈ Members↗
FA-9110

Hermetic action fingerprint: Different compilers collide in the action key · case 05

Different compilers collide in the action key.

Build systems◈ Members↗
FA-9111

Hermetic action fingerprint: Sorting arguments merges order-sensitive commands · case 01

Sorting arguments merges order-sensitive commands.

Build systems● Open access↗
FA-9112

Hermetic action fingerprint: Sorting arguments merges order-sensitive commands · case 02

Sorting arguments merges order-sensitive commands.

Build systems◈ Members↗
FA-9113

Hermetic action fingerprint: Sorting arguments merges order-sensitive commands · case 03

Sorting arguments merges order-sensitive commands.

Build systems◈ Members↗
FA-9114

Hermetic action fingerprint: Sorting arguments merges order-sensitive commands · case 04

Sorting arguments merges order-sensitive commands.

Build systems◈ Members↗
FA-9115

Hermetic action fingerprint: Sorting arguments merges order-sensitive commands · case 05

Sorting arguments merges order-sensitive commands.

Build systems◈ Members↗
FA-9116

Hermetic action fingerprint: Environment insertion order fragments the action key · case 01

Environment insertion order fragments the action key.

Build systems● Open access↗
FA-9117

Hermetic action fingerprint: Environment insertion order fragments the action key · case 02

Environment insertion order fragments the action key.

Build systems◈ Members↗
FA-9118

Hermetic action fingerprint: Environment insertion order fragments the action key · case 03

Environment insertion order fragments the action key.

Build systems◈ Members↗
FA-9119

Hermetic action fingerprint: Environment insertion order fragments the action key · case 04

Environment insertion order fragments the action key.

Build systems◈ Members↗
FA-9120

Hermetic action fingerprint: Environment insertion order fragments the action key · case 05

Environment insertion order fragments the action key.

Build systems◈ Members↗
FA-9121

Hermetic action fingerprint: Input names replace input content identities · case 01

Input names replace input content identities.

Build systems● Open access↗
FA-9122

Hermetic action fingerprint: Input names replace input content identities · case 02

Input names replace input content identities.

Build systems◈ Members↗
FA-9123

Hermetic action fingerprint: Input names replace input content identities · case 03

Input names replace input content identities.

Build systems◈ Members↗
FA-9124

Hermetic action fingerprint: Input names replace input content identities · case 04

Input names replace input content identities.

Build systems◈ Members↗
FA-9125

Hermetic action fingerprint: Input names replace input content identities · case 05

Input names replace input content identities.

Build systems◈ Members↗
FA-9126

Hermetic action fingerprint: Cross-platform actions collide · case 01

Cross-platform actions collide.

Build systems● Open access↗
FA-9127

Hermetic action fingerprint: Cross-platform actions collide · case 02

Cross-platform actions collide.

Build systems◈ Members↗
FA-9128

Hermetic action fingerprint: Cross-platform actions collide · case 03

Cross-platform actions collide.

Build systems◈ Members↗
FA-9129

Hermetic action fingerprint: Cross-platform actions collide · case 04

Cross-platform actions collide.

Build systems◈ Members↗
FA-9130

Hermetic action fingerprint: Cross-platform actions collide · case 05

Cross-platform actions collide.

Build systems◈ Members↗
FA-9131

Build prerequisite closure: Only the first requested target enters the closure · case 01

Only the first requested target enters the closure.

Build systems● Open access↗
FA-9132

Build prerequisite closure: Only the first requested target enters the closure · case 02

Only the first requested target enters the closure.

Build systems◈ Members↗
FA-9133

Build prerequisite closure: Only the first requested target enters the closure · case 03

Only the first requested target enters the closure.

Build systems◈ Members↗
FA-9134

Build prerequisite closure: Only the first requested target enters the closure · case 04

Only the first requested target enters the closure.

Build systems◈ Members↗
FA-9135

Build prerequisite closure: Only the first requested target enters the closure · case 05

Only the first requested target enters the closure.

Build systems◈ Members↗
FA-9136

Build prerequisite closure: Requested root targets disappear from results · case 01

Requested root targets disappear from results.

Build systems● Open access↗
FA-9137

Build prerequisite closure: Requested root targets disappear from results · case 02

Requested root targets disappear from results.

Build systems◈ Members↗
FA-9138

Build prerequisite closure: Requested root targets disappear from results · case 03

Requested root targets disappear from results.

Build systems◈ Members↗
FA-9139

Build prerequisite closure: Requested root targets disappear from results · case 04

Requested root targets disappear from results.

Build systems◈ Members↗
FA-9140

Build prerequisite closure: Requested root targets disappear from results · case 05

Requested root targets disappear from results.

Build systems◈ Members↗
FA-9141

Build prerequisite closure: Order-only edges contaminate content prerequisites · case 01

Order-only edges contaminate content prerequisites.

Build systems● Open access↗
FA-9142

Build prerequisite closure: Order-only edges contaminate content prerequisites · case 02

Order-only edges contaminate content prerequisites.

Build systems◈ Members↗
FA-9143

Build prerequisite closure: Order-only edges contaminate content prerequisites · case 03

Order-only edges contaminate content prerequisites.

Build systems◈ Members↗
FA-9144

Build prerequisite closure: Order-only edges contaminate content prerequisites · case 04

Order-only edges contaminate content prerequisites.

Build systems◈ Members↗
FA-9145

Build prerequisite closure: Order-only edges contaminate content prerequisites · case 05

Order-only edges contaminate content prerequisites.

Build systems◈ Members↗
FA-9146

Build prerequisite closure: Undeclared leaf targets disappear · case 01

Undeclared leaf targets disappear.

Build systems● Open access↗
FA-9147

Build prerequisite closure: Undeclared leaf targets disappear · case 02

Undeclared leaf targets disappear.

Build systems◈ Members↗
FA-9148

Build prerequisite closure: Undeclared leaf targets disappear · case 03

Undeclared leaf targets disappear.

Build systems◈ Members↗
FA-9149

Build prerequisite closure: Undeclared leaf targets disappear · case 04

Undeclared leaf targets disappear.

Build systems◈ Members↗
FA-9150

Build prerequisite closure: Undeclared leaf targets disappear · case 05

Undeclared leaf targets disappear.

Build systems◈ Members↗
FA-9151

Build prerequisite closure: Closure output follows reverse lexical order · case 01

Closure output follows reverse lexical order.

Build systems● Open access↗
FA-9152

Build prerequisite closure: Closure output follows reverse lexical order · case 02

Closure output follows reverse lexical order.

Build systems◈ Members↗
FA-9153

Build prerequisite closure: Closure output follows reverse lexical order · case 03

Closure output follows reverse lexical order.

Build systems◈ Members↗
FA-9154

Build prerequisite closure: Closure output follows reverse lexical order · case 04

Closure output follows reverse lexical order.

Build systems◈ Members↗
FA-9155

Build prerequisite closure: Closure output follows reverse lexical order · case 05

Closure output follows reverse lexical order.

Build systems◈ Members↗
FA-9156

Link command assembly: Object order is alphabetized · case 01

Object order is alphabetized.

Build systems● Open access↗
FA-9157

Link command assembly: Object order is alphabetized · case 02

Object order is alphabetized.

Build systems◈ Members↗
FA-9158

Link command assembly: Object order is alphabetized · case 03

Object order is alphabetized.

Build systems◈ Members↗
FA-9159

Link command assembly: Object order is alphabetized · case 04

Object order is alphabetized.

Build systems◈ Members↗
FA-9160

Link command assembly: Object order is alphabetized · case 05

Object order is alphabetized.

Build systems◈ Members↗
FA-9161

Link command assembly: Repeated archives are dropped · case 01

Repeated archives are dropped.

Build systems● Open access↗
FA-9162

Link command assembly: Repeated archives are dropped · case 02

Repeated archives are dropped.

Build systems◈ Members↗
FA-9163

Link command assembly: Repeated archives are dropped · case 03

Repeated archives are dropped.

Build systems◈ Members↗
FA-9164

Link command assembly: Repeated archives are dropped · case 04

Repeated archives are dropped.

Build systems◈ Members↗
FA-9165

Link command assembly: Repeated archives are dropped · case 05

Repeated archives are dropped.

Build systems◈ Members↗
FA-9166

Link command assembly: A framework flag is omitted · case 01

A framework flag is omitted.

Build systems● Open access↗
FA-9167

Link command assembly: A framework flag is omitted · case 02

A framework flag is omitted.

Build systems◈ Members↗
FA-9168

Link command assembly: A framework flag is omitted · case 03

A framework flag is omitted.

Build systems◈ Members↗
FA-9169

Link command assembly: A framework flag is omitted · case 04

A framework flag is omitted.

Build systems◈ Members↗
FA-9170

Link command assembly: A framework flag is omitted · case 05

A framework flag is omitted.

Build systems◈ Members↗
FA-9171

Link command assembly: Search path arguments are collapsed · case 01

Search path arguments are collapsed.

Build systems● Open access↗
FA-9172

Link command assembly: Search path arguments are collapsed · case 02

Search path arguments are collapsed.

Build systems◈ Members↗
FA-9173

Link command assembly: Search path arguments are collapsed · case 03

Search path arguments are collapsed.

Build systems◈ Members↗
FA-9174

Link command assembly: Search path arguments are collapsed · case 04

Search path arguments are collapsed.

Build systems◈ Members↗
FA-9175

Link command assembly: Search path arguments are collapsed · case 05

Search path arguments are collapsed.

Build systems◈ Members↗
FA-9176

Link command assembly: Output names lose the output selector · case 01

Output names lose the output selector.

Build systems● Open access↗
FA-9177

Link command assembly: Output names lose the output selector · case 02

Output names lose the output selector.

Build systems◈ Members↗
FA-9178

Link command assembly: Output names lose the output selector · case 03

Output names lose the output selector.

Build systems◈ Members↗
FA-9179

Link command assembly: Output names lose the output selector · case 04

Output names lose the output selector.

Build systems◈ Members↗
FA-9180

Link command assembly: Output names lose the output selector · case 05

Output names lose the output selector.

Build systems◈ Members↗
FA-9181

Prerequisite manifest merge: Existing targets are erased during updates · case 01

Existing targets are erased during updates.

Build systems● Open access↗
FA-9182

Prerequisite manifest merge: Existing targets are erased during updates · case 02

Existing targets are erased during updates.

Build systems◈ Members↗
FA-9183

Prerequisite manifest merge: Existing targets are erased during updates · case 03

Existing targets are erased during updates.

Build systems◈ Members↗
FA-9184

Prerequisite manifest merge: Existing targets are erased during updates · case 04

Existing targets are erased during updates.

Build systems◈ Members↗
FA-9185

Prerequisite manifest merge: Existing targets are erased during updates · case 05

Existing targets are erased during updates.

Build systems◈ Members↗
FA-9186

Prerequisite manifest merge: Later rules reset an earlier target list · case 01

Later rules reset an earlier target list.

Build systems● Open access↗
FA-9187

Prerequisite manifest merge: Later rules reset an earlier target list · case 02

Later rules reset an earlier target list.

Build systems◈ Members↗
FA-9188

Prerequisite manifest merge: Later rules reset an earlier target list · case 03

Later rules reset an earlier target list.

Build systems◈ Members↗
FA-9189

Prerequisite manifest merge: Later rules reset an earlier target list · case 04

Later rules reset an earlier target list.

Build systems◈ Members↗
FA-9190

Prerequisite manifest merge: Later rules reset an earlier target list · case 05

Later rules reset an earlier target list.

Build systems◈ Members↗
FA-9191

Prerequisite manifest merge: A target becomes its own prerequisite · case 01

A target becomes its own prerequisite.

Build systems● Open access↗
FA-9192

Prerequisite manifest merge: A target becomes its own prerequisite · case 02

A target becomes its own prerequisite.

Build systems◈ Members↗
FA-9193

Prerequisite manifest merge: A target becomes its own prerequisite · case 03

A target becomes its own prerequisite.

Build systems◈ Members↗
FA-9194

Prerequisite manifest merge: A target becomes its own prerequisite · case 04

A target becomes its own prerequisite.

Build systems◈ Members↗
FA-9195

Prerequisite manifest merge: A target becomes its own prerequisite · case 05

A target becomes its own prerequisite.

Build systems◈ Members↗
FA-9196

Prerequisite manifest merge: Repeated prerequisites survive · case 01

Repeated prerequisites survive.

Build systems● Open access↗
FA-9197

Prerequisite manifest merge: Repeated prerequisites survive · case 02

Repeated prerequisites survive.

Build systems◈ Members↗
FA-9198

Prerequisite manifest merge: Repeated prerequisites survive · case 03

Repeated prerequisites survive.

Build systems◈ Members↗
FA-9199

Prerequisite manifest merge: Repeated prerequisites survive · case 04

Repeated prerequisites survive.

Build systems◈ Members↗
FA-9200

Prerequisite manifest merge: Repeated prerequisites survive · case 05

Repeated prerequisites survive.

Build systems◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗