FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-15101

Lehmer permutation rank: factoradic place weighting · case 01

The exact lehmer permutation rank result violates the stated contract at factoradic place weighting.

Numerics● Open access↗
FA-15102

Lehmer permutation rank: factoradic place weighting · case 02

The exact lehmer permutation rank result violates the stated contract at factoradic place weighting.

Numerics◈ Members↗
FA-15103

Lehmer permutation rank: factoradic place weighting · case 03

The exact lehmer permutation rank result violates the stated contract at factoradic place weighting.

Numerics◈ Members↗
FA-15104

Lehmer permutation rank: factoradic place weighting · case 04

The exact lehmer permutation rank result violates the stated contract at factoradic place weighting.

Numerics◈ Members↗
FA-15105

Lehmer permutation rank: factoradic place weighting · case 05

The exact lehmer permutation rank result violates the stated contract at factoradic place weighting.

Numerics◈ Members↗
FA-15106

Lehmer permutation rank: used symbol removal · case 01

The exact lehmer permutation rank result violates the stated contract at used symbol removal.

Numerics● Open access↗
FA-15107

Lehmer permutation rank: used symbol removal · case 02

The exact lehmer permutation rank result violates the stated contract at used symbol removal.

Numerics◈ Members↗
FA-15108

Lehmer permutation rank: used symbol removal · case 03

The exact lehmer permutation rank result violates the stated contract at used symbol removal.

Numerics◈ Members↗
FA-15109

Lehmer permutation rank: used symbol removal · case 04

The exact lehmer permutation rank result violates the stated contract at used symbol removal.

Numerics◈ Members↗
FA-15110

Lehmer permutation rank: used symbol removal · case 05

The exact lehmer permutation rank result violates the stated contract at used symbol removal.

Numerics◈ Members↗
FA-15111

Lehmer permutation rank: rank origin · case 01

The exact lehmer permutation rank result violates the stated contract at rank origin.

Numerics● Open access↗
FA-15112

Lehmer permutation rank: rank origin · case 02

The exact lehmer permutation rank result violates the stated contract at rank origin.

Numerics◈ Members↗
FA-15113

Lehmer permutation rank: rank origin · case 03

The exact lehmer permutation rank result violates the stated contract at rank origin.

Numerics◈ Members↗
FA-15114

Lehmer permutation rank: rank origin · case 04

The exact lehmer permutation rank result violates the stated contract at rank origin.

Numerics◈ Members↗
FA-15115

Lehmer permutation rank: rank origin · case 05

The exact lehmer permutation rank result violates the stated contract at rank origin.

Numerics◈ Members↗
FA-15116

Factoradic permutation unrank: factoradic digit count · case 01

The exact factoradic permutation unrank result violates the stated contract at factoradic digit count.

Numerics● Open access↗
FA-15117

Factoradic permutation unrank: factoradic digit count · case 02

The exact factoradic permutation unrank result violates the stated contract at factoradic digit count.

Numerics◈ Members↗
FA-15118

Factoradic permutation unrank: factoradic digit count · case 03

The exact factoradic permutation unrank result violates the stated contract at factoradic digit count.

Numerics◈ Members↗
FA-15119

Factoradic permutation unrank: factoradic digit count · case 04

The exact factoradic permutation unrank result violates the stated contract at factoradic digit count.

Numerics◈ Members↗
FA-15120

Factoradic permutation unrank: factoradic digit count · case 05

The exact factoradic permutation unrank result violates the stated contract at factoradic digit count.

Numerics◈ Members↗
FA-15121

Factoradic permutation unrank: permutation block size · case 01

The exact factoradic permutation unrank result violates the stated contract at permutation block size.

Numerics● Open access↗
FA-15122

Factoradic permutation unrank: permutation block size · case 02

The exact factoradic permutation unrank result violates the stated contract at permutation block size.

Numerics◈ Members↗
FA-15123

Factoradic permutation unrank: permutation block size · case 03

The exact factoradic permutation unrank result violates the stated contract at permutation block size.

Numerics◈ Members↗
FA-15124

Factoradic permutation unrank: permutation block size · case 04

The exact factoradic permutation unrank result violates the stated contract at permutation block size.

Numerics◈ Members↗
FA-15125

Factoradic permutation unrank: permutation block size · case 05

The exact factoradic permutation unrank result violates the stated contract at permutation block size.

Numerics◈ Members↗
FA-15126

Factoradic permutation unrank: factoradic quotient digit · case 01

The exact factoradic permutation unrank result violates the stated contract at factoradic quotient digit.

Numerics● Open access↗
FA-15127

Factoradic permutation unrank: factoradic quotient digit · case 02

The exact factoradic permutation unrank result violates the stated contract at factoradic quotient digit.

Numerics◈ Members↗
FA-15128

Factoradic permutation unrank: factoradic quotient digit · case 03

The exact factoradic permutation unrank result violates the stated contract at factoradic quotient digit.

Numerics◈ Members↗
FA-15129

Factoradic permutation unrank: factoradic quotient digit · case 04

The exact factoradic permutation unrank result violates the stated contract at factoradic quotient digit.

Numerics◈ Members↗
FA-15130

Factoradic permutation unrank: factoradic quotient digit · case 05

The exact factoradic permutation unrank result violates the stated contract at factoradic quotient digit.

Numerics◈ Members↗
FA-15131

Factoradic permutation unrank: alphabet selection removal · case 01

The exact factoradic permutation unrank result violates the stated contract at alphabet selection removal.

Numerics● Open access↗
FA-15132

Factoradic permutation unrank: alphabet selection removal · case 02

The exact factoradic permutation unrank result violates the stated contract at alphabet selection removal.

Numerics◈ Members↗
FA-15133

Factoradic permutation unrank: alphabet selection removal · case 03

The exact factoradic permutation unrank result violates the stated contract at alphabet selection removal.

Numerics◈ Members↗
FA-15134

Factoradic permutation unrank: alphabet selection removal · case 04

The exact factoradic permutation unrank result violates the stated contract at alphabet selection removal.

Numerics◈ Members↗
FA-15135

Factoradic permutation unrank: alphabet selection removal · case 05

The exact factoradic permutation unrank result violates the stated contract at alphabet selection removal.

Numerics◈ Members↗
FA-15136

Factoradic permutation unrank: within block rank · case 01

The exact factoradic permutation unrank result violates the stated contract at within block rank.

Numerics● Open access↗
FA-15137

Factoradic permutation unrank: within block rank · case 02

The exact factoradic permutation unrank result violates the stated contract at within block rank.

Numerics◈ Members↗
FA-15138

Factoradic permutation unrank: within block rank · case 03

The exact factoradic permutation unrank result violates the stated contract at within block rank.

Numerics◈ Members↗
FA-15139

Factoradic permutation unrank: within block rank · case 04

The exact factoradic permutation unrank result violates the stated contract at within block rank.

Numerics◈ Members↗
FA-15140

Factoradic permutation unrank: within block rank · case 05

The exact factoradic permutation unrank result violates the stated contract at within block rank.

Numerics◈ Members↗
FA-15141

Colex combination rank: selected element traversal · case 01

The exact colex combination rank result violates the stated contract at selected element traversal.

Numerics● Open access↗
FA-15142

Colex combination rank: selected element traversal · case 02

The exact colex combination rank result violates the stated contract at selected element traversal.

Numerics◈ Members↗
FA-15143

Colex combination rank: selected element traversal · case 03

The exact colex combination rank result violates the stated contract at selected element traversal.

Numerics◈ Members↗
FA-15144

Colex combination rank: selected element traversal · case 04

The exact colex combination rank result violates the stated contract at selected element traversal.

Numerics◈ Members↗
FA-15145

Colex combination rank: selected element traversal · case 05

The exact colex combination rank result violates the stated contract at selected element traversal.

Numerics◈ Members↗
FA-15146

Colex combination rank: binomial top index · case 01

The exact colex combination rank result violates the stated contract at binomial top index.

Numerics● Open access↗
FA-15147

Colex combination rank: binomial top index · case 02

The exact colex combination rank result violates the stated contract at binomial top index.

Numerics◈ Members↗
FA-15148

Colex combination rank: binomial top index · case 03

The exact colex combination rank result violates the stated contract at binomial top index.

Numerics◈ Members↗
FA-15149

Colex combination rank: binomial top index · case 04

The exact colex combination rank result violates the stated contract at binomial top index.

Numerics◈ Members↗
FA-15150

Colex combination rank: binomial top index · case 05

The exact colex combination rank result violates the stated contract at binomial top index.

Numerics◈ Members↗
FA-15151

Colex combination rank: binomial lower index · case 01

The exact colex combination rank result violates the stated contract at binomial lower index.

Numerics● Open access↗
FA-15152

Colex combination rank: binomial lower index · case 02

The exact colex combination rank result violates the stated contract at binomial lower index.

Numerics◈ Members↗
FA-15153

Colex combination rank: binomial lower index · case 03

The exact colex combination rank result violates the stated contract at binomial lower index.

Numerics◈ Members↗
FA-15154

Colex combination rank: binomial lower index · case 04

The exact colex combination rank result violates the stated contract at binomial lower index.

Numerics◈ Members↗
FA-15155

Colex combination rank: binomial lower index · case 05

The exact colex combination rank result violates the stated contract at binomial lower index.

Numerics◈ Members↗
FA-15156

Colex combination rank: combinatorial place accumulation · case 01

The exact colex combination rank result violates the stated contract at combinatorial place accumulation.

Numerics● Open access↗
FA-15157

Colex combination rank: combinatorial place accumulation · case 02

The exact colex combination rank result violates the stated contract at combinatorial place accumulation.

Numerics◈ Members↗
FA-15158

Colex combination rank: combinatorial place accumulation · case 03

The exact colex combination rank result violates the stated contract at combinatorial place accumulation.

Numerics◈ Members↗
FA-15159

Colex combination rank: combinatorial place accumulation · case 04

The exact colex combination rank result violates the stated contract at combinatorial place accumulation.

Numerics◈ Members↗
FA-15160

Colex combination rank: combinatorial place accumulation · case 05

The exact colex combination rank result violates the stated contract at combinatorial place accumulation.

Numerics◈ Members↗
FA-15161

Colex combination rank: colex origin offset · case 01

The exact colex combination rank result violates the stated contract at colex origin offset.

Numerics● Open access↗
FA-15162

Colex combination rank: colex origin offset · case 02

The exact colex combination rank result violates the stated contract at colex origin offset.

Numerics◈ Members↗
FA-15163

Colex combination rank: colex origin offset · case 03

The exact colex combination rank result violates the stated contract at colex origin offset.

Numerics◈ Members↗
FA-15164

Colex combination rank: colex origin offset · case 04

The exact colex combination rank result violates the stated contract at colex origin offset.

Numerics◈ Members↗
FA-15165

Colex combination rank: colex origin offset · case 05

The exact colex combination rank result violates the stated contract at colex origin offset.

Numerics◈ Members↗
FA-15166

Combinadic unrank: descending binomial positions · case 01

The exact combinadic unrank result violates the stated contract at descending binomial positions.

Numerics● Open access↗
FA-15167

Combinadic unrank: descending binomial positions · case 02

The exact combinadic unrank result violates the stated contract at descending binomial positions.

Numerics◈ Members↗
FA-15168

Combinadic unrank: descending binomial positions · case 03

The exact combinadic unrank result violates the stated contract at descending binomial positions.

Numerics◈ Members↗
FA-15169

Combinadic unrank: descending binomial positions · case 04

The exact combinadic unrank result violates the stated contract at descending binomial positions.

Numerics◈ Members↗
FA-15170

Combinadic unrank: descending binomial positions · case 05

The exact combinadic unrank result violates the stated contract at descending binomial positions.

Numerics◈ Members↗
FA-15171

Combinadic unrank: greedy upper bound · case 01

The exact combinadic unrank result violates the stated contract at greedy upper bound.

Numerics● Open access↗
FA-15172

Combinadic unrank: greedy upper bound · case 02

The exact combinadic unrank result violates the stated contract at greedy upper bound.

Numerics◈ Members↗
FA-15173

Combinadic unrank: greedy upper bound · case 03

The exact combinadic unrank result violates the stated contract at greedy upper bound.

Numerics◈ Members↗
FA-15174

Combinadic unrank: greedy upper bound · case 04

The exact combinadic unrank result violates the stated contract at greedy upper bound.

Numerics◈ Members↗
FA-15175

Combinadic unrank: greedy upper bound · case 05

The exact combinadic unrank result violates the stated contract at greedy upper bound.

Numerics◈ Members↗
FA-15176

Combinadic unrank: residual colex rank · case 01

The exact combinadic unrank result violates the stated contract at residual colex rank.

Numerics● Open access↗
FA-15177

Combinadic unrank: residual colex rank · case 02

The exact combinadic unrank result violates the stated contract at residual colex rank.

Numerics◈ Members↗
FA-15178

Combinadic unrank: residual colex rank · case 03

The exact combinadic unrank result violates the stated contract at residual colex rank.

Numerics◈ Members↗
FA-15179

Combinadic unrank: residual colex rank · case 04

The exact combinadic unrank result violates the stated contract at residual colex rank.

Numerics◈ Members↗
FA-15180

Combinadic unrank: residual colex rank · case 05

The exact combinadic unrank result violates the stated contract at residual colex rank.

Numerics◈ Members↗
FA-15181

Combinadic unrank: strict preceding element ceiling · case 01

The exact combinadic unrank result violates the stated contract at strict preceding element ceiling.

Numerics● Open access↗
FA-15182

Combinadic unrank: strict preceding element ceiling · case 02

The exact combinadic unrank result violates the stated contract at strict preceding element ceiling.

Numerics◈ Members↗
FA-15183

Combinadic unrank: strict preceding element ceiling · case 03

The exact combinadic unrank result violates the stated contract at strict preceding element ceiling.

Numerics◈ Members↗
FA-15184

Combinadic unrank: strict preceding element ceiling · case 04

The exact combinadic unrank result violates the stated contract at strict preceding element ceiling.

Numerics◈ Members↗
FA-15185

Combinadic unrank: strict preceding element ceiling · case 05

The exact combinadic unrank result violates the stated contract at strict preceding element ceiling.

Numerics◈ Members↗
FA-15186

Combinadic unrank: increasing combination output · case 01

The exact combinadic unrank result violates the stated contract at increasing combination output.

Numerics● Open access↗
FA-15187

Combinadic unrank: increasing combination output · case 02

The exact combinadic unrank result violates the stated contract at increasing combination output.

Numerics◈ Members↗
FA-15188

Combinadic unrank: increasing combination output · case 03

The exact combinadic unrank result violates the stated contract at increasing combination output.

Numerics◈ Members↗
FA-15189

Combinadic unrank: increasing combination output · case 04

The exact combinadic unrank result violates the stated contract at increasing combination output.

Numerics◈ Members↗
FA-15190

Combinadic unrank: increasing combination output · case 05

The exact combinadic unrank result violates the stated contract at increasing combination output.

Numerics◈ Members↗
FA-15191

Dyck word ranking: prefix balance rejection · case 01

The exact dyck word ranking result violates the stated contract at prefix balance rejection.

Numerics● Open access↗
FA-15192

Dyck word ranking: prefix balance rejection · case 02

The exact dyck word ranking result violates the stated contract at prefix balance rejection.

Numerics◈ Members↗
FA-15193

Dyck word ranking: prefix balance rejection · case 03

The exact dyck word ranking result violates the stated contract at prefix balance rejection.

Numerics◈ Members↗
FA-15194

Dyck word ranking: prefix balance rejection · case 04

The exact dyck word ranking result violates the stated contract at prefix balance rejection.

Numerics◈ Members↗
FA-15195

Dyck word ranking: prefix balance rejection · case 05

The exact dyck word ranking result violates the stated contract at prefix balance rejection.

Numerics◈ Members↗
FA-15196

Dyck word ranking: skipped opening subtree · case 01

The exact dyck word ranking result violates the stated contract at skipped opening subtree.

Numerics● Open access↗
FA-15197

Dyck word ranking: skipped opening subtree · case 02

The exact dyck word ranking result violates the stated contract at skipped opening subtree.

Numerics◈ Members↗
FA-15198

Dyck word ranking: skipped opening subtree · case 03

The exact dyck word ranking result violates the stated contract at skipped opening subtree.

Numerics◈ Members↗
FA-15199

Dyck word ranking: skipped opening subtree · case 04

The exact dyck word ranking result violates the stated contract at skipped opening subtree.

Numerics◈ Members↗
FA-15200

Dyck word ranking: skipped opening subtree · case 05

The exact dyck word ranking result violates the stated contract at skipped opening subtree.

Numerics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗