FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-15201

Dyck word ranking: closing depth update · case 01

The exact dyck word ranking result violates the stated contract at closing depth update.

Numerics● Open access↗
FA-15202

Dyck word ranking: closing depth update · case 02

The exact dyck word ranking result violates the stated contract at closing depth update.

Numerics◈ Members↗
FA-15203

Dyck word ranking: closing depth update · case 03

The exact dyck word ranking result violates the stated contract at closing depth update.

Numerics◈ Members↗
FA-15204

Dyck word ranking: closing depth update · case 04

The exact dyck word ranking result violates the stated contract at closing depth update.

Numerics◈ Members↗
FA-15205

Dyck word ranking: closing depth update · case 05

The exact dyck word ranking result violates the stated contract at closing depth update.

Numerics◈ Members↗
FA-15206

Dyck word ranking: opening depth update · case 01

The exact dyck word ranking result violates the stated contract at opening depth update.

Numerics● Open access↗
FA-15207

Dyck word ranking: opening depth update · case 02

The exact dyck word ranking result violates the stated contract at opening depth update.

Numerics◈ Members↗
FA-15208

Dyck word ranking: opening depth update · case 03

The exact dyck word ranking result violates the stated contract at opening depth update.

Numerics◈ Members↗
FA-15209

Dyck word ranking: opening depth update · case 04

The exact dyck word ranking result violates the stated contract at opening depth update.

Numerics◈ Members↗
FA-15210

Dyck word ranking: opening depth update · case 05

The exact dyck word ranking result violates the stated contract at opening depth update.

Numerics◈ Members↗
FA-15211

Dyck word ranking: balanced word rank origin · case 01

The exact dyck word ranking result violates the stated contract at balanced word rank origin.

Numerics● Open access↗
FA-15212

Dyck word ranking: balanced word rank origin · case 02

The exact dyck word ranking result violates the stated contract at balanced word rank origin.

Numerics◈ Members↗
FA-15213

Dyck word ranking: balanced word rank origin · case 03

The exact dyck word ranking result violates the stated contract at balanced word rank origin.

Numerics◈ Members↗
FA-15214

Dyck word ranking: balanced word rank origin · case 04

The exact dyck word ranking result violates the stated contract at balanced word rank origin.

Numerics◈ Members↗
FA-15215

Dyck word ranking: balanced word rank origin · case 05

The exact dyck word ranking result violates the stated contract at balanced word rank origin.

Numerics◈ Members↗
FA-15216

Multiset permutation unrank: multiset alphabet order · case 01

The exact multiset permutation unrank result violates the stated contract at multiset alphabet order.

Numerics● Open access↗
FA-15217

Multiset permutation unrank: multiset alphabet order · case 02

The exact multiset permutation unrank result violates the stated contract at multiset alphabet order.

Numerics◈ Members↗
FA-15218

Multiset permutation unrank: multiset alphabet order · case 03

The exact multiset permutation unrank result violates the stated contract at multiset alphabet order.

Numerics◈ Members↗
FA-15219

Multiset permutation unrank: multiset alphabet order · case 04

The exact multiset permutation unrank result violates the stated contract at multiset alphabet order.

Numerics◈ Members↗
FA-15220

Multiset permutation unrank: multiset alphabet order · case 05

The exact multiset permutation unrank result violates the stated contract at multiset alphabet order.

Numerics◈ Members↗
FA-15221

Multiset permutation unrank: duplicate block normalization · case 01

The exact multiset permutation unrank result violates the stated contract at duplicate block normalization.

Numerics● Open access↗
FA-15222

Multiset permutation unrank: duplicate block normalization · case 02

The exact multiset permutation unrank result violates the stated contract at duplicate block normalization.

Numerics◈ Members↗
FA-15223

Multiset permutation unrank: duplicate block normalization · case 03

The exact multiset permutation unrank result violates the stated contract at duplicate block normalization.

Numerics◈ Members↗
FA-15224

Multiset permutation unrank: duplicate block normalization · case 04

The exact multiset permutation unrank result violates the stated contract at duplicate block normalization.

Numerics◈ Members↗
FA-15225

Multiset permutation unrank: duplicate block normalization · case 05

The exact multiset permutation unrank result violates the stated contract at duplicate block normalization.

Numerics◈ Members↗
FA-15226

Multiset permutation unrank: rank block membership · case 01

The exact multiset permutation unrank result violates the stated contract at rank block membership.

Numerics● Open access↗
FA-15227

Multiset permutation unrank: rank block membership · case 02

The exact multiset permutation unrank result violates the stated contract at rank block membership.

Numerics◈ Members↗
FA-15228

Multiset permutation unrank: rank block membership · case 03

The exact multiset permutation unrank result violates the stated contract at rank block membership.

Numerics◈ Members↗
FA-15229

Multiset permutation unrank: rank block membership · case 04

The exact multiset permutation unrank result violates the stated contract at rank block membership.

Numerics◈ Members↗
FA-15230

Multiset permutation unrank: rank block membership · case 05

The exact multiset permutation unrank result violates the stated contract at rank block membership.

Numerics◈ Members↗
FA-15231

Multiset permutation unrank: skipped block subtraction · case 01

The exact multiset permutation unrank result violates the stated contract at skipped block subtraction.

Numerics● Open access↗
FA-15232

Multiset permutation unrank: skipped block subtraction · case 02

The exact multiset permutation unrank result violates the stated contract at skipped block subtraction.

Numerics◈ Members↗
FA-15233

Multiset permutation unrank: skipped block subtraction · case 03

The exact multiset permutation unrank result violates the stated contract at skipped block subtraction.

Numerics◈ Members↗
FA-15234

Multiset permutation unrank: skipped block subtraction · case 04

The exact multiset permutation unrank result violates the stated contract at skipped block subtraction.

Numerics◈ Members↗
FA-15235

Multiset permutation unrank: skipped block subtraction · case 05

The exact multiset permutation unrank result violates the stated contract at skipped block subtraction.

Numerics◈ Members↗
FA-15236

Multiset permutation unrank: trial symbol restoration · case 01

The exact multiset permutation unrank result violates the stated contract at trial symbol restoration.

Numerics● Open access↗
FA-15237

Multiset permutation unrank: trial symbol restoration · case 02

The exact multiset permutation unrank result violates the stated contract at trial symbol restoration.

Numerics◈ Members↗
FA-15238

Multiset permutation unrank: trial symbol restoration · case 03

The exact multiset permutation unrank result violates the stated contract at trial symbol restoration.

Numerics◈ Members↗
FA-15239

Multiset permutation unrank: trial symbol restoration · case 04

The exact multiset permutation unrank result violates the stated contract at trial symbol restoration.

Numerics◈ Members↗
FA-15240

Multiset permutation unrank: trial symbol restoration · case 05

The exact multiset permutation unrank result violates the stated contract at trial symbol restoration.

Numerics◈ Members↗
FA-15241

Restricted growth strings: exact block count terminal · case 01

The exact restricted growth strings result violates the stated contract at exact block count terminal.

Numerics● Open access↗
FA-15242

Restricted growth strings: exact block count terminal · case 02

The exact restricted growth strings result violates the stated contract at exact block count terminal.

Numerics◈ Members↗
FA-15243

Restricted growth strings: exact block count terminal · case 03

The exact restricted growth strings result violates the stated contract at exact block count terminal.

Numerics◈ Members↗
FA-15244

Restricted growth strings: exact block count terminal · case 04

The exact restricted growth strings result violates the stated contract at exact block count terminal.

Numerics◈ Members↗
FA-15245

Restricted growth strings: exact block count terminal · case 05

The exact restricted growth strings result violates the stated contract at exact block count terminal.

Numerics◈ Members↗
FA-15246

Restricted growth strings: new block choice inclusion · case 01

The exact restricted growth strings result violates the stated contract at new block choice inclusion.

Numerics● Open access↗
FA-15247

Restricted growth strings: new block choice inclusion · case 02

The exact restricted growth strings result violates the stated contract at new block choice inclusion.

Numerics◈ Members↗
FA-15248

Restricted growth strings: new block choice inclusion · case 03

The exact restricted growth strings result violates the stated contract at new block choice inclusion.

Numerics◈ Members↗
FA-15249

Restricted growth strings: new block choice inclusion · case 04

The exact restricted growth strings result violates the stated contract at new block choice inclusion.

Numerics◈ Members↗
FA-15250

Restricted growth strings: new block choice inclusion · case 05

The exact restricted growth strings result violates the stated contract at new block choice inclusion.

Numerics◈ Members↗
FA-15251

Restricted growth strings: block budget pruning · case 01

The exact restricted growth strings result violates the stated contract at block budget pruning.

Numerics● Open access↗
FA-15252

Restricted growth strings: block budget pruning · case 02

The exact restricted growth strings result violates the stated contract at block budget pruning.

Numerics◈ Members↗
FA-15253

Restricted growth strings: block budget pruning · case 03

The exact restricted growth strings result violates the stated contract at block budget pruning.

Numerics◈ Members↗
FA-15254

Restricted growth strings: block budget pruning · case 04

The exact restricted growth strings result violates the stated contract at block budget pruning.

Numerics◈ Members↗
FA-15255

Restricted growth strings: block budget pruning · case 05

The exact restricted growth strings result violates the stated contract at block budget pruning.

Numerics◈ Members↗
FA-15256

Restricted growth strings: prefix extension position · case 01

The exact restricted growth strings result violates the stated contract at prefix extension position.

Numerics● Open access↗
FA-15257

Restricted growth strings: prefix extension position · case 02

The exact restricted growth strings result violates the stated contract at prefix extension position.

Numerics◈ Members↗
FA-15258

Restricted growth strings: prefix extension position · case 03

The exact restricted growth strings result violates the stated contract at prefix extension position.

Numerics◈ Members↗
FA-15259

Restricted growth strings: prefix extension position · case 04

The exact restricted growth strings result violates the stated contract at prefix extension position.

Numerics◈ Members↗
FA-15260

Restricted growth strings: prefix extension position · case 05

The exact restricted growth strings result violates the stated contract at prefix extension position.

Numerics◈ Members↗
FA-15261

Restricted growth strings: highest used block tracking · case 01

The exact restricted growth strings result violates the stated contract at highest used block tracking.

Numerics● Open access↗
FA-15262

Restricted growth strings: highest used block tracking · case 02

The exact restricted growth strings result violates the stated contract at highest used block tracking.

Numerics◈ Members↗
FA-15263

Restricted growth strings: highest used block tracking · case 03

The exact restricted growth strings result violates the stated contract at highest used block tracking.

Numerics◈ Members↗
FA-15264

Restricted growth strings: highest used block tracking · case 04

The exact restricted growth strings result violates the stated contract at highest used block tracking.

Numerics◈ Members↗
FA-15265

Restricted growth strings: highest used block tracking · case 05

The exact restricted growth strings result violates the stated contract at highest used block tracking.

Numerics◈ Members↗
FA-15266

Integer partition enumeration: partition candidate order · case 01

The exact integer partition enumeration result violates the stated contract at partition candidate order.

Numerics● Open access↗
FA-15267

Integer partition enumeration: partition candidate order · case 02

The exact integer partition enumeration result violates the stated contract at partition candidate order.

Numerics◈ Members↗
FA-15268

Integer partition enumeration: partition candidate order · case 03

The exact integer partition enumeration result violates the stated contract at partition candidate order.

Numerics◈ Members↗
FA-15269

Integer partition enumeration: partition candidate order · case 04

The exact integer partition enumeration result violates the stated contract at partition candidate order.

Numerics◈ Members↗
FA-15270

Integer partition enumeration: partition candidate order · case 05

The exact integer partition enumeration result violates the stated contract at partition candidate order.

Numerics◈ Members↗
FA-15271

Integer partition enumeration: positive part admission · case 01

The exact integer partition enumeration result violates the stated contract at positive part admission.

Numerics● Open access↗
FA-15272

Integer partition enumeration: positive part admission · case 02

The exact integer partition enumeration result violates the stated contract at positive part admission.

Numerics◈ Members↗
FA-15273

Integer partition enumeration: positive part admission · case 03

The exact integer partition enumeration result violates the stated contract at positive part admission.

Numerics◈ Members↗
FA-15274

Integer partition enumeration: positive part admission · case 04

The exact integer partition enumeration result violates the stated contract at positive part admission.

Numerics◈ Members↗
FA-15275

Integer partition enumeration: positive part admission · case 05

The exact integer partition enumeration result violates the stated contract at positive part admission.

Numerics◈ Members↗
FA-15276

Integer partition enumeration: partition remainder subtraction · case 01

The exact integer partition enumeration result violates the stated contract at partition remainder subtraction.

Numerics● Open access↗
FA-15277

Integer partition enumeration: partition remainder subtraction · case 02

The exact integer partition enumeration result violates the stated contract at partition remainder subtraction.

Numerics◈ Members↗
FA-15278

Integer partition enumeration: partition remainder subtraction · case 03

The exact integer partition enumeration result violates the stated contract at partition remainder subtraction.

Numerics◈ Members↗
FA-15279

Integer partition enumeration: partition remainder subtraction · case 04

The exact integer partition enumeration result violates the stated contract at partition remainder subtraction.

Numerics◈ Members↗
FA-15280

Integer partition enumeration: partition remainder subtraction · case 05

The exact integer partition enumeration result violates the stated contract at partition remainder subtraction.

Numerics◈ Members↗
FA-15281

Integer partition enumeration: nonincreasing part bound · case 01

The exact integer partition enumeration result violates the stated contract at nonincreasing part bound.

Numerics● Open access↗
FA-15282

Integer partition enumeration: nonincreasing part bound · case 02

The exact integer partition enumeration result violates the stated contract at nonincreasing part bound.

Numerics◈ Members↗
FA-15283

Integer partition enumeration: nonincreasing part bound · case 03

The exact integer partition enumeration result violates the stated contract at nonincreasing part bound.

Numerics◈ Members↗
FA-15284

Integer partition enumeration: nonincreasing part bound · case 04

The exact integer partition enumeration result violates the stated contract at nonincreasing part bound.

Numerics◈ Members↗
FA-15285

Integer partition enumeration: nonincreasing part bound · case 05

The exact integer partition enumeration result violates the stated contract at nonincreasing part bound.

Numerics◈ Members↗
FA-15286

Integer partition enumeration: partition prefix append · case 01

The exact integer partition enumeration result violates the stated contract at partition prefix append.

Numerics● Open access↗
FA-15287

Integer partition enumeration: partition prefix append · case 02

The exact integer partition enumeration result violates the stated contract at partition prefix append.

Numerics◈ Members↗
FA-15288

Integer partition enumeration: partition prefix append · case 03

The exact integer partition enumeration result violates the stated contract at partition prefix append.

Numerics◈ Members↗
FA-15289

Integer partition enumeration: partition prefix append · case 04

The exact integer partition enumeration result violates the stated contract at partition prefix append.

Numerics◈ Members↗
FA-15290

Integer partition enumeration: partition prefix append · case 05

The exact integer partition enumeration result violates the stated contract at partition prefix append.

Numerics◈ Members↗
FA-15291

Josephus elimination order: ring label origin · case 01

The exact josephus elimination order result violates the stated contract at ring label origin.

Numerics● Open access↗
FA-15292

Josephus elimination order: ring label origin · case 02

The exact josephus elimination order result violates the stated contract at ring label origin.

Numerics◈ Members↗
FA-15293

Josephus elimination order: ring label origin · case 03

The exact josephus elimination order result violates the stated contract at ring label origin.

Numerics◈ Members↗
FA-15294

Josephus elimination order: ring label origin · case 04

The exact josephus elimination order result violates the stated contract at ring label origin.

Numerics◈ Members↗
FA-15295

Josephus elimination order: ring label origin · case 05

The exact josephus elimination order result violates the stated contract at ring label origin.

Numerics◈ Members↗
FA-15296

Josephus elimination order: starting position · case 01

The exact josephus elimination order result violates the stated contract at starting position.

Numerics● Open access↗
FA-15297

Josephus elimination order: starting position · case 02

The exact josephus elimination order result violates the stated contract at starting position.

Numerics◈ Members↗
FA-15298

Josephus elimination order: starting position · case 03

The exact josephus elimination order result violates the stated contract at starting position.

Numerics◈ Members↗
FA-15299

Josephus elimination order: starting position · case 04

The exact josephus elimination order result violates the stated contract at starting position.

Numerics◈ Members↗
FA-15300

Josephus elimination order: starting position · case 05

The exact josephus elimination order result violates the stated contract at starting position.

Numerics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗