FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-86301

Crafting station queue: Station free time forgets queued work · case 01

Consecutive jobs on one station overlap.

Game economy crafting balance● Open access↗
FA-86302

Crafting station queue: Station free time forgets queued work · case 02

Consecutive jobs on one station overlap.

Game economy crafting balance◈ Members↗
FA-86303

Crafting station queue: Station free time forgets queued work · case 03

Consecutive jobs on one station overlap.

Game economy crafting balance◈ Members↗
FA-86304

Crafting station queue: Station free time forgets queued work · case 04

Consecutive jobs on one station overlap.

Game economy crafting balance◈ Members↗
FA-86305

Crafting station queue: Station free time forgets queued work · case 05

Consecutive jobs on one station overlap.

Game economy crafting balance◈ Members↗
FA-86306

Crafting station queue: Finished jobs listed in queue order · case 01

Completion notifications arrive out of finish order.

Game economy crafting balance● Open access↗
FA-86307

Crafting station queue: Finished jobs listed in queue order · case 02

Completion notifications arrive out of finish order.

Game economy crafting balance◈ Members↗
FA-86308

Crafting station queue: Finished jobs listed in queue order · case 03

Completion notifications arrive out of finish order.

Game economy crafting balance◈ Members↗
FA-86309

Crafting station queue: Finished jobs listed in queue order · case 04

Completion notifications arrive out of finish order.

Game economy crafting balance◈ Members↗
FA-86310

Crafting station queue: Finished jobs listed in queue order · case 05

Completion notifications arrive out of finish order.

Game economy crafting balance◈ Members↗
FA-86311

Crafting XP with rested pool: One kill drains the whole rested pool · case 01

A tiny xp gain doubles by the entire rested pool.

Game economy crafting balance● Open access↗
FA-86312

Crafting XP with rested pool: One kill drains the whole rested pool · case 02

A tiny xp gain doubles by the entire rested pool.

Game economy crafting balance◈ Members↗
FA-86313

Crafting XP with rested pool: One kill drains the whole rested pool · case 03

A tiny xp gain doubles by the entire rested pool.

Game economy crafting balance◈ Members↗
FA-86314

Crafting XP with rested pool: One kill drains the whole rested pool · case 04

A tiny xp gain doubles by the entire rested pool.

Game economy crafting balance◈ Members↗
FA-86315

Crafting XP with rested pool: One kill drains the whole rested pool · case 05

A tiny xp gain doubles by the entire rested pool.

Game economy crafting balance◈ Members↗
FA-86316

Crafting XP with rested pool: Rested pool drains by the base gain · case 01

Rested pool goes negative after a large gain.

Game economy crafting balance● Open access↗
FA-86317

Crafting XP with rested pool: Rested pool drains by the base gain · case 02

Rested pool goes negative after a large gain.

Game economy crafting balance◈ Members↗
FA-86318

Crafting XP with rested pool: Rested pool drains by the base gain · case 03

Rested pool goes negative after a large gain.

Game economy crafting balance◈ Members↗
FA-86319

Crafting XP with rested pool: Rested pool drains by the base gain · case 04

Rested pool goes negative after a large gain.

Game economy crafting balance◈ Members↗
FA-86320

Crafting XP with rested pool: Rested pool drains by the base gain · case 05

Rested pool goes negative after a large gain.

Game economy crafting balance◈ Members↗
FA-86321

Crafting XP with rested pool: Only one level per gain · case 01

A huge gain leaves an overfull xp bar.

Game economy crafting balance● Open access↗
FA-86322

Crafting XP with rested pool: Only one level per gain · case 02

A huge gain leaves an overfull xp bar.

Game economy crafting balance◈ Members↗
FA-86323

Crafting XP with rested pool: Only one level per gain · case 03

A huge gain leaves an overfull xp bar.

Game economy crafting balance◈ Members↗
FA-86324

Crafting XP with rested pool: Only one level per gain · case 04

A huge gain leaves an overfull xp bar.

Game economy crafting balance◈ Members↗
FA-86325

Crafting XP with rested pool: Only one level per gain · case 05

A huge gain leaves an overfull xp bar.

Game economy crafting balance◈ Members↗
FA-86326

Crafting XP with rested pool: Level-up discards overflow xp · case 01

Excess xp beyond the requirement is lost on each level.

Game economy crafting balance● Open access↗
FA-86327

Crafting XP with rested pool: Level-up discards overflow xp · case 02

Excess xp beyond the requirement is lost on each level.

Game economy crafting balance◈ Members↗
FA-86328

Crafting XP with rested pool: Level-up discards overflow xp · case 03

Excess xp beyond the requirement is lost on each level.

Game economy crafting balance◈ Members↗
FA-86329

Crafting XP with rested pool: Level-up discards overflow xp · case 04

Excess xp beyond the requirement is lost on each level.

Game economy crafting balance◈ Members↗
FA-86330

Crafting XP with rested pool: Level-up discards overflow xp · case 05

Excess xp beyond the requirement is lost on each level.

Game economy crafting balance◈ Members↗
FA-86331

Crafting XP with rested pool: Capped characters keep leftover xp · case 01

The xp bar shows progress past the level cap.

Game economy crafting balance● Open access↗
FA-86332

Crafting XP with rested pool: Capped characters keep leftover xp · case 02

The xp bar shows progress past the level cap.

Game economy crafting balance◈ Members↗
FA-86333

Crafting XP with rested pool: Capped characters keep leftover xp · case 03

The xp bar shows progress past the level cap.

Game economy crafting balance◈ Members↗
FA-86334

Crafting XP with rested pool: Capped characters keep leftover xp · case 04

The xp bar shows progress past the level cap.

Game economy crafting balance◈ Members↗
FA-86335

Crafting XP with rested pool: Capped characters keep leftover xp · case 05

The xp bar shows progress past the level cap.

Game economy crafting balance◈ Members↗
FA-86336

Crafting XP with rested pool: Capped characters burn rested xp · case 01

Rested pool is consumed after the level cap.

Game economy crafting balance● Open access↗
FA-86337

Crafting XP with rested pool: Capped characters burn rested xp · case 02

Rested pool is consumed after the level cap.

Game economy crafting balance◈ Members↗
FA-86338

Crafting XP with rested pool: Capped characters burn rested xp · case 03

Rested pool is consumed after the level cap.

Game economy crafting balance◈ Members↗
FA-86339

Crafting XP with rested pool: Capped characters burn rested xp · case 04

Rested pool is consumed after the level cap.

Game economy crafting balance◈ Members↗
FA-86340

Crafting XP with rested pool: Capped characters burn rested xp · case 05

Rested pool is consumed after the level cap.

Game economy crafting balance◈ Members↗
FA-86341

Room placement with padding: One-tile-wide rooms are accepted · case 01

Generated levels contain 2-wide slivers flagged as rooms.

Procedural level generation constraints● Open access↗
FA-86342

Room placement with padding: One-tile-wide rooms are accepted · case 02

Generated levels contain 2-wide slivers flagged as rooms.

Procedural level generation constraints◈ Members↗
FA-86343

Room placement with padding: One-tile-wide rooms are accepted · case 03

Generated levels contain 2-wide slivers flagged as rooms.

Procedural level generation constraints◈ Members↗
FA-86344

Room placement with padding: One-tile-wide rooms are accepted · case 04

Generated levels contain 2-wide slivers flagged as rooms.

Procedural level generation constraints◈ Members↗
FA-86345

Room placement with padding: One-tile-wide rooms are accepted · case 05

Generated levels contain 2-wide slivers flagged as rooms.

Procedural level generation constraints◈ Members↗
FA-86346

Room placement with padding: Rooms overwrite the outer wall · case 01

Rooms touch the map edge, leaving no boundary wall.

Procedural level generation constraints● Open access↗
FA-86347

Room placement with padding: Rooms overwrite the outer wall · case 02

Rooms touch the map edge, leaving no boundary wall.

Procedural level generation constraints◈ Members↗
FA-86348

Room placement with padding: Rooms overwrite the outer wall · case 03

Rooms touch the map edge, leaving no boundary wall.

Procedural level generation constraints◈ Members↗
FA-86349

Room placement with padding: Rooms overwrite the outer wall · case 04

Rooms touch the map edge, leaving no boundary wall.

Procedural level generation constraints◈ Members↗
FA-86350

Room placement with padding: Rooms overwrite the outer wall · case 05

Rooms touch the map edge, leaving no boundary wall.

Procedural level generation constraints◈ Members↗
FA-86351

Room placement with padding: Rooms start on the border row · case 01

Rooms at column or row zero erase the top or left wall.

Procedural level generation constraints● Open access↗
FA-86352

Room placement with padding: Rooms start on the border row · case 02

Rooms at column or row zero erase the top or left wall.

Procedural level generation constraints◈ Members↗
FA-86353

Room placement with padding: Rooms start on the border row · case 03

Rooms at column or row zero erase the top or left wall.

Procedural level generation constraints◈ Members↗
FA-86354

Room placement with padding: Rooms start on the border row · case 04

Rooms at column or row zero erase the top or left wall.

Procedural level generation constraints◈ Members↗
FA-86355

Room placement with padding: Rooms start on the border row · case 05

Rooms at column or row zero erase the top or left wall.

Procedural level generation constraints◈ Members↗
FA-86356

Room placement with padding: Horizontal neighbours ignore padding · case 01

Side-by-side rooms share a wall with no corridor gap.

Procedural level generation constraints● Open access↗
FA-86357

Room placement with padding: Horizontal neighbours ignore padding · case 02

Side-by-side rooms share a wall with no corridor gap.

Procedural level generation constraints◈ Members↗
FA-86358

Room placement with padding: Horizontal neighbours ignore padding · case 03

Side-by-side rooms share a wall with no corridor gap.

Procedural level generation constraints◈ Members↗
FA-86359

Room placement with padding: Horizontal neighbours ignore padding · case 04

Side-by-side rooms share a wall with no corridor gap.

Procedural level generation constraints◈ Members↗
FA-86360

Room placement with padding: Horizontal neighbours ignore padding · case 05

Side-by-side rooms share a wall with no corridor gap.

Procedural level generation constraints◈ Members↗
FA-86361

Room placement with padding: Rejected rooms still block space · case 01

A rejected candidate prevents later valid rooms from being placed.

Procedural level generation constraints● Open access↗
FA-86362

Room placement with padding: Rejected rooms still block space · case 02

A rejected candidate prevents later valid rooms from being placed.

Procedural level generation constraints◈ Members↗
FA-86363

Room placement with padding: Rejected rooms still block space · case 03

A rejected candidate prevents later valid rooms from being placed.

Procedural level generation constraints◈ Members↗
FA-86364

Room placement with padding: Rejected rooms still block space · case 04

A rejected candidate prevents later valid rooms from being placed.

Procedural level generation constraints◈ Members↗
FA-86365

Room placement with padding: Rejected rooms still block space · case 05

A rejected candidate prevents later valid rooms from being placed.

Procedural level generation constraints◈ Members↗
FA-86366

Level reachability flood fill: Flood fill squeezes through diagonal gaps · case 01

Levels are validated as solvable although the exit is only diagonally adjacent.

Procedural level generation constraints● Open access↗
FA-86367

Level reachability flood fill: Flood fill squeezes through diagonal gaps · case 02

Levels are validated as solvable although the exit is only diagonally adjacent.

Procedural level generation constraints◈ Members↗
FA-86368

Level reachability flood fill: Flood fill squeezes through diagonal gaps · case 03

Levels are validated as solvable although the exit is only diagonally adjacent.

Procedural level generation constraints◈ Members↗
FA-86369

Level reachability flood fill: Flood fill squeezes through diagonal gaps · case 04

Levels are validated as solvable although the exit is only diagonally adjacent.

Procedural level generation constraints◈ Members↗
FA-86370

Level reachability flood fill: Flood fill squeezes through diagonal gaps · case 05

Levels are validated as solvable although the exit is only diagonally adjacent.

Procedural level generation constraints◈ Members↗
FA-86371

Level reachability flood fill: Water blocks swimmers · case 01

Levels requiring swimming are rejected even when the player can swim.

Procedural level generation constraints● Open access↗
FA-86372

Level reachability flood fill: Water blocks swimmers · case 02

Levels requiring swimming are rejected even when the player can swim.

Procedural level generation constraints◈ Members↗
FA-86373

Level reachability flood fill: Water blocks swimmers · case 03

Levels requiring swimming are rejected even when the player can swim.

Procedural level generation constraints◈ Members↗
FA-86374

Level reachability flood fill: Water blocks swimmers · case 04

Levels requiring swimming are rejected even when the player can swim.

Procedural level generation constraints◈ Members↗
FA-86375

Level reachability flood fill: Water blocks swimmers · case 05

Levels requiring swimming are rejected even when the player can swim.

Procedural level generation constraints◈ Members↗
FA-86376

Level reachability flood fill: Start cell is not counted · case 01

An enclosed start reports zero reachable cells.

Procedural level generation constraints● Open access↗
FA-86377

Level reachability flood fill: Start cell is not counted · case 02

An enclosed start reports zero reachable cells.

Procedural level generation constraints◈ Members↗
FA-86378

Level reachability flood fill: Start cell is not counted · case 03

An enclosed start reports zero reachable cells.

Procedural level generation constraints◈ Members↗
FA-86379

Level reachability flood fill: Start cell is not counted · case 04

An enclosed start reports zero reachable cells.

Procedural level generation constraints◈ Members↗
FA-86380

Level reachability flood fill: Start cell is not counted · case 05

An enclosed start reports zero reachable cells.

Procedural level generation constraints◈ Members↗
FA-86381

Level reachability flood fill: Doors are treated as walls · case 01

Rooms behind doors are reported unreachable.

Procedural level generation constraints● Open access↗
FA-86382

Level reachability flood fill: Doors are treated as walls · case 02

Rooms behind doors are reported unreachable.

Procedural level generation constraints◈ Members↗
FA-86383

Level reachability flood fill: Doors are treated as walls · case 03

Rooms behind doors are reported unreachable.

Procedural level generation constraints◈ Members↗
FA-86384

Level reachability flood fill: Doors are treated as walls · case 04

Rooms behind doors are reported unreachable.

Procedural level generation constraints◈ Members↗
FA-86385

Level reachability flood fill: Doors are treated as walls · case 05

Rooms behind doors are reported unreachable.

Procedural level generation constraints◈ Members↗
FA-86386

Cave smoothing automaton: Only diagonal neighbours are counted · case 01

Caves smooth into diagonal checkerboards.

Procedural level generation constraints● Open access↗
FA-86387

Cave smoothing automaton: Only diagonal neighbours are counted · case 02

Caves smooth into diagonal checkerboards.

Procedural level generation constraints◈ Members↗
FA-86388

Cave smoothing automaton: Only diagonal neighbours are counted · case 03

Caves smooth into diagonal checkerboards.

Procedural level generation constraints◈ Members↗
FA-86389

Cave smoothing automaton: Only diagonal neighbours are counted · case 04

Caves smooth into diagonal checkerboards.

Procedural level generation constraints◈ Members↗
FA-86390

Cave smoothing automaton: Only diagonal neighbours are counted · case 05

Caves smooth into diagonal checkerboards.

Procedural level generation constraints◈ Members↗
FA-86391

Cave smoothing automaton: Borders always count as walls · case 01

Open-edge maps grow walls along the boundary.

Procedural level generation constraints● Open access↗
FA-86392

Cave smoothing automaton: Borders always count as walls · case 02

Open-edge maps grow walls along the boundary.

Procedural level generation constraints◈ Members↗
FA-86393

Cave smoothing automaton: Borders always count as walls · case 03

Open-edge maps grow walls along the boundary.

Procedural level generation constraints◈ Members↗
FA-86394

Cave smoothing automaton: Borders always count as walls · case 04

Open-edge maps grow walls along the boundary.

Procedural level generation constraints◈ Members↗
FA-86395

Cave smoothing automaton: Borders always count as walls · case 05

Open-edge maps grow walls along the boundary.

Procedural level generation constraints◈ Members↗
FA-86396

Cave smoothing automaton: Automaton reads already-updated rows · case 01

Cave shape depends on scan direction.

Procedural level generation constraints● Open access↗
FA-86397

Cave smoothing automaton: Automaton reads already-updated rows · case 02

Cave shape depends on scan direction.

Procedural level generation constraints◈ Members↗
FA-86398

Cave smoothing automaton: Automaton reads already-updated rows · case 03

Cave shape depends on scan direction.

Procedural level generation constraints◈ Members↗
FA-86399

Cave smoothing automaton: Automaton reads already-updated rows · case 04

Cave shape depends on scan direction.

Procedural level generation constraints◈ Members↗
FA-86400

Cave smoothing automaton: Automaton reads already-updated rows · case 05

Cave shape depends on scan direction.

Procedural level generation constraints◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗