FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-82301

Connector bonus granted to high cards · case 01

Queen-jack and ace-king receive the low-connector bonus point.

Poker hand evaluation● Open access↗
FA-82302

Connector bonus granted to high cards · case 02

Queen-jack and ace-king receive the low-connector bonus point.

Poker hand evaluation◈ Members↗
FA-82303

Connector bonus granted to high cards · case 03

Queen-jack and ace-king receive the low-connector bonus point.

Poker hand evaluation◈ Members↗
FA-82304

Connector bonus granted to high cards · case 04

Queen-jack and ace-king receive the low-connector bonus point.

Poker hand evaluation◈ Members↗
FA-82305

Connector bonus granted to high cards · case 05

Queen-jack and ace-king receive the low-connector bonus point.

Poker hand evaluation◈ Members↗
FA-82306

Chen score rounded to even instead of up · case 01

Nine-seven offsuit scores 2 instead of 3.

Poker hand evaluation● Open access↗
FA-82307

Chen score rounded to even instead of up · case 02

Nine-seven offsuit scores 2 instead of 3.

Poker hand evaluation◈ Members↗
FA-82308

Chen score rounded to even instead of up · case 03

Nine-seven offsuit scores 2 instead of 3.

Poker hand evaluation◈ Members↗
FA-82309

Chen score rounded to even instead of up · case 04

Nine-seven offsuit scores 2 instead of 3.

Poker hand evaluation◈ Members↗
FA-82310

Chen score rounded to even instead of up · case 05

Nine-seven offsuit scores 2 instead of 3.

Poker hand evaluation◈ Members↗
FA-82311

Paired badugi counted as four cards · case 01

A-A-3-4 in four suits beats a genuine king-high badugi.

Poker hand evaluation● Open access↗
FA-82312

Paired badugi counted as four cards · case 02

A-A-3-4 in four suits beats a genuine king-high badugi.

Poker hand evaluation◈ Members↗
FA-82313

Paired badugi counted as four cards · case 03

A-A-3-4 in four suits beats a genuine king-high badugi.

Poker hand evaluation◈ Members↗
FA-82314

Paired badugi counted as four cards · case 04

A-A-3-4 in four suits beats a genuine king-high badugi.

Poker hand evaluation◈ Members↗
FA-82315

Paired badugi counted as four cards · case 05

A-A-3-4 in four suits beats a genuine king-high badugi.

Poker hand evaluation◈ Members↗
FA-82316

Worst qualifying subset chosen for a badugi · case 01

A three-card hand is valued by its highest valid subset rather than its lowest.

Poker hand evaluation● Open access↗
FA-82317

Worst qualifying subset chosen for a badugi · case 02

A three-card hand is valued by its highest valid subset rather than its lowest.

Poker hand evaluation◈ Members↗
FA-82318

Worst qualifying subset chosen for a badugi · case 03

A three-card hand is valued by its highest valid subset rather than its lowest.

Poker hand evaluation◈ Members↗
FA-82319

Worst qualifying subset chosen for a badugi · case 04

A three-card hand is valued by its highest valid subset rather than its lowest.

Poker hand evaluation◈ Members↗
FA-82320

Worst qualifying subset chosen for a badugi · case 05

A three-card hand is valued by its highest valid subset rather than its lowest.

Poker hand evaluation◈ Members↗
FA-82321

Higher badugi wins the pot · case 01

A-2-3-8 beats A-2-4-7 although the eight-high badugi is the worse hand.

Poker hand evaluation● Open access↗
FA-82322

Higher badugi wins the pot · case 02

A-2-3-8 beats A-2-4-7 although the eight-high badugi is the worse hand.

Poker hand evaluation◈ Members↗
FA-82323

Higher badugi wins the pot · case 03

A-2-3-8 beats A-2-4-7 although the eight-high badugi is the worse hand.

Poker hand evaluation◈ Members↗
FA-82324

Higher badugi wins the pot · case 04

A-2-3-8 beats A-2-4-7 although the eight-high badugi is the worse hand.

Poker hand evaluation◈ Members↗
FA-82325

Higher badugi wins the pot · case 05

A-2-3-8 beats A-2-4-7 although the eight-high badugi is the worse hand.

Poker hand evaluation◈ Members↗
FA-82326

Badugi search settles for one-card subsets · case 01

Every hand evaluates as a one-card hand, so comparisons depend only on the lowest card.

Poker hand evaluation● Open access↗
FA-82327

Badugi search settles for one-card subsets · case 02

Every hand evaluates as a one-card hand, so comparisons depend only on the lowest card.

Poker hand evaluation◈ Members↗
FA-82328

Badugi search settles for one-card subsets · case 03

Every hand evaluates as a one-card hand, so comparisons depend only on the lowest card.

Poker hand evaluation◈ Members↗
FA-82329

Badugi search settles for one-card subsets · case 04

Every hand evaluates as a one-card hand, so comparisons depend only on the lowest card.

Poker hand evaluation◈ Members↗
FA-82330

Badugi search settles for one-card subsets · case 05

Every hand evaluates as a one-card hand, so comparisons depend only on the lowest card.

Poker hand evaluation◈ Members↗
FA-82331

Reports the most hole cards that can play · case 01

When the board plays, the hand is annotated as using both hole cards.

Poker hand evaluation● Open access↗
FA-82332

Reports the most hole cards that can play · case 02

When the board plays, the hand is annotated as using both hole cards.

Poker hand evaluation◈ Members↗
FA-82333

Reports the most hole cards that can play · case 03

When the board plays, the hand is annotated as using both hole cards.

Poker hand evaluation◈ Members↗
FA-82334

Reports the most hole cards that can play · case 04

When the board plays, the hand is annotated as using both hole cards.

Poker hand evaluation◈ Members↗
FA-82335

Reports the most hole cards that can play · case 05

When the board plays, the hand is annotated as using both hole cards.

Poker hand evaluation◈ Members↗
FA-82336

Board declared to play when only the category matches · case 01

A player whose ace kicker matters is told the board plays.

Poker hand evaluation● Open access↗
FA-82337

Board declared to play when only the category matches · case 02

A player whose ace kicker matters is told the board plays.

Poker hand evaluation◈ Members↗
FA-82338

Board declared to play when only the category matches · case 03

A player whose ace kicker matters is told the board plays.

Poker hand evaluation◈ Members↗
FA-82339

Board declared to play when only the category matches · case 04

A player whose ace kicker matters is told the board plays.

Poker hand evaluation◈ Members↗
FA-82340

Board declared to play when only the category matches · case 05

A player whose ace kicker matters is told the board plays.

Poker hand evaluation◈ Members↗
FA-82341

Knight on the h-file jumps to the a-file · case 01

A knight on h3 is offered a2 and a4, which wrap around the board edge.

Chess move legality● Open access↗
FA-82342

Knight on the h-file jumps to the a-file · case 02

A knight on h3 is offered a2 and a4, which wrap around the board edge.

Chess move legality◈ Members↗
FA-82343

Knight on the h-file jumps to the a-file · case 03

A knight on h3 is offered a2 and a4, which wrap around the board edge.

Chess move legality◈ Members↗
FA-82344

Knight on the h-file jumps to the a-file · case 04

A knight on h3 is offered a2 and a4, which wrap around the board edge.

Chess move legality◈ Members↗
FA-82345

Knight on the h-file jumps to the a-file · case 05

A knight on h3 is offered a2 and a4, which wrap around the board edge.

Chess move legality◈ Members↗
FA-82346

Knight target off the top edge accepted · case 01

A knight on c7 is offered a ninth-rank square named "a9".

Chess move legality● Open access↗
FA-82347

Knight target off the top edge accepted · case 02

A knight on c7 is offered a ninth-rank square named "a9".

Chess move legality◈ Members↗
FA-82348

Knight target off the top edge accepted · case 03

A knight on c7 is offered a ninth-rank square named "a9".

Chess move legality◈ Members↗
FA-82349

Knight target off the top edge accepted · case 04

A knight on c7 is offered a ninth-rank square named "a9".

Chess move legality◈ Members↗
FA-82350

Knight target off the top edge accepted · case 05

A knight on c7 is offered a ninth-rank square named "a9".

Chess move legality◈ Members↗
FA-82351

Knight captures its own side but not the enemy · case 01

The knight may land on a friendly bishop but not capture an enemy pawn.

Chess move legality● Open access↗
FA-82352

Knight captures its own side but not the enemy · case 02

The knight may land on a friendly bishop but not capture an enemy pawn.

Chess move legality◈ Members↗
FA-82353

Knight captures its own side but not the enemy · case 03

The knight may land on a friendly bishop but not capture an enemy pawn.

Chess move legality◈ Members↗
FA-82354

Knight captures its own side but not the enemy · case 04

The knight may land on a friendly bishop but not capture an enemy pawn.

Chess move legality◈ Members↗
FA-82355

Knight captures its own side but not the enemy · case 05

The knight may land on a friendly bishop but not capture an enemy pawn.

Chess move legality◈ Members↗
FA-82356

Mistyped knight offset produces a pawn-like step · case 01

A knight is offered the square two ranks straight below it.

Chess move legality● Open access↗
FA-82357

Mistyped knight offset produces a pawn-like step · case 02

A knight is offered the square two ranks straight below it.

Chess move legality◈ Members↗
FA-82358

Mistyped knight offset produces a pawn-like step · case 03

A knight is offered the square two ranks straight below it.

Chess move legality◈ Members↗
FA-82359

Mistyped knight offset produces a pawn-like step · case 04

A knight is offered the square two ranks straight below it.

Chess move legality◈ Members↗
FA-82360

Mistyped knight offset produces a pawn-like step · case 05

A knight is offered the square two ranks straight below it.

Chess move legality◈ Members↗
FA-82361

Rank digit used as a zero-based row · case 01

Every knight target is reported one rank too high.

Chess move legality● Open access↗
FA-82362

Rank digit used as a zero-based row · case 02

Every knight target is reported one rank too high.

Chess move legality◈ Members↗
FA-82363

Rank digit used as a zero-based row · case 03

Every knight target is reported one rank too high.

Chess move legality◈ Members↗
FA-82364

Rank digit used as a zero-based row · case 04

Every knight target is reported one rank too high.

Chess move legality◈ Members↗
FA-82365

Rank digit used as a zero-based row · case 05

Every knight target is reported one rank too high.

Chess move legality◈ Members↗
FA-82366

Slider x-rays through an enemy piece · case 01

A rook facing an enemy pawn is offered the squares behind it, including the enemy king square.

Chess move legality● Open access↗
FA-82367

Slider x-rays through an enemy piece · case 02

A rook facing an enemy pawn is offered the squares behind it, including the enemy king square.

Chess move legality◈ Members↗
FA-82368

Slider x-rays through an enemy piece · case 03

A rook facing an enemy pawn is offered the squares behind it, including the enemy king square.

Chess move legality◈ Members↗
FA-82369

Slider x-rays through an enemy piece · case 04

A rook facing an enemy pawn is offered the squares behind it, including the enemy king square.

Chess move legality◈ Members↗
FA-82370

Slider x-rays through an enemy piece · case 05

A rook facing an enemy pawn is offered the squares behind it, including the enemy king square.

Chess move legality◈ Members↗
FA-82371

Rays run onto a ninth file and rank · case 01

A rook on a1 is offered "i1" and "a9".

Chess move legality● Open access↗
FA-82372

Rays run onto a ninth file and rank · case 02

A rook on a1 is offered "i1" and "a9".

Chess move legality◈ Members↗
FA-82373

Rays run onto a ninth file and rank · case 03

A rook on a1 is offered "i1" and "a9".

Chess move legality◈ Members↗
FA-82374

Rays run onto a ninth file and rank · case 04

A rook on a1 is offered "i1" and "a9".

Chess move legality◈ Members↗
FA-82375

Rays run onto a ninth file and rank · case 05

A rook on a1 is offered "i1" and "a9".

Chess move legality◈ Members↗
FA-82376

Queen moves only like a rook · case 01

A queen is never offered diagonal moves.

Chess move legality● Open access↗
FA-82377

Queen moves only like a rook · case 02

A queen is never offered diagonal moves.

Chess move legality◈ Members↗
FA-82378

Queen moves only like a rook · case 03

A queen is never offered diagonal moves.

Chess move legality◈ Members↗
FA-82379

Queen moves only like a rook · case 04

A queen is never offered diagonal moves.

Chess move legality◈ Members↗
FA-82380

Queen moves only like a rook · case 05

A queen is never offered diagonal moves.

Chess move legality◈ Members↗
FA-82381

Bishop never moves toward a1 · case 01

A bishop on f5 is not offered e4, d3 or the capture on c2, and some targets repeat.

Chess move legality● Open access↗
FA-82382

Bishop never moves toward a1 · case 02

A bishop on f5 is not offered e4, d3 or the capture on c2, and some targets repeat.

Chess move legality◈ Members↗
FA-82383

Bishop never moves toward a1 · case 03

A bishop on f5 is not offered e4, d3 or the capture on c2, and some targets repeat.

Chess move legality◈ Members↗
FA-82384

Bishop never moves toward a1 · case 04

A bishop on f5 is not offered e4, d3 or the capture on c2, and some targets repeat.

Chess move legality◈ Members↗
FA-82385

Bishop never moves toward a1 · case 05

A bishop on f5 is not offered e4, d3 or the capture on c2, and some targets repeat.

Chess move legality◈ Members↗
FA-82386

Pawn double step jumps over a blocker · case 01

A pawn on e2 with a knight on e3 is offered e4.

Chess move legality● Open access↗
FA-82387

Pawn double step jumps over a blocker · case 02

A pawn on e2 with a knight on e3 is offered e4.

Chess move legality◈ Members↗
FA-82388

Pawn double step jumps over a blocker · case 03

A pawn on e2 with a knight on e3 is offered e4.

Chess move legality◈ Members↗
FA-82389

Pawn double step jumps over a blocker · case 04

A pawn on e2 with a knight on e3 is offered e4.

Chess move legality◈ Members↗
FA-82390

Pawn double step jumps over a blocker · case 05

A pawn on e2 with a knight on e3 is offered e4.

Chess move legality◈ Members↗
FA-82391

Black pawns cannot make their initial double step · case 01

A black pawn on d7 is offered only d6.

Chess move legality● Open access↗
FA-82392

Black pawns cannot make their initial double step · case 02

A black pawn on d7 is offered only d6.

Chess move legality◈ Members↗
FA-82393

Black pawns cannot make their initial double step · case 03

A black pawn on d7 is offered only d6.

Chess move legality◈ Members↗
FA-82394

Black pawns cannot make their initial double step · case 04

A black pawn on d7 is offered only d6.

Chess move legality◈ Members↗
FA-82395

Black pawns cannot make their initial double step · case 05

A black pawn on d7 is offered only d6.

Chess move legality◈ Members↗
FA-82396

Pawn captures its own pieces diagonally · case 01

A white pawn on d4 may capture the white bishop on e5.

Chess move legality● Open access↗
FA-82397

Pawn captures its own pieces diagonally · case 02

A white pawn on d4 may capture the white bishop on e5.

Chess move legality◈ Members↗
FA-82398

Pawn captures its own pieces diagonally · case 03

A white pawn on d4 may capture the white bishop on e5.

Chess move legality◈ Members↗
FA-82399

Pawn captures its own pieces diagonally · case 04

A white pawn on d4 may capture the white bishop on e5.

Chess move legality◈ Members↗
FA-82400

Pawn captures its own pieces diagonally · case 05

A white pawn on d4 may capture the white bishop on e5.

Chess move legality◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗