FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-82401

Promotion triggered one rank early · case 01

A white pawn arriving on the seventh rank is expanded into promotion moves, while the eighth rank is not.

Chess move legality● Open access↗
FA-82402

Promotion triggered one rank early · case 02

A white pawn arriving on the seventh rank is expanded into promotion moves, while the eighth rank is not.

Chess move legality◈ Members↗
FA-82403

Promotion triggered one rank early · case 03

A white pawn arriving on the seventh rank is expanded into promotion moves, while the eighth rank is not.

Chess move legality◈ Members↗
FA-82404

Promotion triggered one rank early · case 04

A white pawn arriving on the seventh rank is expanded into promotion moves, while the eighth rank is not.

Chess move legality◈ Members↗
FA-82405

Promotion triggered one rank early · case 05

A white pawn arriving on the seventh rank is expanded into promotion moves, while the eighth rank is not.

Chess move legality◈ Members↗
FA-82406

Only queen promotions are generated · case 01

Underpromotion to rook, bishop or knight is never offered.

Chess move legality● Open access↗
FA-82407

Only queen promotions are generated · case 02

Underpromotion to rook, bishop or knight is never offered.

Chess move legality◈ Members↗
FA-82408

Only queen promotions are generated · case 03

Underpromotion to rook, bishop or knight is never offered.

Chess move legality◈ Members↗
FA-82409

Only queen promotions are generated · case 04

Underpromotion to rook, bishop or knight is never offered.

Chess move legality◈ Members↗
FA-82410

Only queen promotions are generated · case 05

Underpromotion to rook, bishop or knight is never offered.

Chess move legality◈ Members↗
FA-82411

En passant looks for the victim on the target square · case 01

Every en passant capture is rejected because the target square is empty.

Chess move legality● Open access↗
FA-82412

En passant looks for the victim on the target square · case 02

Every en passant capture is rejected because the target square is empty.

Chess move legality◈ Members↗
FA-82413

En passant looks for the victim on the target square · case 03

Every en passant capture is rejected because the target square is empty.

Chess move legality◈ Members↗
FA-82414

En passant looks for the victim on the target square · case 04

Every en passant capture is rejected because the target square is empty.

Chess move legality◈ Members↗
FA-82415

En passant looks for the victim on the target square · case 05

Every en passant capture is rejected because the target square is empty.

Chess move legality◈ Members↗
FA-82416

Horizontal pin through two pawns missed · case 01

With king and enemy rook on the fifth rank and only the two pawns between them, en passant is allowed.

Chess move legality● Open access↗
FA-82417

Horizontal pin through two pawns missed · case 02

With king and enemy rook on the fifth rank and only the two pawns between them, en passant is allowed.

Chess move legality◈ Members↗
FA-82418

Horizontal pin through two pawns missed · case 03

With king and enemy rook on the fifth rank and only the two pawns between them, en passant is allowed.

Chess move legality◈ Members↗
FA-82419

Horizontal pin through two pawns missed · case 04

With king and enemy rook on the fifth rank and only the two pawns between them, en passant is allowed.

Chess move legality◈ Members↗
FA-82420

Horizontal pin through two pawns missed · case 05

With king and enemy rook on the fifth rank and only the two pawns between them, en passant is allowed.

Chess move legality◈ Members↗
FA-82421

Black en passant rejected on its fifth rank · case 01

A black pawn on d4 cannot capture en passant on e3.

Chess move legality● Open access↗
FA-82422

Black en passant rejected on its fifth rank · case 02

A black pawn on d4 cannot capture en passant on e3.

Chess move legality◈ Members↗
FA-82423

Black en passant rejected on its fifth rank · case 03

A black pawn on d4 cannot capture en passant on e3.

Chess move legality◈ Members↗
FA-82424

Black en passant rejected on its fifth rank · case 04

A black pawn on d4 cannot capture en passant on e3.

Chess move legality◈ Members↗
FA-82425

Black en passant rejected on its fifth rank · case 05

A black pawn on d4 cannot capture en passant on e3.

Chess move legality◈ Members↗
FA-82426

Any diagonal step accepted while an ep square exists · case 01

With ep on d6, a pawn capturing diagonally onto an empty f6 is treated as en passant.

Chess move legality● Open access↗
FA-82427

Any diagonal step accepted while an ep square exists · case 02

With ep on d6, a pawn capturing diagonally onto an empty f6 is treated as en passant.

Chess move legality◈ Members↗
FA-82428

Any diagonal step accepted while an ep square exists · case 03

With ep on d6, a pawn capturing diagonally onto an empty f6 is treated as en passant.

Chess move legality◈ Members↗
FA-82429

Any diagonal step accepted while an ep square exists · case 04

With ep on d6, a pawn capturing diagonally onto an empty f6 is treated as en passant.

Chess move legality◈ Members↗
FA-82430

Any diagonal step accepted while an ep square exists · case 05

With ep on d6, a pawn capturing diagonally onto an empty f6 is treated as en passant.

Chess move legality◈ Members↗
FA-82431

Rook on a diagonal treated as a discovered checker · case 01

En passant is rejected because a rook sits on a diagonal from the king.

Chess move legality● Open access↗
FA-82432

Rook on a diagonal treated as a discovered checker · case 02

En passant is rejected because a rook sits on a diagonal from the king.

Chess move legality◈ Members↗
FA-82433

Rook on a diagonal treated as a discovered checker · case 03

En passant is rejected because a rook sits on a diagonal from the king.

Chess move legality◈ Members↗
FA-82434

Rook on a diagonal treated as a discovered checker · case 04

En passant is rejected because a rook sits on a diagonal from the king.

Chess move legality◈ Members↗
FA-82435

Rook on a diagonal treated as a discovered checker · case 05

En passant is rejected because a rook sits on a diagonal from the king.

Chess move legality◈ Members↗
FA-82436

Queenside castling through a piece on b1 · case 01

White castles long with a knight still on b1.

Chess move legality● Open access↗
FA-82437

Queenside castling through a piece on b1 · case 02

White castles long with a knight still on b1.

Chess move legality◈ Members↗
FA-82438

Queenside castling through a piece on b1 · case 03

White castles long with a knight still on b1.

Chess move legality◈ Members↗
FA-82439

Queenside castling through a piece on b1 · case 04

White castles long with a knight still on b1.

Chess move legality◈ Members↗
FA-82440

Queenside castling through a piece on b1 · case 05

White castles long with a knight still on b1.

Chess move legality◈ Members↗
FA-82441

Queenside castling forbidden when b1 is attacked · case 01

A rook attacking b1 prevents white from castling long.

Chess move legality● Open access↗
FA-82442

Queenside castling forbidden when b1 is attacked · case 02

A rook attacking b1 prevents white from castling long.

Chess move legality◈ Members↗
FA-82443

Queenside castling forbidden when b1 is attacked · case 03

A rook attacking b1 prevents white from castling long.

Chess move legality◈ Members↗
FA-82444

Queenside castling forbidden when b1 is attacked · case 04

A rook attacking b1 prevents white from castling long.

Chess move legality◈ Members↗
FA-82445

Queenside castling forbidden when b1 is attacked · case 05

A rook attacking b1 prevents white from castling long.

Chess move legality◈ Members↗
FA-82446

Black castling checks white's rights letter · case 01

Black may castle kingside when only white holds the K right, and is refused with its own q right.

Chess move legality● Open access↗
FA-82447

Black castling checks white's rights letter · case 02

Black may castle kingside when only white holds the K right, and is refused with its own q right.

Chess move legality◈ Members↗
FA-82448

Black castling checks white's rights letter · case 03

Black may castle kingside when only white holds the K right, and is refused with its own q right.

Chess move legality◈ Members↗
FA-82449

Black castling checks white's rights letter · case 04

Black may castle kingside when only white holds the K right, and is refused with its own q right.

Chess move legality◈ Members↗
FA-82450

Black castling checks white's rights letter · case 05

Black may castle kingside when only white holds the K right, and is refused with its own q right.

Chess move legality◈ Members↗
FA-82451

Castling with a knight in the rook corner · case 01

White castles kingside with a knight or an enemy rook on h1.

Chess move legality● Open access↗
FA-82452

Castling with a knight in the rook corner · case 02

White castles kingside with a knight or an enemy rook on h1.

Chess move legality◈ Members↗
FA-82453

Castling with a knight in the rook corner · case 03

White castles kingside with a knight or an enemy rook on h1.

Chess move legality◈ Members↗
FA-82454

Castling with a knight in the rook corner · case 04

White castles kingside with a knight or an enemy rook on h1.

Chess move legality◈ Members↗
FA-82455

Castling with a knight in the rook corner · case 05

White castles kingside with a knight or an enemy rook on h1.

Chess move legality◈ Members↗
FA-82456

Pawn attacks on castling squares looked up backwards · case 01

A black pawn on h2 attacking g1 does not stop white from castling.

Chess move legality● Open access↗
FA-82457

Pawn attacks on castling squares looked up backwards · case 02

A black pawn on h2 attacking g1 does not stop white from castling.

Chess move legality◈ Members↗
FA-82458

Pawn attacks on castling squares looked up backwards · case 03

A black pawn on h2 attacking g1 does not stop white from castling.

Chess move legality◈ Members↗
FA-82459

Pawn attacks on castling squares looked up backwards · case 04

A black pawn on h2 attacking g1 does not stop white from castling.

Chess move legality◈ Members↗
FA-82460

Pawn attacks on castling squares looked up backwards · case 05

A black pawn on h2 attacking g1 does not stop white from castling.

Chess move legality◈ Members↗
FA-82461

Shielded sliders still veto castling · case 01

A rook behind a white pawn on the f-file stops white from castling kingside.

Chess move legality● Open access↗
FA-82462

Shielded sliders still veto castling · case 02

A rook behind a white pawn on the f-file stops white from castling kingside.

Chess move legality◈ Members↗
FA-82463

Shielded sliders still veto castling · case 03

A rook behind a white pawn on the f-file stops white from castling kingside.

Chess move legality◈ Members↗
FA-82464

Shielded sliders still veto castling · case 04

A rook behind a white pawn on the f-file stops white from castling kingside.

Chess move legality◈ Members↗
FA-82465

Shielded sliders still veto castling · case 05

A rook behind a white pawn on the f-file stops white from castling kingside.

Chess move legality◈ Members↗
FA-82466

King retreats along the checking line · case 01

A king on e4 checked by a rook on e8 may step back to e3.

Chess move legality● Open access↗
FA-82467

King retreats along the checking line · case 02

A king on e4 checked by a rook on e8 may step back to e3.

Chess move legality◈ Members↗
FA-82468

King retreats along the checking line · case 03

A king on e4 checked by a rook on e8 may step back to e3.

Chess move legality◈ Members↗
FA-82469

King retreats along the checking line · case 04

A king on e4 checked by a rook on e8 may step back to e3.

Chess move legality◈ Members↗
FA-82470

King retreats along the checking line · case 05

A king on e4 checked by a rook on e8 may step back to e3.

Chess move legality◈ Members↗
FA-82471

King denied diagonal steps · case 01

A king cannot step from e4 to f5.

Chess move legality● Open access↗
FA-82472

King denied diagonal steps · case 02

A king cannot step from e4 to f5.

Chess move legality◈ Members↗
FA-82473

King denied diagonal steps · case 03

A king cannot step from e4 to f5.

Chess move legality◈ Members↗
FA-82474

King denied diagonal steps · case 04

A king cannot step from e4 to f5.

Chess move legality◈ Members↗
FA-82475

King denied diagonal steps · case 05

A king cannot step from e4 to f5.

Chess move legality◈ Members↗
FA-82476

King refuses captures and lands on friends · case 01

The king may move onto its own pawn but not capture an undefended enemy pawn.

Chess move legality● Open access↗
FA-82477

King refuses captures and lands on friends · case 02

The king may move onto its own pawn but not capture an undefended enemy pawn.

Chess move legality◈ Members↗
FA-82478

King refuses captures and lands on friends · case 03

The king may move onto its own pawn but not capture an undefended enemy pawn.

Chess move legality◈ Members↗
FA-82479

King refuses captures and lands on friends · case 04

The king may move onto its own pawn but not capture an undefended enemy pawn.

Chess move legality◈ Members↗
FA-82480

King refuses captures and lands on friends · case 05

The king may move onto its own pawn but not capture an undefended enemy pawn.

Chess move legality◈ Members↗
FA-82481

Kings allowed to touch orthogonally · case 01

A white king may step to e5 directly below the black king on e6.

Chess move legality● Open access↗
FA-82482

Kings allowed to touch orthogonally · case 02

A white king may step to e5 directly below the black king on e6.

Chess move legality◈ Members↗
FA-82483

Kings allowed to touch orthogonally · case 03

A white king may step to e5 directly below the black king on e6.

Chess move legality◈ Members↗
FA-82484

Kings allowed to touch orthogonally · case 04

A white king may step to e5 directly below the black king on e6.

Chess move legality◈ Members↗
FA-82485

Kings allowed to touch orthogonally · case 05

A white king may step to e5 directly below the black king on e6.

Chess move legality◈ Members↗
FA-82486

King captures a defended piece · case 01

The king takes a pawn on e5 that is protected by another pawn.

Chess move legality● Open access↗
FA-82487

King captures a defended piece · case 02

The king takes a pawn on e5 that is protected by another pawn.

Chess move legality◈ Members↗
FA-82488

King captures a defended piece · case 03

The king takes a pawn on e5 that is protected by another pawn.

Chess move legality◈ Members↗
FA-82489

King captures a defended piece · case 04

The king takes a pawn on e5 that is protected by another pawn.

Chess move legality◈ Members↗
FA-82490

King captures a defended piece · case 05

The king takes a pawn on e5 that is protected by another pawn.

Chess move legality◈ Members↗
FA-82491

Knights below the king are invisible · case 01

The king may step next to a knight that attacks the square from below.

Chess move legality● Open access↗
FA-82492

Knights below the king are invisible · case 02

The king may step next to a knight that attacks the square from below.

Chess move legality◈ Members↗
FA-82493

Knights below the king are invisible · case 03

The king may step next to a knight that attacks the square from below.

Chess move legality◈ Members↗
FA-82494

Knights below the king are invisible · case 04

The king may step next to a knight that attacks the square from below.

Chess move legality◈ Members↗
FA-82495

Knights below the king are invisible · case 05

The king may step next to a knight that attacks the square from below.

Chess move legality◈ Members↗
FA-82496

Diagonal pins are never detected · case 01

A knight pinned by a bishop against its king is allowed to jump away.

Chess move legality● Open access↗
FA-82497

Diagonal pins are never detected · case 02

A knight pinned by a bishop against its king is allowed to jump away.

Chess move legality◈ Members↗
FA-82498

Diagonal pins are never detected · case 03

A knight pinned by a bishop against its king is allowed to jump away.

Chess move legality◈ Members↗
FA-82499

Diagonal pins are never detected · case 04

A knight pinned by a bishop against its king is allowed to jump away.

Chess move legality◈ Members↗
FA-82500

Diagonal pins are never detected · case 05

A knight pinned by a bishop against its king is allowed to jump away.

Chess move legality◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗