FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-82501

Piece shielded by a friend still treated as pinned · case 01

A rook with a pawn between it and the king cannot leave the file.

Chess move legality● Open access↗
FA-82502

Piece shielded by a friend still treated as pinned · case 02

A rook with a pawn between it and the king cannot leave the file.

Chess move legality◈ Members↗
FA-82503

Piece shielded by a friend still treated as pinned · case 03

A rook with a pawn between it and the king cannot leave the file.

Chess move legality◈ Members↗
FA-82504

Piece shielded by a friend still treated as pinned · case 04

A rook with a pawn between it and the king cannot leave the file.

Chess move legality◈ Members↗
FA-82505

Piece shielded by a friend still treated as pinned · case 05

A rook with a pawn between it and the king cannot leave the file.

Chess move legality◈ Members↗
FA-82506

Bishop on the king's file pins a knight · case 01

A knight between its king and an enemy bishop on the same file may not move.

Chess move legality● Open access↗
FA-82507

Bishop on the king's file pins a knight · case 02

A knight between its king and an enemy bishop on the same file may not move.

Chess move legality◈ Members↗
FA-82508

Bishop on the king's file pins a knight · case 03

A knight between its king and an enemy bishop on the same file may not move.

Chess move legality◈ Members↗
FA-82509

Bishop on the king's file pins a knight · case 04

A knight between its king and an enemy bishop on the same file may not move.

Chess move legality◈ Members↗
FA-82510

Bishop on the king's file pins a knight · case 05

A knight between its king and an enemy bishop on the same file may not move.

Chess move legality◈ Members↗
FA-82511

Pinned bishop may switch to another line through its king · case 01

A bishop pinned on the c1-g5 diagonal may move to c3 or e1.

Chess move legality● Open access↗
FA-82512

Pinned bishop may switch to another line through its king · case 02

A bishop pinned on the c1-g5 diagonal may move to c3 or e1.

Chess move legality◈ Members↗
FA-82513

Pinned bishop may switch to another line through its king · case 03

A bishop pinned on the c1-g5 diagonal may move to c3 or e1.

Chess move legality◈ Members↗
FA-82514

Pinned bishop may switch to another line through its king · case 04

A bishop pinned on the c1-g5 diagonal may move to c3 or e1.

Chess move legality◈ Members↗
FA-82515

Pinned bishop may switch to another line through its king · case 05

A bishop pinned on the c1-g5 diagonal may move to c3 or e1.

Chess move legality◈ Members↗
FA-82516

Friendly queen behind a piece pins it · case 01

A knight between its king and its own queen may not move.

Chess move legality● Open access↗
FA-82517

Friendly queen behind a piece pins it · case 02

A knight between its king and its own queen may not move.

Chess move legality◈ Members↗
FA-82518

Friendly queen behind a piece pins it · case 03

A knight between its king and its own queen may not move.

Chess move legality◈ Members↗
FA-82519

Friendly queen behind a piece pins it · case 04

A knight between its king and its own queen may not move.

Chess move legality◈ Members↗
FA-82520

Friendly queen behind a piece pins it · case 05

A knight between its king and its own queen may not move.

Chess move legality◈ Members↗
FA-82521

Double check answered by a blocking move · case 01

With rook and knight both giving check, a queen interposition is accepted.

Chess move legality● Open access↗
FA-82522

Double check answered by a blocking move · case 02

With rook and knight both giving check, a queen interposition is accepted.

Chess move legality◈ Members↗
FA-82523

Double check answered by a blocking move · case 03

With rook and knight both giving check, a queen interposition is accepted.

Chess move legality◈ Members↗
FA-82524

Double check answered by a blocking move · case 04

With rook and knight both giving check, a queen interposition is accepted.

Chess move legality◈ Members↗
FA-82525

Double check answered by a blocking move · case 05

With rook and knight both giving check, a queen interposition is accepted.

Chess move legality◈ Members↗
FA-82526

Capturing the checking piece is not an evasion · case 01

A rook capturing the checking rook is rejected.

Chess move legality● Open access↗
FA-82527

Capturing the checking piece is not an evasion · case 02

A rook capturing the checking rook is rejected.

Chess move legality◈ Members↗
FA-82528

Capturing the checking piece is not an evasion · case 03

A rook capturing the checking rook is rejected.

Chess move legality◈ Members↗
FA-82529

Capturing the checking piece is not an evasion · case 04

A rook capturing the checking rook is rejected.

Chess move legality◈ Members↗
FA-82530

Capturing the checking piece is not an evasion · case 05

A rook capturing the checking rook is rejected.

Chess move legality◈ Members↗
FA-82531

Knight check treated as blockable · case 01

A queen move to a square between king and a checking knight is accepted.

Chess move legality● Open access↗
FA-82532

Knight check treated as blockable · case 02

A queen move to a square between king and a checking knight is accepted.

Chess move legality◈ Members↗
FA-82533

Knight check treated as blockable · case 03

A queen move to a square between king and a checking knight is accepted.

Chess move legality◈ Members↗
FA-82534

Knight check treated as blockable · case 04

A queen move to a square between king and a checking knight is accepted.

Chess move legality◈ Members↗
FA-82535

Knight check treated as blockable · case 05

A queen move to a square between king and a checking knight is accepted.

Chess move legality◈ Members↗
FA-82536

File check walked as a diagonal · case 01

Interposing on the checking file is rejected while unrelated diagonal squares are accepted.

Chess move legality● Open access↗
FA-82537

File check walked as a diagonal · case 02

Interposing on the checking file is rejected while unrelated diagonal squares are accepted.

Chess move legality◈ Members↗
FA-82538

File check walked as a diagonal · case 03

Interposing on the checking file is rejected while unrelated diagonal squares are accepted.

Chess move legality◈ Members↗
FA-82539

File check walked as a diagonal · case 04

Interposing on the checking file is rejected while unrelated diagonal squares are accepted.

Chess move legality◈ Members↗
FA-82540

File check walked as a diagonal · case 05

Interposing on the checking file is rejected while unrelated diagonal squares are accepted.

Chess move legality◈ Members↗
FA-82541

FEN placement read bottom-up · case 01

White pieces listed on the last FEN row appear on rank 8.

Chess move legality● Open access↗
FA-82542

FEN placement read bottom-up · case 02

White pieces listed on the last FEN row appear on rank 8.

Chess move legality◈ Members↗
FA-82543

FEN placement read bottom-up · case 03

White pieces listed on the last FEN row appear on rank 8.

Chess move legality◈ Members↗
FA-82544

FEN placement read bottom-up · case 04

White pieces listed on the last FEN row appear on rank 8.

Chess move legality◈ Members↗
FA-82545

FEN placement read bottom-up · case 05

White pieces listed on the last FEN row appear on rank 8.

Chess move legality◈ Members↗
FA-82546

Digit runs advance one file only · case 01

"4k3" places the king on b8 and every rank fails the eight-file check.

Chess move legality● Open access↗
FA-82547

Digit runs advance one file only · case 02

"4k3" places the king on b8 and every rank fails the eight-file check.

Chess move legality◈ Members↗
FA-82548

Digit runs advance one file only · case 03

"4k3" places the king on b8 and every rank fails the eight-file check.

Chess move legality◈ Members↗
FA-82549

Digit runs advance one file only · case 04

"4k3" places the king on b8 and every rank fails the eight-file check.

Chess move legality◈ Members↗
FA-82550

Digit runs advance one file only · case 05

"4k3" places the king on b8 and every rank fails the eight-file check.

Chess move legality◈ Members↗
FA-82551

Positions without castling rights rejected · case 01

Every FEN with "-" in the castling field is reported invalid.

Chess move legality● Open access↗
FA-82552

Positions without castling rights rejected · case 02

Every FEN with "-" in the castling field is reported invalid.

Chess move legality◈ Members↗
FA-82553

Positions without castling rights rejected · case 03

Every FEN with "-" in the castling field is reported invalid.

Chess move legality◈ Members↗
FA-82554

Positions without castling rights rejected · case 04

Every FEN with "-" in the castling field is reported invalid.

Chess move legality◈ Members↗
FA-82555

Positions without castling rights rejected · case 05

Every FEN with "-" in the castling field is reported invalid.

Chess move legality◈ Members↗
FA-82556

En passant square on the wrong side accepted · case 01

With white to move, an ep square on rank 3 is accepted.

Chess move legality● Open access↗
FA-82557

En passant square on the wrong side accepted · case 02

With white to move, an ep square on rank 3 is accepted.

Chess move legality◈ Members↗
FA-82558

En passant square on the wrong side accepted · case 03

With white to move, an ep square on rank 3 is accepted.

Chess move legality◈ Members↗
FA-82559

En passant square on the wrong side accepted · case 04

With white to move, an ep square on rank 3 is accepted.

Chess move legality◈ Members↗
FA-82560

En passant square on the wrong side accepted · case 05

With white to move, an ep square on rank 3 is accepted.

Chess move legality◈ Members↗
FA-82561

Fullmove number zero accepted · case 01

A FEN ending in "0 0" parses as a valid position.

Chess move legality● Open access↗
FA-82562

Fullmove number zero accepted · case 02

A FEN ending in "0 0" parses as a valid position.

Chess move legality◈ Members↗
FA-82563

Fullmove number zero accepted · case 03

A FEN ending in "0 0" parses as a valid position.

Chess move legality◈ Members↗
FA-82564

Fullmove number zero accepted · case 04

A FEN ending in "0 0" parses as a valid position.

Chess move legality◈ Members↗
FA-82565

Fullmove number zero accepted · case 05

A FEN ending in "0 0" parses as a valid position.

Chess move legality◈ Members↗
FA-82566

Two white kings accepted · case 01

A FEN with two white kings parses successfully.

Chess move legality● Open access↗
FA-82567

Two white kings accepted · case 02

A FEN with two white kings parses successfully.

Chess move legality◈ Members↗
FA-82568

Two white kings accepted · case 03

A FEN with two white kings parses successfully.

Chess move legality◈ Members↗
FA-82569

Two white kings accepted · case 04

A FEN with two white kings parses successfully.

Chess move legality◈ Members↗
FA-82570

Two white kings accepted · case 05

A FEN with two white kings parses successfully.

Chess move legality◈ Members↗
FA-82571

King move keeps the queenside right · case 01

After Ke1-f1, white still holds the Q castling right.

Chess move legality● Open access↗
FA-82572

King move keeps the queenside right · case 02

After Ke1-f1, white still holds the Q castling right.

Chess move legality◈ Members↗
FA-82573

King move keeps the queenside right · case 03

After Ke1-f1, white still holds the Q castling right.

Chess move legality◈ Members↗
FA-82574

King move keeps the queenside right · case 04

After Ke1-f1, white still holds the Q castling right.

Chess move legality◈ Members↗
FA-82575

King move keeps the queenside right · case 05

After Ke1-f1, white still holds the Q castling right.

Chess move legality◈ Members↗
FA-82576

Capturing a rook in its corner keeps the victim's right · case 01

After Bxh8, black still holds the k right.

Chess move legality● Open access↗
FA-82577

Capturing a rook in its corner keeps the victim's right · case 02

After Bxh8, black still holds the k right.

Chess move legality◈ Members↗
FA-82578

Capturing a rook in its corner keeps the victim's right · case 03

After Bxh8, black still holds the k right.

Chess move legality◈ Members↗
FA-82579

Capturing a rook in its corner keeps the victim's right · case 04

After Bxh8, black still holds the k right.

Chess move legality◈ Members↗
FA-82580

Capturing a rook in its corner keeps the victim's right · case 05

After Bxh8, black still holds the k right.

Chess move legality◈ Members↗
FA-82581

En passant target set to the landing square · case 01

After e2-e4 the ep square is reported as e4 instead of e3.

Chess move legality● Open access↗
FA-82582

En passant target set to the landing square · case 02

After e2-e4 the ep square is reported as e4 instead of e3.

Chess move legality◈ Members↗
FA-82583

En passant target set to the landing square · case 03

After e2-e4 the ep square is reported as e4 instead of e3.

Chess move legality◈ Members↗
FA-82584

En passant target set to the landing square · case 04

After e2-e4 the ep square is reported as e4 instead of e3.

Chess move legality◈ Members↗
FA-82585

En passant target set to the landing square · case 05

After e2-e4 the ep square is reported as e4 instead of e3.

Chess move legality◈ Members↗
FA-82586

Captures do not reset the fifty-move clock · case 01

A knight capture increments the halfmove clock.

Chess move legality● Open access↗
FA-82587

Captures do not reset the fifty-move clock · case 02

A knight capture increments the halfmove clock.

Chess move legality◈ Members↗
FA-82588

Captures do not reset the fifty-move clock · case 03

A knight capture increments the halfmove clock.

Chess move legality◈ Members↗
FA-82589

Captures do not reset the fifty-move clock · case 04

A knight capture increments the halfmove clock.

Chess move legality◈ Members↗
FA-82590

Captures do not reset the fifty-move clock · case 05

A knight capture increments the halfmove clock.

Chess move legality◈ Members↗
FA-82591

Exhausted castling rights rendered as an empty field · case 01

After the last right is lost, the rights field is "" instead of "-".

Chess move legality● Open access↗
FA-82592

Exhausted castling rights rendered as an empty field · case 02

After the last right is lost, the rights field is "" instead of "-".

Chess move legality◈ Members↗
FA-82593

Exhausted castling rights rendered as an empty field · case 03

After the last right is lost, the rights field is "" instead of "-".

Chess move legality◈ Members↗
FA-82594

Exhausted castling rights rendered as an empty field · case 04

After the last right is lost, the rights field is "" instead of "-".

Chess move legality◈ Members↗
FA-82595

Exhausted castling rights rendered as an empty field · case 05

After the last right is lost, the rights field is "" instead of "-".

Chess move legality◈ Members↗
FA-82596

Rook sliding two ranks creates an en passant square · case 01

Rd1-d3 next to a black pawn sets ep to d2.

Chess move legality● Open access↗
FA-82597

Rook sliding two ranks creates an en passant square · case 02

Rd1-d3 next to a black pawn sets ep to d2.

Chess move legality◈ Members↗
FA-82598

Rook sliding two ranks creates an en passant square · case 03

Rd1-d3 next to a black pawn sets ep to d2.

Chess move legality◈ Members↗
FA-82599

Rook sliding two ranks creates an en passant square · case 04

Rd1-d3 next to a black pawn sets ep to d2.

Chess move legality◈ Members↗
FA-82600

Rook sliding two ranks creates an en passant square · case 05

Rd1-d3 next to a black pawn sets ep to d2.

Chess move legality◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗