FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-82101

Ranks ordered alphabetically instead of by strength · case 01

Queen-ten is written "TQs" and ace-king "KAo".

Poker hand evaluation● Open access↗
FA-82102

Ranks ordered alphabetically instead of by strength · case 02

Queen-ten is written "TQs" and ace-king "KAo".

Poker hand evaluation◈ Members↗
FA-82103

Ranks ordered alphabetically instead of by strength · case 03

Queen-ten is written "TQs" and ace-king "KAo".

Poker hand evaluation◈ Members↗
FA-82104

Ranks ordered alphabetically instead of by strength · case 04

Queen-ten is written "TQs" and ace-king "KAo".

Poker hand evaluation◈ Members↗
FA-82105

Ranks ordered alphabetically instead of by strength · case 05

Queen-ten is written "TQs" and ace-king "KAo".

Poker hand evaluation◈ Members↗
FA-82106

Pocket pairs carry an offsuit marker · case 01

Pocket queens are written "QQo" and do not match range keys.

Poker hand evaluation● Open access↗
FA-82107

Pocket pairs carry an offsuit marker · case 02

Pocket queens are written "QQo" and do not match range keys.

Poker hand evaluation◈ Members↗
FA-82108

Pocket pairs carry an offsuit marker · case 03

Pocket queens are written "QQo" and do not match range keys.

Poker hand evaluation◈ Members↗
FA-82109

Pocket pairs carry an offsuit marker · case 04

Pocket queens are written "QQo" and do not match range keys.

Poker hand evaluation◈ Members↗
FA-82110

Pocket pairs carry an offsuit marker · case 05

Pocket queens are written "QQo" and do not match range keys.

Poker hand evaluation◈ Members↗
FA-82111

Ten token misreads suitedness · case 01

"10h" with "Jh" is written "JTo".

Poker hand evaluation● Open access↗
FA-82112

Ten token misreads suitedness · case 02

"10h" with "Jh" is written "JTo".

Poker hand evaluation◈ Members↗
FA-82113

Ten token misreads suitedness · case 03

"10h" with "Jh" is written "JTo".

Poker hand evaluation◈ Members↗
FA-82114

Ten token misreads suitedness · case 04

"10h" with "Jh" is written "JTo".

Poker hand evaluation◈ Members↗
FA-82115

Ten token misreads suitedness · case 05

"10h" with "Jh" is written "JTo".

Poker hand evaluation◈ Members↗
FA-82116

Substring test accepts empty and multi-letter ranks · case 01

A card with no rank or a rank token "KQ" produces a hand label instead of "invalid".

Poker hand evaluation● Open access↗
FA-82117

Substring test accepts empty and multi-letter ranks · case 02

A card with no rank or a rank token "KQ" produces a hand label instead of "invalid".

Poker hand evaluation◈ Members↗
FA-82118

Substring test accepts empty and multi-letter ranks · case 03

A card with no rank or a rank token "KQ" produces a hand label instead of "invalid".

Poker hand evaluation◈ Members↗
FA-82119

Substring test accepts empty and multi-letter ranks · case 04

A card with no rank or a rank token "KQ" produces a hand label instead of "invalid".

Poker hand evaluation◈ Members↗
FA-82120

Substring test accepts empty and multi-letter ranks · case 05

A card with no rank or a rank token "KQ" produces a hand label instead of "invalid".

Poker hand evaluation◈ Members↗
FA-82121

Pair-plus range stops at kings · case 01

"QQ+" counts 12 combos (QQ, KK) and "77+" misses pocket aces.

Poker hand evaluation● Open access↗
FA-82122

Pair-plus range stops at kings · case 02

"QQ+" counts 12 combos (QQ, KK) and "77+" misses pocket aces.

Poker hand evaluation◈ Members↗
FA-82123

Pair-plus range stops at kings · case 03

"QQ+" counts 12 combos (QQ, KK) and "77+" misses pocket aces.

Poker hand evaluation◈ Members↗
FA-82124

Pair-plus range stops at kings · case 04

"QQ+" counts 12 combos (QQ, KK) and "77+" misses pocket aces.

Poker hand evaluation◈ Members↗
FA-82125

Pair-plus range stops at kings · case 05

"QQ+" counts 12 combos (QQ, KK) and "77+" misses pocket aces.

Poker hand evaluation◈ Members↗
FA-82126

Kicker-plus range runs into the pair of the top card · case 01

"A9s+" includes an "AAs" class counted as a pocket pair and "KTo+" includes AK-type classes.

Poker hand evaluation● Open access↗
FA-82127

Kicker-plus range runs into the pair of the top card · case 02

"A9s+" includes an "AAs" class counted as a pocket pair and "KTo+" includes AK-type classes.

Poker hand evaluation◈ Members↗
FA-82128

Kicker-plus range runs into the pair of the top card · case 03

"A9s+" includes an "AAs" class counted as a pocket pair and "KTo+" includes AK-type classes.

Poker hand evaluation◈ Members↗
FA-82129

Kicker-plus range runs into the pair of the top card · case 04

"A9s+" includes an "AAs" class counted as a pocket pair and "KTo+" includes AK-type classes.

Poker hand evaluation◈ Members↗
FA-82130

Kicker-plus range runs into the pair of the top card · case 05

"A9s+" includes an "AAs" class counted as a pocket pair and "KTo+" includes AK-type classes.

Poker hand evaluation◈ Members↗
FA-82131

Kicker dash range drops its upper end · case 01

"A9s-A6s" counts three classes instead of four.

Poker hand evaluation● Open access↗
FA-82132

Kicker dash range drops its upper end · case 02

"A9s-A6s" counts three classes instead of four.

Poker hand evaluation◈ Members↗
FA-82133

Kicker dash range drops its upper end · case 03

"A9s-A6s" counts three classes instead of four.

Poker hand evaluation◈ Members↗
FA-82134

Kicker dash range drops its upper end · case 04

"A9s-A6s" counts three classes instead of four.

Poker hand evaluation◈ Members↗
FA-82135

Kicker dash range drops its upper end · case 05

"A9s-A6s" counts three classes instead of four.

Poker hand evaluation◈ Members↗
FA-82136

Unsuffixed non-pair counted as offsuit only · case 01

"AK" counts 12 combos instead of 16.

Poker hand evaluation● Open access↗
FA-82137

Unsuffixed non-pair counted as offsuit only · case 02

"AK" counts 12 combos instead of 16.

Poker hand evaluation◈ Members↗
FA-82138

Unsuffixed non-pair counted as offsuit only · case 03

"AK" counts 12 combos instead of 16.

Poker hand evaluation◈ Members↗
FA-82139

Unsuffixed non-pair counted as offsuit only · case 04

"AK" counts 12 combos instead of 16.

Poker hand evaluation◈ Members↗
FA-82140

Unsuffixed non-pair counted as offsuit only · case 05

"AK" counts 12 combos instead of 16.

Poker hand evaluation◈ Members↗
FA-82141

Space after a comma breaks range parsing · case 01

"QQ+, AKs" fails to parse because the second token starts with a space.

Poker hand evaluation● Open access↗
FA-82142

Space after a comma breaks range parsing · case 02

"QQ+, AKs" fails to parse because the second token starts with a space.

Poker hand evaluation◈ Members↗
FA-82143

Space after a comma breaks range parsing · case 03

"QQ+, AKs" fails to parse because the second token starts with a space.

Poker hand evaluation◈ Members↗
FA-82144

Space after a comma breaks range parsing · case 04

"QQ+, AKs" fails to parse because the second token starts with a space.

Poker hand evaluation◈ Members↗
FA-82145

Space after a comma breaks range parsing · case 05

"QQ+, AKs" fails to parse because the second token starts with a space.

Poker hand evaluation◈ Members↗
FA-82146

High-to-low pair dash range expands to nothing · case 01

"TT-77" counts zero combos.

Poker hand evaluation● Open access↗
FA-82147

High-to-low pair dash range expands to nothing · case 02

"TT-77" counts zero combos.

Poker hand evaluation◈ Members↗
FA-82148

High-to-low pair dash range expands to nothing · case 03

"TT-77" counts zero combos.

Poker hand evaluation◈ Members↗
FA-82149

High-to-low pair dash range expands to nothing · case 04

"TT-77" counts zero combos.

Poker hand evaluation◈ Members↗
FA-82150

High-to-low pair dash range expands to nothing · case 05

"TT-77" counts zero combos.

Poker hand evaluation◈ Members↗
FA-82151

Pocket pairs counted as ordered permutations · case 01

"22" counts 12 combos and "QQ+" counts 36.

Poker hand evaluation● Open access↗
FA-82152

Pocket pairs counted as ordered permutations · case 02

"22" counts 12 combos and "QQ+" counts 36.

Poker hand evaluation◈ Members↗
FA-82153

Pocket pairs counted as ordered permutations · case 03

"22" counts 12 combos and "QQ+" counts 36.

Poker hand evaluation◈ Members↗
FA-82154

Pocket pairs counted as ordered permutations · case 04

"22" counts 12 combos and "QQ+" counts 36.

Poker hand evaluation◈ Members↗
FA-82155

Pocket pairs counted as ordered permutations · case 05

"22" counts 12 combos and "QQ+" counts 36.

Poker hand evaluation◈ Members↗
FA-82156

Pocket pair combos enumerated as ordered deals · case 01

"QQ" enumerates 12 combos with no blockers and 9 with one queen dead.

Poker hand evaluation● Open access↗
FA-82157

Pocket pair combos enumerated as ordered deals · case 02

"QQ" enumerates 12 combos with no blockers and 9 with one queen dead.

Poker hand evaluation◈ Members↗
FA-82158

Pocket pair combos enumerated as ordered deals · case 03

"QQ" enumerates 12 combos with no blockers and 9 with one queen dead.

Poker hand evaluation◈ Members↗
FA-82159

Pocket pair combos enumerated as ordered deals · case 04

"QQ" enumerates 12 combos with no blockers and 9 with one queen dead.

Poker hand evaluation◈ Members↗
FA-82160

Pocket pair combos enumerated as ordered deals · case 05

"QQ" enumerates 12 combos with no blockers and 9 with one queen dead.

Poker hand evaluation◈ Members↗
FA-82161

Suited class enumerates offsuit combos · case 01

"AKs" counts 12 combos.

Poker hand evaluation● Open access↗
FA-82162

Suited class enumerates offsuit combos · case 02

"AKs" counts 12 combos.

Poker hand evaluation◈ Members↗
FA-82163

Suited class enumerates offsuit combos · case 03

"AKs" counts 12 combos.

Poker hand evaluation◈ Members↗
FA-82164

Suited class enumerates offsuit combos · case 04

"AKs" counts 12 combos.

Poker hand evaluation◈ Members↗
FA-82165

Suited class enumerates offsuit combos · case 05

"AKs" counts 12 combos.

Poker hand evaluation◈ Members↗
FA-82166

Blockers on the second rank are ignored · case 01

A dead king does not reduce "AKs" or "AKo" combos.

Poker hand evaluation● Open access↗
FA-82167

Blockers on the second rank are ignored · case 02

A dead king does not reduce "AKs" or "AKo" combos.

Poker hand evaluation◈ Members↗
FA-82168

Blockers on the second rank are ignored · case 03

A dead king does not reduce "AKs" or "AKo" combos.

Poker hand evaluation◈ Members↗
FA-82169

Blockers on the second rank are ignored · case 04

A dead king does not reduce "AKs" or "AKo" combos.

Poker hand evaluation◈ Members↗
FA-82170

Blockers on the second rank are ignored · case 05

A dead king does not reduce "AKs" or "AKo" combos.

Poker hand evaluation◈ Members↗
FA-82171

Lower-case dead cards never block · case 01

Dead cards written "ah" or "JH" leave the combo count unchanged.

Poker hand evaluation● Open access↗
FA-82172

Lower-case dead cards never block · case 02

Dead cards written "ah" or "JH" leave the combo count unchanged.

Poker hand evaluation◈ Members↗
FA-82173

Lower-case dead cards never block · case 03

Dead cards written "ah" or "JH" leave the combo count unchanged.

Poker hand evaluation◈ Members↗
FA-82174

Lower-case dead cards never block · case 04

Dead cards written "ah" or "JH" leave the combo count unchanged.

Poker hand evaluation◈ Members↗
FA-82175

Lower-case dead cards never block · case 05

Dead cards written "ah" or "JH" leave the combo count unchanged.

Poker hand evaluation◈ Members↗
FA-82176

Announcer says "Sixs" and "Twos" · case 01

A pair of sixes is announced as "Pair of Sixs".

Poker hand evaluation● Open access↗
FA-82177

Announcer says "Sixs" and "Twos" · case 02

A pair of sixes is announced as "Pair of Sixs".

Poker hand evaluation◈ Members↗
FA-82178

Announcer says "Sixs" and "Twos" · case 03

A pair of sixes is announced as "Pair of Sixs".

Poker hand evaluation◈ Members↗
FA-82179

Announcer says "Sixs" and "Twos" · case 04

A pair of sixes is announced as "Pair of Sixs".

Poker hand evaluation◈ Members↗
FA-82180

Announcer says "Sixs" and "Twos" · case 05

A pair of sixes is announced as "Pair of Sixs".

Poker hand evaluation◈ Members↗
FA-82181

Wheel announced as an ace-high straight · case 01

A-2-3-4-5 is announced "Straight, Ace high" and the steel wheel as a royal flush.

Poker hand evaluation● Open access↗
FA-82182

Wheel announced as an ace-high straight · case 02

A-2-3-4-5 is announced "Straight, Ace high" and the steel wheel as a royal flush.

Poker hand evaluation◈ Members↗
FA-82183

Wheel announced as an ace-high straight · case 03

A-2-3-4-5 is announced "Straight, Ace high" and the steel wheel as a royal flush.

Poker hand evaluation◈ Members↗
FA-82184

Wheel announced as an ace-high straight · case 04

A-2-3-4-5 is announced "Straight, Ace high" and the steel wheel as a royal flush.

Poker hand evaluation◈ Members↗
FA-82185

Wheel announced as an ace-high straight · case 05

A-2-3-4-5 is announced "Straight, Ace high" and the steel wheel as a royal flush.

Poker hand evaluation◈ Members↗
FA-82186

Steel wheel announced as a royal flush · case 01

A-2-3-4-5 suited is announced as "Royal Flush".

Poker hand evaluation● Open access↗
FA-82187

Steel wheel announced as a royal flush · case 02

A-2-3-4-5 suited is announced as "Royal Flush".

Poker hand evaluation◈ Members↗
FA-82188

Steel wheel announced as a royal flush · case 03

A-2-3-4-5 suited is announced as "Royal Flush".

Poker hand evaluation◈ Members↗
FA-82189

Steel wheel announced as a royal flush · case 04

A-2-3-4-5 suited is announced as "Royal Flush".

Poker hand evaluation◈ Members↗
FA-82190

Steel wheel announced as a royal flush · case 05

A-2-3-4-5 suited is announced as "Royal Flush".

Poker hand evaluation◈ Members↗
FA-82191

Full house named by highest rank instead of trips · case 01

Threes full of kings is announced as "Kings full of Threes".

Poker hand evaluation● Open access↗
FA-82192

Full house named by highest rank instead of trips · case 02

Threes full of kings is announced as "Kings full of Threes".

Poker hand evaluation◈ Members↗
FA-82193

Full house named by highest rank instead of trips · case 03

Threes full of kings is announced as "Kings full of Threes".

Poker hand evaluation◈ Members↗
FA-82194

Full house named by highest rank instead of trips · case 04

Threes full of kings is announced as "Kings full of Threes".

Poker hand evaluation◈ Members↗
FA-82195

Full house named by highest rank instead of trips · case 05

Threes full of kings is announced as "Kings full of Threes".

Poker hand evaluation◈ Members↗
FA-82196

Kicker announced as the second pair · case 01

Kings and sevens with a deuce kicker is announced "Two Pair, Kings and Deuces".

Poker hand evaluation● Open access↗
FA-82197

Kicker announced as the second pair · case 02

Kings and sevens with a deuce kicker is announced "Two Pair, Kings and Deuces".

Poker hand evaluation◈ Members↗
FA-82198

Kicker announced as the second pair · case 03

Kings and sevens with a deuce kicker is announced "Two Pair, Kings and Deuces".

Poker hand evaluation◈ Members↗
FA-82199

Kicker announced as the second pair · case 04

Kings and sevens with a deuce kicker is announced "Two Pair, Kings and Deuces".

Poker hand evaluation◈ Members↗
FA-82200

Kicker announced as the second pair · case 05

Kings and sevens with a deuce kicker is announced "Two Pair, Kings and Deuces".

Poker hand evaluation◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗