Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Bust only undoes the last dart · case 01
After a bust the remaining score keeps the earlier darts of the turn.
Bust only undoes the last dart · case 02
After a bust the remaining score keeps the earlier darts of the turn.
Bust only undoes the last dart · case 03
After a bust the remaining score keeps the earlier darts of the turn.
Bust only undoes the last dart · case 04
After a bust the remaining score keeps the earlier darts of the turn.
Bust only undoes the last dart · case 05
After a bust the remaining score keeps the earlier darts of the turn.
Thrower keeps throwing after a bust · case 01
Darts after a bust in the same turn are scored against the reverted total.
Thrower keeps throwing after a bust · case 02
Darts after a bust in the same turn are scored against the reverted total.
Thrower keeps throwing after a bust · case 03
Darts after a bust in the same turn are scored against the reverted total.
Thrower keeps throwing after a bust · case 04
Darts after a bust in the same turn are scored against the reverted total.
Thrower keeps throwing after a bust · case 05
Darts after a bust in the same turn are scored against the reverted total.
Leaving one or finishing on a single is not a bust · case 01
A player who leaves 1, or reaches 0 without a double, is left on that score.
Leaving one or finishing on a single is not a bust · case 02
A player who leaves 1, or reaches 0 without a double, is left on that score.
Leaving one or finishing on a single is not a bust · case 03
A player who leaves 1, or reaches 0 without a double, is left on that score.
Leaving one or finishing on a single is not a bust · case 04
A player who leaves 1, or reaches 0 without a double, is left on that score.
Leaving one or finishing on a single is not a bust · case 05
A player who leaves 1, or reaches 0 without a double, is left on that score.
Double bull not accepted as a checkout double · case 01
Finishing 50 with the bull is treated as a bust.
Double bull not accepted as a checkout double · case 02
Finishing 50 with the bull is treated as a bust.
Double bull not accepted as a checkout double · case 03
Finishing 50 with the bull is treated as a bust.
Double bull not accepted as a checkout double · case 04
Finishing 50 with the bull is treated as a bust.
Double bull not accepted as a checkout double · case 05
Finishing 50 with the bull is treated as a bust.
Stones biting the house edge ignored · case 01
A stone whose edge overlaps the twelve-foot ring does not count.
Stones biting the house edge ignored · case 02
A stone whose edge overlaps the twelve-foot ring does not count.
Stones biting the house edge ignored · case 03
A stone whose edge overlaps the twelve-foot ring does not count.
Stones biting the house edge ignored · case 04
A stone whose edge overlaps the twelve-foot ring does not count.
Stones biting the house edge ignored · case 05
A stone whose edge overlaps the twelve-foot ring does not count.
Hammer kept by the scoring team · case 01
After scoring, the scoring team is shown with the hammer.
Hammer kept by the scoring team · case 02
After scoring, the scoring team is shown with the hammer.
Hammer kept by the scoring team · case 03
After scoring, the scoring team is shown with the hammer.
Hammer kept by the scoring team · case 04
After scoring, the scoring team is shown with the hammer.
Hammer kept by the scoring team · case 05
After scoring, the scoring team is shown with the hammer.
Blank end passes the hammer · case 01
After a blank end the other team is given the hammer.
Blank end passes the hammer · case 02
After a blank end the other team is given the hammer.
Blank end passes the hammer · case 03
After a blank end the other team is given the hammer.
Blank end passes the hammer · case 04
After a blank end the other team is given the hammer.
Blank end passes the hammer · case 05
After a blank end the other team is given the hammer.
Equidistant shot stones awarded to one team · case 01
Two stones of different teams at the same distance give a point to team A.
Equidistant shot stones awarded to one team · case 02
Two stones of different teams at the same distance give a point to team A.
Equidistant shot stones awarded to one team · case 03
Two stones of different teams at the same distance give a point to team A.
Equidistant shot stones awarded to one team · case 04
Two stones of different teams at the same distance give a point to team A.
Equidistant shot stones awarded to one team · case 05
Two stones of different teams at the same distance give a point to team A.
Every counting stone of the shot team scores · case 01
A team is credited with stones that lie behind the opponent's closest stone.
Every counting stone of the shot team scores · case 02
A team is credited with stones that lie behind the opponent's closest stone.
Every counting stone of the shot team scores · case 03
A team is credited with stones that lie behind the opponent's closest stone.
Every counting stone of the shot team scores · case 04
A team is credited with stones that lie behind the opponent's closest stone.
Every counting stone of the shot team scores · case 05
A team is credited with stones that lie behind the opponent's closest stone.
Seven-judge panel trimmed like a five-judge panel · case 01
Seven-judge dive scores sum five marks and come out far too high.
Seven-judge panel trimmed like a five-judge panel · case 02
Seven-judge dive scores sum five marks and come out far too high.
Seven-judge panel trimmed like a five-judge panel · case 03
Seven-judge dive scores sum five marks and come out far too high.
Seven-judge panel trimmed like a five-judge panel · case 04
Seven-judge dive scores sum five marks and come out far too high.
Seven-judge panel trimmed like a five-judge panel · case 05
Seven-judge dive scores sum five marks and come out far too high.
Only the low marks are trimmed · case 01
A generous outlier judge inflates the dive score.
Only the low marks are trimmed · case 02
A generous outlier judge inflates the dive score.
Only the low marks are trimmed · case 03
A generous outlier judge inflates the dive score.
Only the low marks are trimmed · case 04
A generous outlier judge inflates the dive score.
Only the low marks are trimmed · case 05
A generous outlier judge inflates the dive score.
Judge mark validation accepts off-grid or rejects a perfect ten · case 01
A 7.3 mark is accepted, or a legitimate 10.0 is rejected.
Judge mark validation accepts off-grid or rejects a perfect ten · case 02
A 7.3 mark is accepted, or a legitimate 10.0 is rejected.
Judge mark validation accepts off-grid or rejects a perfect ten · case 03
A 7.3 mark is accepted, or a legitimate 10.0 is rejected.
Judge mark validation accepts off-grid or rejects a perfect ten · case 04
A 7.3 mark is accepted, or a legitimate 10.0 is rejected.
Judge mark validation accepts off-grid or rejects a perfect ten · case 05
A 7.3 mark is accepted, or a legitimate 10.0 is rejected.
Trimmed marks averaged before multiplying by difficulty · case 01
Dive scores are a third of the expected value.
Trimmed marks averaged before multiplying by difficulty · case 02
Dive scores are a third of the expected value.
Trimmed marks averaged before multiplying by difficulty · case 03
Dive scores are a third of the expected value.
Trimmed marks averaged before multiplying by difficulty · case 04
Dive scores are a third of the expected value.
Trimmed marks averaged before multiplying by difficulty · case 05
Dive scores are a third of the expected value.
Timing truncated instead of rounded up · case 01
10.101 is published as 10.10 and ties are split that should be shared.
Timing truncated instead of rounded up · case 02
10.101 is published as 10.10 and ties are split that should be shared.
Timing truncated instead of rounded up · case 03
10.101 is published as 10.10 and ties are split that should be shared.
Timing truncated instead of rounded up · case 04
10.101 is published as 10.10 and ties are split that should be shared.
Timing truncated instead of rounded up · case 05
10.101 is published as 10.10 and ties are split that should be shared.
Short fractional parts read as thousandths · case 01
A time of "10.2" is treated as 10.002 seconds.
Short fractional parts read as thousandths · case 02
A time of "10.2" is treated as 10.002 seconds.
Short fractional parts read as thousandths · case 03
A time of "10.2" is treated as 10.002 seconds.
Short fractional parts read as thousandths · case 04
A time of "10.2" is treated as 10.002 seconds.
Short fractional parts read as thousandths · case 05
A time of "10.2" is treated as 10.002 seconds.
Tied athletes given consecutive places or dense ranks · case 01
Two athletes on the same hundredth are given places 1 and 2, or the next athlete is placed 2nd.
Tied athletes given consecutive places or dense ranks · case 02
Two athletes on the same hundredth are given places 1 and 2, or the next athlete is placed 2nd.
Tied athletes given consecutive places or dense ranks · case 03
Two athletes on the same hundredth are given places 1 and 2, or the next athlete is placed 2nd.
Tied athletes given consecutive places or dense ranks · case 04
Two athletes on the same hundredth are given places 1 and 2, or the next athlete is placed 2nd.
Tied athletes given consecutive places or dense ranks · case 05
Two athletes on the same hundredth are given places 1 and 2, or the next athlete is placed 2nd.
Disqualified athletes listed as non-finishers · case 01
A disqualified athlete appears in the results as DNF.
Disqualified athletes listed as non-finishers · case 02
A disqualified athlete appears in the results as DNF.
Disqualified athletes listed as non-finishers · case 03
A disqualified athlete appears in the results as DNF.
Disqualified athletes listed as non-finishers · case 04
A disqualified athlete appears in the results as DNF.
Disqualified athletes listed as non-finishers · case 05
A disqualified athlete appears in the results as DNF.
Countback skips failures at the best height · case 01
An athlete with a first-attempt clearance at the best height is ranked below one who needed three.
Countback skips failures at the best height · case 02
An athlete with a first-attempt clearance at the best height is ranked below one who needed three.
Countback skips failures at the best height · case 03
An athlete with a first-attempt clearance at the best height is ranked below one who needed three.
Countback skips failures at the best height · case 04
An athlete with a first-attempt clearance at the best height is ranked below one who needed three.
Countback skips failures at the best height · case 05
An athlete with a first-attempt clearance at the best height is ranked below one who needed three.
Total failures include heights above the best · case 01
Failures at the height where the athlete went out count in the countback.
Total failures include heights above the best · case 02
Failures at the height where the athlete went out count in the countback.
Total failures include heights above the best · case 03
Failures at the height where the athlete went out count in the countback.
Total failures include heights above the best · case 04
Failures at the height where the athlete went out count in the countback.
Total failures include heights above the best · case 05
Failures at the height where the athlete went out count in the countback.
Genuine ties split by name or partial countback · case 01
Athletes identical on every criterion receive different places.
Genuine ties split by name or partial countback · case 02
Athletes identical on every criterion receive different places.
Genuine ties split by name or partial countback · case 03
Athletes identical on every criterion receive different places.
Genuine ties split by name or partial countback · case 04
Athletes identical on every criterion receive different places.
Genuine ties split by name or partial countback · case 05
Athletes identical on every criterion receive different places.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗