Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Team without innings gets the best ERA and WHIP · case 01
A roster that never pitched ranks first in both ratio categories.
Team without innings gets the best ERA and WHIP · case 02
A roster that never pitched ranks first in both ratio categories.
Team without innings gets the best ERA and WHIP · case 03
A roster that never pitched ranks first in both ratio categories.
Team without innings gets the best ERA and WHIP · case 04
A roster that never pitched ranks first in both ratio categories.
Team without innings gets the best ERA and WHIP · case 05
A roster that never pitched ranks first in both ratio categories.
Tied teams all receive the best shared position · case 01
Three teams tied in home runs each receive first-place points.
Tied teams all receive the best shared position · case 02
Three teams tied in home runs each receive first-place points.
Tied teams all receive the best shared position · case 03
Three teams tied in home runs each receive first-place points.
Tied teams all receive the best shared position · case 04
Three teams tied in home runs each receive first-place points.
Tied teams all receive the best shared position · case 05
Three teams tied in home runs each receive first-place points.
Offensive rebounds missing from total rebounds · case 01
A big man with 4 offensive and 8 defensive boards misses his double-double.
Offensive rebounds missing from total rebounds · case 02
A big man with 4 offensive and 8 defensive boards misses his double-double.
Offensive rebounds missing from total rebounds · case 03
A big man with 4 offensive and 8 defensive boards misses his double-double.
Offensive rebounds missing from total rebounds · case 04
A big man with 4 offensive and 8 defensive boards misses his double-double.
Offensive rebounds missing from total rebounds · case 05
A big man with 4 offensive and 8 defensive boards misses his double-double.
Exactly ten in a category not counted as double digits · case 01
A 10-point, 10-rebound line earns no double-double bonus.
Exactly ten in a category not counted as double digits · case 02
A 10-point, 10-rebound line earns no double-double bonus.
Exactly ten in a category not counted as double digits · case 03
A 10-point, 10-rebound line earns no double-double bonus.
Exactly ten in a category not counted as double digits · case 04
A 10-point, 10-rebound line earns no double-double bonus.
Exactly ten in a category not counted as double digits · case 05
A 10-point, 10-rebound line earns no double-double bonus.
Triple-double also collects the double-double bonus · case 01
Every triple-double scores 4.5 bonus points instead of 3.
Triple-double also collects the double-double bonus · case 02
Every triple-double scores 4.5 bonus points instead of 3.
Triple-double also collects the double-double bonus · case 03
Every triple-double scores 4.5 bonus points instead of 3.
Triple-double also collects the double-double bonus · case 04
Every triple-double scores 4.5 bonus points instead of 3.
Triple-double also collects the double-double bonus · case 05
Every triple-double scores 4.5 bonus points instead of 3.
Four double-digit categories earn no bonus · case 01
A rare quadruple-double scores no bonus at all.
Four double-digit categories earn no bonus · case 02
A rare quadruple-double scores no bonus at all.
Four double-digit categories earn no bonus · case 03
A rare quadruple-double scores no bonus at all.
Four double-digit categories earn no bonus · case 04
A rare quadruple-double scores no bonus at all.
Four double-digit categories earn no bonus · case 05
A rare quadruple-double scores no bonus at all.
Empty-net goals charged to the pulled goalie · case 01
A goalie who allowed one goal is charged three after two late empty-netters.
Empty-net goals charged to the pulled goalie · case 02
A goalie who allowed one goal is charged three after two late empty-netters.
Empty-net goals charged to the pulled goalie · case 03
A goalie who allowed one goal is charged three after two late empty-netters.
Empty-net goals charged to the pulled goalie · case 04
A goalie who allowed one goal is charged three after two late empty-netters.
Empty-net goals charged to the pulled goalie · case 05
A goalie who allowed one goal is charged three after two late empty-netters.
Saves reduced by empty-net goals the goalie never faced · case 01
Save totals drop by one for every empty-net goal.
Saves reduced by empty-net goals the goalie never faced · case 02
Save totals drop by one for every empty-net goal.
Saves reduced by empty-net goals the goalie never faced · case 03
Save totals drop by one for every empty-net goal.
Saves reduced by empty-net goals the goalie never faced · case 04
Save totals drop by one for every empty-net goal.
Saves reduced by empty-net goals the goalie never faced · case 05
Save totals drop by one for every empty-net goal.
Exactly sixty minutes on ice misses the shutout · case 01
A goalie playing every regulation second of a 1-0 win gets no shutout bonus.
Exactly sixty minutes on ice misses the shutout · case 02
A goalie playing every regulation second of a 1-0 win gets no shutout bonus.
Exactly sixty minutes on ice misses the shutout · case 03
A goalie playing every regulation second of a 1-0 win gets no shutout bonus.
Exactly sixty minutes on ice misses the shutout · case 04
A goalie playing every regulation second of a 1-0 win gets no shutout bonus.
Exactly sixty minutes on ice misses the shutout · case 05
A goalie playing every regulation second of a 1-0 win gets no shutout bonus.
Overtime losses score like regulation losses · case 01
Goalies lose the overtime-loss point.
Overtime losses score like regulation losses · case 02
Goalies lose the overtime-loss point.
Overtime losses score like regulation losses · case 03
Goalies lose the overtime-loss point.
Overtime losses score like regulation losses · case 04
Goalies lose the overtime-loss point.
Overtime losses score like regulation losses · case 05
Goalies lose the overtime-loss point.
Shootout winners scored as goals · case 01
A skater credited with a shootout goal earns 3 extra points.
Shootout winners scored as goals · case 02
A skater credited with a shootout goal earns 3 extra points.
Shootout winners scored as goals · case 03
A skater credited with a shootout goal earns 3 extra points.
Shootout winners scored as goals · case 04
A skater credited with a shootout goal earns 3 extra points.
Shootout winners scored as goals · case 05
A skater credited with a shootout goal earns 3 extra points.
Three-goal game misses the hat-trick bonus · case 01
Only four-goal games receive the hat-trick bonus.
Three-goal game misses the hat-trick bonus · case 02
Only four-goal games receive the hat-trick bonus.
Three-goal game misses the hat-trick bonus · case 03
Only four-goal games receive the hat-trick bonus.
Three-goal game misses the hat-trick bonus · case 04
Only four-goal games receive the hat-trick bonus.
Three-goal game misses the hat-trick bonus · case 05
Only four-goal games receive the hat-trick bonus.
Power-play assists earn no power-play extra · case 01
A quarterback of the power play with three PP assists gets no extra points.
Power-play assists earn no power-play extra · case 02
A quarterback of the power play with three PP assists gets no extra points.
Power-play assists earn no power-play extra · case 03
A quarterback of the power play with three PP assists gets no extra points.
Power-play assists earn no power-play extra · case 04
A quarterback of the power play with three PP assists gets no extra points.
Power-play assists earn no power-play extra · case 05
A quarterback of the power play with three PP assists gets no extra points.
Negative plus/minus scored as positive · case 01
A -3 skater gains 3 points.
Negative plus/minus scored as positive · case 02
A -3 skater gains 3 points.
Negative plus/minus scored as positive · case 03
A -3 skater gains 3 points.
Negative plus/minus scored as positive · case 04
A -3 skater gains 3 points.
Negative plus/minus scored as positive · case 05
A -3 skater gains 3 points.
Century also collects the half-century and thirty bonuses · case 01
A 100-run innings scores 28 milestone points instead of 16.
Century also collects the half-century and thirty bonuses · case 02
A 100-run innings scores 28 milestone points instead of 16.
Century also collects the half-century and thirty bonuses · case 03
A 100-run innings scores 28 milestone points instead of 16.
Century also collects the half-century and thirty bonuses · case 04
A 100-run innings scores 28 milestone points instead of 16.
Century also collects the half-century and thirty bonuses · case 05
A 100-run innings scores 28 milestone points instead of 16.
Tail-end bowlers penalized for ducks · case 01
A number-eleven bowler out first ball loses 2 points.
Tail-end bowlers penalized for ducks · case 02
A number-eleven bowler out first ball loses 2 points.
Tail-end bowlers penalized for ducks · case 03
A number-eleven bowler out first ball loses 2 points.
Tail-end bowlers penalized for ducks · case 04
A number-eleven bowler out first ball loses 2 points.
Tail-end bowlers penalized for ducks · case 05
A number-eleven bowler out first ball loses 2 points.
Unbeaten zero treated as a duck · case 01
A batter not out on 0 at the end of the innings is docked 2 points.
Unbeaten zero treated as a duck · case 02
A batter not out on 0 at the end of the innings is docked 2 points.
Unbeaten zero treated as a duck · case 03
A batter not out on 0 at the end of the innings is docked 2 points.
Unbeaten zero treated as a duck · case 04
A batter not out on 0 at the end of the innings is docked 2 points.
Unbeaten zero treated as a duck · case 05
A batter not out on 0 at the end of the innings is docked 2 points.
Ten-ball innings excluded from strike-rate scoring · case 01
A 10-ball 25 earns no strike-rate bonus.
Ten-ball innings excluded from strike-rate scoring · case 02
A 10-ball 25 earns no strike-rate bonus.
Ten-ball innings excluded from strike-rate scoring · case 03
A 10-ball 25 earns no strike-rate bonus.
Ten-ball innings excluded from strike-rate scoring · case 04
A 10-ball 25 earns no strike-rate bonus.
Ten-ball innings excluded from strike-rate scoring · case 05
A 10-ball 25 earns no strike-rate bonus.
Strike rate rounded before band comparison · case 01
A strike rate of 170.4 misses the >170 band.
Strike rate rounded before band comparison · case 02
A strike rate of 170.4 misses the >170 band.
Strike rate rounded before band comparison · case 03
A strike rate of 170.4 misses the >170 band.
Strike rate rounded before band comparison · case 04
A strike rate of 170.4 misses the >170 band.
Strike rate rounded before band comparison · case 05
A strike rate of 170.4 misses the >170 band.
Run outs credited to the bowler · case 01
A bowler earns 25 points for a run out effected by a fielder.
Run outs credited to the bowler · case 02
A bowler earns 25 points for a run out effected by a fielder.
Run outs credited to the bowler · case 03
A bowler earns 25 points for a run out effected by a fielder.
Run outs credited to the bowler · case 04
A bowler earns 25 points for a run out effected by a fielder.
Run outs credited to the bowler · case 05
A bowler earns 25 points for a run out effected by a fielder.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗