Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Team with no games breaks the percentage · case 01
A team yet to play raises a division error or is shown as a .500 team.
Team with no games breaks the percentage · case 02
A team yet to play raises a division error or is shown as a .500 team.
Team with no games breaks the percentage · case 03
A team yet to play raises a division error or is shown as a .500 team.
Team with no games breaks the percentage · case 04
A team yet to play raises a division error or is shown as a .500 team.
Team with no games breaks the percentage · case 05
A team yet to play raises a division error or is shown as a .500 team.
Dash reserved for the leader row only · case 01
A team with zero games behind shows "0.0" or a trailing team ahead on games shows "-".
Dash reserved for the leader row only · case 02
A team with zero games behind shows "0.0" or a trailing team ahead on games shows "-".
Dash reserved for the leader row only · case 03
A team with zero games behind shows "0.0" or a trailing team ahead on games shows "-".
Dash reserved for the leader row only · case 04
A team with zero games behind shows "0.0" or a trailing team ahead on games shows "-".
Dash reserved for the leader row only · case 05
A team with zero games behind shows "0.0" or a trailing team ahead on games shows "-".
Innings pitched summed as decimal numbers · case 01
Two outings of 5.2 and 1.1 innings total 6.3 instead of 7.0.
Innings pitched summed as decimal numbers · case 02
Two outings of 5.2 and 1.1 innings total 6.3 instead of 7.0.
Innings pitched summed as decimal numbers · case 03
Two outings of 5.2 and 1.1 innings total 6.3 instead of 7.0.
Innings pitched summed as decimal numbers · case 04
Two outings of 5.2 and 1.1 innings total 6.3 instead of 7.0.
Innings pitched summed as decimal numbers · case 05
Two outings of 5.2 and 1.1 innings total 6.3 instead of 7.0.
Total innings displayed as a decimal fraction · case 01
A total of 20 outs is shown as "6.7" instead of "6.2".
Total innings displayed as a decimal fraction · case 02
A total of 20 outs is shown as "6.7" instead of "6.2".
Total innings displayed as a decimal fraction · case 03
A total of 20 outs is shown as "6.7" instead of "6.2".
Total innings displayed as a decimal fraction · case 04
A total of 20 outs is shown as "6.7" instead of "6.2".
Total innings displayed as a decimal fraction · case 05
A total of 20 outs is shown as "6.7" instead of "6.2".
ERA scaled to nine innings for every league · case 01
A softball or seven-inning league ERA is computed per nine innings.
ERA scaled to nine innings for every league · case 02
A softball or seven-inning league ERA is computed per nine innings.
ERA scaled to nine innings for every league · case 03
A softball or seven-inning league ERA is computed per nine innings.
ERA scaled to nine innings for every league · case 04
A softball or seven-inning league ERA is computed per nine innings.
ERA scaled to nine innings for every league · case 05
A softball or seven-inning league ERA is computed per nine innings.
ERA truncated instead of rounded half up · case 01
An ERA of 3.375 is shown as 3.37.
ERA truncated instead of rounded half up · case 02
An ERA of 3.375 is shown as 3.37.
ERA truncated instead of rounded half up · case 03
An ERA of 3.375 is shown as 3.37.
ERA truncated instead of rounded half up · case 04
An ERA of 3.375 is shown as 3.37.
ERA truncated instead of rounded half up · case 05
An ERA of 3.375 is shown as 3.37.
Pitcher with no outs crashes the ERA · case 01
A reliever who faced batters without recording an out raises a division error or shows 0.00.
Pitcher with no outs crashes the ERA · case 02
A reliever who faced batters without recording an out raises a division error or shows 0.00.
Pitcher with no outs crashes the ERA · case 03
A reliever who faced batters without recording an out raises a division error or shows 0.00.
Pitcher with no outs crashes the ERA · case 04
A reliever who faced batters without recording an out raises a division error or shows 0.00.
Pitcher with no outs crashes the ERA · case 05
A reliever who faced batters without recording an out raises a division error or shows 0.00.
Home team declared winner while only tied before the bottom half · case 01
A game tied after the top of the ninth is declared final.
Home team declared winner while only tied before the bottom half · case 02
A game tied after the top of the ninth is declared final.
Home team declared winner while only tied before the bottom half · case 03
A game tied after the top of the ninth is declared final.
Home team declared winner while only tied before the bottom half · case 04
A game tied after the top of the ninth is declared final.
Home team declared winner while only tied before the bottom half · case 05
A game tied after the top of the ninth is declared final.
Extra-inning games never become final · case 01
A game decided in the tenth inning stays in progress.
Extra-inning games never become final · case 02
A game decided in the tenth inning stays in progress.
Extra-inning games never become final · case 03
A game decided in the tenth inning stays in progress.
Extra-inning games never become final · case 04
A game decided in the tenth inning stays in progress.
Extra-inning games never become final · case 05
A game decided in the tenth inning stays in progress.
Tied regulation game finalized · case 01
A game tied after nine full innings is reported as final.
Tied regulation game finalized · case 02
A game tied after nine full innings is reported as final.
Tied regulation game finalized · case 03
A game tied after nine full innings is reported as final.
Tied regulation game finalized · case 04
A game tied after nine full innings is reported as final.
Tied regulation game finalized · case 05
A game tied after nine full innings is reported as final.
Malformed line scores accepted · case 01
A line score with two missing home innings or an extra home inning is scored.
Malformed line scores accepted · case 02
A line score with two missing home innings or an extra home inning is scored.
Malformed line scores accepted · case 03
A line score with two missing home innings or an extra home inning is scored.
Malformed line scores accepted · case 04
A line score with two missing home innings or an extra home inning is scored.
Malformed line scores accepted · case 05
A line score with two missing home innings or an extra home inning is scored.
Handicap stroke missing on the last allocated index · case 01
A 5-handicap player gets no stroke on stroke index 5.
Handicap stroke missing on the last allocated index · case 02
A 5-handicap player gets no stroke on stroke index 5.
Handicap stroke missing on the last allocated index · case 03
A 5-handicap player gets no stroke on stroke index 5.
Handicap stroke missing on the last allocated index · case 04
A 5-handicap player gets no stroke on stroke index 5.
Handicap stroke missing on the last allocated index · case 05
A 5-handicap player gets no stroke on stroke index 5.
Points floor applied before adding handicap strokes · case 01
A double-bogey on a stroke hole scores too many or too few points.
Points floor applied before adding handicap strokes · case 02
A double-bogey on a stroke hole scores too many or too few points.
Points floor applied before adding handicap strokes · case 03
A double-bogey on a stroke hole scores too many or too few points.
Points floor applied before adding handicap strokes · case 04
A double-bogey on a stroke hole scores too many or too few points.
Points floor applied before adding handicap strokes · case 05
A double-bogey on a stroke hole scores too many or too few points.
Plus handicap receives strokes instead of giving them back · case 01
A +2 golfer is given strokes on the two hardest holes.
Plus handicap receives strokes instead of giving them back · case 02
A +2 golfer is given strokes on the two hardest holes.
Plus handicap receives strokes instead of giving them back · case 03
A +2 golfer is given strokes on the two hardest holes.
Plus handicap receives strokes instead of giving them back · case 04
A +2 golfer is given strokes on the two hardest holes.
Plus handicap receives strokes instead of giving them back · case 05
A +2 golfer is given strokes on the two hardest holes.
Handicaps above 18 capped at one stroke per hole · case 01
A 20-handicap player receives only one stroke on the hardest holes.
Handicaps above 18 capped at one stroke per hole · case 02
A 20-handicap player receives only one stroke on the hardest holes.
Handicaps above 18 capped at one stroke per hole · case 03
A 20-handicap player receives only one stroke on the hardest holes.
Handicaps above 18 capped at one stroke per hole · case 04
A 20-handicap player receives only one stroke on the hardest holes.
Handicaps above 18 capped at one stroke per hole · case 05
A 20-handicap player receives only one stroke on the hardest holes.
No-return hole crashes or vanishes from the card · case 01
A hole marked with no score raises an error or disappears from the per-hole list.
No-return hole crashes or vanishes from the card · case 02
A hole marked with no score raises an error or disappears from the per-hole list.
No-return hole crashes or vanishes from the card · case 03
A hole marked with no score raises an error or disappears from the per-hole list.
No-return hole crashes or vanishes from the card · case 04
A hole marked with no score raises an error or disappears from the per-hole list.
No-return hole crashes or vanishes from the card · case 05
A hole marked with no score raises an error or disappears from the per-hole list.
Dormie treated as a closed match · case 01
A player 3 up with 3 to play is declared the winner.
Dormie treated as a closed match · case 02
A player 3 up with 3 to play is declared the winner.
Dormie treated as a closed match · case 03
A player 3 up with 3 to play is declared the winner.
Dormie treated as a closed match · case 04
A player 3 up with 3 to play is declared the winner.
Dormie treated as a closed match · case 05
A player 3 up with 3 to play is declared the winner.
Closure notation reports the wrong holes figure · case 01
A 3&2 win is printed as "3&16" or "3&3".
Closure notation reports the wrong holes figure · case 02
A 3&2 win is printed as "3&16" or "3&3".
Closure notation reports the wrong holes figure · case 03
A 3&2 win is printed as "3&16" or "3&3".
Closure notation reports the wrong holes figure · case 04
A 3&2 win is printed as "3&16" or "3&3".
Closure notation reports the wrong holes figure · case 05
A 3&2 win is printed as "3&16" or "3&3".
Win on the 18th printed as "1&0" · case 01
A match won on the last hole is shown as "A wins 1&0".
Win on the 18th printed as "1&0" · case 02
A match won on the last hole is shown as "A wins 1&0".
Win on the 18th printed as "1&0" · case 03
A match won on the last hole is shown as "A wins 1&0".
Win on the 18th printed as "1&0" · case 04
A match won on the last hole is shown as "A wins 1&0".
Win on the 18th printed as "1&0" · case 05
A match won on the last hole is shown as "A wins 1&0".
Dormie shown only for one side or only on the 18th tee · case 01
B dormie situations display as "B 3 up".
Dormie shown only for one side or only on the 18th tee · case 02
B dormie situations display as "B 3 up".
Dormie shown only for one side or only on the 18th tee · case 03
B dormie situations display as "B 3 up".
Dormie shown only for one side or only on the 18th tee · case 04
B dormie situations display as "B 3 up".
Dormie shown only for one side or only on the 18th tee · case 05
B dormie situations display as "B 3 up".
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗