Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Accumulators beyond seven legs get no bonus · case 01
An eight-fold loses its bonus entirely, or is capped at 20 percent.
Accumulators beyond seven legs get no bonus · case 02
An eight-fold loses its bonus entirely, or is capped at 20 percent.
Accumulators beyond seven legs get no bonus · case 03
An eight-fold loses its bonus entirely, or is capped at 20 percent.
Accumulators beyond seven legs get no bonus · case 04
An eight-fold loses its bonus entirely, or is capped at 20 percent.
Accumulators beyond seven legs get no bonus · case 05
An eight-fold loses its bonus entirely, or is capped at 20 percent.
Non-qualifying legs counted towards the bonus · case 01
Short-priced legs push the accumulator into a higher bonus band.
Non-qualifying legs counted towards the bonus · case 02
Short-priced legs push the accumulator into a higher bonus band.
Non-qualifying legs counted towards the bonus · case 03
Short-priced legs push the accumulator into a higher bonus band.
Non-qualifying legs counted towards the bonus · case 04
Short-priced legs push the accumulator into a higher bonus band.
Non-qualifying legs counted towards the bonus · case 05
Short-priced legs push the accumulator into a higher bonus band.
Tax computed on the gross return · case 01
Winners are taxed on their own stake.
Tax computed on the gross return · case 02
Winners are taxed on their own stake.
Tax computed on the gross return · case 03
Winners are taxed on their own stake.
Tax computed on the gross return · case 04
Winners are taxed on their own stake.
Tax computed on the gross return · case 05
Winners are taxed on their own stake.
Winnings equal to the threshold taxed or cents ignored · case 01
A win of exactly the threshold is taxed, or one just above it is not.
Winnings equal to the threshold taxed or cents ignored · case 02
A win of exactly the threshold is taxed, or one just above it is not.
Winnings equal to the threshold taxed or cents ignored · case 03
A win of exactly the threshold is taxed, or one just above it is not.
Winnings equal to the threshold taxed or cents ignored · case 04
A win of exactly the threshold is taxed, or one just above it is not.
Winnings equal to the threshold taxed or cents ignored · case 05
A win of exactly the threshold is taxed, or one just above it is not.
Only the excess over the threshold is taxed · case 01
Large winners pay far less tax than the stated cliff rule requires.
Only the excess over the threshold is taxed · case 02
Large winners pay far less tax than the stated cliff rule requires.
Only the excess over the threshold is taxed · case 03
Large winners pay far less tax than the stated cliff rule requires.
Only the excess over the threshold is taxed · case 04
Large winners pay far less tax than the stated cliff rule requires.
Only the excess over the threshold is taxed · case 05
Large winners pay far less tax than the stated cliff rule requires.
Lay price converted with the profit instead of the ratio · case 01
Laying at 3.00 is shown as backing the field at 2.00.
Lay price converted with the profit instead of the ratio · case 02
Laying at 3.00 is shown as backing the field at 2.00.
Lay price converted with the profit instead of the ratio · case 03
Laying at 3.00 is shown as backing the field at 2.00.
Lay price converted with the profit instead of the ratio · case 04
Laying at 3.00 is shown as backing the field at 2.00.
Lay price converted with the profit instead of the ratio · case 05
Laying at 3.00 is shown as backing the field at 2.00.
Commission deducted from the whole price · case 01
Effective prices are reduced by commission on the stake as well as winnings.
Commission deducted from the whole price · case 02
Effective prices are reduced by commission on the stake as well as winnings.
Commission deducted from the whole price · case 03
Effective prices are reduced by commission on the stake as well as winnings.
Commission deducted from the whole price · case 04
Effective prices are reduced by commission on the stake as well as winnings.
Commission deducted from the whole price · case 05
Effective prices are reduced by commission on the stake as well as winnings.
Equivalent price rounded with binary floats or truncated · case 01
Laying at 17 shows 1.062 instead of 1.063.
Equivalent price rounded with binary floats or truncated · case 02
Laying at 17 shows 1.062 instead of 1.063.
Equivalent price rounded with binary floats or truncated · case 03
Laying at 17 shows 1.062 instead of 1.063.
Equivalent price rounded with binary floats or truncated · case 04
Laying at 17 shows 1.062 instead of 1.063.
Equivalent price rounded with binary floats or truncated · case 05
Laying at 17 shows 1.062 instead of 1.063.
Negative rushing yards floored to a full lost point · case 01
A back with -7 rushing yards is charged a whole point although he never lost a full 10 yards.
Negative rushing yards floored to a full lost point · case 02
A back with -7 rushing yards is charged a whole point although he never lost a full 10 yards.
Negative rushing yards floored to a full lost point · case 03
A back with -7 rushing yards is charged a whole point although he never lost a full 10 yards.
Negative rushing yards floored to a full lost point · case 04
A back with -7 rushing yards is charged a whole point although he never lost a full 10 yards.
Negative rushing yards floored to a full lost point · case 05
A back with -7 rushing yards is charged a whole point although he never lost a full 10 yards.
Exactly 300 passing yards misses the passing bonus · case 01
A quarterback finishing on exactly 300 passing yards gets no 3 point bonus.
Exactly 300 passing yards misses the passing bonus · case 02
A quarterback finishing on exactly 300 passing yards gets no 3 point bonus.
Exactly 300 passing yards misses the passing bonus · case 03
A quarterback finishing on exactly 300 passing yards gets no 3 point bonus.
Exactly 300 passing yards misses the passing bonus · case 04
A quarterback finishing on exactly 300 passing yards gets no 3 point bonus.
Exactly 300 passing yards misses the passing bonus · case 05
A quarterback finishing on exactly 300 passing yards gets no 3 point bonus.
TE premium replaces the reception value instead of adding to it · case 01
Tight ends in PPR leagues earn only 0.5 per catch, less than wide receivers.
TE premium replaces the reception value instead of adding to it · case 02
Tight ends in PPR leagues earn only 0.5 per catch, less than wide receivers.
TE premium replaces the reception value instead of adding to it · case 03
Tight ends in PPR leagues earn only 0.5 per catch, less than wide receivers.
TE premium replaces the reception value instead of adding to it · case 04
Tight ends in PPR leagues earn only 0.5 per catch, less than wide receivers.
TE premium replaces the reception value instead of adding to it · case 05
Tight ends in PPR leagues earn only 0.5 per catch, less than wide receivers.
Recovered fumbles are penalized like lost fumbles · case 01
A player who fumbled twice but recovered both loses 4 points.
Recovered fumbles are penalized like lost fumbles · case 02
A player who fumbled twice but recovered both loses 4 points.
Recovered fumbles are penalized like lost fumbles · case 03
A player who fumbled twice but recovered both loses 4 points.
Recovered fumbles are penalized like lost fumbles · case 04
A player who fumbled twice but recovered both loses 4 points.
Recovered fumbles are penalized like lost fumbles · case 05
A player who fumbled twice but recovered both loses 4 points.
Score display rounds half-hundredths with binary float formatting · case 01
A 12.25 score shows as 12.2 on the scoreboard while 12.35 shows 12.3 or 12.4 depending on float noise.
Score display rounds half-hundredths with binary float formatting · case 02
A 12.25 score shows as 12.2 on the scoreboard while 12.35 shows 12.3 or 12.4 depending on float noise.
Score display rounds half-hundredths with binary float formatting · case 03
A 12.25 score shows as 12.2 on the scoreboard while 12.35 shows 12.3 or 12.4 depending on float noise.
Score display rounds half-hundredths with binary float formatting · case 04
A 12.25 score shows as 12.2 on the scoreboard while 12.35 shows 12.3 or 12.4 depending on float noise.
Score display rounds half-hundredths with binary float formatting · case 05
A 12.25 score shows as 12.2 on the scoreboard while 12.35 shows 12.3 or 12.4 depending on float noise.
Rushing and receiving yards truncated as one pool · case 01
A player with 9 rushing and 9 receiving yards scores 1 point instead of 0.
Rushing and receiving yards truncated as one pool · case 02
A player with 9 rushing and 9 receiving yards scores 1 point instead of 0.
Rushing and receiving yards truncated as one pool · case 03
A player with 9 rushing and 9 receiving yards scores 1 point instead of 0.
Rushing and receiving yards truncated as one pool · case 04
A player with 9 rushing and 9 receiving yards scores 1 point instead of 0.
Rushing and receiving yards truncated as one pool · case 05
A player with 9 rushing and 9 receiving yards scores 1 point instead of 0.
Passing yards scored fractionally instead of per full 25 yards · case 01
A 310-yard passer earns 12.4 passing points where the league awards 12.
Passing yards scored fractionally instead of per full 25 yards · case 02
A 310-yard passer earns 12.4 passing points where the league awards 12.
Passing yards scored fractionally instead of per full 25 yards · case 03
A 310-yard passer earns 12.4 passing points where the league awards 12.
Passing yards scored fractionally instead of per full 25 yards · case 04
A 310-yard passer earns 12.4 passing points where the league awards 12.
Passing yards scored fractionally instead of per full 25 yards · case 05
A 310-yard passer earns 12.4 passing points where the league awards 12.
Pick-six against the offense charged to the defense · case 01
A defense that allowed 0 points loses its shutout because its own quarterback threw a pick-six.
Pick-six against the offense charged to the defense · case 02
A defense that allowed 0 points loses its shutout because its own quarterback threw a pick-six.
Pick-six against the offense charged to the defense · case 03
A defense that allowed 0 points loses its shutout because its own quarterback threw a pick-six.
Pick-six against the offense charged to the defense · case 04
A defense that allowed 0 points loses its shutout because its own quarterback threw a pick-six.
Pick-six against the offense charged to the defense · case 05
A defense that allowed 0 points loses its shutout because its own quarterback threw a pick-six.
Points allowed tier upper bounds treated as exclusive · case 01
A defense allowing exactly 6 points lands in the 7-13 tier.
Points allowed tier upper bounds treated as exclusive · case 02
A defense allowing exactly 6 points lands in the 7-13 tier.
Points allowed tier upper bounds treated as exclusive · case 03
A defense allowing exactly 6 points lands in the 7-13 tier.
Points allowed tier upper bounds treated as exclusive · case 04
A defense allowing exactly 6 points lands in the 7-13 tier.
Points allowed tier upper bounds treated as exclusive · case 05
A defense allowing exactly 6 points lands in the 7-13 tier.
Yards allowed tier scan keeps the last matching tier · case 01
Every defense allowing under 450 yards receives -3 yards points.
Yards allowed tier scan keeps the last matching tier · case 02
Every defense allowing under 450 yards receives -3 yards points.
Yards allowed tier scan keeps the last matching tier · case 03
Every defense allowing under 450 yards receives -3 yards points.
Yards allowed tier scan keeps the last matching tier · case 04
Every defense allowing under 450 yards receives -3 yards points.
Yards allowed tier scan keeps the last matching tier · case 05
Every defense allowing under 450 yards receives -3 yards points.
Half-sack units scored as whole sacks · case 01
A defense with 2.5 sacks scores 5 sack points.
Half-sack units scored as whole sacks · case 02
A defense with 2.5 sacks scores 5 sack points.
Half-sack units scored as whole sacks · case 03
A defense with 2.5 sacks scores 5 sack points.
Half-sack units scored as whole sacks · case 04
A defense with 2.5 sacks scores 5 sack points.
Half-sack units scored as whole sacks · case 05
A defense with 2.5 sacks scores 5 sack points.
Recovering own muffed punts scores as a takeaway · case 01
Special teams recovering their own fumble adds 2 defense points.
Recovering own muffed punts scores as a takeaway · case 02
Special teams recovering their own fumble adds 2 defense points.
Recovering own muffed punts scores as a takeaway · case 03
Special teams recovering their own fumble adds 2 defense points.
Recovering own muffed punts scores as a takeaway · case 04
Special teams recovering their own fumble adds 2 defense points.
Recovering own muffed punts scores as a takeaway · case 05
Special teams recovering their own fumble adds 2 defense points.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗