Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Stumpings earn the bowled/lbw bonus · case 01
Spinners collect 8 extra points for every stumping.
Stumpings earn the bowled/lbw bonus · case 02
Spinners collect 8 extra points for every stumping.
Stumpings earn the bowled/lbw bonus · case 03
Spinners collect 8 extra points for every stumping.
Stumpings earn the bowled/lbw bonus · case 04
Spinners collect 8 extra points for every stumping.
Stumpings earn the bowled/lbw bonus · case 05
Spinners collect 8 extra points for every stumping.
Economy bonus applied after two balls instead of two overs · case 01
A bowler who delivered 5 balls for 1 run receives the best economy bonus.
Economy bonus applied after two balls instead of two overs · case 02
A bowler who delivered 5 balls for 1 run receives the best economy bonus.
Economy bonus applied after two balls instead of two overs · case 03
A bowler who delivered 5 balls for 1 run receives the best economy bonus.
Economy bonus applied after two balls instead of two overs · case 04
A bowler who delivered 5 balls for 1 run receives the best economy bonus.
Economy bonus applied after two balls instead of two overs · case 05
A bowler who delivered 5 balls for 1 run receives the best economy bonus.
Economy divides by the overs string as a decimal · case 01
2.3 overs is treated as 2.3 overs rather than 2.5, inflating economy.
Economy divides by the overs string as a decimal · case 02
2.3 overs is treated as 2.3 overs rather than 2.5, inflating economy.
Economy divides by the overs string as a decimal · case 03
2.3 overs is treated as 2.3 overs rather than 2.5, inflating economy.
Economy divides by the overs string as a decimal · case 04
2.3 overs is treated as 2.3 overs rather than 2.5, inflating economy.
Economy divides by the overs string as a decimal · case 05
2.3 overs is treated as 2.3 overs rather than 2.5, inflating economy.
Exactly sixty minutes earns the short appearance point · case 01
A player substituted in the 60th minute gets 1 appearance point.
Exactly sixty minutes earns the short appearance point · case 02
A player substituted in the 60th minute gets 1 appearance point.
Exactly sixty minutes earns the short appearance point · case 03
A player substituted in the 60th minute gets 1 appearance point.
Exactly sixty minutes earns the short appearance point · case 04
A player substituted in the 60th minute gets 1 appearance point.
Exactly sixty minutes earns the short appearance point · case 05
A player substituted in the 60th minute gets 1 appearance point.
Late substitutes earn clean sheets · case 01
A defender who played 10 minutes gets 4 clean-sheet points.
Late substitutes earn clean sheets · case 02
A defender who played 10 minutes gets 4 clean-sheet points.
Late substitutes earn clean sheets · case 03
A defender who played 10 minutes gets 4 clean-sheet points.
Late substitutes earn clean sheets · case 04
A defender who played 10 minutes gets 4 clean-sheet points.
Late substitutes earn clean sheets · case 05
A defender who played 10 minutes gets 4 clean-sheet points.
Every goal conceded costs a defender a point · case 01
A goalkeeper conceding 3 loses 3 points instead of 1.
Every goal conceded costs a defender a point · case 02
A goalkeeper conceding 3 loses 3 points instead of 1.
Every goal conceded costs a defender a point · case 03
A goalkeeper conceding 3 loses 3 points instead of 1.
Every goal conceded costs a defender a point · case 04
A goalkeeper conceding 3 loses 3 points instead of 1.
Every goal conceded costs a defender a point · case 05
A goalkeeper conceding 3 loses 3 points instead of 1.
Midfielders penalized for goals conceded · case 01
Midfielders lose points when their team concedes twice.
Midfielders penalized for goals conceded · case 02
Midfielders lose points when their team concedes twice.
Midfielders penalized for goals conceded · case 03
Midfielders lose points when their team concedes twice.
Midfielders penalized for goals conceded · case 04
Midfielders lose points when their team concedes twice.
Midfielders penalized for goals conceded · case 05
Midfielders lose points when their team concedes twice.
Yellow card also charged on a red-carded player · case 01
A player sent off after two bookings loses 4 points.
Yellow card also charged on a red-carded player · case 02
A player sent off after two bookings loses 4 points.
Yellow card also charged on a red-carded player · case 03
A player sent off after two bookings loses 4 points.
Yellow card also charged on a red-carded player · case 04
A player sent off after two bookings loses 4 points.
Yellow card also charged on a red-carded player · case 05
A player sent off after two bookings loses 4 points.
Unused substitute receives an appearance point · case 01
A goalkeeper who never left the bench scores 1 point.
Unused substitute receives an appearance point · case 02
A goalkeeper who never left the bench scores 1 point.
Unused substitute receives an appearance point · case 03
A goalkeeper who never left the bench scores 1 point.
Unused substitute receives an appearance point · case 04
A goalkeeper who never left the bench scores 1 point.
Unused substitute receives an appearance point · case 05
A goalkeeper who never left the bench scores 1 point.
Outfield bench player replaces a goalkeeper · case 01
When the starting goalkeeper does not play, a benched striker takes his place.
Outfield bench player replaces a goalkeeper · case 02
When the starting goalkeeper does not play, a benched striker takes his place.
Outfield bench player replaces a goalkeeper · case 03
When the starting goalkeeper does not play, a benched striker takes his place.
Outfield bench player replaces a goalkeeper · case 04
When the starting goalkeeper does not play, a benched striker takes his place.
Outfield bench player replaces a goalkeeper · case 05
When the starting goalkeeper does not play, a benched striker takes his place.
Bench priority ignored in favor of most minutes · case 01
The manager's first bench choice is skipped for a player with more minutes.
Bench priority ignored in favor of most minutes · case 02
The manager's first bench choice is skipped for a player with more minutes.
Bench priority ignored in favor of most minutes · case 03
The manager's first bench choice is skipped for a player with more minutes.
Bench priority ignored in favor of most minutes · case 04
The manager's first bench choice is skipped for a player with more minutes.
Bench priority ignored in favor of most minutes · case 05
The manager's first bench choice is skipped for a player with more minutes.
Formation validated before the substitution is applied · case 01
A forward replaces the only other defender and leaves two at the back.
Formation validated before the substitution is applied · case 02
A forward replaces the only other defender and leaves two at the back.
Formation validated before the substitution is applied · case 03
A forward replaces the only other defender and leaves two at the back.
Formation validated before the substitution is applied · case 04
A forward replaces the only other defender and leaves two at the back.
Formation validated before the substitution is applied · case 05
A forward replaces the only other defender and leaves two at the back.
One bench player substitutes for two starters · case 01
The same bench midfielder appears twice in the final XI.
One bench player substitutes for two starters · case 02
The same bench midfielder appears twice in the final XI.
One bench player substitutes for two starters · case 03
The same bench midfielder appears twice in the final XI.
One bench player substitutes for two starters · case 04
The same bench midfielder appears twice in the final XI.
One bench player substitutes for two starters · case 05
The same bench midfielder appears twice in the final XI.
Ties consume only one bonus position · case 01
After a two-way tie for first, the next player still receives 2 bonus.
Ties consume only one bonus position · case 02
After a two-way tie for first, the next player still receives 2 bonus.
Ties consume only one bonus position · case 03
After a two-way tie for first, the next player still receives 2 bonus.
Ties consume only one bonus position · case 04
After a two-way tie for first, the next player still receives 2 bonus.
Ties consume only one bonus position · case 05
After a two-way tie for first, the next player still receives 2 bonus.
Players with no performance index receive bonus · case 01
In a low-scoring match a player with index 0 is awarded 1 bonus.
Players with no performance index receive bonus · case 02
In a low-scoring match a player with index 0 is awarded 1 bonus.
Players with no performance index receive bonus · case 03
In a low-scoring match a player with index 0 is awarded 1 bonus.
Players with no performance index receive bonus · case 04
In a low-scoring match a player with index 0 is awarded 1 bonus.
Players with no performance index receive bonus · case 05
In a low-scoring match a player with index 0 is awarded 1 bonus.
Tied indices split by name order · case 01
Two players tied on the top index receive 3 and 2.
Tied indices split by name order · case 02
Two players tied on the top index receive 3 and 2.
Tied indices split by name order · case 03
Two players tied on the top index receive 3 and 2.
Tied indices split by name order · case 04
Two players tied on the top index receive 3 and 2.
Tied indices split by name order · case 05
Two players tied on the top index receive 3 and 2.
Birdie streak bonus repeated on every extra birdie · case 01
Five straight birdies earn three streak bonuses.
Birdie streak bonus repeated on every extra birdie · case 02
Five straight birdies earn three streak bonuses.
Birdie streak bonus repeated on every extra birdie · case 03
Five straight birdies earn three streak bonuses.
Birdie streak bonus repeated on every extra birdie · case 04
Five straight birdies earn three streak bonuses.
Birdie streak bonus repeated on every extra birdie · case 05
Five straight birdies earn three streak bonuses.
Pars do not break a birdie streak · case 01
Birdie, par, birdie, birdie counts as a three-hole streak.
Pars do not break a birdie streak · case 02
Birdie, par, birdie, birdie counts as a three-hole streak.
Pars do not break a birdie streak · case 03
Birdie, par, birdie, birdie counts as a three-hole streak.
Pars do not break a birdie streak · case 04
Birdie, par, birdie, birdie counts as a three-hole streak.
Pars do not break a birdie streak · case 05
Birdie, par, birdie, birdie counts as a three-hole streak.
Hole-in-one bonus only on par threes · case 01
An ace on a short par four earns no hole-in-one bonus.
Hole-in-one bonus only on par threes · case 02
An ace on a short par four earns no hole-in-one bonus.
Hole-in-one bonus only on par threes · case 03
An ace on a short par four earns no hole-in-one bonus.
Hole-in-one bonus only on par threes · case 04
An ace on a short par four earns no hole-in-one bonus.
Hole-in-one bonus only on par threes · case 05
An ace on a short par four earns no hole-in-one bonus.
Bogey-free bonus paid on incomplete rounds · case 01
A golfer who withdrew after nine clean holes earns the bogey-free bonus.
Bogey-free bonus paid on incomplete rounds · case 02
A golfer who withdrew after nine clean holes earns the bogey-free bonus.
Bogey-free bonus paid on incomplete rounds · case 03
A golfer who withdrew after nine clean holes earns the bogey-free bonus.
Bogey-free bonus paid on incomplete rounds · case 04
A golfer who withdrew after nine clean holes earns the bogey-free bonus.
Bogey-free bonus paid on incomplete rounds · case 05
A golfer who withdrew after nine clean holes earns the bogey-free bonus.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗