Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Set closed at six games without a two-game lead · case 01
A 6-5 set is recorded as complete.
Set closed at six games without a two-game lead · case 02
A 6-5 set is recorded as complete.
Set closed at six games without a two-game lead · case 03
A 6-5 set is recorded as complete.
Set closed at six games without a two-game lead · case 04
A 6-5 set is recorded as complete.
Set closed at six games without a two-game lead · case 05
A 6-5 set is recorded as complete.
Fifth set played to 25 points · case 01
A deciding set is not closed at 15-13 and continues to 25.
Fifth set played to 25 points · case 02
A deciding set is not closed at 15-13 and continues to 25.
Fifth set played to 25 points · case 03
A deciding set is not closed at 15-13 and continues to 25.
Fifth set played to 25 points · case 04
A deciding set is not closed at 15-13 and continues to 25.
Fifth set played to 25 points · case 05
A deciding set is not closed at 15-13 and continues to 25.
Rotation advanced on every point instead of on side-outs · case 01
A serving team that keeps winning rallies is shown rotating through positions.
Rotation advanced on every point instead of on side-outs · case 02
A serving team that keeps winning rallies is shown rotating through positions.
Rotation advanced on every point instead of on side-outs · case 03
A serving team that keeps winning rallies is shown rotating through positions.
Rotation advanced on every point instead of on side-outs · case 04
A serving team that keeps winning rallies is shown rotating through positions.
Rotation advanced on every point instead of on side-outs · case 05
A serving team that keeps winning rallies is shown rotating through positions.
Rotations carried over into the next set · case 01
The rotation counters at the start of set two still reflect set one.
Rotations carried over into the next set · case 02
The rotation counters at the start of set two still reflect set one.
Rotations carried over into the next set · case 03
The rotation counters at the start of set two still reflect set one.
Rotations carried over into the next set · case 04
The rotation counters at the start of set two still reflect set one.
Rotations carried over into the next set · case 05
The rotation counters at the start of set two still reflect set one.
Next set opened by the wrong server · case 01
After a set the team that won the last rally keeps serving instead of the alternating first server.
Next set opened by the wrong server · case 02
After a set the team that won the last rally keeps serving instead of the alternating first server.
Next set opened by the wrong server · case 03
After a set the team that won the last rally keeps serving instead of the alternating first server.
Next set opened by the wrong server · case 04
After a set the team that won the last rally keeps serving instead of the alternating first server.
Next set opened by the wrong server · case 05
After a set the team that won the last rally keeps serving instead of the alternating first server.
Volleyball set capped like badminton · case 01
A set is closed at 25-24 or at a 27-26 cap instead of continuing until a two-point lead.
Volleyball set capped like badminton · case 02
A set is closed at 25-24 or at a 27-26 cap instead of continuing until a two-point lead.
Volleyball set capped like badminton · case 03
A set is closed at 25-24 or at a 27-26 cap instead of continuing until a two-point lead.
Volleyball set capped like badminton · case 04
A set is closed at 25-24 or at a 27-26 cap instead of continuing until a two-point lead.
Volleyball set capped like badminton · case 05
A set is closed at 25-24 or at a 27-26 cap instead of continuing until a two-point lead.
Badminton game runs past the 30-point cap · case 01
At 29-29 the next rally does not end the game.
Badminton game runs past the 30-point cap · case 02
At 29-29 the next rally does not end the game.
Badminton game runs past the 30-point cap · case 03
At 29-29 the next rally does not end the game.
Badminton game runs past the 30-point cap · case 04
At 29-29 the next rally does not end the game.
Badminton game runs past the 30-point cap · case 05
At 29-29 the next rally does not end the game.
Service court chosen from the combined score · case 01
The server is sent to the wrong court when the scores have different parity.
Service court chosen from the combined score · case 02
The server is sent to the wrong court when the scores have different parity.
Service court chosen from the combined score · case 03
The server is sent to the wrong court when the scores have different parity.
Service court chosen from the combined score · case 04
The server is sent to the wrong court when the scores have different parity.
Service court chosen from the combined score · case 05
The server is sent to the wrong court when the scores have different parity.
Serve alternates instead of following the rally winner · case 01
After a side-out the wrong player is shown serving.
Serve alternates instead of following the rally winner · case 02
After a side-out the wrong player is shown serving.
Serve alternates instead of following the rally winner · case 03
After a side-out the wrong player is shown serving.
Serve alternates instead of following the rally winner · case 04
After a side-out the wrong player is shown serving.
Serve alternates instead of following the rally winner · case 05
After a side-out the wrong player is shown serving.
Point-by-point service starts when only one player reaches ten · case 01
At 10-6 the server changes every point instead of every two points.
Point-by-point service starts when only one player reaches ten · case 02
At 10-6 the server changes every point instead of every two points.
Point-by-point service starts when only one player reaches ten · case 03
At 10-6 the server changes every point instead of every two points.
Point-by-point service starts when only one player reaches ten · case 04
At 10-6 the server changes every point instead of every two points.
Point-by-point service starts when only one player reaches ten · case 05
At 10-6 the server changes every point instead of every two points.
Service changes every point from the start · case 01
The next server is wrong after the first point of the game.
Service changes every point from the start · case 02
The next server is wrong after the first point of the game.
Service changes every point from the start · case 03
The next server is wrong after the first point of the game.
Service changes every point from the start · case 04
The next server is wrong after the first point of the game.
Service changes every point from the start · case 05
The next server is wrong after the first point of the game.
Table tennis game target is wrong · case 01
An 11-9 game is not recognized as finished.
Table tennis game target is wrong · case 02
An 11-9 game is not recognized as finished.
Table tennis game target is wrong · case 03
An 11-9 game is not recognized as finished.
Table tennis game target is wrong · case 04
An 11-9 game is not recognized as finished.
Table tennis game target is wrong · case 05
An 11-9 game is not recognized as finished.
Cricket overs notation parsed as a decimal fraction · case 01
"43.4" overs is treated as 43.4 decimal overs, skewing net run rate.
Cricket overs notation parsed as a decimal fraction · case 02
"43.4" overs is treated as 43.4 decimal overs, skewing net run rate.
Cricket overs notation parsed as a decimal fraction · case 03
"43.4" overs is treated as 43.4 decimal overs, skewing net run rate.
Cricket overs notation parsed as a decimal fraction · case 04
"43.4" overs is treated as 43.4 decimal overs, skewing net run rate.
Cricket overs notation parsed as a decimal fraction · case 05
"43.4" overs is treated as 43.4 decimal overs, skewing net run rate.
All-out innings counted at actual overs · case 01
A side bowled out early is credited with a very high run rate instead of the full quota.
All-out innings counted at actual overs · case 02
A side bowled out early is credited with a very high run rate instead of the full quota.
All-out innings counted at actual overs · case 03
A side bowled out early is credited with a very high run rate instead of the full quota.
All-out innings counted at actual overs · case 04
A side bowled out early is credited with a very high run rate instead of the full quota.
All-out innings counted at actual overs · case 05
A side bowled out early is credited with a very high run rate instead of the full quota.
Net run rate rounded before subtracting the two rates · case 01
The published net run rate differs by 0.001 from the exact value.
Net run rate rounded before subtracting the two rates · case 02
The published net run rate differs by 0.001 from the exact value.
Net run rate rounded before subtracting the two rates · case 03
The published net run rate differs by 0.001 from the exact value.
Net run rate rounded before subtracting the two rates · case 04
The published net run rate differs by 0.001 from the exact value.
Net run rate rounded before subtracting the two rates · case 05
The published net run rate differs by 0.001 from the exact value.
Positive net run rate printed without its sign · case 01
Standings show "0.512" instead of "+0.512", and negative rates may show a doubled sign.
Positive net run rate printed without its sign · case 02
Standings show "0.512" instead of "+0.512", and negative rates may show a doubled sign.
Positive net run rate printed without its sign · case 03
Standings show "0.512" instead of "+0.512", and negative rates may show a doubled sign.
Positive net run rate printed without its sign · case 04
Standings show "0.512" instead of "+0.512", and negative rates may show a doubled sign.
Positive net run rate printed without its sign · case 05
Standings show "0.512" instead of "+0.512", and negative rates may show a doubled sign.
Zero-overs guard checks the wrong totals · case 01
A table with no completed deliveries raises or reports a bogus rate.
Zero-overs guard checks the wrong totals · case 02
A table with no completed deliveries raises or reports a bogus rate.
Zero-overs guard checks the wrong totals · case 03
A table with no completed deliveries raises or reports a bogus rate.
Zero-overs guard checks the wrong totals · case 04
A table with no completed deliveries raises or reports a bogus rate.
Zero-overs guard checks the wrong totals · case 05
A table with no completed deliveries raises or reports a bogus rate.
Wides counted as legal deliveries · case 01
The over ends after five legal balls when a wide was bowled in it.
Wides counted as legal deliveries · case 02
The over ends after five legal balls when a wide was bowled in it.
Wides counted as legal deliveries · case 03
The over ends after five legal balls when a wide was bowled in it.
Wides counted as legal deliveries · case 04
The over ends after five legal balls when a wide was bowled in it.
Wides counted as legal deliveries · case 05
The over ends after five legal balls when a wide was bowled in it.
No-ball bat runs booked as extras · case 01
Extras are inflated when runs are hit off a no-ball.
No-ball bat runs booked as extras · case 02
Extras are inflated when runs are hit off a no-ball.
No-ball bat runs booked as extras · case 03
Extras are inflated when runs are hit off a no-ball.
No-ball bat runs booked as extras · case 04
Extras are inflated when runs are hit off a no-ball.
No-ball bat runs booked as extras · case 05
Extras are inflated when runs are hit off a no-ball.
Wide penalty run omitted · case 01
A plain wide adds nothing to the total.
Wide penalty run omitted · case 02
A plain wide adds nothing to the total.
Wide penalty run omitted · case 03
A plain wide adds nothing to the total.
Wide penalty run omitted · case 04
A plain wide adds nothing to the total.
Wide penalty run omitted · case 05
A plain wide adds nothing to the total.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗