Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Strike not rotated at the end of an over · case 01
The same batter is shown on strike for the first ball of the new over.
Strike not rotated at the end of an over · case 02
The same batter is shown on strike for the first ball of the new over.
Strike not rotated at the end of an over · case 03
The same batter is shown on strike for the first ball of the new over.
Strike not rotated at the end of an over · case 04
The same batter is shown on strike for the first ball of the new over.
Strike not rotated at the end of an over · case 05
The same batter is shown on strike for the first ball of the new over.
Run wides do not change the strike · case 01
After the batters run one on a wide the wrong batter is on strike.
Run wides do not change the strike · case 02
After the batters run one on a wide the wrong batter is on strike.
Run wides do not change the strike · case 03
After the batters run one on a wide the wrong batter is on strike.
Run wides do not change the strike · case 04
After the batters run one on a wide the wrong batter is on strike.
Run wides do not change the strike · case 05
After the batters run one on a wide the wrong batter is on strike.
New batter placed at the wrong end after a wicket · case 01
After a dismissal the dismissed batter number stays on strike.
New batter placed at the wrong end after a wicket · case 02
After a dismissal the dismissed batter number stays on strike.
New batter placed at the wrong end after a wicket · case 03
After a dismissal the dismissed batter number stays on strike.
New batter placed at the wrong end after a wicket · case 04
After a dismissal the dismissed batter number stays on strike.
New batter placed at the wrong end after a wicket · case 05
After a dismissal the dismissed batter number stays on strike.
Completed overs displayed as decimal thirds or 0.6 · case 01
After seven legal balls the overs read "1.2" or an over boundary reads "0.6".
Completed overs displayed as decimal thirds or 0.6 · case 02
After seven legal balls the overs read "1.2" or an over boundary reads "0.6".
Completed overs displayed as decimal thirds or 0.6 · case 03
After seven legal balls the overs read "1.2" or an over boundary reads "0.6".
Completed overs displayed as decimal thirds or 0.6 · case 04
After seven legal balls the overs read "1.2" or an over boundary reads "0.6".
Completed overs displayed as decimal thirds or 0.6 · case 05
After seven legal balls the overs read "1.2" or an over boundary reads "0.6".
Away side credited with the home score · case 01
Away teams receive the home side goals and the wrong results.
Away side credited with the home score · case 02
Away teams receive the home side goals and the wrong results.
Away side credited with the home score · case 03
Away teams receive the home side goals and the wrong results.
Away side credited with the home score · case 04
Away teams receive the home side goals and the wrong results.
Away side credited with the home score · case 05
Away teams receive the home side goals and the wrong results.
Goals scored consulted before goal difference · case 01
Two teams level on points are ordered by goals scored when goal difference should decide.
Goals scored consulted before goal difference · case 02
Two teams level on points are ordered by goals scored when goal difference should decide.
Goals scored consulted before goal difference · case 03
Two teams level on points are ordered by goals scored when goal difference should decide.
Goals scored consulted before goal difference · case 04
Two teams level on points are ordered by goals scored when goal difference should decide.
Goals scored consulted before goal difference · case 05
Two teams level on points are ordered by goals scored when goal difference should decide.
Head-to-head mini-table includes matches against other teams · case 01
Level teams are split by overall form instead of their meetings with each other.
Head-to-head mini-table includes matches against other teams · case 02
Level teams are split by overall form instead of their meetings with each other.
Head-to-head mini-table includes matches against other teams · case 03
Level teams are split by overall form instead of their meetings with each other.
Head-to-head mini-table includes matches against other teams · case 04
Level teams are split by overall form instead of their meetings with each other.
Head-to-head mini-table includes matches against other teams · case 05
Level teams are split by overall form instead of their meetings with each other.
Head-to-head compares goals instead of points · case 01
A team that lost a head-to-head match on points is ranked above its rival by goals.
Head-to-head compares goals instead of points · case 02
A team that lost a head-to-head match on points is ranked above its rival by goals.
Head-to-head compares goals instead of points · case 03
A team that lost a head-to-head match on points is ranked above its rival by goals.
Head-to-head compares goals instead of points · case 04
A team that lost a head-to-head match on points is ranked above its rival by goals.
Head-to-head compares goals instead of points · case 05
A team that lost a head-to-head match on points is ranked above its rival by goals.
Try bonus requires five tries · case 01
Teams scoring exactly four tries are denied the bonus point.
Try bonus requires five tries · case 02
Teams scoring exactly four tries are denied the bonus point.
Try bonus requires five tries · case 03
Teams scoring exactly four tries are denied the bonus point.
Try bonus requires five tries · case 04
Teams scoring exactly four tries are denied the bonus point.
Try bonus requires five tries · case 05
Teams scoring exactly four tries are denied the bonus point.
Losing bonus margin off by one · case 01
A seven-point defeat earns no losing bonus.
Losing bonus margin off by one · case 02
A seven-point defeat earns no losing bonus.
Losing bonus margin off by one · case 03
A seven-point defeat earns no losing bonus.
Losing bonus margin off by one · case 04
A seven-point defeat earns no losing bonus.
Losing bonus margin off by one · case 05
A seven-point defeat earns no losing bonus.
Losing bonus granted to winners or drawn sides · case 01
Drawn and winning teams collect a losing bonus point.
Losing bonus granted to winners or drawn sides · case 02
Drawn and winning teams collect a losing bonus point.
Losing bonus granted to winners or drawn sides · case 03
Drawn and winning teams collect a losing bonus point.
Losing bonus granted to winners or drawn sides · case 04
Drawn and winning teams collect a losing bonus point.
Losing bonus granted to winners or drawn sides · case 05
Drawn and winning teams collect a losing bonus point.
Points difference ranked ahead of wins · case 01
Teams level on points are ordered by points difference instead of wins.
Points difference ranked ahead of wins · case 02
Teams level on points are ordered by points difference instead of wins.
Points difference ranked ahead of wins · case 03
Teams level on points are ordered by points difference instead of wins.
Points difference ranked ahead of wins · case 04
Teams level on points are ordered by points difference instead of wins.
Points difference ranked ahead of wins · case 05
Teams level on points are ordered by points difference instead of wins.
Overtime losers denied their point · case 01
Teams losing in overtime get zero points while shootout losers get one.
Overtime losers denied their point · case 02
Teams losing in overtime get zero points while shootout losers get one.
Overtime losers denied their point · case 03
Teams losing in overtime get zero points while shootout losers get one.
Overtime losers denied their point · case 04
Teams losing in overtime get zero points while shootout losers get one.
Overtime losers denied their point · case 05
Teams losing in overtime get zero points while shootout losers get one.
Shootout wins counted as regulation-plus-overtime wins · case 01
A team with shootout wins is ranked ahead on ROW.
Shootout wins counted as regulation-plus-overtime wins · case 02
A team with shootout wins is ranked ahead on ROW.
Shootout wins counted as regulation-plus-overtime wins · case 03
A team with shootout wins is ranked ahead on ROW.
Shootout wins counted as regulation-plus-overtime wins · case 04
A team with shootout wins is ranked ahead on ROW.
Shootout wins counted as regulation-plus-overtime wins · case 05
A team with shootout wins is ranked ahead on ROW.
Shootout decisive goal not reflected in goal difference · case 01
After a shootout both teams show an unchanged goal difference.
Shootout decisive goal not reflected in goal difference · case 02
After a shootout both teams show an unchanged goal difference.
Shootout decisive goal not reflected in goal difference · case 03
After a shootout both teams show an unchanged goal difference.
Shootout decisive goal not reflected in goal difference · case 04
After a shootout both teams show an unchanged goal difference.
Shootout decisive goal not reflected in goal difference · case 05
After a shootout both teams show an unchanged goal difference.
ROW consulted before regulation wins · case 01
Teams level on points are ordered by ROW before RW.
ROW consulted before regulation wins · case 02
Teams level on points are ordered by ROW before RW.
ROW consulted before regulation wins · case 03
Teams level on points are ordered by ROW before RW.
ROW consulted before regulation wins · case 04
Teams level on points are ordered by ROW before RW.
ROW consulted before regulation wins · case 05
Teams level on points are ordered by ROW before RW.
Perfect record rendered as ".000" · case 01
An unbeaten team shows ".000" instead of "1.000".
Perfect record rendered as ".000" · case 02
An unbeaten team shows ".000" instead of "1.000".
Perfect record rendered as ".000" · case 03
An unbeaten team shows ".000" instead of "1.000".
Perfect record rendered as ".000" · case 04
An unbeaten team shows ".000" instead of "1.000".
Perfect record rendered as ".000" · case 05
An unbeaten team shows ".000" instead of "1.000".
Games behind not halved · case 01
A team one win and one loss back is shown 2.0 games behind.
Games behind not halved · case 02
A team one win and one loss back is shown 2.0 games behind.
Games behind not halved · case 03
A team one win and one loss back is shown 2.0 games behind.
Games behind not halved · case 04
A team one win and one loss back is shown 2.0 games behind.
Games behind not halved · case 05
A team one win and one loss back is shown 2.0 games behind.
Games behind measured from the team with most wins · case 01
Games behind is computed from the team with the most wins rather than the best percentage.
Games behind measured from the team with most wins · case 02
Games behind is computed from the team with the most wins rather than the best percentage.
Games behind measured from the team with most wins · case 03
Games behind is computed from the team with the most wins rather than the best percentage.
Games behind measured from the team with most wins · case 04
Games behind is computed from the team with the most wins rather than the best percentage.
Games behind measured from the team with most wins · case 05
Games behind is computed from the team with the most wins rather than the best percentage.
Equal percentages ordered by name before wins · case 01
A 4-4 team is listed below a 2-2 team.
Equal percentages ordered by name before wins · case 02
A 4-4 team is listed below a 2-2 team.
Equal percentages ordered by name before wins · case 03
A 4-4 team is listed below a 2-2 team.
Equal percentages ordered by name before wins · case 04
A 4-4 team is listed below a 2-2 team.
Equal percentages ordered by name before wins · case 05
A 4-4 team is listed below a 2-2 team.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗