Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Kick distance omits the seven-yard hold · case 01
A 43-yard field goal is scored as a 36-yarder worth 3 points.
Kick distance omits the seven-yard hold · case 02
A 43-yard field goal is scored as a 36-yarder worth 3 points.
Kick distance omits the seven-yard hold · case 03
A 43-yard field goal is scored as a 36-yarder worth 3 points.
Kick distance omits the seven-yard hold · case 04
A 43-yard field goal is scored as a 36-yarder worth 3 points.
Kick distance omits the seven-yard hold · case 05
A 43-yard field goal is scored as a 36-yarder worth 3 points.
Blocked field goals penalized as misses · case 01
A kicker whose 30-yard attempt is blocked loses 2 points.
Blocked field goals penalized as misses · case 02
A kicker whose 30-yard attempt is blocked loses 2 points.
Blocked field goals penalized as misses · case 03
A kicker whose 30-yard attempt is blocked loses 2 points.
Blocked field goals penalized as misses · case 04
A kicker whose 30-yard attempt is blocked loses 2 points.
Blocked field goals penalized as misses · case 05
A kicker whose 30-yard attempt is blocked loses 2 points.
Extra points fall through into field goal scoring · case 01
Each made PAT also scores as a 32-yard field goal.
Extra points fall through into field goal scoring · case 02
Each made PAT also scores as a 32-yard field goal.
Extra points fall through into field goal scoring · case 03
Each made PAT also scores as a 32-yard field goal.
Extra points fall through into field goal scoring · case 04
Each made PAT also scores as a 32-yard field goal.
Extra points fall through into field goal scoring · case 05
Each made PAT also scores as a 32-yard field goal.
Longest field goal includes misses · case 01
A missed 58-yarder is reported as the kicker's longest field goal.
Longest field goal includes misses · case 02
A missed 58-yarder is reported as the kicker's longest field goal.
Longest field goal includes misses · case 03
A missed 58-yarder is reported as the kicker's longest field goal.
Longest field goal includes misses · case 04
A missed 58-yarder is reported as the kicker's longest field goal.
Longest field goal includes misses · case 05
A missed 58-yarder is reported as the kicker's longest field goal.
Made field goal bands exclude their upper edge · case 01
A 39-yard make earns 4 points and a 49-yard make earns 5.
Made field goal bands exclude their upper edge · case 02
A 39-yard make earns 4 points and a 49-yard make earns 5.
Made field goal bands exclude their upper edge · case 03
A 39-yard make earns 4 points and a 49-yard make earns 5.
Made field goal bands exclude their upper edge · case 04
A 39-yard make earns 4 points and a 49-yard make earns 5.
Made field goal bands exclude their upper edge · case 05
A 39-yard make earns 4 points and a 49-yard make earns 5.
Missed 50+ yard attempts penalized · case 01
Kickers lose a point for missing a 55-yard attempt that the league exempts.
Missed 50+ yard attempts penalized · case 02
Kickers lose a point for missing a 55-yard attempt that the league exempts.
Missed 50+ yard attempts penalized · case 03
Kickers lose a point for missing a 55-yard attempt that the league exempts.
Missed 50+ yard attempts penalized · case 04
Kickers lose a point for missing a 55-yard attempt that the league exempts.
Missed 50+ yard attempts penalized · case 05
Kickers lose a point for missing a 55-yard attempt that the league exempts.
Questionable players dropped from the optimal lineup · case 01
A questionable star is benched in favor of a lower-projected healthy player.
Questionable players dropped from the optimal lineup · case 02
A questionable star is benched in favor of a lower-projected healthy player.
Questionable players dropped from the optimal lineup · case 03
A questionable star is benched in favor of a lower-projected healthy player.
Questionable players dropped from the optimal lineup · case 04
A questionable star is benched in favor of a lower-projected healthy player.
Questionable players dropped from the optimal lineup · case 05
A questionable star is benched in favor of a lower-projected healthy player.
Equal projections start whoever was listed first · case 01
Two WRs projected equally swap between starter and bench depending on roster order.
Equal projections start whoever was listed first · case 02
Two WRs projected equally swap between starter and bench depending on roster order.
Equal projections start whoever was listed first · case 03
Two WRs projected equally swap between starter and bench depending on roster order.
Equal projections start whoever was listed first · case 04
Two WRs projected equally swap between starter and bench depending on roster order.
Equal projections start whoever was listed first · case 05
Two WRs projected equally swap between starter and bench depending on roster order.
Backup quarterback placed in the FLEX slot · case 01
A second quarterback with a high projection occupies FLEX in a non-superflex league.
Backup quarterback placed in the FLEX slot · case 02
A second quarterback with a high projection occupies FLEX in a non-superflex league.
Backup quarterback placed in the FLEX slot · case 03
A second quarterback with a high projection occupies FLEX in a non-superflex league.
Backup quarterback placed in the FLEX slot · case 04
A second quarterback with a high projection occupies FLEX in a non-superflex league.
Backup quarterback placed in the FLEX slot · case 05
A second quarterback with a high projection occupies FLEX in a non-superflex league.
FLEX filled from the bottom of the bench · case 01
The lowest-projected eligible bench player is started at FLEX.
FLEX filled from the bottom of the bench · case 02
The lowest-projected eligible bench player is started at FLEX.
FLEX filled from the bottom of the bench · case 03
The lowest-projected eligible bench player is started at FLEX.
FLEX filled from the bottom of the bench · case 04
The lowest-projected eligible bench player is started at FLEX.
FLEX filled from the bottom of the bench · case 05
The lowest-projected eligible bench player is started at FLEX.
Positional slots accept one player too many · case 01
Three running backs are placed in the two RB slots.
Positional slots accept one player too many · case 02
Three running backs are placed in the two RB slots.
Positional slots accept one player too many · case 03
Three running backs are placed in the two RB slots.
Positional slots accept one player too many · case 04
Three running backs are placed in the two RB slots.
Positional slots accept one player too many · case 05
Three running backs are placed in the two RB slots.
FLEX absorbs every eligible bench player · case 01
All remaining running backs and receivers are started at FLEX.
FLEX absorbs every eligible bench player · case 02
All remaining running backs and receivers are started at FLEX.
FLEX absorbs every eligible bench player · case 03
All remaining running backs and receivers are started at FLEX.
FLEX absorbs every eligible bench player · case 04
All remaining running backs and receivers are started at FLEX.
FLEX absorbs every eligible bench player · case 05
All remaining running backs and receivers are started at FLEX.
Swap submitted at kickoff second accepted · case 01
A swap timestamped exactly at kickoff moves a player whose game has started.
Swap submitted at kickoff second accepted · case 02
A swap timestamped exactly at kickoff moves a player whose game has started.
Swap submitted at kickoff second accepted · case 03
A swap timestamped exactly at kickoff moves a player whose game has started.
Swap submitted at kickoff second accepted · case 04
A swap timestamped exactly at kickoff moves a player whose game has started.
Swap submitted at kickoff second accepted · case 05
A swap timestamped exactly at kickoff moves a player whose game has started.
Started player benched after his game kicked off · case 01
A user removes a starter whose game already began and replaces him with a later player.
Started player benched after his game kicked off · case 02
A user removes a starter whose game already began and replaces him with a later player.
Started player benched after his game kicked off · case 03
A user removes a starter whose game already began and replaces him with a later player.
Started player benched after his game kicked off · case 04
A user removes a starter whose game already began and replaces him with a later player.
Started player benched after his game kicked off · case 05
A user removes a starter whose game already began and replaces him with a later player.
Swaps applied in arrival order instead of time order · case 01
A delayed earlier-timestamped swap overrides a later one.
Swaps applied in arrival order instead of time order · case 02
A delayed earlier-timestamped swap overrides a later one.
Swaps applied in arrival order instead of time order · case 03
A delayed earlier-timestamped swap overrides a later one.
Swaps applied in arrival order instead of time order · case 04
A delayed earlier-timestamped swap overrides a later one.
Swaps applied in arrival order instead of time order · case 05
A delayed earlier-timestamped swap overrides a later one.
Same player started in two slots · case 01
A player swapped into a second slot counts twice in the total.
Same player started in two slots · case 02
A player swapped into a second slot counts twice in the total.
Same player started in two slots · case 03
A player swapped into a second slot counts twice in the total.
Same player started in two slots · case 04
A player swapped into a second slot counts twice in the total.
Same player started in two slots · case 05
A player swapped into a second slot counts twice in the total.
Absolute corrections added as deltas · case 01
A correction of rushing yards to 88 turns 85 yards into 173.
Absolute corrections added as deltas · case 02
A correction of rushing yards to 88 turns 85 yards into 173.
Absolute corrections added as deltas · case 03
A correction of rushing yards to 88 turns 85 yards into 173.
Absolute corrections added as deltas · case 04
A correction of rushing yards to 88 turns 85 yards into 173.
Absolute corrections added as deltas · case 05
A correction of rushing yards to 88 turns 85 yards into 173.
Corrections issued on the deadline day ignored · case 01
A correction published at noon on the deadline day is discarded.
Corrections issued on the deadline day ignored · case 02
A correction published at noon on the deadline day is discarded.
Corrections issued on the deadline day ignored · case 03
A correction published at noon on the deadline day is discarded.
Corrections issued on the deadline day ignored · case 04
A correction published at noon on the deadline day is discarded.
Corrections issued on the deadline day ignored · case 05
A correction published at noon on the deadline day is discarded.
Later-day correction overwritten by earlier-day correction · case 01
A Tuesday correction with sequence 0 is overridden by Monday's sequence 2.
Later-day correction overwritten by earlier-day correction · case 02
A Tuesday correction with sequence 0 is overridden by Monday's sequence 2.
Later-day correction overwritten by earlier-day correction · case 03
A Tuesday correction with sequence 0 is overridden by Monday's sequence 2.
Later-day correction overwritten by earlier-day correction · case 04
A Tuesday correction with sequence 0 is overridden by Monday's sequence 2.
Later-day correction overwritten by earlier-day correction · case 05
A Tuesday correction with sequence 0 is overridden by Monday's sequence 2.
Late corrections counted as applied · case 01
The audit trail reports five applied corrections while only three were within the deadline.
Late corrections counted as applied · case 02
The audit trail reports five applied corrections while only three were within the deadline.
Late corrections counted as applied · case 03
The audit trail reports five applied corrections while only three were within the deadline.
Late corrections counted as applied · case 04
The audit trail reports five applied corrections while only three were within the deadline.
Late corrections counted as applied · case 05
The audit trail reports five applied corrections while only three were within the deadline.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗