Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Retractable zero aware product: Sign handling bypasses an active zero factor. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Sign handling bypasses an active zero factor. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Sign handling bypasses an active zero factor. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Sign handling bypasses an active zero factor. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Sign handling bypasses an active zero factor. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: An add operation replaces rather than multiplies the accumulated magnitude. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: An add operation replaces rather than multiplies the accumulated magnitude. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: An add operation replaces rather than multiplies the accumulated magnitude. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: An add operation replaces rather than multiplies the accumulated magnitude. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: An add operation replaces rather than multiplies the accumulated magnitude. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Cross-block neighboring products are omitted. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Cross-block neighboring products are omitted. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Cross-block neighboring products are omitted. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Cross-block neighboring products are omitted. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Cross-block neighboring products are omitted. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The previous final observation is paired with the incoming final observation. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The previous final observation is paired with the incoming final observation. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The previous final observation is paired with the incoming final observation. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The previous final observation is paired with the incoming final observation. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The previous final observation is paired with the incoming final observation. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The carried endpoint is the first observation of the old block. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The carried endpoint is the first observation of the old block. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The carried endpoint is the first observation of the old block. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The carried endpoint is the first observation of the old block. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: The carried endpoint is the first observation of the old block. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: An empty block clears the carried neighbor. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: An empty block clears the carried neighbor. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: An empty block clears the carried neighbor. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: An empty block clears the carried neighbor. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: An empty block clears the carried neighbor. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A singleton block is ignored because it has no local neighboring pair. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A singleton block is ignored because it has no local neighboring pair. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A singleton block is ignored because it has no local neighboring pair. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A singleton block is ignored because it has no local neighboring pair. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A singleton block is ignored because it has no local neighboring pair. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Within-block products pair each value with itself. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Within-block products pair each value with itself. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Within-block products pair each value with itself. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Within-block products pair each value with itself. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Within-block products pair each value with itself. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A boundary product is counted once from each block. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A boundary product is counted once from each block. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A boundary product is counted once from each block. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A boundary product is counted once from each block. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: A boundary product is counted once from each block. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Incoming within-block reduction replaces accumulated total. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Incoming within-block reduction replaces accumulated total. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Incoming within-block reduction replaces accumulated total. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Incoming within-block reduction replaces accumulated total. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Incoming within-block reduction replaces accumulated total. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Each block is treated as a cyclic sequence. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Each block is treated as a cyclic sequence. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Each block is treated as a cyclic sequence. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Each block is treated as a cyclic sequence. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Each block is treated as a cyclic sequence. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Negative neighboring products are discarded. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Negative neighboring products are discarded. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Negative neighboring products are discarded. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Negative neighboring products are discarded. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjacent product block reduction: Negative neighboring products are discarded. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Calibration components give every forecast bin equal weight. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Calibration components give every forecast bin equal weight. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Calibration components give every forecast bin equal weight. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Calibration components give every forecast bin equal weight. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Calibration components give every forecast bin equal weight. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability is measured around the global outcome rate. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability is measured around the global outcome rate. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability is measured around the global outcome rate. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability is measured around the global outcome rate. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability is measured around the global outcome rate. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution is measured around forecast probability rather than global outcome rate. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution is measured around forecast probability rather than global outcome rate. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution is measured around forecast probability rather than global outcome rate. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution is measured around forecast probability rather than global outcome rate. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution is measured around forecast probability rather than global outcome rate. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability accumulates signed instead of squared calibration error. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability accumulates signed instead of squared calibration error. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability accumulates signed instead of squared calibration error. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability accumulates signed instead of squared calibration error. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Reliability accumulates signed instead of squared calibration error. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution accumulates absolute outcome-rate displacement. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution accumulates absolute outcome-rate displacement. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution accumulates absolute outcome-rate displacement. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution accumulates absolute outcome-rate displacement. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Resolution accumulates absolute outcome-rate displacement. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: The global outcome rate is averaged over bin rates. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: The global outcome rate is averaged over bin rates. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: The global outcome rate is averaged over bin rates. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: The global outcome rate is averaged over bin rates. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: The global outcome rate is averaged over bin rates. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Duplicate forecast bins overwrite earlier outcome counts. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Duplicate forecast bins overwrite earlier outcome counts. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Duplicate forecast bins overwrite earlier outcome counts. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Duplicate forecast bins overwrite earlier outcome counts. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: Duplicate forecast bins overwrite earlier outcome counts. · case 05
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: A bin outcome rate divides positives by negatives. · case 01
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: A bin outcome rate divides positives by negatives. · case 02
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: A bin outcome rate divides positives by negatives. · case 03
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: A bin outcome rate divides positives by negatives. · case 04
The reduction disagrees with its explicit aggregation oracle.
Binary calibration decomposition: A bin outcome rate divides positives by negatives. · case 05
The reduction disagrees with its explicit aggregation oracle.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗