Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Empirical cdf supremum: The discrepancy is measured between simultaneous equal-value jumps. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The discrepancy is measured between simultaneous equal-value jumps. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The discrepancy is measured between simultaneous equal-value jumps. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The discrepancy is measured between simultaneous equal-value jumps. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The discrepancy is measured between simultaneous equal-value jumps. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The final cumulative discrepancy overwrites earlier maxima. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The final cumulative discrepancy overwrites earlier maxima. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The final cumulative discrepancy overwrites earlier maxima. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The final cumulative discrepancy overwrites earlier maxima. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: The final cumulative discrepancy overwrites earlier maxima. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Each distinct support value receives one count regardless of duplicates. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Each distinct support value receives one count regardless of duplicates. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Each distinct support value receives one count regardless of duplicates. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Each distinct support value receives one count regardless of duplicates. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Each distinct support value receives one count regardless of duplicates. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Cumulative support is traversed by magnitude. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Cumulative support is traversed by magnitude. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Cumulative support is traversed by magnitude. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Cumulative support is traversed by magnitude. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical cdf supremum: Cumulative support is traversed by magnitude. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The CDF discrepancy is summed without interval width. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The CDF discrepancy is summed without interval width. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The CDF discrepancy is summed without interval width. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The CDF discrepancy is summed without interval width. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The CDF discrepancy is summed without interval width. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Area uses the CDF state before its left-boundary jumps. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Area uses the CDF state before its left-boundary jumps. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Area uses the CDF state before its left-boundary jumps. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Area uses the CDF state before its left-boundary jumps. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Area uses the CDF state before its left-boundary jumps. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Signed CDF differences cancel before absolute value. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Signed CDF differences cancel before absolute value. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Signed CDF differences cancel before absolute value. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Signed CDF differences cancel before absolute value. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Signed CDF differences cancel before absolute value. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Squared CDF difference replaces absolute discrepancy. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Squared CDF difference replaces absolute discrepancy. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Squared CDF difference replaces absolute discrepancy. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Squared CDF difference replaces absolute discrepancy. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Squared CDF difference replaces absolute discrepancy. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Only the support diameter is used as the transport distance. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Only the support diameter is used as the transport distance. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Only the support diameter is used as the transport distance. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Only the support diameter is used as the transport distance. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Only the support diameter is used as the transport distance. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The largest interval contribution replaces integrated area. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The largest interval contribution replaces integrated area. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The largest interval contribution replaces integrated area. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The largest interval contribution replaces integrated area. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: The largest interval contribution replaces integrated area. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Support gaps are forced to at least one even after normalization. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Support gaps are forced to at least one even after normalization. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Support gaps are forced to at least one even after normalization. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Support gaps are forced to at least one even after normalization. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Support gaps are forced to at least one even after normalization. · case 05
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Integrated cost is divided by support span. · case 01
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Integrated cost is divided by support span. · case 02
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Integrated cost is divided by support span. · case 03
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Integrated cost is divided by support span. · case 04
The reduction disagrees with its explicit aggregation oracle.
Empirical transport distance: Integrated cost is divided by support span. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion squares the old-center residual instead of multiplying old and new residuals. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion squares the old-center residual instead of multiplying old and new residuals. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion squares the old-center residual instead of multiplying old and new residuals. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion squares the old-center residual instead of multiplying old and new residuals. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion squares the old-center residual instead of multiplying old and new residuals. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion updates its center using the old count. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion updates its center using the old count. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion updates its center using the old count. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion updates its center using the old count. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Insertion updates its center using the old count. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds the removed observation into the updated total. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds the removed observation into the updated total. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds the removed observation into the updated total. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds the removed observation into the updated total. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds the removed observation into the updated total. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction keeps the old mean denominator. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction keeps the old mean denominator. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction keeps the old mean denominator. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction keeps the old mean denominator. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction keeps the old mean denominator. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds instead of subtracting its scatter contribution. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds instead of subtracting its scatter contribution. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds instead of subtracting its scatter contribution. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds instead of subtracting its scatter contribution. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: Retraction adds instead of subtracting its scatter contribution. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The retraction correction squares the residual about the old center. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The retraction correction squares the residual about the old center. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The retraction correction squares the residual about the old center. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The retraction correction squares the residual about the old center. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The retraction correction squares the residual about the old center. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The state resets when one surviving observation still remains. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The state resets when one surviving observation still remains. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The state resets when one surviving observation still remains. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The state resets when one surviving observation still remains. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: The state resets when one surviving observation still remains. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: A removal incorrectly increments the active population count. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: A removal incorrectly increments the active population count. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: A removal incorrectly increments the active population count. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: A removal incorrectly increments the active population count. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable central summary: A removal incorrectly increments the active population count. · case 05
The reduction disagrees with its explicit aggregation oracle.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗