Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Adjusted partition pair agreement: Degenerate perfectly agreeing partitions are assigned zero score. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Degenerate perfectly agreeing partitions are assigned zero score. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Degenerate perfectly agreeing partitions are assigned zero score. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Degenerate perfectly agreeing partitions are assigned zero score. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Degenerate perfectly agreeing partitions are assigned zero score. · case 05
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Expected pair agreement is truncated before adjustment. · case 01
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Expected pair agreement is truncated before adjustment. · case 02
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Expected pair agreement is truncated before adjustment. · case 03
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Expected pair agreement is truncated before adjustment. · case 04
The reduction disagrees with its explicit aggregation oracle.
Adjusted partition pair agreement: Expected pair agreement is truncated before adjustment. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear tail omits its continuity offset. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear tail omits its continuity offset. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear tail omits its continuity offset. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear tail omits its continuity offset. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear tail omits its continuity offset. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic region omits its one-half coefficient. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic region omits its one-half coefficient. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic region omits its one-half coefficient. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic region omits its one-half coefficient. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic region omits its one-half coefficient. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear/quadratic branch compares signed rather than absolute residual. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear/quadratic branch compares signed rather than absolute residual. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear/quadratic branch compares signed rather than absolute residual. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear/quadratic branch compares signed rather than absolute residual. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The linear/quadratic branch compares signed rather than absolute residual. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Negative tail residuals contribute negative loss. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Negative tail residuals contribute negative loss. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Negative tail residuals contribute negative loss. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Negative tail residuals contribute negative loss. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Negative tail residuals contribute negative loss. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic branch threshold is compared to squared residual magnitude. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic branch threshold is compared to squared residual magnitude. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic branch threshold is compared to squared residual magnitude. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic branch threshold is compared to squared residual magnitude. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The quadratic branch threshold is compared to squared residual magnitude. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Loss itself is clipped rather than the derivative. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Loss itself is clipped rather than the derivative. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Loss itself is clipped rather than the derivative. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Loss itself is clipped rather than the derivative. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Loss itself is clipped rather than the derivative. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Residuals are summed before applying the nonlinear loss. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Residuals are summed before applying the nonlinear loss. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Residuals are summed before applying the nonlinear loss. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Residuals are summed before applying the nonlinear loss. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Residuals are summed before applying the nonlinear loss. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Only the largest residual contributes to total loss. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Only the largest residual contributes to total loss. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Only the largest residual contributes to total loss. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Only the largest residual contributes to total loss. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Only the largest residual contributes to total loss. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The sum contract is replaced by average loss. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The sum contract is replaced by average loss. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The sum contract is replaced by average loss. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The sum contract is replaced by average loss. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: The sum contract is replaced by average loss. · case 05
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Zero threshold is treated as ordinary squared error. · case 01
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Zero threshold is treated as ordinary squared error. · case 02
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Zero threshold is treated as ordinary squared error. · case 03
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Zero threshold is treated as ordinary squared error. · case 04
The reduction disagrees with its explicit aggregation oracle.
Huber residual total: Zero threshold is treated as ordinary squared error. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Zero presence is stored as a boolean instead of multiplicity. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Zero presence is stored as a boolean instead of multiplicity. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Zero presence is stored as a boolean instead of multiplicity. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Zero presence is stored as a boolean instead of multiplicity. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Zero presence is stored as a boolean instead of multiplicity. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing one zero clears all remaining zero factors. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing one zero clears all remaining zero factors. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing one zero clears all remaining zero factors. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing one zero clears all remaining zero factors. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing one zero clears all remaining zero factors. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Nonzero factors added while a zero exists are not recorded. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Nonzero factors added while a zero exists are not recorded. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Nonzero factors added while a zero exists are not recorded. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Nonzero factors added while a zero exists are not recorded. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Nonzero factors added while a zero exists are not recorded. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Retracting a nonzero factor multiplies it into the product again. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Retracting a nonzero factor multiplies it into the product again. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Retracting a nonzero factor multiplies it into the product again. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Retracting a nonzero factor multiplies it into the product again. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Retracting a nonzero factor multiplies it into the product again. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing a negative factor leaves negative parity unchanged. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing a negative factor leaves negative parity unchanged. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing a negative factor leaves negative parity unchanged. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing a negative factor leaves negative parity unchanged. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Removing a negative factor leaves negative parity unchanged. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Any negative factor forces a negative result instead of parity. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Any negative factor forces a negative result instead of parity. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Any negative factor forces a negative result instead of parity. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Any negative factor forces a negative result instead of parity. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Any negative factor forces a negative result instead of parity. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Signed factors are stored in magnitude and also in sign count. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Signed factors are stored in magnitude and also in sign count. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Signed factors are stored in magnitude and also in sign count. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Signed factors are stored in magnitude and also in sign count. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: Signed factors are stored in magnitude and also in sign count. · case 05
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: The multiplicative accumulator starts at zero. · case 01
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: The multiplicative accumulator starts at zero. · case 02
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: The multiplicative accumulator starts at zero. · case 03
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: The multiplicative accumulator starts at zero. · case 04
The reduction disagrees with its explicit aggregation oracle.
Retractable zero aware product: The multiplicative accumulator starts at zero. · case 05
The reduction disagrees with its explicit aggregation oracle.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗