Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Rosenzweig-MacArthur equilibrium and enrichment stability: predator equilibrium · case 01
Predator equilibrium is understated for slow handlers.
Rosenzweig-MacArthur equilibrium and enrichment stability: predator equilibrium · case 02
Predator equilibrium is understated for slow handlers.
Rosenzweig-MacArthur equilibrium and enrichment stability: predator equilibrium · case 03
Predator equilibrium is understated for slow handlers.
Rosenzweig-MacArthur equilibrium and enrichment stability: predator equilibrium · case 04
Predator equilibrium is understated for slow handlers.
Rosenzweig-MacArthur equilibrium and enrichment stability: predator equilibrium · case 05
Predator equilibrium is understated for slow handlers.
Rosenzweig-MacArthur equilibrium and enrichment stability: prey isocline hump · case 01
The enrichment threshold is placed at twice its true density.
Rosenzweig-MacArthur equilibrium and enrichment stability: prey isocline hump · case 02
The enrichment threshold is placed at twice its true density.
Rosenzweig-MacArthur equilibrium and enrichment stability: prey isocline hump · case 03
The enrichment threshold is placed at twice its true density.
Rosenzweig-MacArthur equilibrium and enrichment stability: prey isocline hump · case 04
The enrichment threshold is placed at twice its true density.
Rosenzweig-MacArthur equilibrium and enrichment stability: prey isocline hump · case 05
The enrichment threshold is placed at twice its true density.
Rosenzweig-MacArthur equilibrium and enrichment stability: Hopf boundary · case 01
The exact Hopf bifurcation point is labelled stable.
Rosenzweig-MacArthur equilibrium and enrichment stability: Hopf boundary · case 02
The exact Hopf bifurcation point is labelled stable.
Rosenzweig-MacArthur equilibrium and enrichment stability: Hopf boundary · case 03
The exact Hopf bifurcation point is labelled stable.
Rosenzweig-MacArthur equilibrium and enrichment stability: Hopf boundary · case 04
The exact Hopf bifurcation point is labelled stable.
Rosenzweig-MacArthur equilibrium and enrichment stability: Hopf boundary · case 05
The exact Hopf bifurcation point is labelled stable.
Count-based population viability (diffusion approximation): sample variance · case 01
Environmental variance is underestimated, understating extinction risk.
Count-based population viability (diffusion approximation): sample variance · case 02
Environmental variance is underestimated, understating extinction risk.
Count-based population viability (diffusion approximation): sample variance · case 03
Environmental variance is underestimated, understating extinction risk.
Count-based population viability (diffusion approximation): sample variance · case 04
Environmental variance is underestimated, understating extinction risk.
Count-based population viability (diffusion approximation): sample variance · case 05
Environmental variance is underestimated, understating extinction risk.
Count-based population viability (diffusion approximation): log ratio direction · case 01
Declining populations appear to grow.
Count-based population viability (diffusion approximation): log ratio direction · case 02
Declining populations appear to grow.
Count-based population viability (diffusion approximation): log ratio direction · case 03
Declining populations appear to grow.
Count-based population viability (diffusion approximation): log ratio direction · case 04
Declining populations appear to grow.
Count-based population viability (diffusion approximation): log ratio direction · case 05
Declining populations appear to grow.
Count-based population viability (diffusion approximation): distance to threshold · case 01
Risk is computed from the first census rather than the current population.
Count-based population viability (diffusion approximation): distance to threshold · case 02
Risk is computed from the first census rather than the current population.
Count-based population viability (diffusion approximation): distance to threshold · case 03
Risk is computed from the first census rather than the current population.
Count-based population viability (diffusion approximation): distance to threshold · case 04
Risk is computed from the first census rather than the current population.
Count-based population viability (diffusion approximation): distance to threshold · case 05
Risk is computed from the first census rather than the current population.
Count-based population viability (diffusion approximation): reflection term sign · case 01
Growing populations receive inflated extinction probabilities.
Count-based population viability (diffusion approximation): reflection term sign · case 02
Growing populations receive inflated extinction probabilities.
Count-based population viability (diffusion approximation): reflection term sign · case 03
Growing populations receive inflated extinction probabilities.
Count-based population viability (diffusion approximation): reflection term sign · case 04
Growing populations receive inflated extinction probabilities.
Count-based population viability (diffusion approximation): reflection term sign · case 05
Growing populations receive inflated extinction probabilities.
Count-based population viability (diffusion approximation): time scaling · case 01
Uncertainty grows linearly instead of with the square root of time.
Count-based population viability (diffusion approximation): time scaling · case 02
Uncertainty grows linearly instead of with the square root of time.
Count-based population viability (diffusion approximation): time scaling · case 03
Uncertainty grows linearly instead of with the square root of time.
Count-based population viability (diffusion approximation): time scaling · case 04
Uncertainty grows linearly instead of with the square root of time.
Count-based population viability (diffusion approximation): time scaling · case 05
Uncertainty grows linearly instead of with the square root of time.
Empty aircraft weight counted without its moment · case 01
Loaded CG sits far forward of any realistic value while total weight looks right.
Empty aircraft weight counted without its moment · case 02
Loaded CG sits far forward of any realistic value while total weight looks right.
Empty aircraft weight counted without its moment · case 03
Loaded CG sits far forward of any realistic value while total weight looks right.
Empty aircraft weight counted without its moment · case 04
Loaded CG sits far forward of any realistic value while total weight looks right.
Empty aircraft weight counted without its moment · case 05
Loaded CG sits far forward of any realistic value while total weight looks right.
Avgas and jet fuel densities transposed · case 01
Fuel weight is overstated for avgas aircraft and understated for diesel-converted aircraft.
Avgas and jet fuel densities transposed · case 02
Fuel weight is overstated for avgas aircraft and understated for diesel-converted aircraft.
Avgas and jet fuel densities transposed · case 03
Fuel weight is overstated for avgas aircraft and understated for diesel-converted aircraft.
Avgas and jet fuel densities transposed · case 04
Fuel weight is overstated for avgas aircraft and understated for diesel-converted aircraft.
Avgas and jet fuel densities transposed · case 05
Fuel weight is overstated for avgas aircraft and understated for diesel-converted aircraft.
Fuel moment computed from gallons instead of pounds · case 01
Adding fuel moves the computed CG forward even though the tanks are aft of the loaded CG.
Fuel moment computed from gallons instead of pounds · case 02
Adding fuel moves the computed CG forward even though the tanks are aft of the loaded CG.
Fuel moment computed from gallons instead of pounds · case 03
Adding fuel moves the computed CG forward even though the tanks are aft of the loaded CG.
Fuel moment computed from gallons instead of pounds · case 04
Adding fuel moves the computed CG forward even though the tanks are aft of the loaded CG.
Fuel moment computed from gallons instead of pounds · case 05
Adding fuel moves the computed CG forward even though the tanks are aft of the loaded CG.
Equipment removal entries silently skipped · case 01
Aircraft with a removed seat or fairing report the as-equipped weight and CG.
Equipment removal entries silently skipped · case 02
Aircraft with a removed seat or fairing report the as-equipped weight and CG.
Equipment removal entries silently skipped · case 03
Aircraft with a removed seat or fairing report the as-equipped weight and CG.
Equipment removal entries silently skipped · case 04
Aircraft with a removed seat or fairing report the as-equipped weight and CG.
Equipment removal entries silently skipped · case 05
Aircraft with a removed seat or fairing report the as-equipped weight and CG.
Loaded CG truncated instead of rounded · case 01
The reported CG is a hundredth of an inch forward of the computed value for many loads.
Loaded CG truncated instead of rounded · case 02
The reported CG is a hundredth of an inch forward of the computed value for many loads.
Loaded CG truncated instead of rounded · case 03
The reported CG is a hundredth of an inch forward of the computed value for many loads.
Loaded CG truncated instead of rounded · case 04
The reported CG is a hundredth of an inch forward of the computed value for many loads.
Loaded CG truncated instead of rounded · case 05
The reported CG is a hundredth of an inch forward of the computed value for many loads.
A CG exactly on the forward limit line is rejected · case 01
Loads placed precisely on the sloped forward boundary are reported FWD.
A CG exactly on the forward limit line is rejected · case 02
Loads placed precisely on the sloped forward boundary are reported FWD.
A CG exactly on the forward limit line is rejected · case 03
Loads placed precisely on the sloped forward boundary are reported FWD.
A CG exactly on the forward limit line is rejected · case 04
Loads placed precisely on the sloped forward boundary are reported FWD.
A CG exactly on the forward limit line is rejected · case 05
Loads placed precisely on the sloped forward boundary are reported FWD.
Utility category inherits the normal gross weight · case 01
Utility-category flights between 2200 and 2550 lb are accepted and evaluated for CG.
Utility category inherits the normal gross weight · case 02
Utility-category flights between 2200 and 2550 lb are accepted and evaluated for CG.
Utility category inherits the normal gross weight · case 03
Utility-category flights between 2200 and 2550 lb are accepted and evaluated for CG.
Utility category inherits the normal gross weight · case 04
Utility-category flights between 2200 and 2550 lb are accepted and evaluated for CG.
Utility category inherits the normal gross weight · case 05
Utility-category flights between 2200 and 2550 lb are accepted and evaluated for CG.
Sloped forward limit interpolated from the wrong end · case 01
Heavy aircraft get a forward limit near 35 in and light aircraft near 41 in on the sloped segment.
Sloped forward limit interpolated from the wrong end · case 02
Heavy aircraft get a forward limit near 35 in and light aircraft near 41 in on the sloped segment.
Sloped forward limit interpolated from the wrong end · case 03
Heavy aircraft get a forward limit near 35 in and light aircraft near 41 in on the sloped segment.
Sloped forward limit interpolated from the wrong end · case 04
Heavy aircraft get a forward limit near 35 in and light aircraft near 41 in on the sloped segment.
Sloped forward limit interpolated from the wrong end · case 05
Heavy aircraft get a forward limit near 35 in and light aircraft near 41 in on the sloped segment.
Utility aft limit replaced by the normal aft limit · case 01
Utility-category loads well aft of 40.5 in are reported IN.
Utility aft limit replaced by the normal aft limit · case 02
Utility-category loads well aft of 40.5 in are reported IN.
Utility aft limit replaced by the normal aft limit · case 03
Utility-category loads well aft of 40.5 in are reported IN.
Utility aft limit replaced by the normal aft limit · case 04
Utility-category loads well aft of 40.5 in are reported IN.
Utility aft limit replaced by the normal aft limit · case 05
Utility-category loads well aft of 40.5 in are reported IN.
CG verdict reported before the overweight condition · case 01
An overweight aircraft with a forward or aft CG is reported as a CG problem instead of OVERWEIGHT.
CG verdict reported before the overweight condition · case 02
An overweight aircraft with a forward or aft CG is reported as a CG problem instead of OVERWEIGHT.
CG verdict reported before the overweight condition · case 03
An overweight aircraft with a forward or aft CG is reported as a CG problem instead of OVERWEIGHT.
CG verdict reported before the overweight condition · case 04
An overweight aircraft with a forward or aft CG is reported as a CG problem instead of OVERWEIGHT.
CG verdict reported before the overweight condition · case 05
An overweight aircraft with a forward or aft CG is reported as a CG problem instead of OVERWEIGHT.
Exactly empty-weight load rejected as below empty · case 01
A ferry configuration at exactly the minimum weight returns ERR_BELOW_EMPTY.
Exactly empty-weight load rejected as below empty · case 02
A ferry configuration at exactly the minimum weight returns ERR_BELOW_EMPTY.
Exactly empty-weight load rejected as below empty · case 03
A ferry configuration at exactly the minimum weight returns ERR_BELOW_EMPTY.
Exactly empty-weight load rejected as below empty · case 04
A ferry configuration at exactly the minimum weight returns ERR_BELOW_EMPTY.
Exactly empty-weight load rejected as below empty · case 05
A ferry configuration at exactly the minimum weight returns ERR_BELOW_EMPTY.
Item index uses the raw arm instead of distance from the reference · case 01
Every loaded item pushes the index strongly aft, even items at the reference station.
Item index uses the raw arm instead of distance from the reference · case 02
Every loaded item pushes the index strongly aft, even items at the reference station.
Item index uses the raw arm instead of distance from the reference · case 03
Every loaded item pushes the index strongly aft, even items at the reference station.
Item index uses the raw arm instead of distance from the reference · case 04
Every loaded item pushes the index strongly aft, even items at the reference station.
Item index uses the raw arm instead of distance from the reference · case 05
Every loaded item pushes the index strongly aft, even items at the reference station.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗