Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Excess heat factor heatwave days: significance window · case 01
Heatwaves are flagged a day before the hot three-day window starts.
Excess heat factor heatwave days: significance window · case 02
Heatwaves are flagged a day before the hot three-day window starts.
Excess heat factor heatwave days: significance window · case 03
Heatwaves are flagged a day before the hot three-day window starts.
Excess heat factor heatwave days: significance window · case 04
Heatwaves are flagged a day before the hot three-day window starts.
Excess heat factor heatwave days: significance window · case 05
Heatwaves are flagged a day before the hot three-day window starts.
Excess heat factor heatwave days: acclimatisation window · case 01
The acclimatisation baseline includes the first hot day.
Excess heat factor heatwave days: acclimatisation window · case 02
The acclimatisation baseline includes the first hot day.
Excess heat factor heatwave days: acclimatisation window · case 03
The acclimatisation baseline includes the first hot day.
Excess heat factor heatwave days: acclimatisation window · case 04
The acclimatisation baseline includes the first hot day.
Excess heat factor heatwave days: acclimatisation window · case 05
The acclimatisation baseline includes the first hot day.
Excess heat factor heatwave days: acclimatisation floor · case 01
A cool spell after a hot week turns negative significance into a positive EHF.
Excess heat factor heatwave days: acclimatisation floor · case 02
A cool spell after a hot week turns negative significance into a positive EHF.
Excess heat factor heatwave days: acclimatisation floor · case 03
A cool spell after a hot week turns negative significance into a positive EHF.
Excess heat factor heatwave days: acclimatisation floor · case 04
A cool spell after a hot week turns negative significance into a positive EHF.
Excess heat factor heatwave days: acclimatisation floor · case 05
A cool spell after a hot week turns negative significance into a positive EHF.
Excess heat factor heatwave days: last evaluable day · case 01
The most recent day with a complete forecast window is never assessed.
Excess heat factor heatwave days: last evaluable day · case 02
The most recent day with a complete forecast window is never assessed.
Excess heat factor heatwave days: last evaluable day · case 03
The most recent day with a complete forecast window is never assessed.
Excess heat factor heatwave days: last evaluable day · case 04
The most recent day with a complete forecast window is never assessed.
Excess heat factor heatwave days: last evaluable day · case 05
The most recent day with a complete forecast window is never assessed.
Excess heat factor heatwave days: positive EHF test · case 01
Days warmer than last week but below the threshold are reported.
Excess heat factor heatwave days: positive EHF test · case 02
Days warmer than last week but below the threshold are reported.
Excess heat factor heatwave days: positive EHF test · case 03
Days warmer than last week but below the threshold are reported.
Excess heat factor heatwave days: positive EHF test · case 04
Days warmer than last week but below the threshold are reported.
Excess heat factor heatwave days: positive EHF test · case 05
Days warmer than last week but below the threshold are reported.
Hourly snowfall and settled depth: freezing ratio band · case 01
Snow at exactly -5 degC is reported with the wet 10:1 ratio instead of 15:1.
Hourly snowfall and settled depth: freezing ratio band · case 02
Snow at exactly -5 degC is reported with the wet 10:1 ratio instead of 15:1.
Hourly snowfall and settled depth: freezing ratio band · case 03
Snow at exactly -5 degC is reported with the wet 10:1 ratio instead of 15:1.
Hourly snowfall and settled depth: freezing ratio band · case 04
Snow at exactly -5 degC is reported with the wet 10:1 ratio instead of 15:1.
Hourly snowfall and settled depth: freezing ratio band · case 05
Snow at exactly -5 degC is reported with the wet 10:1 ratio instead of 15:1.
Hourly snowfall and settled depth: settling order · case 01
Freshly fallen snow is compacted in the same hour it falls; depth under-reads after bursts.
Hourly snowfall and settled depth: settling order · case 02
Freshly fallen snow is compacted in the same hour it falls; depth under-reads after bursts.
Hourly snowfall and settled depth: settling order · case 03
Freshly fallen snow is compacted in the same hour it falls; depth under-reads after bursts.
Hourly snowfall and settled depth: settling order · case 04
Freshly fallen snow is compacted in the same hour it falls; depth under-reads after bursts.
Hourly snowfall and settled depth: settling order · case 05
Freshly fallen snow is compacted in the same hour it falls; depth under-reads after bursts.
Hourly snowfall and settled depth: rain melt floor · case 01
Heavy rain on a thin pack reports negative snow depth.
Hourly snowfall and settled depth: rain melt floor · case 02
Heavy rain on a thin pack reports negative snow depth.
Hourly snowfall and settled depth: rain melt floor · case 03
Heavy rain on a thin pack reports negative snow depth.
Hourly snowfall and settled depth: rain melt floor · case 04
Heavy rain on a thin pack reports negative snow depth.
Hourly snowfall and settled depth: rain melt floor · case 05
Heavy rain on a thin pack reports negative snow depth.
Hutton-Boore local magnitude: zero-to-peak halving · case 01
Every station magnitude is 0.30 units too large.
Hutton-Boore local magnitude: zero-to-peak halving · case 02
Every station magnitude is 0.30 units too large.
Hutton-Boore local magnitude: zero-to-peak halving · case 03
Every station magnitude is 0.30 units too large.
Hutton-Boore local magnitude: zero-to-peak halving · case 04
Every station magnitude is 0.30 units too large.
Hutton-Boore local magnitude: zero-to-peak halving · case 05
Every station magnitude is 0.30 units too large.
Hutton-Boore local magnitude: nanometre to millimetre scale · case 01
Magnitudes are three units too large.
Hutton-Boore local magnitude: nanometre to millimetre scale · case 02
Magnitudes are three units too large.
Hutton-Boore local magnitude: nanometre to millimetre scale · case 03
Magnitudes are three units too large.
Hutton-Boore local magnitude: nanometre to millimetre scale · case 04
Magnitudes are three units too large.
Hutton-Boore local magnitude: nanometre to millimetre scale · case 05
Magnitudes are three units too large.
Hutton-Boore local magnitude: hypocentral distance · case 01
Events recorded directly above the source crash or read far too small.
Hutton-Boore local magnitude: hypocentral distance · case 02
Events recorded directly above the source crash or read far too small.
Hutton-Boore local magnitude: hypocentral distance · case 03
Events recorded directly above the source crash or read far too small.
Hutton-Boore local magnitude: hypocentral distance · case 04
Events recorded directly above the source crash or read far too small.
Hutton-Boore local magnitude: hypocentral distance · case 05
Events recorded directly above the source crash or read far too small.
Hutton-Boore local magnitude: anelastic reference distance · case 01
All magnitudes are about 0.19 high and near-field events are biased.
Hutton-Boore local magnitude: anelastic reference distance · case 02
All magnitudes are about 0.19 high and near-field events are biased.
Hutton-Boore local magnitude: anelastic reference distance · case 03
All magnitudes are about 0.19 high and near-field events are biased.
Hutton-Boore local magnitude: anelastic reference distance · case 04
All magnitudes are about 0.19 high and near-field events are biased.
Hutton-Boore local magnitude: anelastic reference distance · case 05
All magnitudes are about 0.19 high and near-field events are biased.
Hutton-Boore local magnitude: geometric spreading log base · case 01
Distant stations report magnitudes that grow with distance.
Hutton-Boore local magnitude: geometric spreading log base · case 02
Distant stations report magnitudes that grow with distance.
Hutton-Boore local magnitude: geometric spreading log base · case 03
Distant stations report magnitudes that grow with distance.
Hutton-Boore local magnitude: geometric spreading log base · case 04
Distant stations report magnitudes that grow with distance.
Hutton-Boore local magnitude: geometric spreading log base · case 05
Distant stations report magnitudes that grow with distance.
Network magnitude from station magnitudes: even-count median · case 01
With an even number of stations the magnitude is biased upward.
Network magnitude from station magnitudes: even-count median · case 02
With an even number of stations the magnitude is biased upward.
Network magnitude from station magnitudes: even-count median · case 03
With an even number of stations the magnitude is biased upward.
Network magnitude from station magnitudes: even-count median · case 04
With an even number of stations the magnitude is biased upward.
Network magnitude from station magnitudes: even-count median · case 05
With an even number of stations the magnitude is biased upward.
Network magnitude from station magnitudes: outlier window inclusivity · case 01
Stations exactly half a unit from the median are discarded.
Network magnitude from station magnitudes: outlier window inclusivity · case 02
Stations exactly half a unit from the median are discarded.
Network magnitude from station magnitudes: outlier window inclusivity · case 03
Stations exactly half a unit from the median are discarded.
Network magnitude from station magnitudes: outlier window inclusivity · case 04
Stations exactly half a unit from the median are discarded.
Network magnitude from station magnitudes: outlier window inclusivity · case 05
Stations exactly half a unit from the median are discarded.
Network magnitude from station magnitudes: rejection anchor · case 01
A single wild station drags the rejection window and good stations are dropped.
Network magnitude from station magnitudes: rejection anchor · case 02
A single wild station drags the rejection window and good stations are dropped.
Network magnitude from station magnitudes: rejection anchor · case 03
A single wild station drags the rejection window and good stations are dropped.
Network magnitude from station magnitudes: rejection anchor · case 04
A single wild station drags the rejection window and good stations are dropped.
Network magnitude from station magnitudes: rejection anchor · case 05
A single wild station drags the rejection window and good stations are dropped.
Network magnitude from station magnitudes: post-rejection station quorum · case 01
Events keep a published magnitude after rejection leaves too few stations.
Network magnitude from station magnitudes: post-rejection station quorum · case 02
Events keep a published magnitude after rejection leaves too few stations.
Network magnitude from station magnitudes: post-rejection station quorum · case 03
Events keep a published magnitude after rejection leaves too few stations.
Network magnitude from station magnitudes: post-rejection station quorum · case 04
Events keep a published magnitude after rejection leaves too few stations.
Network magnitude from station magnitudes: post-rejection station quorum · case 05
Events keep a published magnitude after rejection leaves too few stations.
Network magnitude from station magnitudes: tenth rounding · case 01
An exact x.x5 median such as 3.25 is published as 3.2.
Network magnitude from station magnitudes: tenth rounding · case 02
An exact x.x5 median such as 3.25 is published as 3.2.
Network magnitude from station magnitudes: tenth rounding · case 03
An exact x.x5 median such as 3.25 is published as 3.2.
Network magnitude from station magnitudes: tenth rounding · case 04
An exact x.x5 median such as 3.25 is published as 3.2.
Network magnitude from station magnitudes: tenth rounding · case 05
An exact x.x5 median such as 3.25 is published as 3.2.
Network magnitude from station magnitudes: valid zero magnitude · case 01
Microearthquake station magnitudes of exactly 0.00 are discarded.
Network magnitude from station magnitudes: valid zero magnitude · case 02
Microearthquake station magnitudes of exactly 0.00 are discarded.
Network magnitude from station magnitudes: valid zero magnitude · case 03
Microearthquake station magnitudes of exactly 0.00 are discarded.
Network magnitude from station magnitudes: valid zero magnitude · case 04
Microearthquake station magnitudes of exactly 0.00 are discarded.
Network magnitude from station magnitudes: valid zero magnitude · case 05
Microearthquake station magnitudes of exactly 0.00 are discarded.
Moment magnitude from fault dimensions: rupture area units · case 01
Scenario magnitudes are two units low.
Moment magnitude from fault dimensions: rupture area units · case 02
Scenario magnitudes are two units low.
Moment magnitude from fault dimensions: rupture area units · case 03
Scenario magnitudes are two units low.
Moment magnitude from fault dimensions: rupture area units · case 04
Scenario magnitudes are two units low.
Moment magnitude from fault dimensions: rupture area units · case 05
Scenario magnitudes are two units low.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗