Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Fosberg fire weather index: cubic damping term · case 01
Moist conditions show too much fire potential.
Fosberg fire weather index: cubic damping term · case 02
Moist conditions show too much fire potential.
Fosberg fire weather index: cubic damping term · case 03
Moist conditions show too much fire potential.
Fosberg fire weather index: cubic damping term · case 04
Moist conditions show too much fire potential.
Fosberg fire weather index: cubic damping term · case 05
Moist conditions show too much fire potential.
Fosberg fire weather index: index ceiling · case 01
Windy dry days report FFWI above 100.
Fosberg fire weather index: index ceiling · case 02
Windy dry days report FFWI above 100.
Fosberg fire weather index: index ceiling · case 03
Windy dry days report FFWI above 100.
Fosberg fire weather index: index ceiling · case 04
Windy dry days report FFWI above 100.
Fosberg fire weather index: index ceiling · case 05
Windy dry days report FFWI above 100.
Beaufort force and marine warning: knot conversion · case 01
Warnings arrive a force late because winds read low.
Beaufort force and marine warning: knot conversion · case 02
Warnings arrive a force late because winds read low.
Beaufort force and marine warning: knot conversion · case 03
Warnings arrive a force late because winds read low.
Beaufort force and marine warning: knot conversion · case 04
Warnings arrive a force late because winds read low.
Beaufort force and marine warning: knot conversion · case 05
Warnings arrive a force late because winds read low.
Beaufort force and marine warning: force bound inclusivity · case 01
A wind of exactly 17.2 m/s is reported as force 7.
Beaufort force and marine warning: force bound inclusivity · case 02
A wind of exactly 17.2 m/s is reported as force 7.
Beaufort force and marine warning: force bound inclusivity · case 03
A wind of exactly 17.2 m/s is reported as force 7.
Beaufort force and marine warning: force bound inclusivity · case 04
A wind of exactly 17.2 m/s is reported as force 7.
Beaufort force and marine warning: force bound inclusivity · case 05
A wind of exactly 17.2 m/s is reported as force 7.
Beaufort force and marine warning: gust upgrade threshold · case 01
Ordinary gustiness upgrades nearly every warning.
Beaufort force and marine warning: gust upgrade threshold · case 02
Ordinary gustiness upgrades nearly every warning.
Beaufort force and marine warning: gust upgrade threshold · case 03
Ordinary gustiness upgrades nearly every warning.
Beaufort force and marine warning: gust upgrade threshold · case 04
Ordinary gustiness upgrades nearly every warning.
Beaufort force and marine warning: gust upgrade threshold · case 05
Ordinary gustiness upgrades nearly every warning.
Beaufort force and marine warning: small craft upper edge · case 01
Force 8 winds only raise a small-craft advisory instead of a gale warning.
Beaufort force and marine warning: small craft upper edge · case 02
Force 8 winds only raise a small-craft advisory instead of a gale warning.
Beaufort force and marine warning: small craft upper edge · case 03
Force 8 winds only raise a small-craft advisory instead of a gale warning.
Beaufort force and marine warning: small craft upper edge · case 04
Force 8 winds only raise a small-craft advisory instead of a gale warning.
Beaufort force and marine warning: small craft upper edge · case 05
Force 8 winds only raise a small-craft advisory instead of a gale warning.
Beaufort force and marine warning: observation rounding · case 01
A 33.4 kt wind (17.18 m/s, reported 17.2) is classified force 7.
Beaufort force and marine warning: observation rounding · case 02
A 33.4 kt wind (17.18 m/s, reported 17.2) is classified force 7.
Beaufort force and marine warning: observation rounding · case 03
A 33.4 kt wind (17.18 m/s, reported 17.2) is classified force 7.
Beaufort force and marine warning: observation rounding · case 04
A 33.4 kt wind (17.18 m/s, reported 17.2) is classified force 7.
Beaufort force and marine warning: observation rounding · case 05
A 33.4 kt wind (17.18 m/s, reported 17.2) is classified force 7.
Haines lower-atmosphere severity index: mid elevation moisture level · case 01
Mid-elevation Haines values disagree with the published mid variant.
Haines lower-atmosphere severity index: mid elevation moisture level · case 02
Mid-elevation Haines values disagree with the published mid variant.
Haines lower-atmosphere severity index: mid elevation moisture level · case 03
Mid-elevation Haines values disagree with the published mid variant.
Haines lower-atmosphere severity index: mid elevation moisture level · case 04
Mid-elevation Haines values disagree with the published mid variant.
Haines lower-atmosphere severity index: mid elevation moisture level · case 05
Mid-elevation Haines values disagree with the published mid variant.
Haines lower-atmosphere severity index: stability lapse direction · case 01
Strong lapse rates score as stable while inversions score as unstable.
Haines lower-atmosphere severity index: stability lapse direction · case 02
Strong lapse rates score as stable while inversions score as unstable.
Haines lower-atmosphere severity index: stability lapse direction · case 03
Strong lapse rates score as stable while inversions score as unstable.
Haines lower-atmosphere severity index: stability lapse direction · case 04
Strong lapse rates score as stable while inversions score as unstable.
Haines lower-atmosphere severity index: stability lapse direction · case 05
Strong lapse rates score as stable while inversions score as unstable.
Haines lower-atmosphere severity index: stability breakpoint inclusivity · case 01
Soundings exactly on a stability breakpoint are scored one category too high.
Haines lower-atmosphere severity index: stability breakpoint inclusivity · case 02
Soundings exactly on a stability breakpoint are scored one category too high.
Haines lower-atmosphere severity index: stability breakpoint inclusivity · case 03
Soundings exactly on a stability breakpoint are scored one category too high.
Haines lower-atmosphere severity index: stability breakpoint inclusivity · case 04
Soundings exactly on a stability breakpoint are scored one category too high.
Haines lower-atmosphere severity index: stability breakpoint inclusivity · case 05
Soundings exactly on a stability breakpoint are scored one category too high.
Haines lower-atmosphere severity index: unknown elevation variant · case 01
An unsupported alpine variant silently reports the low-elevation Haines value.
Haines lower-atmosphere severity index: unknown elevation variant · case 02
An unsupported alpine variant silently reports the low-elevation Haines value.
Haines lower-atmosphere severity index: unknown elevation variant · case 03
An unsupported alpine variant silently reports the low-elevation Haines value.
Haines lower-atmosphere severity index: unknown elevation variant · case 04
An unsupported alpine variant silently reports the low-elevation Haines value.
Haines lower-atmosphere severity index: unknown elevation variant · case 05
An unsupported alpine variant silently reports the low-elevation Haines value.
Utah chill unit accumulation: hourly zero floor · case 01
Warm autumn hours create a chill debt that later cold hours must repay.
Utah chill unit accumulation: hourly zero floor · case 02
Warm autumn hours create a chill debt that later cold hours must repay.
Utah chill unit accumulation: hourly zero floor · case 03
Warm autumn hours create a chill debt that later cold hours must repay.
Utah chill unit accumulation: hourly zero floor · case 04
Warm autumn hours create a chill debt that later cold hours must repay.
Utah chill unit accumulation: hourly zero floor · case 05
Warm autumn hours create a chill debt that later cold hours must repay.
Utah chill unit accumulation: full-chill band upper edge · case 01
Hours at exactly 9.1 degC earn half a unit.
Utah chill unit accumulation: full-chill band upper edge · case 02
Hours at exactly 9.1 degC earn half a unit.
Utah chill unit accumulation: full-chill band upper edge · case 03
Hours at exactly 9.1 degC earn half a unit.
Utah chill unit accumulation: full-chill band upper edge · case 04
Hours at exactly 9.1 degC earn half a unit.
Utah chill unit accumulation: full-chill band upper edge · case 05
Hours at exactly 9.1 degC earn half a unit.
Utah chill unit accumulation: negation band sign · case 01
Mild 16 to 18 degC afternoons add chill instead of removing it.
Utah chill unit accumulation: negation band sign · case 02
Mild 16 to 18 degC afternoons add chill instead of removing it.
Utah chill unit accumulation: negation band sign · case 03
Mild 16 to 18 degC afternoons add chill instead of removing it.
Utah chill unit accumulation: negation band sign · case 04
Mild 16 to 18 degC afternoons add chill instead of removing it.
Utah chill unit accumulation: negation band sign · case 05
Mild 16 to 18 degC afternoons add chill instead of removing it.
Utah chill unit accumulation: missing hour handling · case 01
A single dropped logger hour discards the rest of the night.
Utah chill unit accumulation: missing hour handling · case 02
A single dropped logger hour discards the rest of the night.
Utah chill unit accumulation: missing hour handling · case 03
A single dropped logger hour discards the rest of the night.
Utah chill unit accumulation: missing hour handling · case 04
A single dropped logger hour discards the rest of the night.
Utah chill unit accumulation: missing hour handling · case 05
A single dropped logger hour discards the rest of the night.
Hargreaves reference evapotranspiration: radiation equivalent evaporation · case 01
Irrigation demand is about 2.5 times too high.
Hargreaves reference evapotranspiration: radiation equivalent evaporation · case 02
Irrigation demand is about 2.5 times too high.
Hargreaves reference evapotranspiration: radiation equivalent evaporation · case 03
Irrigation demand is about 2.5 times too high.
Hargreaves reference evapotranspiration: radiation equivalent evaporation · case 04
Irrigation demand is about 2.5 times too high.
Hargreaves reference evapotranspiration: radiation equivalent evaporation · case 05
Irrigation demand is about 2.5 times too high.
Hargreaves reference evapotranspiration: temperature offset · case 01
Moderate days show near-zero evapotranspiration.
Hargreaves reference evapotranspiration: temperature offset · case 02
Moderate days show near-zero evapotranspiration.
Hargreaves reference evapotranspiration: temperature offset · case 03
Moderate days show near-zero evapotranspiration.
Hargreaves reference evapotranspiration: temperature offset · case 04
Moderate days show near-zero evapotranspiration.
Hargreaves reference evapotranspiration: temperature offset · case 05
Moderate days show near-zero evapotranspiration.
Hargreaves reference evapotranspiration: cold day clamp · case 01
Deep-cold days report negative evapotranspiration.
Hargreaves reference evapotranspiration: cold day clamp · case 02
Deep-cold days report negative evapotranspiration.
Hargreaves reference evapotranspiration: cold day clamp · case 03
Deep-cold days report negative evapotranspiration.
Hargreaves reference evapotranspiration: cold day clamp · case 04
Deep-cold days report negative evapotranspiration.
Hargreaves reference evapotranspiration: cold day clamp · case 05
Deep-cold days report negative evapotranspiration.
Hargreaves reference evapotranspiration: mean temperature · case 01
ET0 tracks the diurnal range instead of the air temperature.
Hargreaves reference evapotranspiration: mean temperature · case 02
ET0 tracks the diurnal range instead of the air temperature.
Hargreaves reference evapotranspiration: mean temperature · case 03
ET0 tracks the diurnal range instead of the air temperature.
Hargreaves reference evapotranspiration: mean temperature · case 04
ET0 tracks the diurnal range instead of the air temperature.
Hargreaves reference evapotranspiration: mean temperature · case 05
ET0 tracks the diurnal range instead of the air temperature.
K-index and Total Totals: 700 hPa depression sign · case 01
Dry mid-levels increase the K-index instead of suppressing it.
K-index and Total Totals: 700 hPa depression sign · case 02
Dry mid-levels increase the K-index instead of suppressing it.
K-index and Total Totals: 700 hPa depression sign · case 03
Dry mid-levels increase the K-index instead of suppressing it.
K-index and Total Totals: 700 hPa depression sign · case 04
Dry mid-levels increase the K-index instead of suppressing it.
K-index and Total Totals: 700 hPa depression sign · case 05
Dry mid-levels increase the K-index instead of suppressing it.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗