Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Standard port tidal curve: Curve factor is measured down from high water · case 01
Low water heights are reported at high water and vice versa.
Standard port tidal curve: Curve factor is measured down from high water · case 02
Low water heights are reported at high water and vice versa.
Standard port tidal curve: Curve factor is measured down from high water · case 03
Low water heights are reported at high water and vice versa.
Standard port tidal curve: Curve factor is measured down from high water · case 04
Low water heights are reported at high water and vice versa.
Standard port tidal curve: Curve factor is measured down from high water · case 05
Low water heights are reported at high water and vice versa.
Standard port tidal curve: Curve factor is applied to the mean spring range · case 01
Neap-day heights swing as far as spring tides.
Standard port tidal curve: Curve factor is applied to the mean spring range · case 02
Neap-day heights swing as far as spring tides.
Standard port tidal curve: Curve factor is applied to the mean spring range · case 03
Neap-day heights swing as far as spring tides.
Standard port tidal curve: Curve factor is applied to the mean spring range · case 04
Neap-day heights swing as far as spring tides.
Standard port tidal curve: Curve factor is applied to the mean spring range · case 05
Neap-day heights swing as far as spring tides.
Standard port tidal curve: Neap curve is interpolated with the spring slope · case 01
Neap-weighted heights drift from the neap curve between table hours.
Standard port tidal curve: Neap curve is interpolated with the spring slope · case 02
Neap-weighted heights drift from the neap curve between table hours.
Standard port tidal curve: Neap curve is interpolated with the spring slope · case 03
Neap-weighted heights drift from the neap curve between table hours.
Standard port tidal curve: Neap curve is interpolated with the spring slope · case 04
Neap-weighted heights drift from the neap curve between table hours.
Standard port tidal curve: Neap curve is interpolated with the spring slope · case 05
Neap-weighted heights drift from the neap curve between table hours.
Light geographic and visible range: Heights are added under a single square root · case 01
Lights are raised far too late.
Light geographic and visible range: Heights are added under a single square root · case 02
Lights are raised far too late.
Light geographic and visible range: Heights are added under a single square root · case 03
Lights are raised far too late.
Light geographic and visible range: Heights are added under a single square root · case 04
Lights are raised far too late.
Light geographic and visible range: Heights are added under a single square root · case 05
Lights are raised far too late.
Light geographic and visible range: Visible range takes the larger of the two ranges · case 01
A weak light is promised beyond its luminous range.
Light geographic and visible range: Visible range takes the larger of the two ranges · case 02
A weak light is promised beyond its luminous range.
Light geographic and visible range: Visible range takes the larger of the two ranges · case 03
A weak light is promised beyond its luminous range.
Light geographic and visible range: Visible range takes the larger of the two ranges · case 04
A weak light is promised beyond its luminous range.
Light geographic and visible range: Visible range takes the larger of the two ranges · case 05
A weak light is promised beyond its luminous range.
Light geographic and visible range: Equal ranges are labelled geographic · case 01
The limiting factor flips when the two ranges coincide.
Light geographic and visible range: Equal ranges are labelled geographic · case 02
The limiting factor flips when the two ranges coincide.
Light geographic and visible range: Equal ranges are labelled geographic · case 03
The limiting factor flips when the two ranges coincide.
Light geographic and visible range: Equal ranges are labelled geographic · case 04
The limiting factor flips when the two ranges coincide.
Light geographic and visible range: Equal ranges are labelled geographic · case 05
The limiting factor flips when the two ranges coincide.
Light geographic and visible range: Horizon constant for feet is used with metres · case 01
Every light is sighted too early relative to a metric table.
Light geographic and visible range: Horizon constant for feet is used with metres · case 02
Every light is sighted too early relative to a metric table.
Light geographic and visible range: Horizon constant for feet is used with metres · case 03
Every light is sighted too early relative to a metric table.
Light geographic and visible range: Horizon constant for feet is used with metres · case 04
Every light is sighted too early relative to a metric table.
Light geographic and visible range: Horizon constant for feet is used with metres · case 05
Every light is sighted too early relative to a metric table.
Light geographic and visible range: Light elevation is not corrected for the tide · case 01
At low water lights are sighted later than predicted.
Light geographic and visible range: Light elevation is not corrected for the tide · case 02
At low water lights are sighted later than predicted.
Light geographic and visible range: Light elevation is not corrected for the tide · case 03
At low water lights are sighted later than predicted.
Light geographic and visible range: Light elevation is not corrected for the tide · case 04
At low water lights are sighted later than predicted.
Light geographic and visible range: Light elevation is not corrected for the tide · case 05
At low water lights are sighted later than predicted.
Light characteristic abbreviation: Single-flash lights have no group count · case 01
Plain "Fl" lights are reported with a null group.
Light characteristic abbreviation: Single-flash lights have no group count · case 02
Plain "Fl" lights are reported with a null group.
Light characteristic abbreviation: Single-flash lights have no group count · case 03
Plain "Fl" lights are reported with a null group.
Light characteristic abbreviation: Single-flash lights have no group count · case 04
Plain "Fl" lights are reported with a null group.
Light characteristic abbreviation: Single-flash lights have no group count · case 05
Plain "Fl" lights are reported with a null group.
Light characteristic abbreviation: Composite groups such as 2+1 are rejected · case 01
Composite group flashing lights cannot be parsed.
Light characteristic abbreviation: Composite groups such as 2+1 are rejected · case 02
Composite group flashing lights cannot be parsed.
Light characteristic abbreviation: Composite groups such as 2+1 are rejected · case 03
Composite group flashing lights cannot be parsed.
Light characteristic abbreviation: Composite groups such as 2+1 are rejected · case 04
Composite group flashing lights cannot be parsed.
Light characteristic abbreviation: Composite groups such as 2+1 are rejected · case 05
Composite group flashing lights cannot be parsed.
Light characteristic abbreviation: Lights without a colour letter get an empty colour · case 01
White lights are reported with no colour.
Light characteristic abbreviation: Lights without a colour letter get an empty colour · case 02
White lights are reported with no colour.
Light characteristic abbreviation: Lights without a colour letter get an empty colour · case 03
White lights are reported with no colour.
Light characteristic abbreviation: Lights without a colour letter get an empty colour · case 04
White lights are reported with no colour.
Light characteristic abbreviation: Lights without a colour letter get an empty colour · case 05
White lights are reported with no colour.
Light characteristic abbreviation: Fractional periods are not recognised · case 01
Quick lights with 1.2 s or 2.5 s periods fail to parse.
Light characteristic abbreviation: Fractional periods are not recognised · case 02
Quick lights with 1.2 s or 2.5 s periods fail to parse.
Light characteristic abbreviation: Fractional periods are not recognised · case 03
Quick lights with 1.2 s or 2.5 s periods fail to parse.
Light characteristic abbreviation: Fractional periods are not recognised · case 04
Quick lights with 1.2 s or 2.5 s periods fail to parse.
Light characteristic abbreviation: Fractional periods are not recognised · case 05
Quick lights with 1.2 s or 2.5 s periods fail to parse.
Light characteristic abbreviation: Alternating prefix is dropped from the class · case 01
Alternating lights are indistinguishable from fixed-colour ones.
Light characteristic abbreviation: Alternating prefix is dropped from the class · case 02
Alternating lights are indistinguishable from fixed-colour ones.
Light characteristic abbreviation: Alternating prefix is dropped from the class · case 03
Alternating lights are indistinguishable from fixed-colour ones.
Light characteristic abbreviation: Alternating prefix is dropped from the class · case 04
Alternating lights are indistinguishable from fixed-colour ones.
Light characteristic abbreviation: Alternating prefix is dropped from the class · case 05
Alternating lights are indistinguishable from fixed-colour ones.
Light characteristic abbreviation: Height and range suffixes are matched case-insensitively · case 01
A range such as 20M is read as a 20 m elevation when no height is given.
Light characteristic abbreviation: Height and range suffixes are matched case-insensitively · case 02
A range such as 20M is read as a 20 m elevation when no height is given.
Light characteristic abbreviation: Height and range suffixes are matched case-insensitively · case 03
A range such as 20M is read as a 20 m elevation when no height is given.
Light characteristic abbreviation: Height and range suffixes are matched case-insensitively · case 04
A range such as 20M is read as a 20 m elevation when no height is given.
Light characteristic abbreviation: Height and range suffixes are matched case-insensitively · case 05
A range such as 20M is read as a 20 m elevation when no height is given.
Compass variation and deviation: Westerly corrections are treated as easterly · case 01
Conversions in westerly variation go the wrong way.
Compass variation and deviation: Westerly corrections are treated as easterly · case 02
Conversions in westerly variation go the wrong way.
Compass variation and deviation: Westerly corrections are treated as easterly · case 03
Conversions in westerly variation go the wrong way.
Compass variation and deviation: Westerly corrections are treated as easterly · case 04
Conversions in westerly variation go the wrong way.
Compass variation and deviation: Westerly corrections are treated as easterly · case 05
Conversions in westerly variation go the wrong way.
Compass variation and deviation: Compass to magnetic also applies variation · case 01
Magnetic courses include variation that belongs only to true.
Compass variation and deviation: Compass to magnetic also applies variation · case 02
Magnetic courses include variation that belongs only to true.
Compass variation and deviation: Compass to magnetic also applies variation · case 03
Magnetic courses include variation that belongs only to true.
Compass variation and deviation: Compass to magnetic also applies variation · case 04
Magnetic courses include variation that belongs only to true.
Compass variation and deviation: Compass to magnetic also applies variation · case 05
Magnetic courses include variation that belongs only to true.
Compass variation and deviation: True to compass adds the corrections · case 01
Compass courses derived from true are off by twice the error.
Compass variation and deviation: True to compass adds the corrections · case 02
Compass courses derived from true are off by twice the error.
Compass variation and deviation: True to compass adds the corrections · case 03
Compass courses derived from true are off by twice the error.
Compass variation and deviation: True to compass adds the corrections · case 04
Compass courses derived from true are off by twice the error.
Compass variation and deviation: True to compass adds the corrections · case 05
Compass courses derived from true are off by twice the error.
Compass variation and deviation: Zero compass error is printed as a westerly error · case 01
Cancelling deviation and variation shows as 0.0W.
Compass variation and deviation: Zero compass error is printed as a westerly error · case 02
Cancelling deviation and variation shows as 0.0W.
Compass variation and deviation: Zero compass error is printed as a westerly error · case 03
Cancelling deviation and variation shows as 0.0W.
Compass variation and deviation: Zero compass error is printed as a westerly error · case 04
Cancelling deviation and variation shows as 0.0W.
Compass variation and deviation: Zero compass error is printed as a westerly error · case 05
Cancelling deviation and variation shows as 0.0W.
Compass variation and deviation: Compass error reports variation only · case 01
The published compass error ignores the ship deviation.
Compass variation and deviation: Compass error reports variation only · case 02
The published compass error ignores the ship deviation.
Compass variation and deviation: Compass error reports variation only · case 03
The published compass error ignores the ship deviation.
Compass variation and deviation: Compass error reports variation only · case 04
The published compass error ignores the ship deviation.
Compass variation and deviation: Compass error reports variation only · case 05
The published compass error ignores the ship deviation.
Deviation card interpolation: Headings past the last card entry have no deviation · case 01
Headings between the last card heading and 360 return nothing.
Deviation card interpolation: Headings past the last card entry have no deviation · case 02
Headings between the last card heading and 360 return nothing.
Deviation card interpolation: Headings past the last card entry have no deviation · case 03
Headings between the last card heading and 360 return nothing.
Deviation card interpolation: Headings past the last card entry have no deviation · case 04
Headings between the last card heading and 360 return nothing.
Deviation card interpolation: Headings past the last card entry have no deviation · case 05
Headings between the last card heading and 360 return nothing.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗