Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Ounce tiers: pounds truncated · case 01
A 17 oz parcel is priced as one pound.
Ounce tiers: pounds truncated · case 02
A 17 oz parcel is priced as one pound.
Ounce tiers: pounds truncated · case 03
A 17 oz parcel is priced as one pound.
Ounce tiers: pounds truncated · case 04
A 17 oz parcel is priced as one pound.
Ounce tiers: pounds truncated · case 05
A 17 oz parcel is priced as one pound.
Ounce tiers: zone 1 priced as group 0 · case 01
Local zone 1 parcels look up a nonexistent price group 0.
Ounce tiers: zone 1 priced as group 0 · case 02
Local zone 1 parcels look up a nonexistent price group 0.
Ounce tiers: zone 1 priced as group 0 · case 03
Local zone 1 parcels look up a nonexistent price group 0.
Ounce tiers: zone 1 priced as group 0 · case 04
Local zone 1 parcels look up a nonexistent price group 0.
Ounce tiers: zone 1 priced as group 0 · case 05
Local zone 1 parcels look up a nonexistent price group 0.
LTL breaks: deficit bill shows actual weight · case 01
Invoices rated at a deficit break show the actual weight, so the charge cannot be reproduced from the bill.
LTL breaks: deficit bill shows actual weight · case 02
Invoices rated at a deficit break show the actual weight, so the charge cannot be reproduced from the bill.
LTL breaks: deficit bill shows actual weight · case 03
Invoices rated at a deficit break show the actual weight, so the charge cannot be reproduced from the bill.
LTL breaks: deficit bill shows actual weight · case 04
Invoices rated at a deficit break show the actual weight, so the charge cannot be reproduced from the bill.
LTL breaks: deficit bill shows actual weight · case 05
Invoices rated at a deficit break show the actual weight, so the charge cannot be reproduced from the bill.
LTL breaks: deficit weight never considered · case 01
Shipments just under a break pay more than rating at the break minimum would cost.
LTL breaks: deficit weight never considered · case 02
Shipments just under a break pay more than rating at the break minimum would cost.
LTL breaks: deficit weight never considered · case 03
Shipments just under a break pay more than rating at the break minimum would cost.
LTL breaks: deficit weight never considered · case 04
Shipments just under a break pay more than rating at the break minimum would cost.
LTL breaks: deficit weight never considered · case 05
Shipments just under a break pay more than rating at the break minimum would cost.
LTL breaks: cwt charge truncated · case 01
Charges are a cent low on fractional hundredweight results.
LTL breaks: cwt charge truncated · case 02
Charges are a cent low on fractional hundredweight results.
LTL breaks: cwt charge truncated · case 03
Charges are a cent low on fractional hundredweight results.
LTL breaks: cwt charge truncated · case 04
Charges are a cent low on fractional hundredweight results.
LTL breaks: cwt charge truncated · case 05
Charges are a cent low on fractional hundredweight results.
LTL breaks: equal deficit charge replaces actual · case 01
When deficit and actual charges are equal the bill shows phantom deficit weight.
LTL breaks: equal deficit charge replaces actual · case 02
When deficit and actual charges are equal the bill shows phantom deficit weight.
LTL breaks: equal deficit charge replaces actual · case 03
When deficit and actual charges are equal the bill shows phantom deficit weight.
LTL breaks: equal deficit charge replaces actual · case 04
When deficit and actual charges are equal the bill shows phantom deficit weight.
LTL breaks: equal deficit charge replaces actual · case 05
When deficit and actual charges are equal the bill shows phantom deficit weight.
LTL breaks: minimum charge skipped · case 01
Small shipments are billed below the lane minimum.
LTL breaks: minimum charge skipped · case 02
Small shipments are billed below the lane minimum.
LTL breaks: minimum charge skipped · case 03
Small shipments are billed below the lane minimum.
LTL breaks: minimum charge skipped · case 04
Small shipments are billed below the lane minimum.
LTL breaks: minimum charge skipped · case 05
Small shipments are billed below the lane minimum.
LTL breaks: weight rounded to nearest pound · case 01
Fractional pounds below one half are not billed.
LTL breaks: weight rounded to nearest pound · case 02
Fractional pounds below one half are not billed.
LTL breaks: weight rounded to nearest pound · case 03
Fractional pounds below one half are not billed.
LTL breaks: weight rounded to nearest pound · case 04
Fractional pounds below one half are not billed.
LTL breaks: weight rounded to nearest pound · case 05
Fractional pounds below one half are not billed.
Street line standardizer: table lookups run on the raw-case line · case 01
"Oak Street" keeps its long suffix and mixed case while "OAK STREET" is abbreviated.
Street line standardizer: table lookups run on the raw-case line · case 02
"Oak Street" keeps its long suffix and mixed case while "OAK STREET" is abbreviated.
Street line standardizer: table lookups run on the raw-case line · case 03
"Oak Street" keeps its long suffix and mixed case while "OAK STREET" is abbreviated.
Street line standardizer: table lookups run on the raw-case line · case 04
"Oak Street" keeps its long suffix and mixed case while "OAK STREET" is abbreviated.
Street line standardizer: table lookups run on the raw-case line · case 05
"Oak Street" keeps its long suffix and mixed case while "OAK STREET" is abbreviated.
Street line standardizer: abbreviations keep their periods · case 01
"N. OAK AVE." is returned unchanged instead of "N OAK AVE".
Street line standardizer: abbreviations keep their periods · case 02
"N. OAK AVE." is returned unchanged instead of "N OAK AVE".
Street line standardizer: abbreviations keep their periods · case 03
"N. OAK AVE." is returned unchanged instead of "N OAK AVE".
Street line standardizer: abbreviations keep their periods · case 04
"N. OAK AVE." is returned unchanged instead of "N OAK AVE".
Street line standardizer: abbreviations keep their periods · case 05
"N. OAK AVE." is returned unchanged instead of "N OAK AVE".
Street line standardizer: a street named North is reduced to a post-directional · case 01
"107 NORTH" becomes "107 N" and loses its only street-name token.
Street line standardizer: a street named North is reduced to a post-directional · case 02
"107 NORTH" becomes "107 N" and loses its only street-name token.
Street line standardizer: a street named North is reduced to a post-directional · case 03
"107 NORTH" becomes "107 N" and loses its only street-name token.
Street line standardizer: a street named North is reduced to a post-directional · case 04
"107 NORTH" becomes "107 N" and loses its only street-name token.
Street line standardizer: a street named North is reduced to a post-directional · case 05
"107 NORTH" becomes "107 N" and loses its only street-name token.
Street line standardizer: suffix is peeled before the post-directional · case 01
"OAK ROAD SOUTH" normalizes to "OAK ROAD S" and the suffix stays unabbreviated.
Street line standardizer: suffix is peeled before the post-directional · case 02
"OAK ROAD SOUTH" normalizes to "OAK ROAD S" and the suffix stays unabbreviated.
Street line standardizer: suffix is peeled before the post-directional · case 03
"OAK ROAD SOUTH" normalizes to "OAK ROAD S" and the suffix stays unabbreviated.
Street line standardizer: suffix is peeled before the post-directional · case 04
"OAK ROAD SOUTH" normalizes to "OAK ROAD S" and the suffix stays unabbreviated.
Street line standardizer: suffix is peeled before the post-directional · case 05
"OAK ROAD SOUTH" normalizes to "OAK ROAD S" and the suffix stays unabbreviated.
Street line standardizer: a direction-named street loses its name to the pre-directional · case 01
"WEST ST" becomes "W ST" although WEST is the street name.
Street line standardizer: a direction-named street loses its name to the pre-directional · case 02
"WEST ST" becomes "W ST" although WEST is the street name.
Street line standardizer: a direction-named street loses its name to the pre-directional · case 03
"WEST ST" becomes "W ST" although WEST is the street name.
Street line standardizer: a direction-named street loses its name to the pre-directional · case 04
"WEST ST" becomes "W ST" although WEST is the street name.
Street line standardizer: a direction-named street loses its name to the pre-directional · case 05
"WEST ST" becomes "W ST" although WEST is the street name.
Secondary unit extractor: a dangling hash becomes an empty unit · case 01
"21 OAK ST #" returns street "21 OAK ST" with unit "# " instead of leaving the line intact.
Secondary unit extractor: a dangling hash becomes an empty unit · case 02
"21 OAK ST #" returns street "21 OAK ST" with unit "# " instead of leaving the line intact.
Secondary unit extractor: a dangling hash becomes an empty unit · case 03
"21 OAK ST #" returns street "21 OAK ST" with unit "# " instead of leaving the line intact.
Secondary unit extractor: a dangling hash becomes an empty unit · case 04
"21 OAK ST #" returns street "21 OAK ST" with unit "# " instead of leaving the line intact.
Secondary unit extractor: a dangling hash becomes an empty unit · case 05
"21 OAK ST #" returns street "21 OAK ST" with unit "# " instead of leaving the line intact.
Secondary unit extractor: a line made only of a unit is split into an empty street · case 01
"UNIT 9" yields an empty street and unit "UNIT 9".
Secondary unit extractor: a line made only of a unit is split into an empty street · case 02
"UNIT 9" yields an empty street and unit "UNIT 9".
Secondary unit extractor: a line made only of a unit is split into an empty street · case 03
"UNIT 9" yields an empty street and unit "UNIT 9".
Secondary unit extractor: a line made only of a unit is split into an empty street · case 04
"UNIT 9" yields an empty street and unit "UNIT 9".
Secondary unit extractor: a line made only of a unit is split into an empty street · case 05
"UNIT 9" yields an empty street and unit "UNIT 9".
Secondary unit extractor: long designators are emitted verbatim · case 01
The unit reads "SUITE 100" and "APARTMENT 1B" instead of "STE 100" and "APT 1B".
Secondary unit extractor: long designators are emitted verbatim · case 02
The unit reads "SUITE 100" and "APARTMENT 1B" instead of "STE 100" and "APT 1B".
Secondary unit extractor: long designators are emitted verbatim · case 03
The unit reads "SUITE 100" and "APARTMENT 1B" instead of "STE 100" and "APT 1B".
Secondary unit extractor: long designators are emitted verbatim · case 04
The unit reads "SUITE 100" and "APARTMENT 1B" instead of "STE 100" and "APT 1B".
Secondary unit extractor: long designators are emitted verbatim · case 05
The unit reads "SUITE 100" and "APARTMENT 1B" instead of "STE 100" and "APT 1B".
Secondary unit extractor: a free-standing hash is not a designator · case 01
"21 OAK ST # 5" keeps the unit inside the street line.
Secondary unit extractor: a free-standing hash is not a designator · case 02
"21 OAK ST # 5" keeps the unit inside the street line.
Secondary unit extractor: a free-standing hash is not a designator · case 03
"21 OAK ST # 5" keeps the unit inside the street line.
Secondary unit extractor: a free-standing hash is not a designator · case 04
"21 OAK ST # 5" keeps the unit inside the street line.
Secondary unit extractor: a free-standing hash is not a designator · case 05
"21 OAK ST # 5" keeps the unit inside the street line.
Secondary unit extractor: attached hash unit is not re-spaced · case 01
The unit is rendered "#1B" while spaced input renders "# 1B", so equal units compare unequal.
Secondary unit extractor: attached hash unit is not re-spaced · case 02
The unit is rendered "#1B" while spaced input renders "# 1B", so equal units compare unequal.
Secondary unit extractor: attached hash unit is not re-spaced · case 03
The unit is rendered "#1B" while spaced input renders "# 1B", so equal units compare unequal.
Secondary unit extractor: attached hash unit is not re-spaced · case 04
The unit is rendered "#1B" while spaced input renders "# 1B", so equal units compare unequal.
Secondary unit extractor: attached hash unit is not re-spaced · case 05
The unit is rendered "#1B" while spaced input renders "# 1B", so equal units compare unequal.
Secondary unit extractor: the designator is left in the street remainder · case 01
The street reads "21 OAK ST APARTMENT" after the unit is extracted.
Secondary unit extractor: the designator is left in the street remainder · case 02
The street reads "21 OAK ST APARTMENT" after the unit is extracted.
Secondary unit extractor: the designator is left in the street remainder · case 03
The street reads "21 OAK ST APARTMENT" after the unit is extracted.
Secondary unit extractor: the designator is left in the street remainder · case 04
The street reads "21 OAK ST APARTMENT" after the unit is extracted.
Secondary unit extractor: the designator is left in the street remainder · case 05
The street reads "21 OAK ST APARTMENT" after the unit is extracted.
Five-or-nine digit postal code: integer codes are not zero-padded · case 01
A code stored as the integer 1231 is rejected instead of normalizing to "01231".
Five-or-nine digit postal code: integer codes are not zero-padded · case 02
A code stored as the integer 1231 is rejected instead of normalizing to "01231".
Five-or-nine digit postal code: integer codes are not zero-padded · case 03
A code stored as the integer 1231 is rejected instead of normalizing to "01231".
Five-or-nine digit postal code: integer codes are not zero-padded · case 04
A code stored as the integer 1231 is rejected instead of normalizing to "01231".
Five-or-nine digit postal code: integer codes are not zero-padded · case 05
A code stored as the integer 1231 is rejected instead of normalizing to "01231".
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗