Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Rate card: oldest applicable card chosen · case 01
Superseded rate cards stay in use after a new card takes effect.
Rate card: oldest applicable card chosen · case 02
Superseded rate cards stay in use after a new card takes effect.
Rate card: oldest applicable card chosen · case 03
Superseded rate cards stay in use after a new card takes effect.
Rate card: oldest applicable card chosen · case 04
Superseded rate cards stay in use after a new card takes effect.
Rate card: oldest applicable card chosen · case 05
Superseded rate cards stay in use after a new card takes effect.
Rate card: same-day corrections ignored · case 01
A corrected card republished with a higher version on the same date is not used.
Rate card: same-day corrections ignored · case 02
A corrected card republished with a higher version on the same date is not used.
Rate card: same-day corrections ignored · case 03
A corrected card republished with a higher version on the same date is not used.
Rate card: same-day corrections ignored · case 04
A corrected card republished with a higher version on the same date is not used.
Rate card: same-day corrections ignored · case 05
A corrected card republished with a higher version on the same date is not used.
Rate card: duplicate card choice unstable · case 01
Among identical date and version cards the largest id is used.
Rate card: duplicate card choice unstable · case 02
Among identical date and version cards the largest id is used.
Rate card: duplicate card choice unstable · case 03
Among identical date and version cards the largest id is used.
Rate card: duplicate card choice unstable · case 04
Among identical date and version cards the largest id is used.
Rate card: duplicate card choice unstable · case 05
Among identical date and version cards the largest id is used.
International zones: raw country code used · case 01
Lowercase or padded country codes from web checkout fall into the wrong group.
International zones: raw country code used · case 02
Lowercase or padded country codes from web checkout fall into the wrong group.
International zones: raw country code used · case 03
Lowercase or padded country codes from web checkout fall into the wrong group.
International zones: raw country code used · case 04
Lowercase or padded country codes from web checkout fall into the wrong group.
International zones: raw country code used · case 05
Lowercase or padded country codes from web checkout fall into the wrong group.
International zones: UK treated as unknown country · case 01
Shipments entered with country "UK" are rated as rest of world or refused for economy.
International zones: UK treated as unknown country · case 02
Shipments entered with country "UK" are rated as rest of world or refused for economy.
International zones: UK treated as unknown country · case 03
Shipments entered with country "UK" are rated as rest of world or refused for economy.
International zones: UK treated as unknown country · case 04
Shipments entered with country "UK" are rated as rest of world or refused for economy.
International zones: UK treated as unknown country · case 05
Shipments entered with country "UK" are rated as rest of world or refused for economy.
International zones: territories rated as foreign · case 01
Packages to US territories are sent through international rating and customs.
International zones: territories rated as foreign · case 02
Packages to US territories are sent through international rating and customs.
International zones: territories rated as foreign · case 03
Packages to US territories are sent through international rating and customs.
International zones: territories rated as foreign · case 04
Packages to US territories are sent through international rating and customs.
International zones: territories rated as foreign · case 05
Packages to US territories are sent through international rating and customs.
International zones: economy sold to unsupported group · case 01
Economy service is quoted to rest-of-world destinations where it is not offered.
International zones: economy sold to unsupported group · case 02
Economy service is quoted to rest-of-world destinations where it is not offered.
International zones: economy sold to unsupported group · case 03
Economy service is quoted to rest-of-world destinations where it is not offered.
International zones: economy sold to unsupported group · case 04
Economy service is quoted to rest-of-world destinations where it is not offered.
International zones: economy sold to unsupported group · case 05
Economy service is quoted to rest-of-world destinations where it is not offered.
International zones: three-letter codes accepted · case 01
Alpha-3 codes like "USA" are rated as rest of world.
International zones: three-letter codes accepted · case 02
Alpha-3 codes like "USA" are rated as rest of world.
International zones: three-letter codes accepted · case 03
Alpha-3 codes like "USA" are rated as rest of world.
International zones: three-letter codes accepted · case 04
Alpha-3 codes like "USA" are rated as rest of world.
International zones: three-letter codes accepted · case 05
Alpha-3 codes like "USA" are rated as rest of world.
International zones: unlisted countries rejected · case 01
Valid but unlisted countries are reported INVALID instead of rest of world.
International zones: unlisted countries rejected · case 02
Valid but unlisted countries are reported INVALID instead of rest of world.
International zones: unlisted countries rejected · case 03
Valid but unlisted countries are reported INVALID instead of rest of world.
International zones: unlisted countries rejected · case 04
Valid but unlisted countries are reported INVALID instead of rest of world.
International zones: unlisted countries rejected · case 05
Valid but unlisted countries are reported INVALID instead of rest of world.
Hundredweight: weight rounded at shipment level · case 01
Multi-piece shipments are under-billed because fractional pounds are pooled before rounding.
Hundredweight: weight rounded at shipment level · case 02
Multi-piece shipments are under-billed because fractional pounds are pooled before rounding.
Hundredweight: weight rounded at shipment level · case 03
Multi-piece shipments are under-billed because fractional pounds are pooled before rounding.
Hundredweight: weight rounded at shipment level · case 04
Multi-piece shipments are under-billed because fractional pounds are pooled before rounding.
Hundredweight: weight rounded at shipment level · case 05
Multi-piece shipments are under-billed because fractional pounds are pooled before rounding.
Hundredweight: 200 lb shipment disqualified · case 01
A shipment totalling exactly 200 billed pounds is rated as parcels.
Hundredweight: 200 lb shipment disqualified · case 02
A shipment totalling exactly 200 billed pounds is rated as parcels.
Hundredweight: 200 lb shipment disqualified · case 03
A shipment totalling exactly 200 billed pounds is rated as parcels.
Hundredweight: 200 lb shipment disqualified · case 04
A shipment totalling exactly 200 billed pounds is rated as parcels.
Hundredweight: 200 lb shipment disqualified · case 05
A shipment totalling exactly 200 billed pounds is rated as parcels.
Hundredweight: single piece qualifies · case 01
A single heavy piece is priced at hundredweight rates.
Hundredweight: single piece qualifies · case 02
A single heavy piece is priced at hundredweight rates.
Hundredweight: single piece qualifies · case 03
A single heavy piece is priced at hundredweight rates.
Hundredweight: single piece qualifies · case 04
A single heavy piece is priced at hundredweight rates.
Hundredweight: single piece qualifies · case 05
A single heavy piece is priced at hundredweight rates.
Hundredweight: many tiny pieces qualify · case 01
Shipments padded with many one-pound pieces reach hundredweight pricing.
Hundredweight: many tiny pieces qualify · case 02
Shipments padded with many one-pound pieces reach hundredweight pricing.
Hundredweight: many tiny pieces qualify · case 03
Shipments padded with many one-pound pieces reach hundredweight pricing.
Hundredweight: many tiny pieces qualify · case 04
Shipments padded with many one-pound pieces reach hundredweight pricing.
Hundredweight: many tiny pieces qualify · case 05
Shipments padded with many one-pound pieces reach hundredweight pricing.
Hundredweight: charge cents truncated · case 01
Hundredweight charges come out a cent low on fractional results.
Hundredweight: charge cents truncated · case 02
Hundredweight charges come out a cent low on fractional results.
Hundredweight: charge cents truncated · case 03
Hundredweight charges come out a cent low on fractional results.
Hundredweight: charge cents truncated · case 04
Hundredweight charges come out a cent low on fractional results.
Hundredweight: charge cents truncated · case 05
Hundredweight charges come out a cent low on fractional results.
Hundredweight: minimum not multiplied by pieces · case 01
Light multi-piece shipments are billed below the per-piece minimum.
Hundredweight: minimum not multiplied by pieces · case 02
Light multi-piece shipments are billed below the per-piece minimum.
Hundredweight: minimum not multiplied by pieces · case 03
Light multi-piece shipments are billed below the per-piece minimum.
Hundredweight: minimum not multiplied by pieces · case 04
Light multi-piece shipments are billed below the per-piece minimum.
Hundredweight: minimum not multiplied by pieces · case 05
Light multi-piece shipments are billed below the per-piece minimum.
Injection zone: distance truncated · case 01
Destinations a fraction of a mile past a band edge are rated in the cheaper zone.
Injection zone: distance truncated · case 02
Destinations a fraction of a mile past a band edge are rated in the cheaper zone.
Injection zone: distance truncated · case 03
Destinations a fraction of a mile past a band edge are rated in the cheaper zone.
Injection zone: distance truncated · case 04
Destinations a fraction of a mile past a band edge are rated in the cheaper zone.
Injection zone: distance truncated · case 05
Destinations a fraction of a mile past a band edge are rated in the cheaper zone.
Injection zone: band limit exclusive · case 01
A destination exactly at a band limit is rated one zone higher.
Injection zone: band limit exclusive · case 02
A destination exactly at a band limit is rated one zone higher.
Injection zone: band limit exclusive · case 03
A destination exactly at a band limit is rated one zone higher.
Injection zone: band limit exclusive · case 04
A destination exactly at a band limit is rated one zone higher.
Injection zone: band limit exclusive · case 05
A destination exactly at a band limit is rated one zone higher.
Injection zone: cheapest linehaul beats lower zone · case 01
Parcels are injected at the cheapest hub even when it lands them in a higher delivery zone.
Injection zone: cheapest linehaul beats lower zone · case 02
Parcels are injected at the cheapest hub even when it lands them in a higher delivery zone.
Injection zone: cheapest linehaul beats lower zone · case 03
Parcels are injected at the cheapest hub even when it lands them in a higher delivery zone.
Injection zone: cheapest linehaul beats lower zone · case 04
Parcels are injected at the cheapest hub even when it lands them in a higher delivery zone.
Injection zone: cheapest linehaul beats lower zone · case 05
Parcels are injected at the cheapest hub even when it lands them in a higher delivery zone.
Injection zone: grid distance instead of straight line · case 01
Diagonal destinations are rated one or two zones too far.
Injection zone: grid distance instead of straight line · case 02
Diagonal destinations are rated one or two zones too far.
Injection zone: grid distance instead of straight line · case 03
Diagonal destinations are rated one or two zones too far.
Injection zone: grid distance instead of straight line · case 04
Diagonal destinations are rated one or two zones too far.
Injection zone: grid distance instead of straight line · case 05
Diagonal destinations are rated one or two zones too far.
Injection zone: equal hubs resolved by list order · case 01
Two hubs with the same zone and linehaul are chosen by input order.
Injection zone: equal hubs resolved by list order · case 02
Two hubs with the same zone and linehaul are chosen by input order.
Injection zone: equal hubs resolved by list order · case 03
Two hubs with the same zone and linehaul are chosen by input order.
Injection zone: equal hubs resolved by list order · case 04
Two hubs with the same zone and linehaul are chosen by input order.
Injection zone: equal hubs resolved by list order · case 05
Two hubs with the same zone and linehaul are chosen by input order.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗