Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Cubic tiers: quarter inches rounded to nearest · case 01
Parcels are bumped into a higher cubic tier because measurements round up to the next quarter inch.
Cubic tiers: quarter inches rounded to nearest · case 02
Parcels are bumped into a higher cubic tier because measurements round up to the next quarter inch.
Cubic tiers: quarter inches rounded to nearest · case 03
Parcels are bumped into a higher cubic tier because measurements round up to the next quarter inch.
Cubic tiers: quarter inches rounded to nearest · case 04
Parcels are bumped into a higher cubic tier because measurements round up to the next quarter inch.
Cubic tiers: quarter inches rounded to nearest · case 05
Parcels are bumped into a higher cubic tier because measurements round up to the next quarter inch.
Cubic tiers: tier truncated · case 01
Parcels are priced one cubic tier too low.
Cubic tiers: tier truncated · case 02
Parcels are priced one cubic tier too low.
Cubic tiers: tier truncated · case 03
Parcels are priced one cubic tier too low.
Cubic tiers: tier truncated · case 04
Parcels are priced one cubic tier too low.
Cubic tiers: tier truncated · case 05
Parcels are priced one cubic tier too low.
Cubic tiers: side limit on raw measurement · case 01
An 18.2 inch side that measures 18 after rounding is refused cubic pricing.
Cubic tiers: side limit on raw measurement · case 02
An 18.2 inch side that measures 18 after rounding is refused cubic pricing.
Cubic tiers: side limit on raw measurement · case 03
An 18.2 inch side that measures 18 after rounding is refused cubic pricing.
Cubic tiers: side limit on raw measurement · case 04
An 18.2 inch side that measures 18 after rounding is refused cubic pricing.
Cubic tiers: side limit on raw measurement · case 05
An 18.2 inch side that measures 18 after rounding is refused cubic pricing.
Cubic tiers: heavy parcels cubic priced · case 01
Dense parcels over 20 lb get cubic pricing.
Cubic tiers: heavy parcels cubic priced · case 02
Dense parcels over 20 lb get cubic pricing.
Cubic tiers: heavy parcels cubic priced · case 03
Dense parcels over 20 lb get cubic pricing.
Cubic tiers: heavy parcels cubic priced · case 04
Dense parcels over 20 lb get cubic pricing.
Cubic tiers: heavy parcels cubic priced · case 05
Dense parcels over 20 lb get cubic pricing.
Cubic tiers: tier above 0.5 cubic feet priced cubic · case 01
Large parcels are quoted non-existent cubic tiers above 0.5.
Cubic tiers: tier above 0.5 cubic feet priced cubic · case 02
Large parcels are quoted non-existent cubic tiers above 0.5.
Cubic tiers: tier above 0.5 cubic feet priced cubic · case 03
Large parcels are quoted non-existent cubic tiers above 0.5.
Cubic tiers: tier above 0.5 cubic feet priced cubic · case 04
Large parcels are quoted non-existent cubic tiers above 0.5.
Cubic tiers: tier above 0.5 cubic feet priced cubic · case 05
Large parcels are quoted non-existent cubic tiers above 0.5.
Flat vs weight: box dims not rotated · case 01
Items that fit a flat box on their side are told the box is too small.
Flat vs weight: box dims not rotated · case 02
Items that fit a flat box on their side are told the box is too small.
Flat vs weight: box dims not rotated · case 03
Items that fit a flat box on their side are told the box is too small.
Flat vs weight: box dims not rotated · case 04
Items that fit a flat box on their side are told the box is too small.
Flat vs weight: box dims not rotated · case 05
Items that fit a flat box on their side are told the box is too small.
Flat vs weight: 70 lb flat box refused · case 01
A box weighing exactly 70 lb is refused flat-rate pricing.
Flat vs weight: 70 lb flat box refused · case 02
A box weighing exactly 70 lb is refused flat-rate pricing.
Flat vs weight: 70 lb flat box refused · case 03
A box weighing exactly 70 lb is refused flat-rate pricing.
Flat vs weight: 70 lb flat box refused · case 04
A box weighing exactly 70 lb is refused flat-rate pricing.
Flat vs weight: 70 lb flat box refused · case 05
A box weighing exactly 70 lb is refused flat-rate pricing.
Flat vs weight: first eligible option taken · case 01
The first box in the catalogue is used even when a cheaper box or weight price exists.
Flat vs weight: first eligible option taken · case 02
The first box in the catalogue is used even when a cheaper box or weight price exists.
Flat vs weight: first eligible option taken · case 03
The first box in the catalogue is used even when a cheaper box or weight price exists.
Flat vs weight: first eligible option taken · case 04
The first box in the catalogue is used even when a cheaper box or weight price exists.
Flat vs weight: first eligible option taken · case 05
The first box in the catalogue is used even when a cheaper box or weight price exists.
Flat vs weight: fractional pound uses lower rate · case 01
A 3.2 lb parcel is priced at the 3 lb rate; sub-pound parcels wrap to the heaviest rate.
Flat vs weight: fractional pound uses lower rate · case 02
A 3.2 lb parcel is priced at the 3 lb rate; sub-pound parcels wrap to the heaviest rate.
Flat vs weight: fractional pound uses lower rate · case 03
A 3.2 lb parcel is priced at the 3 lb rate; sub-pound parcels wrap to the heaviest rate.
Flat vs weight: fractional pound uses lower rate · case 04
A 3.2 lb parcel is priced at the 3 lb rate; sub-pound parcels wrap to the heaviest rate.
Flat vs weight: fractional pound uses lower rate · case 05
A 3.2 lb parcel is priced at the 3 lb rate; sub-pound parcels wrap to the heaviest rate.
Destination zones: private carrier quoted to APO · case 01
Ground service is sold to military addresses that only the postal network delivers.
Destination zones: private carrier quoted to APO · case 02
Ground service is sold to military addresses that only the postal network delivers.
Destination zones: private carrier quoted to APO · case 03
Ground service is sold to military addresses that only the postal network delivers.
Destination zones: private carrier quoted to APO · case 04
Ground service is sold to military addresses that only the postal network delivers.
Destination zones: private carrier quoted to APO · case 05
Ground service is sold to military addresses that only the postal network delivers.
Destination zones: Americas military code missed · case 01
AA addresses are rated as ordinary Florida destinations.
Destination zones: Americas military code missed · case 02
AA addresses are rated as ordinary Florida destinations.
Destination zones: Americas military code missed · case 03
AA addresses are rated as ordinary Florida destinations.
Destination zones: Americas military code missed · case 04
AA addresses are rated as ordinary Florida destinations.
Destination zones: Americas military code missed · case 05
AA addresses are rated as ordinary Florida destinations.
Destination zones: 996 rated as remote Alaska · case 01
Alaska ZIP3 996 is charged the remote zone.
Destination zones: 996 rated as remote Alaska · case 02
Alaska ZIP3 996 is charged the remote zone.
Destination zones: 996 rated as remote Alaska · case 03
Alaska ZIP3 996 is charged the remote zone.
Destination zones: 996 rated as remote Alaska · case 04
Alaska ZIP3 996 is charged the remote zone.
Destination zones: 996 rated as remote Alaska · case 05
Alaska ZIP3 996 is charged the remote zone.
Destination zones: Honolulu ZIPs flagged mismatch · case 01
Honolulu (968) addresses are rejected as state/ZIP mismatches.
Destination zones: Honolulu ZIPs flagged mismatch · case 02
Honolulu (968) addresses are rejected as state/ZIP mismatches.
Destination zones: Honolulu ZIPs flagged mismatch · case 03
Honolulu (968) addresses are rejected as state/ZIP mismatches.
Destination zones: Honolulu ZIPs flagged mismatch · case 04
Honolulu (968) addresses are rejected as state/ZIP mismatches.
Destination zones: Honolulu ZIPs flagged mismatch · case 05
Honolulu (968) addresses are rejected as state/ZIP mismatches.
Destination zones: San Juan and USVI rejected · case 01
Puerto Rico 009 and Virgin Islands 008 addresses are flagged mismatched.
Destination zones: San Juan and USVI rejected · case 02
Puerto Rico 009 and Virgin Islands 008 addresses are flagged mismatched.
Destination zones: San Juan and USVI rejected · case 03
Puerto Rico 009 and Virgin Islands 008 addresses are flagged mismatched.
Destination zones: San Juan and USVI rejected · case 04
Puerto Rico 009 and Virgin Islands 008 addresses are flagged mismatched.
Destination zones: San Juan and USVI rejected · case 05
Puerto Rico 009 and Virgin Islands 008 addresses are flagged mismatched.
Contract discount: spend on threshold gets lower tier · case 01
Accounts spending exactly a tier threshold receive the lower discount.
Contract discount: spend on threshold gets lower tier · case 02
Accounts spending exactly a tier threshold receive the lower discount.
Contract discount: spend on threshold gets lower tier · case 03
Accounts spending exactly a tier threshold receive the lower discount.
Contract discount: spend on threshold gets lower tier · case 04
Accounts spending exactly a tier threshold receive the lower discount.
Contract discount: spend on threshold gets lower tier · case 05
Accounts spending exactly a tier threshold receive the lower discount.
Contract discount: largest accounts get the smallest discount · case 01
Top-tier accounts are discounted at the entry tier rate.
Contract discount: largest accounts get the smallest discount · case 02
Top-tier accounts are discounted at the entry tier rate.
Contract discount: largest accounts get the smallest discount · case 03
Top-tier accounts are discounted at the entry tier rate.
Contract discount: largest accounts get the smallest discount · case 04
Top-tier accounts are discounted at the entry tier rate.
Contract discount: largest accounts get the smallest discount · case 05
Top-tier accounts are discounted at the entry tier rate.
Contract discount: discount cents truncated · case 01
Discounts come out a cent short on half-cent results.
Contract discount: discount cents truncated · case 02
Discounts come out a cent short on half-cent results.
Contract discount: discount cents truncated · case 03
Discounts come out a cent short on half-cent results.
Contract discount: discount cents truncated · case 04
Discounts come out a cent short on half-cent results.
Contract discount: discount cents truncated · case 05
Discounts come out a cent short on half-cent results.
Contract discount: minimum exceeds list price · case 01
Cheap lanes are billed above their published list rate because of the minimum.
Contract discount: minimum exceeds list price · case 02
Cheap lanes are billed above their published list rate because of the minimum.
Contract discount: minimum exceeds list price · case 03
Cheap lanes are billed above their published list rate because of the minimum.
Contract discount: minimum exceeds list price · case 04
Cheap lanes are billed above their published list rate because of the minimum.
Contract discount: minimum exceeds list price · case 05
Cheap lanes are billed above their published list rate because of the minimum.
Contract discount: minimum charge not enforced · case 01
Heavily discounted lanes fall below the contractual minimum.
Contract discount: minimum charge not enforced · case 02
Heavily discounted lanes fall below the contractual minimum.
Contract discount: minimum charge not enforced · case 03
Heavily discounted lanes fall below the contractual minimum.
Contract discount: minimum charge not enforced · case 04
Heavily discounted lanes fall below the contractual minimum.
Contract discount: minimum charge not enforced · case 05
Heavily discounted lanes fall below the contractual minimum.
Rate shopping: service arriving on deadline excluded · case 01
A cheaper service that arrives exactly on the promised day is skipped.
Rate shopping: service arriving on deadline excluded · case 02
A cheaper service that arrives exactly on the promised day is skipped.
Rate shopping: service arriving on deadline excluded · case 03
A cheaper service that arrives exactly on the promised day is skipped.
Rate shopping: service arriving on deadline excluded · case 04
A cheaper service that arrives exactly on the promised day is skipped.
Rate shopping: service arriving on deadline excluded · case 05
A cheaper service that arrives exactly on the promised day is skipped.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗