Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Closed-system distance toll: tolls are truncated to 5 cents · case 01
Closed-system distance toll returns a wrong result when tolls are truncated to 5 cents.
Closed-system distance toll: tolls are truncated to 5 cents · case 02
Closed-system distance toll returns a wrong result when tolls are truncated to 5 cents.
Closed-system distance toll: tolls are truncated to 5 cents · case 03
Closed-system distance toll returns a wrong result when tolls are truncated to 5 cents.
Closed-system distance toll: tolls are truncated to 5 cents · case 04
Closed-system distance toll returns a wrong result when tolls are truncated to 5 cents.
Closed-system distance toll: tolls are truncated to 5 cents · case 05
Closed-system distance toll returns a wrong result when tolls are truncated to 5 cents.
Closed-system distance toll: short trips bypass the minimum toll · case 01
Closed-system distance toll returns a wrong result when short trips bypass the minimum toll.
Closed-system distance toll: short trips bypass the minimum toll · case 02
Closed-system distance toll returns a wrong result when short trips bypass the minimum toll.
Closed-system distance toll: short trips bypass the minimum toll · case 03
Closed-system distance toll returns a wrong result when short trips bypass the minimum toll.
Closed-system distance toll: short trips bypass the minimum toll · case 04
Closed-system distance toll returns a wrong result when short trips bypass the minimum toll.
Closed-system distance toll: short trips bypass the minimum toll · case 05
Closed-system distance toll returns a wrong result when short trips bypass the minimum toll.
Axle and height vehicle classification: a motorcycle towing a trailer stays in class M · case 01
Axle and height vehicle classification returns a wrong result when a motorcycle towing a trailer stays in class M.
Axle and height vehicle classification: a motorcycle towing a trailer stays in class M · case 02
Axle and height vehicle classification returns a wrong result when a motorcycle towing a trailer stays in class M.
Axle and height vehicle classification: a motorcycle towing a trailer stays in class M · case 03
Axle and height vehicle classification returns a wrong result when a motorcycle towing a trailer stays in class M.
Axle and height vehicle classification: a motorcycle towing a trailer stays in class M · case 04
Axle and height vehicle classification returns a wrong result when a motorcycle towing a trailer stays in class M.
Axle and height vehicle classification: a motorcycle towing a trailer stays in class M · case 05
Axle and height vehicle classification returns a wrong result when a motorcycle towing a trailer stays in class M.
Axle and height vehicle classification: trailer axles are not counted · case 01
Axle and height vehicle classification returns a wrong result when trailer axles are not counted.
Axle and height vehicle classification: trailer axles are not counted · case 02
Axle and height vehicle classification returns a wrong result when trailer axles are not counted.
Axle and height vehicle classification: trailer axles are not counted · case 03
Axle and height vehicle classification returns a wrong result when trailer axles are not counted.
Axle and height vehicle classification: trailer axles are not counted · case 04
Axle and height vehicle classification returns a wrong result when trailer axles are not counted.
Axle and height vehicle classification: trailer axles are not counted · case 05
Axle and height vehicle classification returns a wrong result when trailer axles are not counted.
Axle and height vehicle classification: dual tires are ignored for two-axle vehicles · case 01
Axle and height vehicle classification returns a wrong result when dual tires are ignored for two-axle vehicles.
Axle and height vehicle classification: dual tires are ignored for two-axle vehicles · case 02
Axle and height vehicle classification returns a wrong result when dual tires are ignored for two-axle vehicles.
Axle and height vehicle classification: dual tires are ignored for two-axle vehicles · case 03
Axle and height vehicle classification returns a wrong result when dual tires are ignored for two-axle vehicles.
Axle and height vehicle classification: dual tires are ignored for two-axle vehicles · case 04
Axle and height vehicle classification returns a wrong result when dual tires are ignored for two-axle vehicles.
Axle and height vehicle classification: dual tires are ignored for two-axle vehicles · case 05
Axle and height vehicle classification returns a wrong result when dual tires are ignored for two-axle vehicles.
Axle and height vehicle classification: the oversize surcharge ignores trailer axles · case 01
Axle and height vehicle classification returns a wrong result when the oversize surcharge ignores trailer axles.
Axle and height vehicle classification: the oversize surcharge ignores trailer axles · case 02
Axle and height vehicle classification returns a wrong result when the oversize surcharge ignores trailer axles.
Axle and height vehicle classification: the oversize surcharge ignores trailer axles · case 03
Axle and height vehicle classification returns a wrong result when the oversize surcharge ignores trailer axles.
Axle and height vehicle classification: the oversize surcharge ignores trailer axles · case 04
Axle and height vehicle classification returns a wrong result when the oversize surcharge ignores trailer axles.
Axle and height vehicle classification: the oversize surcharge ignores trailer axles · case 05
Axle and height vehicle classification returns a wrong result when the oversize surcharge ignores trailer axles.
Axle and height vehicle classification: oversize applies only to trucks · case 01
Axle and height vehicle classification returns a wrong result when oversize applies only to trucks.
Axle and height vehicle classification: oversize applies only to trucks · case 02
Axle and height vehicle classification returns a wrong result when oversize applies only to trucks.
Axle and height vehicle classification: oversize applies only to trucks · case 03
Axle and height vehicle classification returns a wrong result when oversize applies only to trucks.
Axle and height vehicle classification: oversize applies only to trucks · case 04
Axle and height vehicle classification returns a wrong result when oversize applies only to trucks.
Axle and height vehicle classification: oversize applies only to trucks · case 05
Axle and height vehicle classification returns a wrong result when oversize applies only to trucks.
Cordon congestion charge: the grace window slides with every free crossing · case 01
Cordon congestion charge returns a wrong result when the grace window slides with every free crossing.
Cordon congestion charge: the grace window slides with every free crossing · case 02
Cordon congestion charge returns a wrong result when the grace window slides with every free crossing.
Cordon congestion charge: the grace window slides with every free crossing · case 03
Cordon congestion charge returns a wrong result when the grace window slides with every free crossing.
Cordon congestion charge: the grace window slides with every free crossing · case 04
Cordon congestion charge returns a wrong result when the grace window slides with every free crossing.
Cordon congestion charge: the grace window slides with every free crossing · case 05
Cordon congestion charge returns a wrong result when the grace window slides with every free crossing.
Cordon congestion charge: the peak window includes its end minute · case 01
Cordon congestion charge returns a wrong result when the peak window includes its end minute.
Cordon congestion charge: the peak window includes its end minute · case 02
Cordon congestion charge returns a wrong result when the peak window includes its end minute.
Cordon congestion charge: the peak window includes its end minute · case 03
Cordon congestion charge returns a wrong result when the peak window includes its end minute.
Cordon congestion charge: the peak window includes its end minute · case 04
Cordon congestion charge returns a wrong result when the peak window includes its end minute.
Cordon congestion charge: the peak window includes its end minute · case 05
Cordon congestion charge returns a wrong result when the peak window includes its end minute.
Cordon congestion charge: Saturday is charged · case 01
Cordon congestion charge returns a wrong result when saturday is charged.
Cordon congestion charge: Saturday is charged · case 02
Cordon congestion charge returns a wrong result when saturday is charged.
Cordon congestion charge: Saturday is charged · case 03
Cordon congestion charge returns a wrong result when saturday is charged.
Cordon congestion charge: Saturday is charged · case 04
Cordon congestion charge returns a wrong result when saturday is charged.
Cordon congestion charge: Saturday is charged · case 05
Cordon congestion charge returns a wrong result when saturday is charged.
Cordon congestion charge: the cap applies to the whole billing period · case 01
Cordon congestion charge returns a wrong result when the cap applies to the whole billing period.
Cordon congestion charge: the cap applies to the whole billing period · case 02
Cordon congestion charge returns a wrong result when the cap applies to the whole billing period.
Cordon congestion charge: the cap applies to the whole billing period · case 03
Cordon congestion charge returns a wrong result when the cap applies to the whole billing period.
Cordon congestion charge: the cap applies to the whole billing period · case 04
Cordon congestion charge returns a wrong result when the cap applies to the whole billing period.
Cordon congestion charge: the cap applies to the whole billing period · case 05
Cordon congestion charge returns a wrong result when the cap applies to the whole billing period.
Cordon congestion charge: crossings are processed in the order received · case 01
Cordon congestion charge returns a wrong result when crossings are processed in the order received.
Cordon congestion charge: crossings are processed in the order received · case 02
Cordon congestion charge returns a wrong result when crossings are processed in the order received.
Cordon congestion charge: crossings are processed in the order received · case 03
Cordon congestion charge returns a wrong result when crossings are processed in the order received.
Cordon congestion charge: crossings are processed in the order received · case 04
Cordon congestion charge returns a wrong result when crossings are processed in the order received.
Cordon congestion charge: crossings are processed in the order received · case 05
Cordon congestion charge returns a wrong result when crossings are processed in the order received.
Express lane dynamic price: a density equal to the band limit falls into the next band · case 01
Express lane dynamic price returns a wrong result when a density equal to the band limit falls into the next band.
Express lane dynamic price: a density equal to the band limit falls into the next band · case 02
Express lane dynamic price returns a wrong result when a density equal to the band limit falls into the next band.
Express lane dynamic price: a density equal to the band limit falls into the next band · case 03
Express lane dynamic price returns a wrong result when a density equal to the band limit falls into the next band.
Express lane dynamic price: a density equal to the band limit falls into the next band · case 04
Express lane dynamic price returns a wrong result when a density equal to the band limit falls into the next band.
Express lane dynamic price: a density equal to the band limit falls into the next band · case 05
Express lane dynamic price returns a wrong result when a density equal to the band limit falls into the next band.
Express lane dynamic price: price decreases are not rate limited · case 01
Express lane dynamic price returns a wrong result when price decreases are not rate limited.
Express lane dynamic price: price decreases are not rate limited · case 02
Express lane dynamic price returns a wrong result when price decreases are not rate limited.
Express lane dynamic price: price decreases are not rate limited · case 03
Express lane dynamic price returns a wrong result when price decreases are not rate limited.
Express lane dynamic price: price decreases are not rate limited · case 04
Express lane dynamic price returns a wrong result when price decreases are not rate limited.
Express lane dynamic price: price decreases are not rate limited · case 05
Express lane dynamic price returns a wrong result when price decreases are not rate limited.
Express lane dynamic price: the posted price is not floored at the minimum · case 01
Express lane dynamic price returns a wrong result when the posted price is not floored at the minimum.
Express lane dynamic price: the posted price is not floored at the minimum · case 02
Express lane dynamic price returns a wrong result when the posted price is not floored at the minimum.
Express lane dynamic price: the posted price is not floored at the minimum · case 03
Express lane dynamic price returns a wrong result when the posted price is not floored at the minimum.
Express lane dynamic price: the posted price is not floored at the minimum · case 04
Express lane dynamic price returns a wrong result when the posted price is not floored at the minimum.
Express lane dynamic price: the posted price is not floored at the minimum · case 05
Express lane dynamic price returns a wrong result when the posted price is not floored at the minimum.
Express lane dynamic price: the HOV free threshold is hard-coded · case 01
Express lane dynamic price returns a wrong result when the HOV free threshold is hard-coded.
Express lane dynamic price: the HOV free threshold is hard-coded · case 02
Express lane dynamic price returns a wrong result when the HOV free threshold is hard-coded.
Express lane dynamic price: the HOV free threshold is hard-coded · case 03
Express lane dynamic price returns a wrong result when the HOV free threshold is hard-coded.
Express lane dynamic price: the HOV free threshold is hard-coded · case 04
Express lane dynamic price returns a wrong result when the HOV free threshold is hard-coded.
Express lane dynamic price: the HOV free threshold is hard-coded · case 05
Express lane dynamic price returns a wrong result when the HOV free threshold is hard-coded.
Express lane dynamic price: the HOV2 price is not floored to 5 cents · case 01
Express lane dynamic price returns a wrong result when the HOV2 price is not floored to 5 cents.
Express lane dynamic price: the HOV2 price is not floored to 5 cents · case 02
Express lane dynamic price returns a wrong result when the HOV2 price is not floored to 5 cents.
Express lane dynamic price: the HOV2 price is not floored to 5 cents · case 03
Express lane dynamic price returns a wrong result when the HOV2 price is not floored to 5 cents.
Express lane dynamic price: the HOV2 price is not floored to 5 cents · case 04
Express lane dynamic price returns a wrong result when the HOV2 price is not floored to 5 cents.
Express lane dynamic price: the HOV2 price is not floored to 5 cents · case 05
Express lane dynamic price returns a wrong result when the HOV2 price is not floored to 5 cents.
Express lane dynamic price: densities beyond the table hold the previous price · case 01
Express lane dynamic price returns a wrong result when densities beyond the table hold the previous price.
Express lane dynamic price: densities beyond the table hold the previous price · case 02
Express lane dynamic price returns a wrong result when densities beyond the table hold the previous price.
Express lane dynamic price: densities beyond the table hold the previous price · case 03
Express lane dynamic price returns a wrong result when densities beyond the table hold the previous price.
Express lane dynamic price: densities beyond the table hold the previous price · case 04
Express lane dynamic price returns a wrong result when densities beyond the table hold the previous price.
Express lane dynamic price: densities beyond the table hold the previous price · case 05
Express lane dynamic price returns a wrong result when densities beyond the table hold the previous price.
Pay-by-plate invoice and tag discount: invoice periods assume 1-based days · case 01
Pay-by-plate invoice and tag discount returns a wrong result when invoice periods assume 1-based days.
Pay-by-plate invoice and tag discount: invoice periods assume 1-based days · case 02
Pay-by-plate invoice and tag discount returns a wrong result when invoice periods assume 1-based days.
Pay-by-plate invoice and tag discount: invoice periods assume 1-based days · case 03
Pay-by-plate invoice and tag discount returns a wrong result when invoice periods assume 1-based days.
Pay-by-plate invoice and tag discount: invoice periods assume 1-based days · case 04
Pay-by-plate invoice and tag discount returns a wrong result when invoice periods assume 1-based days.
Pay-by-plate invoice and tag discount: invoice periods assume 1-based days · case 05
Pay-by-plate invoice and tag discount returns a wrong result when invoice periods assume 1-based days.
Pay-by-plate invoice and tag discount: the plate surcharge is floored · case 01
Pay-by-plate invoice and tag discount returns a wrong result when the plate surcharge is floored.
Pay-by-plate invoice and tag discount: the plate surcharge is floored · case 02
Pay-by-plate invoice and tag discount returns a wrong result when the plate surcharge is floored.
Pay-by-plate invoice and tag discount: the plate surcharge is floored · case 03
Pay-by-plate invoice and tag discount returns a wrong result when the plate surcharge is floored.
Pay-by-plate invoice and tag discount: the plate surcharge is floored · case 04
Pay-by-plate invoice and tag discount returns a wrong result when the plate surcharge is floored.
Pay-by-plate invoice and tag discount: the plate surcharge is floored · case 05
Pay-by-plate invoice and tag discount returns a wrong result when the plate surcharge is floored.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗