Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Pay-by-plate invoice and tag discount: the discounted price is floored instead of the discount · case 01
Pay-by-plate invoice and tag discount returns a wrong result when the discounted price is floored instead of the discount.
Pay-by-plate invoice and tag discount: the discounted price is floored instead of the discount · case 02
Pay-by-plate invoice and tag discount returns a wrong result when the discounted price is floored instead of the discount.
Pay-by-plate invoice and tag discount: the discounted price is floored instead of the discount · case 03
Pay-by-plate invoice and tag discount returns a wrong result when the discounted price is floored instead of the discount.
Pay-by-plate invoice and tag discount: the discounted price is floored instead of the discount · case 04
Pay-by-plate invoice and tag discount returns a wrong result when the discounted price is floored instead of the discount.
Pay-by-plate invoice and tag discount: the discounted price is floored instead of the discount · case 05
Pay-by-plate invoice and tag discount returns a wrong result when the discounted price is floored instead of the discount.
Pay-by-plate invoice and tag discount: a single invoice fee is added regardless of invoices · case 01
Pay-by-plate invoice and tag discount returns a wrong result when a single invoice fee is added regardless of invoices.
Pay-by-plate invoice and tag discount: a single invoice fee is added regardless of invoices · case 02
Pay-by-plate invoice and tag discount returns a wrong result when a single invoice fee is added regardless of invoices.
Pay-by-plate invoice and tag discount: a single invoice fee is added regardless of invoices · case 03
Pay-by-plate invoice and tag discount returns a wrong result when a single invoice fee is added regardless of invoices.
Pay-by-plate invoice and tag discount: a single invoice fee is added regardless of invoices · case 04
Pay-by-plate invoice and tag discount returns a wrong result when a single invoice fee is added regardless of invoices.
Pay-by-plate invoice and tag discount: a single invoice fee is added regardless of invoices · case 05
Pay-by-plate invoice and tag discount returns a wrong result when a single invoice fee is added regardless of invoices.
Pay-by-plate invoice and tag discount: exempt trips fall through to plate billing · case 01
Pay-by-plate invoice and tag discount returns a wrong result when exempt trips fall through to plate billing.
Pay-by-plate invoice and tag discount: exempt trips fall through to plate billing · case 02
Pay-by-plate invoice and tag discount returns a wrong result when exempt trips fall through to plate billing.
Pay-by-plate invoice and tag discount: exempt trips fall through to plate billing · case 03
Pay-by-plate invoice and tag discount returns a wrong result when exempt trips fall through to plate billing.
Pay-by-plate invoice and tag discount: exempt trips fall through to plate billing · case 04
Pay-by-plate invoice and tag discount returns a wrong result when exempt trips fall through to plate billing.
Pay-by-plate invoice and tag discount: exempt trips fall through to plate billing · case 05
Pay-by-plate invoice and tag discount returns a wrong result when exempt trips fall through to plate billing.
Prepaid toll account auto-replenishment: a balance equal to the threshold triggers replenishment · case 01
Prepaid toll account auto-replenishment returns a wrong result when a balance equal to the threshold triggers replenishment.
Prepaid toll account auto-replenishment: a balance equal to the threshold triggers replenishment · case 02
Prepaid toll account auto-replenishment returns a wrong result when a balance equal to the threshold triggers replenishment.
Prepaid toll account auto-replenishment: a balance equal to the threshold triggers replenishment · case 03
Prepaid toll account auto-replenishment returns a wrong result when a balance equal to the threshold triggers replenishment.
Prepaid toll account auto-replenishment: a balance equal to the threshold triggers replenishment · case 04
Prepaid toll account auto-replenishment returns a wrong result when a balance equal to the threshold triggers replenishment.
Prepaid toll account auto-replenishment: a balance equal to the threshold triggers replenishment · case 05
Prepaid toll account auto-replenishment returns a wrong result when a balance equal to the threshold triggers replenishment.
Prepaid toll account auto-replenishment: the usage-based amount is floored to 500 · case 01
Prepaid toll account auto-replenishment returns a wrong result when the usage-based amount is floored to 500.
Prepaid toll account auto-replenishment: the usage-based amount is floored to 500 · case 02
Prepaid toll account auto-replenishment returns a wrong result when the usage-based amount is floored to 500.
Prepaid toll account auto-replenishment: the usage-based amount is floored to 500 · case 03
Prepaid toll account auto-replenishment returns a wrong result when the usage-based amount is floored to 500.
Prepaid toll account auto-replenishment: the usage-based amount is floored to 500 · case 04
Prepaid toll account auto-replenishment returns a wrong result when the usage-based amount is floored to 500.
Prepaid toll account auto-replenishment: the usage-based amount is floored to 500 · case 05
Prepaid toll account auto-replenishment returns a wrong result when the usage-based amount is floored to 500.
Prepaid toll account auto-replenishment: the minimum replenishment acts as a ceiling · case 01
Prepaid toll account auto-replenishment returns a wrong result when the minimum replenishment acts as a ceiling.
Prepaid toll account auto-replenishment: the minimum replenishment acts as a ceiling · case 02
Prepaid toll account auto-replenishment returns a wrong result when the minimum replenishment acts as a ceiling.
Prepaid toll account auto-replenishment: the minimum replenishment acts as a ceiling · case 03
Prepaid toll account auto-replenishment returns a wrong result when the minimum replenishment acts as a ceiling.
Prepaid toll account auto-replenishment: the minimum replenishment acts as a ceiling · case 04
Prepaid toll account auto-replenishment returns a wrong result when the minimum replenishment acts as a ceiling.
Prepaid toll account auto-replenishment: the minimum replenishment acts as a ceiling · case 05
Prepaid toll account auto-replenishment returns a wrong result when the minimum replenishment acts as a ceiling.
Prepaid toll account auto-replenishment: the negative index is overwritten by later charges · case 01
Prepaid toll account auto-replenishment returns a wrong result when the negative index is overwritten by later charges.
Prepaid toll account auto-replenishment: the negative index is overwritten by later charges · case 02
Prepaid toll account auto-replenishment returns a wrong result when the negative index is overwritten by later charges.
Prepaid toll account auto-replenishment: the negative index is overwritten by later charges · case 03
Prepaid toll account auto-replenishment returns a wrong result when the negative index is overwritten by later charges.
Prepaid toll account auto-replenishment: the negative index is overwritten by later charges · case 04
Prepaid toll account auto-replenishment returns a wrong result when the negative index is overwritten by later charges.
Prepaid toll account auto-replenishment: the negative index is overwritten by later charges · case 05
Prepaid toll account auto-replenishment returns a wrong result when the negative index is overwritten by later charges.
Prepaid toll account auto-replenishment: replenishment is attempted with a declined card · case 01
Prepaid toll account auto-replenishment returns a wrong result when replenishment is attempted with a declined card.
Prepaid toll account auto-replenishment: replenishment is attempted with a declined card · case 02
Prepaid toll account auto-replenishment returns a wrong result when replenishment is attempted with a declined card.
Prepaid toll account auto-replenishment: replenishment is attempted with a declined card · case 03
Prepaid toll account auto-replenishment returns a wrong result when replenishment is attempted with a declined card.
Prepaid toll account auto-replenishment: replenishment is attempted with a declined card · case 04
Prepaid toll account auto-replenishment returns a wrong result when replenishment is attempted with a declined card.
Prepaid toll account auto-replenishment: replenishment is attempted with a declined card · case 05
Prepaid toll account auto-replenishment returns a wrong result when replenishment is attempted with a declined card.
One-way bridge toll with frequent-user discount: the tolled direction is hard-coded westbound · case 01
One-way bridge toll with frequent-user discount returns a wrong result when the tolled direction is hard-coded westbound.
One-way bridge toll with frequent-user discount: the tolled direction is hard-coded westbound · case 02
One-way bridge toll with frequent-user discount returns a wrong result when the tolled direction is hard-coded westbound.
One-way bridge toll with frequent-user discount: the tolled direction is hard-coded westbound · case 03
One-way bridge toll with frequent-user discount returns a wrong result when the tolled direction is hard-coded westbound.
One-way bridge toll with frequent-user discount: the tolled direction is hard-coded westbound · case 04
One-way bridge toll with frequent-user discount returns a wrong result when the tolled direction is hard-coded westbound.
One-way bridge toll with frequent-user discount: the tolled direction is hard-coded westbound · case 05
One-way bridge toll with frequent-user discount returns a wrong result when the tolled direction is hard-coded westbound.
One-way bridge toll with frequent-user discount: carpools of exactly the minimum occupancy are charged · case 01
One-way bridge toll with frequent-user discount returns a wrong result when carpools of exactly the minimum occupancy are charged.
One-way bridge toll with frequent-user discount: carpools of exactly the minimum occupancy are charged · case 02
One-way bridge toll with frequent-user discount returns a wrong result when carpools of exactly the minimum occupancy are charged.
One-way bridge toll with frequent-user discount: carpools of exactly the minimum occupancy are charged · case 03
One-way bridge toll with frequent-user discount returns a wrong result when carpools of exactly the minimum occupancy are charged.
One-way bridge toll with frequent-user discount: carpools of exactly the minimum occupancy are charged · case 04
One-way bridge toll with frequent-user discount returns a wrong result when carpools of exactly the minimum occupancy are charged.
One-way bridge toll with frequent-user discount: carpools of exactly the minimum occupancy are charged · case 05
One-way bridge toll with frequent-user discount returns a wrong result when carpools of exactly the minimum occupancy are charged.
One-way bridge toll with frequent-user discount: the frequency counter never resets between months · case 01
One-way bridge toll with frequent-user discount returns a wrong result when the frequency counter never resets between months.
One-way bridge toll with frequent-user discount: the frequency counter never resets between months · case 02
One-way bridge toll with frequent-user discount returns a wrong result when the frequency counter never resets between months.
One-way bridge toll with frequent-user discount: the frequency counter never resets between months · case 03
One-way bridge toll with frequent-user discount returns a wrong result when the frequency counter never resets between months.
One-way bridge toll with frequent-user discount: the frequency counter never resets between months · case 04
One-way bridge toll with frequent-user discount returns a wrong result when the frequency counter never resets between months.
One-way bridge toll with frequent-user discount: the frequency counter never resets between months · case 05
One-way bridge toll with frequent-user discount returns a wrong result when the frequency counter never resets between months.
One-way bridge toll with frequent-user discount: the threshold trip itself is discounted · case 01
One-way bridge toll with frequent-user discount returns a wrong result when the threshold trip itself is discounted.
One-way bridge toll with frequent-user discount: the threshold trip itself is discounted · case 02
One-way bridge toll with frequent-user discount returns a wrong result when the threshold trip itself is discounted.
One-way bridge toll with frequent-user discount: the threshold trip itself is discounted · case 03
One-way bridge toll with frequent-user discount returns a wrong result when the threshold trip itself is discounted.
One-way bridge toll with frequent-user discount: the threshold trip itself is discounted · case 04
One-way bridge toll with frequent-user discount returns a wrong result when the threshold trip itself is discounted.
One-way bridge toll with frequent-user discount: the threshold trip itself is discounted · case 05
One-way bridge toll with frequent-user discount returns a wrong result when the threshold trip itself is discounted.
One-way bridge toll with frequent-user discount: the discounted price is rounded to nearest · case 01
One-way bridge toll with frequent-user discount returns a wrong result when the discounted price is rounded to nearest.
One-way bridge toll with frequent-user discount: the discounted price is rounded to nearest · case 02
One-way bridge toll with frequent-user discount returns a wrong result when the discounted price is rounded to nearest.
One-way bridge toll with frequent-user discount: the discounted price is rounded to nearest · case 03
One-way bridge toll with frequent-user discount returns a wrong result when the discounted price is rounded to nearest.
One-way bridge toll with frequent-user discount: the discounted price is rounded to nearest · case 04
One-way bridge toll with frequent-user discount returns a wrong result when the discounted price is rounded to nearest.
One-way bridge toll with frequent-user discount: the discounted price is rounded to nearest · case 05
One-way bridge toll with frequent-user discount returns a wrong result when the discounted price is rounded to nearest.
Merchant parking validations: the free-minute cap is applied per validation · case 01
Merchant parking validations returns a wrong result when the free-minute cap is applied per validation.
Merchant parking validations: the free-minute cap is applied per validation · case 02
Merchant parking validations returns a wrong result when the free-minute cap is applied per validation.
Merchant parking validations: the free-minute cap is applied per validation · case 03
Merchant parking validations returns a wrong result when the free-minute cap is applied per validation.
Merchant parking validations: the free-minute cap is applied per validation · case 04
Merchant parking validations returns a wrong result when the free-minute cap is applied per validation.
Merchant parking validations: the free-minute cap is applied per validation · case 05
Merchant parking validations returns a wrong result when the free-minute cap is applied per validation.
Merchant parking validations: free minutes are converted to money after rating · case 01
Merchant parking validations returns a wrong result when free minutes are converted to money after rating.
Merchant parking validations: free minutes are converted to money after rating · case 02
Merchant parking validations returns a wrong result when free minutes are converted to money after rating.
Merchant parking validations: free minutes are converted to money after rating · case 03
Merchant parking validations returns a wrong result when free minutes are converted to money after rating.
Merchant parking validations: free minutes are converted to money after rating · case 04
Merchant parking validations returns a wrong result when free minutes are converted to money after rating.
Merchant parking validations: free minutes are converted to money after rating · case 05
Merchant parking validations returns a wrong result when free minutes are converted to money after rating.
Merchant parking validations: percentage validations are summed · case 01
Merchant parking validations returns a wrong result when percentage validations are summed.
Merchant parking validations: percentage validations are summed · case 02
Merchant parking validations returns a wrong result when percentage validations are summed.
Merchant parking validations: percentage validations are summed · case 03
Merchant parking validations returns a wrong result when percentage validations are summed.
Merchant parking validations: percentage validations are summed · case 04
Merchant parking validations returns a wrong result when percentage validations are summed.
Merchant parking validations: percentage validations are summed · case 05
Merchant parking validations returns a wrong result when percentage validations are summed.
Merchant parking validations: flat validations can drive the fee negative · case 01
Merchant parking validations returns a wrong result when flat validations can drive the fee negative.
Merchant parking validations: flat validations can drive the fee negative · case 02
Merchant parking validations returns a wrong result when flat validations can drive the fee negative.
Merchant parking validations: flat validations can drive the fee negative · case 03
Merchant parking validations returns a wrong result when flat validations can drive the fee negative.
Merchant parking validations: flat validations can drive the fee negative · case 04
Merchant parking validations returns a wrong result when flat validations can drive the fee negative.
Merchant parking validations: flat validations can drive the fee negative · case 05
Merchant parking validations returns a wrong result when flat validations can drive the fee negative.
Merchant parking validations: only the largest flat validation applies · case 01
Merchant parking validations returns a wrong result when only the largest flat validation applies.
Merchant parking validations: only the largest flat validation applies · case 02
Merchant parking validations returns a wrong result when only the largest flat validation applies.
Merchant parking validations: only the largest flat validation applies · case 03
Merchant parking validations returns a wrong result when only the largest flat validation applies.
Merchant parking validations: only the largest flat validation applies · case 04
Merchant parking validations returns a wrong result when only the largest flat validation applies.
Merchant parking validations: only the largest flat validation applies · case 05
Merchant parking validations returns a wrong result when only the largest flat validation applies.
EV charging session and idle fee: energy is billed in whole kWh · case 01
EV charging session and idle fee returns a wrong result when energy is billed in whole kWh.
EV charging session and idle fee: energy is billed in whole kWh · case 02
EV charging session and idle fee returns a wrong result when energy is billed in whole kWh.
EV charging session and idle fee: energy is billed in whole kWh · case 03
EV charging session and idle fee returns a wrong result when energy is billed in whole kWh.
EV charging session and idle fee: energy is billed in whole kWh · case 04
EV charging session and idle fee returns a wrong result when energy is billed in whole kWh.
EV charging session and idle fee: energy is billed in whole kWh · case 05
EV charging session and idle fee returns a wrong result when energy is billed in whole kWh.
EV charging session and idle fee: idle time is measured from plug-in · case 01
EV charging session and idle fee returns a wrong result when idle time is measured from plug-in.
EV charging session and idle fee: idle time is measured from plug-in · case 02
EV charging session and idle fee returns a wrong result when idle time is measured from plug-in.
EV charging session and idle fee: idle time is measured from plug-in · case 03
EV charging session and idle fee returns a wrong result when idle time is measured from plug-in.
EV charging session and idle fee: idle time is measured from plug-in · case 04
EV charging session and idle fee returns a wrong result when idle time is measured from plug-in.
EV charging session and idle fee: idle time is measured from plug-in · case 05
EV charging session and idle fee returns a wrong result when idle time is measured from plug-in.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗