Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Surged fare truncated instead of rounded · case 01
A 1.5x fare on 12.35 shows 18.52 instead of 18.53.
Surged fare truncated instead of rounded · case 02
A 1.5x fare on 12.35 shows 18.52 instead of 18.53.
Surged fare truncated instead of rounded · case 03
A 1.5x fare on 12.35 shows 18.52 instead of 18.53.
Surged fare truncated instead of rounded · case 04
A 1.5x fare on 12.35 shows 18.52 instead of 18.53.
Surged fare truncated instead of rounded · case 05
A 1.5x fare on 12.35 shows 18.52 instead of 18.53.
Route exactly 25% longer voids the quote · case 01
A trip precisely at the 25% tolerance is repriced on the meter.
Route exactly 25% longer voids the quote · case 02
A trip precisely at the 25% tolerance is repriced on the meter.
Route exactly 25% longer voids the quote · case 03
A trip precisely at the 25% tolerance is repriced on the meter.
Route exactly 25% longer voids the quote · case 04
A trip precisely at the 25% tolerance is repriced on the meter.
Route exactly 25% longer voids the quote · case 05
A trip precisely at the 25% tolerance is repriced on the meter.
Time tolerance ratio inverted · case 01
Any trip taking more than two thirds of the estimated time is metered.
Time tolerance ratio inverted · case 02
Any trip taking more than two thirds of the estimated time is metered.
Time tolerance ratio inverted · case 03
Any trip taking more than two thirds of the estimated time is metered.
Time tolerance ratio inverted · case 04
Any trip taking more than two thirds of the estimated time is metered.
Time tolerance ratio inverted · case 05
Any trip taking more than two thirds of the estimated time is metered.
Added stop reported instead of destination change · case 01
Receipts cite added stops when the rider also changed the destination.
Added stop reported instead of destination change · case 02
Receipts cite added stops when the rider also changed the destination.
Added stop reported instead of destination change · case 03
Receipts cite added stops when the rider also changed the destination.
Added stop reported instead of destination change · case 04
Receipts cite added stops when the rider also changed the destination.
Added stop reported instead of destination change · case 05
Receipts cite added stops when the rider also changed the destination.
Voided quote recomputed from the estimated distance · case 01
A rider who lengthened the trip pays for the estimated distance.
Voided quote recomputed from the estimated distance · case 02
A rider who lengthened the trip pays for the estimated distance.
Voided quote recomputed from the estimated distance · case 03
A rider who lengthened the trip pays for the estimated distance.
Voided quote recomputed from the estimated distance · case 04
A rider who lengthened the trip pays for the estimated distance.
Voided quote recomputed from the estimated distance · case 05
A rider who lengthened the trip pays for the estimated distance.
Partial wait minutes not billed · case 01
A rider who kept the driver 61 seconds past grace pays for one minute instead of two.
Partial wait minutes not billed · case 02
A rider who kept the driver 61 seconds past grace pays for one minute instead of two.
Partial wait minutes not billed · case 03
A rider who kept the driver 61 seconds past grace pays for one minute instead of two.
Partial wait minutes not billed · case 04
A rider who kept the driver 61 seconds past grace pays for one minute instead of two.
Partial wait minutes not billed · case 05
A rider who kept the driver 61 seconds past grace pays for one minute instead of two.
Early arrival for a scheduled ride billed as rider wait · case 01
A driver arriving five minutes before a scheduled pickup bills the rider for those minutes.
Early arrival for a scheduled ride billed as rider wait · case 02
A driver arriving five minutes before a scheduled pickup bills the rider for those minutes.
Early arrival for a scheduled ride billed as rider wait · case 03
A driver arriving five minutes before a scheduled pickup bills the rider for those minutes.
Early arrival for a scheduled ride billed as rider wait · case 04
A driver arriving five minutes before a scheduled pickup bills the rider for those minutes.
Early arrival for a scheduled ride billed as rider wait · case 05
A driver arriving five minutes before a scheduled pickup bills the rider for those minutes.
Wait cap in minutes compared against cents · case 01
Every wait fee is capped at a few cents.
Wait cap in minutes compared against cents · case 02
Every wait fee is capped at a few cents.
Wait cap in minutes compared against cents · case 03
Every wait fee is capped at a few cents.
Wait cap in minutes compared against cents · case 04
Every wait fee is capped at a few cents.
Wait cap in minutes compared against cents · case 05
Every wait fee is capped at a few cents.
Grace period billed once exceeded · case 01
A wait one second past the grace is billed for the full wait including the free minutes.
Grace period billed once exceeded · case 02
A wait one second past the grace is billed for the full wait including the free minutes.
Grace period billed once exceeded · case 03
A wait one second past the grace is billed for the full wait including the free minutes.
Grace period billed once exceeded · case 04
A wait one second past the grace is billed for the full wait including the free minutes.
Grace period billed once exceeded · case 05
A wait one second past the grace is billed for the full wait including the free minutes.
Rider charged when the driver cancels · case 01
Riders receive cancellation fees for trips the driver cancelled.
Rider charged when the driver cancels · case 02
Riders receive cancellation fees for trips the driver cancelled.
Rider charged when the driver cancels · case 03
Riders receive cancellation fees for trips the driver cancelled.
Rider charged when the driver cancels · case 04
Riders receive cancellation fees for trips the driver cancelled.
Rider charged when the driver cancels · case 05
Riders receive cancellation fees for trips the driver cancelled.
Cancel at the last second of the free window charged · case 01
Cancelling exactly two minutes after acceptance incurs the fee.
Cancel at the last second of the free window charged · case 02
Cancelling exactly two minutes after acceptance incurs the fee.
Cancel at the last second of the free window charged · case 03
Cancelling exactly two minutes after acceptance incurs the fee.
Cancel at the last second of the free window charged · case 04
Cancelling exactly two minutes after acceptance incurs the fee.
Cancel at the last second of the free window charged · case 05
Cancelling exactly two minutes after acceptance incurs the fee.
No-show fee withheld at exactly the waiting limit · case 01
A driver who waited exactly five minutes receives only the regular fee.
No-show fee withheld at exactly the waiting limit · case 02
A driver who waited exactly five minutes receives only the regular fee.
No-show fee withheld at exactly the waiting limit · case 03
A driver who waited exactly five minutes receives only the regular fee.
No-show fee withheld at exactly the waiting limit · case 04
A driver who waited exactly five minutes receives only the regular fee.
No-show fee withheld at exactly the waiting limit · case 05
A driver who waited exactly five minutes receives only the regular fee.
ETA improvement treated as driver lateness · case 01
Riders are charged although the ETA ballooned by ten minutes.
ETA improvement treated as driver lateness · case 02
Riders are charged although the ETA ballooned by ten minutes.
ETA improvement treated as driver lateness · case 03
Riders are charged although the ETA ballooned by ten minutes.
ETA improvement treated as driver lateness · case 04
Riders are charged although the ETA ballooned by ten minutes.
ETA improvement treated as driver lateness · case 05
Riders are charged although the ETA ballooned by ten minutes.
Driver considered late the moment the ETA passes · case 01
Riders cancelling a few seconds after the ETA get a free cancel.
Driver considered late the moment the ETA passes · case 02
Riders cancelling a few seconds after the ETA get a free cancel.
Driver considered late the moment the ETA passes · case 03
Riders cancelling a few seconds after the ETA get a free cancel.
Driver considered late the moment the ETA passes · case 04
Riders cancelling a few seconds after the ETA get a free cancel.
Driver considered late the moment the ETA passes · case 05
Riders cancelling a few seconds after the ETA get a free cancel.
Shared zone border belongs to both zones · case 01
A pickup on the border between two zones picks up the neighbor's surge.
Shared zone border belongs to both zones · case 02
A pickup on the border between two zones picks up the neighbor's surge.
Shared zone border belongs to both zones · case 03
A pickup on the border between two zones picks up the neighbor's surge.
Shared zone border belongs to both zones · case 04
A pickup on the border between two zones picks up the neighbor's surge.
Shared zone border belongs to both zones · case 05
A pickup on the border between two zones picks up the neighbor's surge.
Surge taken from the dropoff zone · case 01
Riders heading into a surging stadium zone pay its surge from a calm neighborhood.
Surge taken from the dropoff zone · case 02
Riders heading into a surging stadium zone pay its surge from a calm neighborhood.
Surge taken from the dropoff zone · case 03
Riders heading into a surging stadium zone pay its surge from a calm neighborhood.
Surge taken from the dropoff zone · case 04
Riders heading into a surging stadium zone pay its surge from a calm neighborhood.
Surge taken from the dropoff zone · case 05
Riders heading into a surging stadium zone pay its surge from a calm neighborhood.
Highest multiplier overrides zone priority · case 01
An event overlay with priority 2 loses to a base zone with a higher multiplier.
Highest multiplier overrides zone priority · case 02
An event overlay with priority 2 loses to a base zone with a higher multiplier.
Highest multiplier overrides zone priority · case 03
An event overlay with priority 2 loses to a base zone with a higher multiplier.
Highest multiplier overrides zone priority · case 04
An event overlay with priority 2 loses to a base zone with a higher multiplier.
Highest multiplier overrides zone priority · case 05
An event overlay with priority 2 loses to a base zone with a higher multiplier.
Equal zones resolved to the highest id · case 01
Receipts cite a different zone id than the zone map for identical overlaps.
Equal zones resolved to the highest id · case 02
Receipts cite a different zone id than the zone map for identical overlaps.
Equal zones resolved to the highest id · case 03
Receipts cite a different zone id than the zone map for identical overlaps.
Equal zones resolved to the highest id · case 04
Receipts cite a different zone id than the zone map for identical overlaps.
Equal zones resolved to the highest id · case 05
Receipts cite a different zone id than the zone map for identical overlaps.
Pickup outside every zone gets a zero multiplier · case 01
Trips starting outside the zone map are priced at zero.
Pickup outside every zone gets a zero multiplier · case 02
Trips starting outside the zone map are priced at zero.
Pickup outside every zone gets a zero multiplier · case 03
Trips starting outside the zone map are priced at zero.
Pickup outside every zone gets a zero multiplier · case 04
Trips starting outside the zone map are priced at zero.
Pickup outside every zone gets a zero multiplier · case 05
Trips starting outside the zone map are priced at zero.
UTC offset applied in the wrong direction · case 01
A city behind UTC gets its evening rush card in the early afternoon.
UTC offset applied in the wrong direction · case 02
A city behind UTC gets its evening rush card in the early afternoon.
UTC offset applied in the wrong direction · case 03
A city behind UTC gets its evening rush card in the early afternoon.
UTC offset applied in the wrong direction · case 04
A city behind UTC gets its evening rush card in the early afternoon.
UTC offset applied in the wrong direction · case 05
A city behind UTC gets its evening rush card in the early afternoon.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗