Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Ride credits consumed on the pre-discount fare · case 01
A rider with credits and a promo is charged negative amounts and loses credit balance.
Ride credits consumed on the pre-discount fare · case 02
A rider with credits and a promo is charged negative amounts and loses credit balance.
Ride credits consumed on the pre-discount fare · case 03
A rider with credits and a promo is charged negative amounts and loses credit balance.
Ride credits consumed on the pre-discount fare · case 04
A rider with credits and a promo is charged negative amounts and loses credit balance.
Ride credits consumed on the pre-discount fare · case 05
A rider with credits and a promo is charged negative amounts and loses credit balance.
Fare exactly at the promo minimum rejected · case 01
A 10.00 ride fails a 10.00 minimum-spend promo.
Fare exactly at the promo minimum rejected · case 02
A 10.00 ride fails a 10.00 minimum-spend promo.
Fare exactly at the promo minimum rejected · case 03
A 10.00 ride fails a 10.00 minimum-spend promo.
Fare exactly at the promo minimum rejected · case 04
A 10.00 ride fails a 10.00 minimum-spend promo.
Fare exactly at the promo minimum rejected · case 05
A 10.00 ride fails a 10.00 minimum-spend promo.
Quote honored at the exact expiry second · case 01
A request exactly five minutes after the quote still uses the locked surge.
Quote honored at the exact expiry second · case 02
A request exactly five minutes after the quote still uses the locked surge.
Quote honored at the exact expiry second · case 03
A request exactly five minutes after the quote still uses the locked surge.
Quote honored at the exact expiry second · case 04
A request exactly five minutes after the quote still uses the locked surge.
Quote honored at the exact expiry second · case 05
A request exactly five minutes after the quote still uses the locked surge.
Locked quote ignores a lower current surge · case 01
Riders pay the quoted 2.0x after surge dropped to 1.2x.
Locked quote ignores a lower current surge · case 02
Riders pay the quoted 2.0x after surge dropped to 1.2x.
Locked quote ignores a lower current surge · case 03
Riders pay the quoted 2.0x after surge dropped to 1.2x.
Locked quote ignores a lower current surge · case 04
Riders pay the quoted 2.0x after surge dropped to 1.2x.
Locked quote ignores a lower current surge · case 05
Riders pay the quoted 2.0x after surge dropped to 1.2x.
Request stamped before its quote treated as locked · case 01
Replayed or skewed requests reuse quotes that were not yet issued.
Request stamped before its quote treated as locked · case 02
Replayed or skewed requests reuse quotes that were not yet issued.
Request stamped before its quote treated as locked · case 03
Replayed or skewed requests reuse quotes that were not yet issued.
Request stamped before its quote treated as locked · case 04
Replayed or skewed requests reuse quotes that were not yet issued.
Request stamped before its quote treated as locked · case 05
Replayed or skewed requests reuse quotes that were not yet issued.
Flat fare only applies in the stored direction · case 01
Downtown-to-airport trips are metered while airport-to-downtown is flat.
Flat fare only applies in the stored direction · case 02
Downtown-to-airport trips are metered while airport-to-downtown is flat.
Flat fare only applies in the stored direction · case 03
Downtown-to-airport trips are metered while airport-to-downtown is flat.
Flat fare only applies in the stored direction · case 04
Downtown-to-airport trips are metered while airport-to-downtown is flat.
Flat fare only applies in the stored direction · case 05
Downtown-to-airport trips are metered while airport-to-downtown is flat.
Surge applied to a flat airport fare · case 01
The advertised 45.00 airport flat becomes 90.00 during surge.
Surge applied to a flat airport fare · case 02
The advertised 45.00 airport flat becomes 90.00 during surge.
Surge applied to a flat airport fare · case 03
The advertised 45.00 airport flat becomes 90.00 during surge.
Surge applied to a flat airport fare · case 04
The advertised 45.00 airport flat becomes 90.00 during surge.
Surge applied to a flat airport fare · case 05
The advertised 45.00 airport flat becomes 90.00 during surge.
Lower-case zone names miss the flat table · case 01
A pickup reported as "air" is metered and skips the airport fee.
Lower-case zone names miss the flat table · case 02
A pickup reported as "air" is metered and skips the airport fee.
Lower-case zone names miss the flat table · case 03
A pickup reported as "air" is metered and skips the airport fee.
Lower-case zone names miss the flat table · case 04
A pickup reported as "air" is metered and skips the airport fee.
Lower-case zone names miss the flat table · case 05
A pickup reported as "air" is metered and skips the airport fee.
Airport dropoff charged the pickup fee · case 01
Trips to the airport are charged the higher pickup fee.
Airport dropoff charged the pickup fee · case 02
Trips to the airport are charged the higher pickup fee.
Airport dropoff charged the pickup fee · case 03
Trips to the airport are charged the higher pickup fee.
Airport dropoff charged the pickup fee · case 04
Trips to the airport are charged the higher pickup fee.
Airport dropoff charged the pickup fee · case 05
Trips to the airport are charged the higher pickup fee.
Request exactly one window old still counted · case 01
Requests from exactly ten minutes ago keep inflating demand.
Request exactly one window old still counted · case 02
Requests from exactly ten minutes ago keep inflating demand.
Request exactly one window old still counted · case 03
Requests from exactly ten minutes ago keep inflating demand.
Request exactly one window old still counted · case 04
Requests from exactly ten minutes ago keep inflating demand.
Request exactly one window old still counted · case 05
Requests from exactly ten minutes ago keep inflating demand.
Rider counted in every zone they requested from · case 01
A rider re-requesting after walking to another zone counts twice.
Rider counted in every zone they requested from · case 02
A rider re-requesting after walking to another zone counts twice.
Rider counted in every zone they requested from · case 03
A rider re-requesting after walking to another zone counts twice.
Rider counted in every zone they requested from · case 04
A rider re-requesting after walking to another zone counts twice.
Rider counted in every zone they requested from · case 05
A rider re-requesting after walking to another zone counts twice.
Rider attributed to their first requested zone · case 01
Demand stays in the zone the rider left.
Rider attributed to their first requested zone · case 02
Demand stays in the zone the rider left.
Rider attributed to their first requested zone · case 03
Demand stays in the zone the rider left.
Rider attributed to their first requested zone · case 04
Demand stays in the zone the rider left.
Rider attributed to their first requested zone · case 05
Demand stays in the zone the rider left.
Requests stamped after now counted · case 01
Scheduled or skewed requests stamped in the future raise current demand.
Requests stamped after now counted · case 02
Scheduled or skewed requests stamped in the future raise current demand.
Requests stamped after now counted · case 03
Scheduled or skewed requests stamped in the future raise current demand.
Requests stamped after now counted · case 04
Scheduled or skewed requests stamped in the future raise current demand.
Requests stamped after now counted · case 05
Scheduled or skewed requests stamped in the future raise current demand.
Whole pickup distance billed once past the threshold · case 01
A 6 km pickup is charged for all 6 km instead of the 1.2 km beyond the threshold.
Whole pickup distance billed once past the threshold · case 02
A 6 km pickup is charged for all 6 km instead of the 1.2 km beyond the threshold.
Whole pickup distance billed once past the threshold · case 03
A 6 km pickup is charged for all 6 km instead of the 1.2 km beyond the threshold.
Whole pickup distance billed once past the threshold · case 04
A 6 km pickup is charged for all 6 km instead of the 1.2 km beyond the threshold.
Whole pickup distance billed once past the threshold · case 05
A 6 km pickup is charged for all 6 km instead of the 1.2 km beyond the threshold.
Quick long pickup reduces the distance fee · case 01
A fast long-distance pickup gets a negative time component that offsets the distance fee.
Quick long pickup reduces the distance fee · case 02
A fast long-distance pickup gets a negative time component that offsets the distance fee.
Quick long pickup reduces the distance fee · case 03
A fast long-distance pickup gets a negative time component that offsets the distance fee.
Quick long pickup reduces the distance fee · case 04
A fast long-distance pickup gets a negative time component that offsets the distance fee.
Quick long pickup reduces the distance fee · case 05
A fast long-distance pickup gets a negative time component that offsets the distance fee.
Partial pickup minutes not compensated · case 01
Drivers get nothing for the first 59 seconds beyond the time threshold.
Partial pickup minutes not compensated · case 02
Drivers get nothing for the first 59 seconds beyond the time threshold.
Partial pickup minutes not compensated · case 03
Drivers get nothing for the first 59 seconds beyond the time threshold.
Partial pickup minutes not compensated · case 04
Drivers get nothing for the first 59 seconds beyond the time threshold.
Partial pickup minutes not compensated · case 05
Drivers get nothing for the first 59 seconds beyond the time threshold.
Low estimate rounded to the nearest dollar · case 01
The low end of the range can exceed 90% of the estimate.
Low estimate rounded to the nearest dollar · case 02
The low end of the range can exceed 90% of the estimate.
Low estimate rounded to the nearest dollar · case 03
The low end of the range can exceed 90% of the estimate.
Low estimate rounded to the nearest dollar · case 04
The low end of the range can exceed 90% of the estimate.
Low estimate rounded to the nearest dollar · case 05
The low end of the range can exceed 90% of the estimate.
High estimate floored below 110% · case 01
Final fares land above the displayed range more often than expected.
High estimate floored below 110% · case 02
Final fares land above the displayed range more often than expected.
High estimate floored below 110% · case 03
Final fares land above the displayed range more often than expected.
High estimate floored below 110% · case 04
Final fares land above the displayed range more often than expected.
High estimate floored below 110% · case 05
Final fares land above the displayed range more often than expected.
Range narrower than two dollars shown · case 01
Short trips show a 1.00-wide range that the contract forbids.
Range narrower than two dollars shown · case 02
Short trips show a 1.00-wide range that the contract forbids.
Range narrower than two dollars shown · case 03
Short trips show a 1.00-wide range that the contract forbids.
Range narrower than two dollars shown · case 04
Short trips show a 1.00-wide range that the contract forbids.
Range narrower than two dollars shown · case 05
Short trips show a 1.00-wide range that the contract forbids.
Minimum fare applied after the width adjustment · case 01
Short trips show a range whose low end equals the high end.
Minimum fare applied after the width adjustment · case 02
Short trips show a range whose low end equals the high end.
Minimum fare applied after the width adjustment · case 03
Short trips show a range whose low end equals the high end.
Minimum fare applied after the width adjustment · case 04
Short trips show a range whose low end equals the high end.
Minimum fare applied after the width adjustment · case 05
Short trips show a range whose low end equals the high end.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗