Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Periodic weighted average with vendor returns: count validity bound · case 01
A physical count that includes goods already returned to the vendor is accepted.
Periodic weighted average with vendor returns: count validity bound · case 02
A physical count that includes goods already returned to the vendor is accepted.
Periodic weighted average with vendor returns: count validity bound · case 03
A physical count that includes goods already returned to the vendor is accepted.
Periodic weighted average with vendor returns: count validity bound · case 04
A physical count that includes goods already returned to the vendor is accepted.
Periodic weighted average with vendor returns: count validity bound · case 05
A physical count that includes goods already returned to the vendor is accepted.
Periodic weighted average with vendor returns: COGS rounding leak · case 01
Ending inventory plus COGS no longer equals goods available by a cent.
Periodic weighted average with vendor returns: COGS rounding leak · case 02
Ending inventory plus COGS no longer equals goods available by a cent.
Periodic weighted average with vendor returns: COGS rounding leak · case 03
Ending inventory plus COGS no longer equals goods available by a cent.
Periodic weighted average with vendor returns: COGS rounding leak · case 04
Ending inventory plus COGS no longer equals goods available by a cent.
Periodic weighted average with vendor returns: COGS rounding leak · case 05
Ending inventory plus COGS no longer equals goods available by a cent.
Period-end ownership cutoff adjustments: inbound title terms · case 01
Purchases shipped FOB shipping point are missing from year-end inventory while FOB destination goods still at sea are added.
Period-end ownership cutoff adjustments: inbound title terms · case 02
Purchases shipped FOB shipping point are missing from year-end inventory while FOB destination goods still at sea are added.
Period-end ownership cutoff adjustments: inbound title terms · case 03
Purchases shipped FOB shipping point are missing from year-end inventory while FOB destination goods still at sea are added.
Period-end ownership cutoff adjustments: inbound title terms · case 04
Purchases shipped FOB shipping point are missing from year-end inventory while FOB destination goods still at sea are added.
Period-end ownership cutoff adjustments: inbound title terms · case 05
Purchases shipped FOB shipping point are missing from year-end inventory while FOB destination goods still at sea are added.
Period-end ownership cutoff adjustments: shipment date cutoff · case 01
Goods shipped on the last day of the period are left out of the cutoff adjustment.
Period-end ownership cutoff adjustments: shipment date cutoff · case 02
Goods shipped on the last day of the period are left out of the cutoff adjustment.
Period-end ownership cutoff adjustments: shipment date cutoff · case 03
Goods shipped on the last day of the period are left out of the cutoff adjustment.
Period-end ownership cutoff adjustments: shipment date cutoff · case 04
Goods shipped on the last day of the period are left out of the cutoff adjustment.
Period-end ownership cutoff adjustments: shipment date cutoff · case 05
Goods shipped on the last day of the period are left out of the cutoff adjustment.
Period-end ownership cutoff adjustments: undelivered arrival test · case 01
Shipments with no recorded arrival are treated as already received and never adjusted.
Period-end ownership cutoff adjustments: undelivered arrival test · case 02
Shipments with no recorded arrival are treated as already received and never adjusted.
Period-end ownership cutoff adjustments: undelivered arrival test · case 03
Shipments with no recorded arrival are treated as already received and never adjusted.
Period-end ownership cutoff adjustments: undelivered arrival test · case 04
Shipments with no recorded arrival are treated as already received and never adjusted.
Period-end ownership cutoff adjustments: undelivered arrival test · case 05
Shipments with no recorded arrival are treated as already received and never adjusted.
Period-end ownership cutoff adjustments: outbound title terms · case 01
Sales shipped FOB shipping point are added back to inventory although title passed to the customer.
Period-end ownership cutoff adjustments: outbound title terms · case 02
Sales shipped FOB shipping point are added back to inventory although title passed to the customer.
Period-end ownership cutoff adjustments: outbound title terms · case 03
Sales shipped FOB shipping point are added back to inventory although title passed to the customer.
Period-end ownership cutoff adjustments: outbound title terms · case 04
Sales shipped FOB shipping point are added back to inventory although title passed to the customer.
Period-end ownership cutoff adjustments: outbound title terms · case 05
Sales shipped FOB shipping point are added back to inventory although title passed to the customer.
Period-end ownership cutoff adjustments: consigned-out direction · case 01
Goods held by consignees are deducted from inventory instead of added.
Period-end ownership cutoff adjustments: consigned-out direction · case 02
Goods held by consignees are deducted from inventory instead of added.
Period-end ownership cutoff adjustments: consigned-out direction · case 03
Goods held by consignees are deducted from inventory instead of added.
Period-end ownership cutoff adjustments: consigned-out direction · case 04
Goods held by consignees are deducted from inventory instead of added.
Period-end ownership cutoff adjustments: consigned-out direction · case 05
Goods held by consignees are deducted from inventory instead of added.
Period-end ownership cutoff adjustments: bill-and-hold exclusion · case 01
Goods sold on bill-and-hold terms remain in inventory because they sit in the warehouse.
Period-end ownership cutoff adjustments: bill-and-hold exclusion · case 02
Goods sold on bill-and-hold terms remain in inventory because they sit in the warehouse.
Period-end ownership cutoff adjustments: bill-and-hold exclusion · case 03
Goods sold on bill-and-hold terms remain in inventory because they sit in the warehouse.
Period-end ownership cutoff adjustments: bill-and-hold exclusion · case 04
Goods sold on bill-and-hold terms remain in inventory because they sit in the warehouse.
Period-end ownership cutoff adjustments: bill-and-hold exclusion · case 05
Goods sold on bill-and-hold terms remain in inventory because they sit in the warehouse.
Order points earning: gift card exclusion · case 01
Members earn points on gift card purchases, which later earn again when the card is spent.
Order points earning: gift card exclusion · case 02
Members earn points on gift card purchases, which later earn again when the card is spent.
Order points earning: gift card exclusion · case 03
Members earn points on gift card purchases, which later earn again when the card is spent.
Order points earning: gift card exclusion · case 04
Members earn points on gift card purchases, which later earn again when the card is spent.
Order points earning: gift card exclusion · case 05
Members earn points on gift card purchases, which later earn again when the card is spent.
Order points earning: earning on order total · case 01
Tax and shipping charges earn points.
Order points earning: earning on order total · case 02
Tax and shipping charges earn points.
Order points earning: earning on order total · case 03
Tax and shipping charges earn points.
Order points earning: earning on order total · case 04
Tax and shipping charges earn points.
Order points earning: earning on order total · case 05
Tax and shipping charges earn points.
Order points earning: minimum spend boundary · case 01
An order of exactly five dollars of eligible spend earns nothing.
Order points earning: minimum spend boundary · case 02
An order of exactly five dollars of eligible spend earns nothing.
Order points earning: minimum spend boundary · case 03
An order of exactly five dollars of eligible spend earns nothing.
Order points earning: minimum spend boundary · case 04
An order of exactly five dollars of eligible spend earns nothing.
Order points earning: minimum spend boundary · case 05
An order of exactly five dollars of eligible spend earns nothing.
Order points earning: per-order flooring · case 01
Orders with many small lines earn fewer points than one line of the same total.
Order points earning: per-order flooring · case 02
Orders with many small lines earn fewer points than one line of the same total.
Order points earning: per-order flooring · case 03
Orders with many small lines earn fewer points than one line of the same total.
Order points earning: per-order flooring · case 04
Orders with many small lines earn fewer points than one line of the same total.
Order points earning: per-order flooring · case 05
Orders with many small lines earn fewer points than one line of the same total.
Order points earning: tier multiplier base · case 01
Silver and gold members receive tier points computed from cents rather than base points, off by fractional points.
Order points earning: tier multiplier base · case 02
Silver and gold members receive tier points computed from cents rather than base points, off by fractional points.
Order points earning: tier multiplier base · case 03
Silver and gold members receive tier points computed from cents rather than base points, off by fractional points.
Order points earning: tier multiplier base · case 04
Silver and gold members receive tier points computed from cents rather than base points, off by fractional points.
Order points earning: tier multiplier base · case 05
Silver and gold members receive tier points computed from cents rather than base points, off by fractional points.
Order points earning: order bonus cap · case 01
Large promotional orders receive unlimited bonus points.
Order points earning: order bonus cap · case 02
Large promotional orders receive unlimited bonus points.
Order points earning: order bonus cap · case 03
Large promotional orders receive unlimited bonus points.
Order points earning: order bonus cap · case 04
Large promotional orders receive unlimited bonus points.
Order points earning: order bonus cap · case 05
Large promotional orders receive unlimited bonus points.
Order points earning: promo multiplier increment · case 01
Promotional categories earn their base points twice.
Order points earning: promo multiplier increment · case 02
Promotional categories earn their base points twice.
Order points earning: promo multiplier increment · case 03
Promotional categories earn their base points twice.
Order points earning: promo multiplier increment · case 04
Promotional categories earn their base points twice.
Order points earning: promo multiplier increment · case 05
Promotional categories earn their base points twice.
Expiring point lots: usable through expiry day · case 01
Points cannot be redeemed on the day printed as their expiry date.
Expiring point lots: usable through expiry day · case 02
Points cannot be redeemed on the day printed as their expiry date.
Expiring point lots: usable through expiry day · case 03
Points cannot be redeemed on the day printed as their expiry date.
Expiring point lots: usable through expiry day · case 04
Points cannot be redeemed on the day printed as their expiry date.
Expiring point lots: usable through expiry day · case 05
Points cannot be redeemed on the day printed as their expiry date.
Expiring point lots: sweep cutoff · case 01
The nightly sweep removes points on their last valid day.
Expiring point lots: sweep cutoff · case 02
The nightly sweep removes points on their last valid day.
Expiring point lots: sweep cutoff · case 03
The nightly sweep removes points on their last valid day.
Expiring point lots: sweep cutoff · case 04
The nightly sweep removes points on their last valid day.
Expiring point lots: sweep cutoff · case 05
The nightly sweep removes points on their last valid day.
Expiring point lots: redemption lot order · case 01
Short-lived promotional points expire unused while long-lived points are spent first.
Expiring point lots: redemption lot order · case 02
Short-lived promotional points expire unused while long-lived points are spent first.
Expiring point lots: redemption lot order · case 03
Short-lived promotional points expire unused while long-lived points are spent first.
Expiring point lots: redemption lot order · case 04
Short-lived promotional points expire unused while long-lived points are spent first.
Expiring point lots: redemption lot order · case 05
Short-lived promotional points expire unused while long-lived points are spent first.
Expiring point lots: expiry date computation · case 01
Lots expire on an absolute day equal to their time-to-live, long before or after the intended date.
Expiring point lots: expiry date computation · case 02
Lots expire on an absolute day equal to their time-to-live, long before or after the intended date.
Expiring point lots: expiry date computation · case 03
Lots expire on an absolute day equal to their time-to-live, long before or after the intended date.
Expiring point lots: expiry date computation · case 04
Lots expire on an absolute day equal to their time-to-live, long before or after the intended date.
Expiring point lots: expiry date computation · case 05
Lots expire on an absolute day equal to their time-to-live, long before or after the intended date.
Expiring point lots: availability pool · case 01
A redemption is accepted against expired points and then only partly filled.
Expiring point lots: availability pool · case 02
A redemption is accepted against expired points and then only partly filled.
Expiring point lots: availability pool · case 03
A redemption is accepted against expired points and then only partly filled.
Expiring point lots: availability pool · case 04
A redemption is accepted against expired points and then only partly filled.
Expiring point lots: availability pool · case 05
A redemption is accepted against expired points and then only partly filled.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗