Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Reserve schedule: hidden reserve redaction · case 01
Reserve disclosure ignores its seller-approved visibility mode.
Reserve schedule: hidden reserve redaction · case 02
Reserve disclosure ignores its seller-approved visibility mode.
Reserve schedule: hidden reserve redaction · case 03
Reserve disclosure ignores its seller-approved visibility mode.
Reserve schedule: hidden reserve redaction · case 04
Reserve disclosure ignores its seller-approved visibility mode.
Reserve schedule: hidden reserve redaction · case 05
Reserve disclosure ignores its seller-approved visibility mode.
Reserve schedule: reserve freeze · case 01
A frozen reserve is overwritten by a late seller amendment.
Reserve schedule: reserve freeze · case 02
A frozen reserve is overwritten by a late seller amendment.
Reserve schedule: reserve freeze · case 03
A frozen reserve is overwritten by a late seller amendment.
Reserve schedule: reserve freeze · case 04
A frozen reserve is overwritten by a late seller amendment.
Reserve schedule: reserve freeze · case 05
A frozen reserve is overwritten by a late seller amendment.
Reserve schedule: reserve lower bound · case 01
Reserve admission drops one independently binding lower bound.
Reserve schedule: reserve lower bound · case 02
Reserve admission drops one independently binding lower bound.
Reserve schedule: reserve lower bound · case 03
Reserve admission drops one independently binding lower bound.
Reserve schedule: reserve lower bound · case 04
Reserve admission drops one independently binding lower bound.
Reserve schedule: reserve lower bound · case 05
Reserve admission drops one independently binding lower bound.
Reserve schedule: reserve range admission · case 01
A reserve range check enforces only one side of the approved interval.
Reserve schedule: reserve range admission · case 02
A reserve range check enforces only one side of the approved interval.
Reserve schedule: reserve range admission · case 03
A reserve range check enforces only one side of the approved interval.
Reserve schedule: reserve range admission · case 04
A reserve range check enforces only one side of the approved interval.
Reserve schedule: reserve range admission · case 05
A reserve range check enforces only one side of the approved interval.
Reserve schedule: whole lot reserve · case 01
Whole-lot reserve ignores either lot minimum or number of units.
Reserve schedule: whole lot reserve · case 02
Whole-lot reserve ignores either lot minimum or number of units.
Reserve schedule: whole lot reserve · case 03
Whole-lot reserve ignores either lot minimum or number of units.
Reserve schedule: whole lot reserve · case 04
Whole-lot reserve ignores either lot minimum or number of units.
Reserve schedule: whole lot reserve · case 05
Whole-lot reserve ignores either lot minimum or number of units.
Reserve schedule: reserve not a bidder · case 01
A reserve placeholder is counted as auction participation.
Reserve schedule: reserve not a bidder · case 02
A reserve placeholder is counted as auction participation.
Reserve schedule: reserve not a bidder · case 03
A reserve placeholder is counted as auction participation.
Reserve schedule: reserve not a bidder · case 04
A reserve placeholder is counted as auction participation.
Reserve schedule: reserve not a bidder · case 05
A reserve placeholder is counted as auction participation.
Reserve schedule: withdrawn reserve amendment · case 01
A withdrawn seller reserve amendment still replaces the binding reserve.
Reserve schedule: withdrawn reserve amendment · case 02
A withdrawn seller reserve amendment still replaces the binding reserve.
Reserve schedule: withdrawn reserve amendment · case 03
A withdrawn seller reserve amendment still replaces the binding reserve.
Reserve schedule: withdrawn reserve amendment · case 04
A withdrawn seller reserve amendment still replaces the binding reserve.
Reserve schedule: withdrawn reserve amendment · case 05
A withdrawn seller reserve amendment still replaces the binding reserve.
Reserve schedule: grant round activation · case 01
Reserve amendment approval is confused with its effective auction round.
Reserve schedule: grant round activation · case 02
Reserve amendment approval is confused with its effective auction round.
Reserve schedule: grant round activation · case 03
Reserve amendment approval is confused with its effective auction round.
Reserve schedule: grant round activation · case 04
Reserve amendment approval is confused with its effective auction round.
Reserve schedule: grant round activation · case 05
Reserve amendment approval is confused with its effective auction round.
Award installments: due installments · case 01
Future installments are due immediately or the current due tick is skipped.
Award installments: due installments · case 02
Future installments are due immediately or the current due tick is skipped.
Award installments: due installments · case 03
Future installments are due immediately or the current due tick is skipped.
Award installments: due installments · case 04
Future installments are due immediately or the current due tick is skipped.
Award installments: due installments · case 05
Future installments are due immediately or the current due tick is skipped.
Award installments: oldest tranche credit · case 01
Paid credits are reused for each installment or allocated in reverse maturity order.
Award installments: oldest tranche credit · case 02
Paid credits are reused for each installment or allocated in reverse maturity order.
Award installments: oldest tranche credit · case 03
Paid credits are reused for each installment or allocated in reverse maturity order.
Award installments: oldest tranche credit · case 04
Paid credits are reused for each installment or allocated in reverse maturity order.
Award installments: oldest tranche credit · case 05
Paid credits are reused for each installment or allocated in reverse maturity order.
Award installments: delivery tranche threshold · case 01
Delivery threshold ignores earlier required tranches or waits for every tranche.
Award installments: delivery tranche threshold · case 02
Delivery threshold ignores earlier required tranches or waits for every tranche.
Award installments: delivery tranche threshold · case 03
Delivery threshold ignores earlier required tranches or waits for every tranche.
Award installments: delivery tranche threshold · case 04
Delivery threshold ignores earlier required tranches or waits for every tranche.
Award installments: delivery tranche threshold · case 05
Delivery threshold ignores earlier required tranches or waits for every tranche.
Award installments: disputed tranche hold · case 01
One disputed installment freezes the wrong proceeds.
Award installments: disputed tranche hold · case 02
One disputed installment freezes the wrong proceeds.
Award installments: disputed tranche hold · case 03
One disputed installment freezes the wrong proceeds.
Award installments: disputed tranche hold · case 04
One disputed installment freezes the wrong proceeds.
Award installments: disputed tranche hold · case 05
One disputed installment freezes the wrong proceeds.
Award installments: waived tranche obligation · case 01
Waiving one award tranche waives the entire award or changes no obligation.
Award installments: waived tranche obligation · case 02
Waiving one award tranche waives the entire award or changes no obligation.
Award installments: waived tranche obligation · case 03
Waiving one award tranche waives the entire award or changes no obligation.
Award installments: waived tranche obligation · case 04
Waiving one award tranche waives the entire award or changes no obligation.
Award installments: waived tranche obligation · case 05
Waiving one award tranche waives the entire award or changes no obligation.
Award installments: refundable paid installments · case 01
Installment refunds reuse already refunded credits.
Award installments: refundable paid installments · case 02
Installment refunds reuse already refunded credits.
Award installments: refundable paid installments · case 03
Installment refunds reuse already refunded credits.
Award installments: refundable paid installments · case 04
Installment refunds reuse already refunded credits.
Award installments: refundable paid installments · case 05
Installment refunds reuse already refunded credits.
Award installments: cancel future collection · case 01
Cancelled award installments remain scheduled for collection.
Award installments: cancel future collection · case 02
Cancelled award installments remain scheduled for collection.
Award installments: cancel future collection · case 03
Cancelled award installments remain scheduled for collection.
Award installments: cancel future collection · case 04
Cancelled award installments remain scheduled for collection.
Award installments: cancel future collection · case 05
Cancelled award installments remain scheduled for collection.
Award installments: accelerated maturity · case 01
Acceleration leaves future due dates unchanged or rewrites past maturities.
Award installments: accelerated maturity · case 02
Acceleration leaves future due dates unchanged or rewrites past maturities.
Award installments: accelerated maturity · case 03
Acceleration leaves future due dates unchanged or rewrites past maturities.
Award installments: accelerated maturity · case 04
Acceleration leaves future due dates unchanged or rewrites past maturities.
Award installments: accelerated maturity · case 05
Acceleration leaves future due dates unchanged or rewrites past maturities.
Award installments: deposit credit once · case 01
An award deposit is credited twice into installment payments.
Award installments: deposit credit once · case 02
An award deposit is credited twice into installment payments.
Award installments: deposit credit once · case 03
An award deposit is credited twice into installment payments.
Award installments: deposit credit once · case 04
An award deposit is credited twice into installment payments.
Award installments: deposit credit once · case 05
An award deposit is credited twice into installment payments.
Award installments: excess installment credit · case 01
Overpayment disposition ignores waived award tranches or refunds credits still needed for future installments.
Award installments: excess installment credit · case 02
Overpayment disposition ignores waived award tranches or refunds credits still needed for future installments.
Award installments: excess installment credit · case 03
Overpayment disposition ignores waived award tranches or refunds credits still needed for future installments.
Award installments: excess installment credit · case 04
Overpayment disposition ignores waived award tranches or refunds credits still needed for future installments.
Award installments: excess installment credit · case 05
Overpayment disposition ignores waived award tranches or refunds credits still needed for future installments.
Award assignment: three party consent · case 01
A proposed assignee is bound without its acceptance or the transferor consents.
Award assignment: three party consent · case 02
A proposed assignee is bound without its acceptance or the transferor consents.
Award assignment: three party consent · case 03
A proposed assignee is bound without its acceptance or the transferor consents.
Award assignment: three party consent · case 04
A proposed assignee is bound without its acceptance or the transferor consents.
Award assignment: three party consent · case 05
A proposed assignee is bound without its acceptance or the transferor consents.
Award assignment: undelivered assignment cap · case 01
Assignment transfers units already delivered under the award.
Award assignment: undelivered assignment cap · case 02
Assignment transfers units already delivered under the award.
Award assignment: undelivered assignment cap · case 03
Assignment transfers units already delivered under the award.
Award assignment: undelivered assignment cap · case 04
Assignment transfers units already delivered under the award.
Award assignment: undelivered assignment cap · case 05
Assignment transfers units already delivered under the award.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗