Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Soft close: hard stop cap · case 01
Soft-close extensions overrun the immutable hard stop.
Soft close: hard stop cap · case 02
Soft-close extensions overrun the immutable hard stop.
Soft close: hard stop cap · case 03
Soft-close extensions overrun the immutable hard stop.
Soft close: hard stop cap · case 04
Soft-close extensions overrun the immutable hard stop.
Soft close: hard stop cap · case 05
Soft-close extensions overrun the immutable hard stop.
Soft close: eligible bid extension · case 01
Withdrawn or rejected offers keep postponing auction closure.
Soft close: eligible bid extension · case 02
Withdrawn or rejected offers keep postponing auction closure.
Soft close: eligible bid extension · case 03
Withdrawn or rejected offers keep postponing auction closure.
Soft close: eligible bid extension · case 04
Withdrawn or rejected offers keep postponing auction closure.
Soft close: eligible bid extension · case 05
Withdrawn or rejected offers keep postponing auction closure.
Soft close: extension budget · case 01
Extension count authorizes one extra postponement.
Soft close: extension budget · case 02
Extension count authorizes one extra postponement.
Soft close: extension budget · case 03
Extension count authorizes one extra postponement.
Soft close: extension budget · case 04
Extension count authorizes one extra postponement.
Soft close: extension budget · case 05
Extension count authorizes one extra postponement.
Soft close: timely submission · case 01
Admission latency rejects a bid submitted before the deadline.
Soft close: timely submission · case 02
Admission latency rejects a bid submitted before the deadline.
Soft close: timely submission · case 03
Admission latency rejects a bid submitted before the deadline.
Soft close: timely submission · case 04
Admission latency rejects a bid submitted before the deadline.
Soft close: timely submission · case 05
Admission latency rejects a bid submitted before the deadline.
Soft close: paused deadline · case 01
Pause compensation applies while running or exceeds the hard stop.
Soft close: paused deadline · case 02
Pause compensation applies while running or exceeds the hard stop.
Soft close: paused deadline · case 03
Pause compensation applies while running or exceeds the hard stop.
Soft close: paused deadline · case 04
Pause compensation applies while running or exceeds the hard stop.
Soft close: paused deadline · case 05
Pause compensation applies while running or exceeds the hard stop.
Soft close: quiet period close · case 01
Quiet-period close ignores a newer last-bid grace obligation.
Soft close: quiet period close · case 02
Quiet-period close ignores a newer last-bid grace obligation.
Soft close: quiet period close · case 03
Quiet-period close ignores a newer last-bid grace obligation.
Soft close: quiet period close · case 04
Quiet-period close ignores a newer last-bid grace obligation.
Soft close: quiet period close · case 05
Quiet-period close ignores a newer last-bid grace obligation.
Soft close: new batch extensions · case 01
Batch replay consumes another extension for an already processed bid.
Soft close: new batch extensions · case 02
Batch replay consumes another extension for an already processed bid.
Soft close: new batch extensions · case 03
Batch replay consumes another extension for an already processed bid.
Soft close: new batch extensions · case 04
Batch replay consumes another extension for an already processed bid.
Soft close: new batch extensions · case 05
Batch replay consumes another extension for an already processed bid.
Soft close: paused close event · case 01
A timer closes a paused auction or misses the exact close tick.
Soft close: paused close event · case 02
A timer closes a paused auction or misses the exact close tick.
Soft close: paused close event · case 03
A timer closes a paused auction or misses the exact close tick.
Soft close: paused close event · case 04
A timer closes a paused auction or misses the exact close tick.
Soft close: paused close event · case 05
A timer closes a paused auction or misses the exact close tick.
Withdrawal liability: resale shortfall · case 01
Successful resale produces a negative or reversed withdrawal loss.
Withdrawal liability: resale shortfall · case 02
Successful resale produces a negative or reversed withdrawal loss.
Withdrawal liability: resale shortfall · case 03
Successful resale produces a negative or reversed withdrawal loss.
Withdrawal liability: resale shortfall · case 04
Successful resale produces a negative or reversed withdrawal loss.
Withdrawal liability: resale shortfall · case 05
Successful resale produces a negative or reversed withdrawal loss.
Withdrawal liability: excused fee waiver · case 01
Excused withdrawals still incur the stipulated administrative fee.
Withdrawal liability: excused fee waiver · case 02
Excused withdrawals still incur the stipulated administrative fee.
Withdrawal liability: excused fee waiver · case 03
Excused withdrawals still incur the stipulated administrative fee.
Withdrawal liability: excused fee waiver · case 04
Excused withdrawals still incur the stipulated administrative fee.
Withdrawal liability: excused fee waiver · case 05
Excused withdrawals still incur the stipulated administrative fee.
Withdrawal liability: award liability gate · case 01
Unawarded bidders are charged award-default damages.
Withdrawal liability: award liability gate · case 02
Unawarded bidders are charged award-default damages.
Withdrawal liability: award liability gate · case 03
Unawarded bidders are charged award-default damages.
Withdrawal liability: award liability gate · case 04
Unawarded bidders are charged award-default damages.
Withdrawal liability: award liability gate · case 05
Unawarded bidders are charged award-default damages.
Withdrawal liability: notice penalty · case 01
Notice at the contractual cutoff is wrongly penalized.
Withdrawal liability: notice penalty · case 02
Notice at the contractual cutoff is wrongly penalized.
Withdrawal liability: notice penalty · case 03
Notice at the contractual cutoff is wrongly penalized.
Withdrawal liability: notice penalty · case 04
Notice at the contractual cutoff is wrongly penalized.
Withdrawal liability: notice penalty · case 05
Notice at the contractual cutoff is wrongly penalized.
Withdrawal liability: deposit offset · case 01
An already forfeited deposit is added to damages instead of credited.
Withdrawal liability: deposit offset · case 02
An already forfeited deposit is added to damages instead of credited.
Withdrawal liability: deposit offset · case 03
An already forfeited deposit is added to damages instead of credited.
Withdrawal liability: deposit offset · case 04
An already forfeited deposit is added to damages instead of credited.
Withdrawal liability: deposit offset · case 05
An already forfeited deposit is added to damages instead of credited.
Withdrawal liability: paid liability credit · case 01
Collected liability is credited on the wrong side of the liability cap.
Withdrawal liability: paid liability credit · case 02
Collected liability is credited on the wrong side of the liability cap.
Withdrawal liability: paid liability credit · case 03
Collected liability is credited on the wrong side of the liability cap.
Withdrawal liability: paid liability credit · case 04
Collected liability is credited on the wrong side of the liability cap.
Withdrawal liability: paid liability credit · case 05
Collected liability is credited on the wrong side of the liability cap.
Withdrawal liability: released bond exclusion · case 01
Withdrawal consumes a bond already released or not subject to forfeiture.
Withdrawal liability: released bond exclusion · case 02
Withdrawal consumes a bond already released or not subject to forfeiture.
Withdrawal liability: released bond exclusion · case 03
Withdrawal consumes a bond already released or not subject to forfeiture.
Withdrawal liability: released bond exclusion · case 04
Withdrawal consumes a bond already released or not subject to forfeiture.
Withdrawal liability: released bond exclusion · case 05
Withdrawal consumes a bond already released or not subject to forfeiture.
Withdrawal liability: unreturned award units · case 01
Return accounting subtracts from withdrawn quantity rather than the outstanding award.
Withdrawal liability: unreturned award units · case 02
Return accounting subtracts from withdrawn quantity rather than the outstanding award.
Withdrawal liability: unreturned award units · case 03
Return accounting subtracts from withdrawn quantity rather than the outstanding award.
Withdrawal liability: unreturned award units · case 04
Return accounting subtracts from withdrawn quantity rather than the outstanding award.
Withdrawal liability: unreturned award units · case 05
Return accounting subtracts from withdrawn quantity rather than the outstanding award.
Withdrawal liability: withdrawal unit cap · case 01
Withdrawals include award units already physically returned.
Withdrawal liability: withdrawal unit cap · case 02
Withdrawals include award units already physically returned.
Withdrawal liability: withdrawal unit cap · case 03
Withdrawals include award units already physically returned.
Withdrawal liability: withdrawal unit cap · case 04
Withdrawals include award units already physically returned.
Withdrawal liability: withdrawal unit cap · case 05
Withdrawals include award units already physically returned.
Withdrawal liability: reinstatement after withdrawal · case 01
A reinstated offer still incurs withdrawal liability or a later withdrawal is masked by earlier reinstatement.
Withdrawal liability: reinstatement after withdrawal · case 02
A reinstated offer still incurs withdrawal liability or a later withdrawal is masked by earlier reinstatement.
Withdrawal liability: reinstatement after withdrawal · case 03
A reinstated offer still incurs withdrawal liability or a later withdrawal is masked by earlier reinstatement.
Withdrawal liability: reinstatement after withdrawal · case 04
A reinstated offer still incurs withdrawal liability or a later withdrawal is masked by earlier reinstatement.
Withdrawal liability: reinstatement after withdrawal · case 05
A reinstated offer still incurs withdrawal liability or a later withdrawal is masked by earlier reinstatement.
Award forfeiture: default resale eligibility · case 01
A paid original award is resold solely because its default flag remains set.
Award forfeiture: default resale eligibility · case 02
A paid original award is resold solely because its default flag remains set.
Award forfeiture: default resale eligibility · case 03
A paid original award is resold solely because its default flag remains set.
Award forfeiture: default resale eligibility · case 04
A paid original award is resold solely because its default flag remains set.
Award forfeiture: default resale eligibility · case 05
A paid original award is resold solely because its default flag remains set.
Award forfeiture: delivery recovery · case 01
A delivered lot is re-awarded before physical recovery.
Award forfeiture: delivery recovery · case 02
A delivered lot is re-awarded before physical recovery.
Award forfeiture: delivery recovery · case 03
A delivered lot is re-awarded before physical recovery.
Award forfeiture: delivery recovery · case 04
A delivered lot is re-awarded before physical recovery.
Award forfeiture: delivery recovery · case 05
A delivered lot is re-awarded before physical recovery.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗