Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Delivery acceptance: award remainder · case 01
Shipping notice prematurely closes the undelivered award obligation.
Delivery acceptance: award remainder · case 02
Shipping notice prematurely closes the undelivered award obligation.
Delivery acceptance: award remainder · case 03
Shipping notice prematurely closes the undelivered award obligation.
Delivery acceptance: award remainder · case 04
Shipping notice prematurely closes the undelivered award obligation.
Delivery acceptance: award remainder · case 05
Shipping notice prematurely closes the undelivered award obligation.
Delivery acceptance: title acceptance · case 01
Title transfers on only one required acceptance signature.
Delivery acceptance: title acceptance · case 02
Title transfers on only one required acceptance signature.
Delivery acceptance: title acceptance · case 03
Title transfers on only one required acceptance signature.
Delivery acceptance: title acceptance · case 04
Title transfers on only one required acceptance signature.
Delivery acceptance: title acceptance · case 05
Title transfers on only one required acceptance signature.
Delivery acceptance: certificate coverage · case 01
One certificate stands in for all awarded lot certificates.
Delivery acceptance: certificate coverage · case 02
One certificate stands in for all awarded lot certificates.
Delivery acceptance: certificate coverage · case 03
One certificate stands in for all awarded lot certificates.
Delivery acceptance: certificate coverage · case 04
One certificate stands in for all awarded lot certificates.
Delivery acceptance: certificate coverage · case 05
One certificate stands in for all awarded lot certificates.
Delivery acceptance: undamaged certificate release · case 01
Damaged or uncertified lots are released from award custody.
Delivery acceptance: undamaged certificate release · case 02
Damaged or uncertified lots are released from award custody.
Delivery acceptance: undamaged certificate release · case 03
Damaged or uncertified lots are released from award custody.
Delivery acceptance: undamaged certificate release · case 04
Damaged or uncertified lots are released from award custody.
Delivery acceptance: undamaged certificate release · case 05
Damaged or uncertified lots are released from award custody.
Delivery acceptance: payout payment cap · case 01
Seller receives proceeds for unaccepted delivery units.
Delivery acceptance: payout payment cap · case 02
Seller receives proceeds for unaccepted delivery units.
Delivery acceptance: payout payment cap · case 03
Seller receives proceeds for unaccepted delivery units.
Delivery acceptance: payout payment cap · case 04
Seller receives proceeds for unaccepted delivery units.
Delivery acceptance: payout payment cap · case 05
Seller receives proceeds for unaccepted delivery units.
Delivery acceptance: returned fulfillment · case 01
Returned auction goods still count as fulfilled delivery.
Delivery acceptance: returned fulfillment · case 02
Returned auction goods still count as fulfilled delivery.
Delivery acceptance: returned fulfillment · case 03
Returned auction goods still count as fulfilled delivery.
Delivery acceptance: returned fulfillment · case 04
Returned auction goods still count as fulfilled delivery.
Delivery acceptance: returned fulfillment · case 05
Returned auction goods still count as fulfilled delivery.
Delivery acceptance: late storage charge · case 01
Storage charges begin before the stipulated post-deadline period.
Delivery acceptance: late storage charge · case 02
Storage charges begin before the stipulated post-deadline period.
Delivery acceptance: late storage charge · case 03
Storage charges begin before the stipulated post-deadline period.
Delivery acceptance: late storage charge · case 04
Storage charges begin before the stipulated post-deadline period.
Delivery acceptance: late storage charge · case 05
Storage charges begin before the stipulated post-deadline period.
Delivery acceptance: dispute payout hold · case 01
A delivery dispute fails to hold seller proceeds.
Delivery acceptance: dispute payout hold · case 02
A delivery dispute fails to hold seller proceeds.
Delivery acceptance: dispute payout hold · case 03
A delivery dispute fails to hold seller proceeds.
Delivery acceptance: dispute payout hold · case 04
A delivery dispute fails to hold seller proceeds.
Delivery acceptance: dispute payout hold · case 05
A delivery dispute fails to hold seller proceeds.
Award objection: challenger standing · case 01
An award challenge admits a winner self-challenge or an outside bidder.
Award objection: challenger standing · case 02
An award challenge admits a winner self-challenge or an outside bidder.
Award objection: challenger standing · case 03
An award challenge admits a winner self-challenge or an outside bidder.
Award objection: challenger standing · case 04
An award challenge admits a winner self-challenge or an outside bidder.
Award objection: challenger standing · case 05
An award challenge admits a winner self-challenge or an outside bidder.
Award objection: admissible grounds · case 01
Challenge grounds are admitted without the stipulated ground filter or filing order.
Award objection: admissible grounds · case 02
Challenge grounds are admitted without the stipulated ground filter or filing order.
Award objection: admissible grounds · case 03
Challenge grounds are admitted without the stipulated ground filter or filing order.
Award objection: admissible grounds · case 04
Challenge grounds are admitted without the stipulated ground filter or filing order.
Award objection: admissible grounds · case 05
Challenge grounds are admitted without the stipulated ground filter or filing order.
Award objection: filing deadline · case 01
A filing on the final objection tick loses its remedy.
Award objection: filing deadline · case 02
A filing on the final objection tick loses its remedy.
Award objection: filing deadline · case 03
A filing on the final objection tick loses its remedy.
Award objection: filing deadline · case 04
A filing on the final objection tick loses its remedy.
Award objection: filing deadline · case 05
A filing on the final objection tick loses its remedy.
Award objection: evidence completeness · case 01
An objection proceeds with only part of its required evidence.
Award objection: evidence completeness · case 02
An objection proceeds with only part of its required evidence.
Award objection: evidence completeness · case 03
An objection proceeds with only part of its required evidence.
Award objection: evidence completeness · case 04
An objection proceeds with only part of its required evidence.
Award objection: evidence completeness · case 05
An objection proceeds with only part of its required evidence.
Award objection: open objection finality · case 01
One resolved objection makes an award final while others remain open.
Award objection: open objection finality · case 02
One resolved objection makes an award final while others remain open.
Award objection: open objection finality · case 03
One resolved objection makes an award final while others remain open.
Award objection: open objection finality · case 04
One resolved objection makes an award final while others remain open.
Award objection: open objection finality · case 05
One resolved objection makes an award final while others remain open.
Award objection: remedy lot scope · case 01
A successful challenge voids unaffected lots or a rejected challenge voids affected lots.
Award objection: remedy lot scope · case 02
A successful challenge voids unaffected lots or a rejected challenge voids affected lots.
Award objection: remedy lot scope · case 03
A successful challenge voids unaffected lots or a rejected challenge voids affected lots.
Award objection: remedy lot scope · case 04
A successful challenge voids unaffected lots or a rejected challenge voids affected lots.
Award objection: remedy lot scope · case 05
A successful challenge voids unaffected lots or a rejected challenge voids affected lots.
Award objection: withdrawn hearing removal · case 01
Withdrawn objections continue to occupy the hearing queue.
Award objection: withdrawn hearing removal · case 02
Withdrawn objections continue to occupy the hearing queue.
Award objection: withdrawn hearing removal · case 03
Withdrawn objections continue to occupy the hearing queue.
Award objection: withdrawn hearing removal · case 04
Withdrawn objections continue to occupy the hearing queue.
Award objection: withdrawn hearing removal · case 05
Withdrawn objections continue to occupy the hearing queue.
Award objection: objection deposit disposition · case 01
A nonfrivolous unsuccessful challenge loses a refundable deposit.
Award objection: objection deposit disposition · case 02
A nonfrivolous unsuccessful challenge loses a refundable deposit.
Award objection: objection deposit disposition · case 03
A nonfrivolous unsuccessful challenge loses a refundable deposit.
Award objection: objection deposit disposition · case 04
A nonfrivolous unsuccessful challenge loses a refundable deposit.
Award objection: objection deposit disposition · case 05
A nonfrivolous unsuccessful challenge loses a refundable deposit.
Award objection: hearing notice parties · case 01
Hearing notice omits losing participants or re-notifies everyone.
Award objection: hearing notice parties · case 02
Hearing notice omits losing participants or re-notifies everyone.
Award objection: hearing notice parties · case 03
Hearing notice omits losing participants or re-notifies everyone.
Award objection: hearing notice parties · case 04
Hearing notice omits losing participants or re-notifies everyone.
Award objection: hearing notice parties · case 05
Hearing notice omits losing participants or re-notifies everyone.
Award objection: upheld live objections · case 01
Withdrawn or unfiled objections can drive the award remedy.
Award objection: upheld live objections · case 02
Withdrawn or unfiled objections can drive the award remedy.
Award objection: upheld live objections · case 03
Withdrawn or unfiled objections can drive the award remedy.
Award objection: upheld live objections · case 04
Withdrawn or unfiled objections can drive the award remedy.
Award objection: upheld live objections · case 05
Withdrawn or unfiled objections can drive the award remedy.
Performance bond: callable face · case 01
Unpaid bond calls fail to consume callable face value.
Performance bond: callable face · case 02
Unpaid bond calls fail to consume callable face value.
Performance bond: callable face · case 03
Unpaid bond calls fail to consume callable face value.
Performance bond: callable face · case 04
Unpaid bond calls fail to consume callable face value.
Performance bond: callable face · case 05
Unpaid bond calls fail to consume callable face value.
Performance bond: claim call cap · case 01
A new bond claim exceeds the uncalled bond remainder.
Performance bond: claim call cap · case 02
A new bond claim exceeds the uncalled bond remainder.
Performance bond: claim call cap · case 03
A new bond claim exceeds the uncalled bond remainder.
Performance bond: claim call cap · case 04
A new bond claim exceeds the uncalled bond remainder.
Performance bond: claim call cap · case 05
A new bond claim exceeds the uncalled bond remainder.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗