Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Qualification stages: certified award category · case 01
Any certified category authorizes bids in an uncertified auction category.
Qualification stages: certified award category · case 02
Any certified category authorizes bids in an uncertified auction category.
Qualification stages: certified award category · case 03
Any certified category authorizes bids in an uncertified auction category.
Qualification stages: certified award category · case 04
Any certified category authorizes bids in an uncertified auction category.
Qualification stages: certified award category · case 05
Any certified category authorizes bids in an uncertified auction category.
Qualification stages: qualified volume · case 01
The bidder maximum qualification volume replaces actual requested award volume.
Qualification stages: qualified volume · case 02
The bidder maximum qualification volume replaces actual requested award volume.
Qualification stages: qualified volume · case 03
The bidder maximum qualification volume replaces actual requested award volume.
Qualification stages: qualified volume · case 04
The bidder maximum qualification volume replaces actual requested award volume.
Qualification stages: qualified volume · case 05
The bidder maximum qualification volume replaces actual requested award volume.
Qualification stages: qualification validity · case 01
A qualification remains bid-eligible at its expiration tick.
Qualification stages: qualification validity · case 02
A qualification remains bid-eligible at its expiration tick.
Qualification stages: qualification validity · case 03
A qualification remains bid-eligible at its expiration tick.
Qualification stages: qualification validity · case 04
A qualification remains bid-eligible at its expiration tick.
Qualification stages: qualification validity · case 05
A qualification remains bid-eligible at its expiration tick.
Qualification stages: suspension bid gate · case 01
Suspended or expired qualification still admits a new offer.
Qualification stages: suspension bid gate · case 02
Suspended or expired qualification still admits a new offer.
Qualification stages: suspension bid gate · case 03
Suspended or expired qualification still admits a new offer.
Qualification stages: suspension bid gate · case 04
Suspended or expired qualification still admits a new offer.
Qualification stages: suspension bid gate · case 05
Suspended or expired qualification still admits a new offer.
Qualification stages: appeal during suspension · case 01
Suspension incorrectly extinguishes the bidder pending appeal right.
Qualification stages: appeal during suspension · case 02
Suspension incorrectly extinguishes the bidder pending appeal right.
Qualification stages: appeal during suspension · case 03
Suspension incorrectly extinguishes the bidder pending appeal right.
Qualification stages: appeal during suspension · case 04
Suspension incorrectly extinguishes the bidder pending appeal right.
Qualification stages: appeal during suspension · case 05
Suspension incorrectly extinguishes the bidder pending appeal right.
Qualification stages: preceding stage certification · case 01
A qualification stage skips unfinished earlier stages.
Qualification stages: preceding stage certification · case 02
A qualification stage skips unfinished earlier stages.
Qualification stages: preceding stage certification · case 03
A qualification stage skips unfinished earlier stages.
Qualification stages: preceding stage certification · case 04
A qualification stage skips unfinished earlier stages.
Qualification stages: preceding stage certification · case 05
A qualification stage skips unfinished earlier stages.
Qualification stages: reviewed evidence revision · case 01
A review of older evidence approves the amended qualification packet.
Qualification stages: reviewed evidence revision · case 02
A review of older evidence approves the amended qualification packet.
Qualification stages: reviewed evidence revision · case 03
A review of older evidence approves the amended qualification packet.
Qualification stages: reviewed evidence revision · case 04
A review of older evidence approves the amended qualification packet.
Qualification stages: reviewed evidence revision · case 05
A review of older evidence approves the amended qualification packet.
Qualification stages: conditional admission · case 01
Provisional qualification becomes unconditional before its conditions are fulfilled.
Qualification stages: conditional admission · case 02
Provisional qualification becomes unconditional before its conditions are fulfilled.
Qualification stages: conditional admission · case 03
Provisional qualification becomes unconditional before its conditions are fulfilled.
Qualification stages: conditional admission · case 04
Provisional qualification becomes unconditional before its conditions are fulfilled.
Qualification stages: conditional admission · case 05
Provisional qualification becomes unconditional before its conditions are fulfilled.
Award unwind: unshipped inventory release · case 01
Annulment releases inventory already shipped or previously released.
Award unwind: unshipped inventory release · case 02
Annulment releases inventory already shipped or previously released.
Award unwind: unshipped inventory release · case 03
Annulment releases inventory already shipped or previously released.
Award unwind: unshipped inventory release · case 04
Annulment releases inventory already shipped or previously released.
Award unwind: unshipped inventory release · case 05
Annulment releases inventory already shipped or previously released.
Award unwind: returned inventory restoration · case 01
Unwind restores shipped inventory before return receipt.
Award unwind: returned inventory restoration · case 02
Unwind restores shipped inventory before return receipt.
Award unwind: returned inventory restoration · case 03
Unwind restores shipped inventory before return receipt.
Award unwind: returned inventory restoration · case 04
Unwind restores shipped inventory before return receipt.
Award unwind: returned inventory restoration · case 05
Unwind restores shipped inventory before return receipt.
Award unwind: buyer refund residue · case 01
Award unwind repeats prior refunds or emits a negative refund.
Award unwind: buyer refund residue · case 02
Award unwind repeats prior refunds or emits a negative refund.
Award unwind: buyer refund residue · case 03
Award unwind repeats prior refunds or emits a negative refund.
Award unwind: buyer refund residue · case 04
Award unwind repeats prior refunds or emits a negative refund.
Award unwind: buyer refund residue · case 05
Award unwind repeats prior refunds or emits a negative refund.
Award unwind: seller proceeds recovery · case 01
Seller clawback uses buyer payment instead of seller proceeds outstanding.
Award unwind: seller proceeds recovery · case 02
Seller clawback uses buyer payment instead of seller proceeds outstanding.
Award unwind: seller proceeds recovery · case 03
Seller clawback uses buyer payment instead of seller proceeds outstanding.
Award unwind: seller proceeds recovery · case 04
Seller clawback uses buyer payment instead of seller proceeds outstanding.
Award unwind: seller proceeds recovery · case 05
Seller clawback uses buyer payment instead of seller proceeds outstanding.
Award unwind: annulment execution gate · case 01
Refund unwind runs on an award that has not been annulled.
Award unwind: annulment execution gate · case 02
Refund unwind runs on an award that has not been annulled.
Award unwind: annulment execution gate · case 03
Refund unwind runs on an award that has not been annulled.
Award unwind: annulment execution gate · case 04
Refund unwind runs on an award that has not been annulled.
Award unwind: annulment execution gate · case 05
Refund unwind runs on an award that has not been annulled.
Award unwind: fee refund policy · case 01
Nonrefundable fees are repaid as part of annulment.
Award unwind: fee refund policy · case 02
Nonrefundable fees are repaid as part of annulment.
Award unwind: fee refund policy · case 03
Nonrefundable fees are repaid as part of annulment.
Award unwind: fee refund policy · case 04
Nonrefundable fees are repaid as part of annulment.
Award unwind: fee refund policy · case 05
Nonrefundable fees are repaid as part of annulment.
Award unwind: reversal award binding · case 01
A related award identity authorizes reversal of the wrong auction award.
Award unwind: reversal award binding · case 02
A related award identity authorizes reversal of the wrong auction award.
Award unwind: reversal award binding · case 03
A related award identity authorizes reversal of the wrong auction award.
Award unwind: reversal award binding · case 04
A related award identity authorizes reversal of the wrong auction award.
Award unwind: reversal award binding · case 05
A related award identity authorizes reversal of the wrong auction award.
Award unwind: title return gate · case 01
Title reversal happens while delivered award units remain with the buyer.
Award unwind: title return gate · case 02
Title reversal happens while delivered award units remain with the buyer.
Award unwind: title return gate · case 03
Title reversal happens while delivered award units remain with the buyer.
Award unwind: title return gate · case 04
Title reversal happens while delivered award units remain with the buyer.
Award unwind: title return gate · case 05
Title reversal happens while delivered award units remain with the buyer.
Award unwind: uncalled bond release · case 01
Unwind releases already called bond value as unused security.
Award unwind: uncalled bond release · case 02
Unwind releases already called bond value as unused security.
Award unwind: uncalled bond release · case 03
Unwind releases already called bond value as unused security.
Award unwind: uncalled bond release · case 04
Unwind releases already called bond value as unused security.
Award unwind: uncalled bond release · case 05
Unwind releases already called bond value as unused security.
Award unwind: related award isolation · case 01
Annulment cascades to unrelated surviving awards.
Award unwind: related award isolation · case 02
Annulment cascades to unrelated surviving awards.
Award unwind: related award isolation · case 03
Annulment cascades to unrelated surviving awards.
Award unwind: related award isolation · case 04
Annulment cascades to unrelated surviving awards.
Award unwind: related award isolation · case 05
Annulment cascades to unrelated surviving awards.
Result publication: latest award revision · case 01
Publication arrival order replaces the latest award correction with an older revision.
Result publication: latest award revision · case 02
Publication arrival order replaces the latest award correction with an older revision.
Result publication: latest award revision · case 03
Publication arrival order replaces the latest award correction with an older revision.
Result publication: latest award revision · case 04
Publication arrival order replaces the latest award correction with an older revision.
Result publication: latest award revision · case 05
Publication arrival order replaces the latest award correction with an older revision.
Result publication: draft result filter · case 01
Draft award rows enter the published result edition.
Result publication: draft result filter · case 02
Draft award rows enter the published result edition.
Result publication: draft result filter · case 03
Draft award rows enter the published result edition.
Result publication: draft result filter · case 04
Draft award rows enter the published result edition.
Result publication: draft result filter · case 05
Draft award rows enter the published result edition.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗