Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Bilateral confirmation: rejection release · case 01
A rejection releases collateral for an already executed auction trade.
Bilateral confirmation: rejection release · case 02
A rejection releases collateral for an already executed auction trade.
Bilateral confirmation: rejection release · case 03
A rejection releases collateral for an already executed auction trade.
Bilateral confirmation: rejection release · case 04
A rejection releases collateral for an already executed auction trade.
Bilateral confirmation: rejection release · case 05
A rejection releases collateral for an already executed auction trade.
Bilateral confirmation: partial fill reservation · case 01
Trade hold release uses proposed size instead of actual held units.
Bilateral confirmation: partial fill reservation · case 02
Trade hold release uses proposed size instead of actual held units.
Bilateral confirmation: partial fill reservation · case 03
Trade hold release uses proposed size instead of actual held units.
Bilateral confirmation: partial fill reservation · case 04
Trade hold release uses proposed size instead of actual held units.
Bilateral confirmation: partial fill reservation · case 05
Trade hold release uses proposed size instead of actual held units.
Bilateral confirmation: buyer confirmation author · case 01
Seller-authored confirmation can bind the buyer.
Bilateral confirmation: buyer confirmation author · case 02
Seller-authored confirmation can bind the buyer.
Bilateral confirmation: buyer confirmation author · case 03
Seller-authored confirmation can bind the buyer.
Bilateral confirmation: buyer confirmation author · case 04
Seller-authored confirmation can bind the buyer.
Bilateral confirmation: buyer confirmation author · case 05
Seller-authored confirmation can bind the buyer.
Bilateral confirmation: seller delegate authorization · case 01
A designated seller clearing delegate cannot confirm, or the presence of any delegate authorizes all signers.
Bilateral confirmation: seller delegate authorization · case 02
A designated seller clearing delegate cannot confirm, or the presence of any delegate authorizes all signers.
Bilateral confirmation: seller delegate authorization · case 03
A designated seller clearing delegate cannot confirm, or the presence of any delegate authorizes all signers.
Bilateral confirmation: seller delegate authorization · case 04
A designated seller clearing delegate cannot confirm, or the presence of any delegate authorizes all signers.
Bilateral confirmation: seller delegate authorization · case 05
A designated seller clearing delegate cannot confirm, or the presence of any delegate authorizes all signers.
Bilateral confirmation: execution match replay · case 01
Replayed match identity books another execution.
Bilateral confirmation: execution match replay · case 02
Replayed match identity books another execution.
Bilateral confirmation: execution match replay · case 03
Replayed match identity books another execution.
Bilateral confirmation: execution match replay · case 04
Replayed match identity books another execution.
Bilateral confirmation: execution match replay · case 05
Replayed match identity books another execution.
Bilateral confirmation: reversal execution guard · case 01
Reversal posts before the corresponding trade executed.
Bilateral confirmation: reversal execution guard · case 02
Reversal posts before the corresponding trade executed.
Bilateral confirmation: reversal execution guard · case 03
Reversal posts before the corresponding trade executed.
Bilateral confirmation: reversal execution guard · case 04
Reversal posts before the corresponding trade executed.
Bilateral confirmation: reversal execution guard · case 05
Reversal posts before the corresponding trade executed.
Bilateral confirmation: timeout release guard · case 01
Confirmation timeout releases a completed trade reservation.
Bilateral confirmation: timeout release guard · case 02
Confirmation timeout releases a completed trade reservation.
Bilateral confirmation: timeout release guard · case 03
Confirmation timeout releases a completed trade reservation.
Bilateral confirmation: timeout release guard · case 04
Confirmation timeout releases a completed trade reservation.
Bilateral confirmation: timeout release guard · case 05
Confirmation timeout releases a completed trade reservation.
Bilateral confirmation: unreported match output · case 01
Trade report emission repeats acknowledged matches instead of pending matches.
Bilateral confirmation: unreported match output · case 02
Trade report emission repeats acknowledged matches instead of pending matches.
Bilateral confirmation: unreported match output · case 03
Trade report emission repeats acknowledged matches instead of pending matches.
Bilateral confirmation: unreported match output · case 04
Trade report emission repeats acknowledged matches instead of pending matches.
Bilateral confirmation: unreported match output · case 05
Trade report emission repeats acknowledged matches instead of pending matches.
Tie ballot: one ticket per bidder · case 01
Duplicate ballot tickets increase one tied bidder draw weight.
Tie ballot: one ticket per bidder · case 02
Duplicate ballot tickets increase one tied bidder draw weight.
Tie ballot: one ticket per bidder · case 03
Duplicate ballot tickets increase one tied bidder draw weight.
Tie ballot: one ticket per bidder · case 04
Duplicate ballot tickets increase one tied bidder draw weight.
Tie ballot: one ticket per bidder · case 05
Duplicate ballot tickets increase one tied bidder draw weight.
Tie ballot: roster ticket admission · case 01
An outsider obtains a tie-break ticket.
Tie ballot: roster ticket admission · case 02
An outsider obtains a tie-break ticket.
Tie ballot: roster ticket admission · case 03
An outsider obtains a tie-break ticket.
Tie ballot: roster ticket admission · case 04
An outsider obtains a tie-break ticket.
Tie ballot: roster ticket admission · case 05
An outsider obtains a tie-break ticket.
Tie ballot: disqualification before draw · case 01
Disqualified or outside tickets remain in the frozen draw pool.
Tie ballot: disqualification before draw · case 02
Disqualified or outside tickets remain in the frozen draw pool.
Tie ballot: disqualification before draw · case 03
Disqualified or outside tickets remain in the frozen draw pool.
Tie ballot: disqualification before draw · case 04
Disqualified or outside tickets remain in the frozen draw pool.
Tie ballot: disqualification before draw · case 05
Disqualified or outside tickets remain in the frozen draw pool.
Tie ballot: draw index contract · case 01
An out-of-range published draw wraps to another bidder.
Tie ballot: draw index contract · case 02
An out-of-range published draw wraps to another bidder.
Tie ballot: draw index contract · case 03
An out-of-range published draw wraps to another bidder.
Tie ballot: draw index contract · case 04
An out-of-range published draw wraps to another bidder.
Tie ballot: draw index contract · case 05
An out-of-range published draw wraps to another bidder.
Tie ballot: declined ticket rotation · case 01
A declined tied winner is reoffered the same lot or successor order reverses.
Tie ballot: declined ticket rotation · case 02
A declined tied winner is reoffered the same lot or successor order reverses.
Tie ballot: declined ticket rotation · case 03
A declined tied winner is reoffered the same lot or successor order reverses.
Tie ballot: declined ticket rotation · case 04
A declined tied winner is reoffered the same lot or successor order reverses.
Tie ballot: declined ticket rotation · case 05
A declined tied winner is reoffered the same lot or successor order reverses.
Tie ballot: ballot supply remainder · case 01
Tie ballot distributes full supply again after partial awards.
Tie ballot: ballot supply remainder · case 02
Tie ballot distributes full supply again after partial awards.
Tie ballot: ballot supply remainder · case 03
Tie ballot distributes full supply again after partial awards.
Tie ballot: ballot supply remainder · case 04
Tie ballot distributes full supply again after partial awards.
Tie ballot: ballot supply remainder · case 05
Tie ballot distributes full supply again after partial awards.
Tie ballot: ticket order commitment · case 01
Ticket-order changes are hidden by set comparison of the published commitment.
Tie ballot: ticket order commitment · case 02
Ticket-order changes are hidden by set comparison of the published commitment.
Tie ballot: ticket order commitment · case 03
Ticket-order changes are hidden by set comparison of the published commitment.
Tie ballot: ticket order commitment · case 04
Ticket-order changes are hidden by set comparison of the published commitment.
Tie ballot: ticket order commitment · case 05
Ticket-order changes are hidden by set comparison of the published commitment.
Tie ballot: publication before award · case 01
Unpublished ballot outcomes or too many winners become awards.
Tie ballot: publication before award · case 02
Unpublished ballot outcomes or too many winners become awards.
Tie ballot: publication before award · case 03
Unpublished ballot outcomes or too many winners become awards.
Tie ballot: publication before award · case 04
Unpublished ballot outcomes or too many winners become awards.
Tie ballot: publication before award · case 05
Unpublished ballot outcomes or too many winners become awards.
Tie ballot: round specific ballot · case 01
A previous auction-round ballot is reused for a new tie.
Tie ballot: round specific ballot · case 02
A previous auction-round ballot is reused for a new tie.
Tie ballot: round specific ballot · case 03
A previous auction-round ballot is reused for a new tie.
Tie ballot: round specific ballot · case 04
A previous auction-round ballot is reused for a new tie.
Tie ballot: round specific ballot · case 05
A previous auction-round ballot is reused for a new tie.
Tie ballot: winner substitute consent · case 01
A tied award transfers to an unconsenting designated substitute.
Tie ballot: winner substitute consent · case 02
A tied award transfers to an unconsenting designated substitute.
Tie ballot: winner substitute consent · case 03
A tied award transfers to an unconsenting designated substitute.
Tie ballot: winner substitute consent · case 04
A tied award transfers to an unconsenting designated substitute.
Tie ballot: winner substitute consent · case 05
A tied award transfers to an unconsenting designated substitute.
Bid disclosure: self view scope · case 01
A bidder self-view includes other participants offers.
Bid disclosure: self view scope · case 02
A bidder self-view includes other participants offers.
Bid disclosure: self view scope · case 03
A bidder self-view includes other participants offers.
Bid disclosure: self view scope · case 04
A bidder self-view includes other participants offers.
Bid disclosure: self view scope · case 05
A bidder self-view includes other participants offers.
Bid disclosure: preclose value embargo · case 01
Sealed offer values leak before the auction closes.
Bid disclosure: preclose value embargo · case 02
Sealed offer values leak before the auction closes.
Bid disclosure: preclose value embargo · case 03
Sealed offer values leak before the auction closes.
Bid disclosure: preclose value embargo · case 04
Sealed offer values leak before the auction closes.
Bid disclosure: preclose value embargo · case 05
Sealed offer values leak before the auction closes.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗