Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Result publication: withdrawn result tombstone · case 01
Withdrawn results remain public or appealed results are mistakenly removed.
Result publication: withdrawn result tombstone · case 02
Withdrawn results remain public or appealed results are mistakenly removed.
Result publication: withdrawn result tombstone · case 03
Withdrawn results remain public or appealed results are mistakenly removed.
Result publication: withdrawn result tombstone · case 04
Withdrawn results remain public or appealed results are mistakenly removed.
Result publication: withdrawn result tombstone · case 05
Withdrawn results remain public or appealed results are mistakenly removed.
Result publication: appeal finality label · case 01
Appeal result labels never reflect final resolution.
Result publication: appeal finality label · case 02
Appeal result labels never reflect final resolution.
Result publication: appeal finality label · case 03
Appeal result labels never reflect final resolution.
Result publication: appeal finality label · case 04
Appeal result labels never reflect final resolution.
Result publication: appeal finality label · case 05
Appeal result labels never reflect final resolution.
Result publication: edition existence · case 01
A reader receives an unpublished result edition merely because another exists.
Result publication: edition existence · case 02
A reader receives an unpublished result edition merely because another exists.
Result publication: edition existence · case 03
A reader receives an unpublished result edition merely because another exists.
Result publication: edition existence · case 04
A reader receives an unpublished result edition merely because another exists.
Result publication: edition existence · case 05
A reader receives an unpublished result edition merely because another exists.
Result publication: correction quantity replacement · case 01
A correction quantity is added to the original award instead of replacing it.
Result publication: correction quantity replacement · case 02
A correction quantity is added to the original award instead of replacing it.
Result publication: correction quantity replacement · case 03
A correction quantity is added to the original award instead of replacing it.
Result publication: correction quantity replacement · case 04
A correction quantity is added to the original award instead of replacing it.
Result publication: correction quantity replacement · case 05
A correction quantity is added to the original award instead of replacing it.
Result publication: correction notice edition · case 01
Acknowledging the original award suppresses a later correction notice or re-emits the acknowledged correction.
Result publication: correction notice edition · case 02
Acknowledging the original award suppresses a later correction notice or re-emits the acknowledged correction.
Result publication: correction notice edition · case 03
Acknowledging the original award suppresses a later correction notice or re-emits the acknowledged correction.
Result publication: correction notice edition · case 04
Acknowledging the original award suppresses a later correction notice or re-emits the acknowledged correction.
Result publication: correction notice edition · case 05
Acknowledging the original award suppresses a later correction notice or re-emits the acknowledged correction.
Result publication: owner redaction · case 01
Owner redaction leaks identity or destroys award-row alignment.
Result publication: owner redaction · case 02
Owner redaction leaks identity or destroys award-row alignment.
Result publication: owner redaction · case 03
Owner redaction leaks identity or destroys award-row alignment.
Result publication: owner redaction · case 04
Owner redaction leaks identity or destroys award-row alignment.
Result publication: owner redaction · case 05
Owner redaction leaks identity or destroys award-row alignment.
Result publication: edition revision cutoff · case 01
A historic result edition includes later corrections or drops unchanged awards.
Result publication: edition revision cutoff · case 02
A historic result edition includes later corrections or drops unchanged awards.
Result publication: edition revision cutoff · case 03
A historic result edition includes later corrections or drops unchanged awards.
Result publication: edition revision cutoff · case 04
A historic result edition includes later corrections or drops unchanged awards.
Result publication: edition revision cutoff · case 05
A historic result edition includes later corrections or drops unchanged awards.
Result publication: lot publication scope · case 01
Result export ignores the approved multi-lot publication scope.
Result publication: lot publication scope · case 02
Result export ignores the approved multi-lot publication scope.
Result publication: lot publication scope · case 03
Result export ignores the approved multi-lot publication scope.
Result publication: lot publication scope · case 04
Result export ignores the approved multi-lot publication scope.
Result publication: lot publication scope · case 05
Result export ignores the approved multi-lot publication scope.
Round carryover: unsold reoffer · case 01
Sold or unconsented lots reappear in the next auction round.
Round carryover: unsold reoffer · case 02
Sold or unconsented lots reappear in the next auction round.
Round carryover: unsold reoffer · case 03
Sold or unconsented lots reappear in the next auction round.
Round carryover: unsold reoffer · case 04
Sold or unconsented lots reappear in the next auction round.
Round carryover: unsold reoffer · case 05
Sold or unconsented lots reappear in the next auction round.
Round carryover: standing bid reconsent · case 01
Seller carry permission substitutes for bidder standing-offer permission.
Round carryover: standing bid reconsent · case 02
Seller carry permission substitutes for bidder standing-offer permission.
Round carryover: standing bid reconsent · case 03
Seller carry permission substitutes for bidder standing-offer permission.
Round carryover: standing bid reconsent · case 04
Seller carry permission substitutes for bidder standing-offer permission.
Round carryover: standing bid reconsent · case 05
Seller carry permission substitutes for bidder standing-offer permission.
Round carryover: withdrawal carry veto · case 01
Withdrawn prior-round offers revive during carryover.
Round carryover: withdrawal carry veto · case 02
Withdrawn prior-round offers revive during carryover.
Round carryover: withdrawal carry veto · case 03
Withdrawn prior-round offers revive during carryover.
Round carryover: withdrawal carry veto · case 04
Withdrawn prior-round offers revive during carryover.
Round carryover: withdrawal carry veto · case 05
Withdrawn prior-round offers revive during carryover.
Round carryover: specification priority reset · case 01
A materially changed lot carries obsolete standing-bid priority.
Round carryover: specification priority reset · case 02
A materially changed lot carries obsolete standing-bid priority.
Round carryover: specification priority reset · case 03
A materially changed lot carries obsolete standing-bid priority.
Round carryover: specification priority reset · case 04
A materially changed lot carries obsolete standing-bid priority.
Round carryover: specification priority reset · case 05
A materially changed lot carries obsolete standing-bid priority.
Round carryover: carry once per round · case 01
Carryover rerun duplicates a previously copied standing offer.
Round carryover: carry once per round · case 02
Carryover rerun duplicates a previously copied standing offer.
Round carryover: carry once per round · case 03
Carryover rerun duplicates a previously copied standing offer.
Round carryover: carry once per round · case 04
Carryover rerun duplicates a previously copied standing offer.
Round carryover: carry once per round · case 05
Carryover rerun duplicates a previously copied standing offer.
Round carryover: inherited reservation · case 01
Carryover drops a binding hold or carries all holds regardless of encumbrance.
Round carryover: inherited reservation · case 02
Carryover drops a binding hold or carries all holds regardless of encumbrance.
Round carryover: inherited reservation · case 03
Carryover drops a binding hold or carries all holds regardless of encumbrance.
Round carryover: inherited reservation · case 04
Carryover drops a binding hold or carries all holds regardless of encumbrance.
Round carryover: inherited reservation · case 05
Carryover drops a binding hold or carries all holds regardless of encumbrance.
Round carryover: source round provenance · case 01
Carryover rewrites original auction-round provenance.
Round carryover: source round provenance · case 02
Carryover rewrites original auction-round provenance.
Round carryover: source round provenance · case 03
Carryover rewrites original auction-round provenance.
Round carryover: source round provenance · case 04
Carryover rewrites original auction-round provenance.
Round carryover: source round provenance · case 05
Carryover rewrites original auction-round provenance.
Round carryover: future round reoffer · case 01
An offer is carried back into the same source round.
Round carryover: future round reoffer · case 02
An offer is carried back into the same source round.
Round carryover: future round reoffer · case 03
An offer is carried back into the same source round.
Round carryover: future round reoffer · case 04
An offer is carried back into the same source round.
Round carryover: future round reoffer · case 05
An offer is carried back into the same source round.
Round carryover: authorization expiry carry · case 01
Standing offers carry after bidder authorization expires.
Round carryover: authorization expiry carry · case 02
Standing offers carry after bidder authorization expires.
Round carryover: authorization expiry carry · case 03
Standing offers carry after bidder authorization expires.
Round carryover: authorization expiry carry · case 04
Standing offers carry after bidder authorization expires.
Round carryover: authorization expiry carry · case 05
Standing offers carry after bidder authorization expires.
Round carryover: approved reserve revision · case 01
Reserve revision drops unchanged carryover reserves or ignores seller-approved updates.
Round carryover: approved reserve revision · case 02
Reserve revision drops unchanged carryover reserves or ignores seller-approved updates.
Round carryover: approved reserve revision · case 03
Reserve revision drops unchanged carryover reserves or ignores seller-approved updates.
Round carryover: approved reserve revision · case 04
Reserve revision drops unchanged carryover reserves or ignores seller-approved updates.
Round carryover: approved reserve revision · case 05
Reserve revision drops unchanged carryover reserves or ignores seller-approved updates.
Permit constrained award: permit category scope · case 01
Any permit or only its first category authorizes auction award category.
Permit constrained award: permit category scope · case 02
Any permit or only its first category authorizes auction award category.
Permit constrained award: permit category scope · case 03
Any permit or only its first category authorizes auction award category.
Permit constrained award: permit category scope · case 04
Any permit or only its first category authorizes auction award category.
Permit constrained award: permit category scope · case 05
Any permit or only its first category authorizes auction award category.
Permit constrained award: transit route permit · case 01
Auction shipment permit covers the destination but not the intermediate transit route.
Permit constrained award: transit route permit · case 02
Auction shipment permit covers the destination but not the intermediate transit route.
Permit constrained award: transit route permit · case 03
Auction shipment permit covers the destination but not the intermediate transit route.
Permit constrained award: transit route permit · case 04
Auction shipment permit covers the destination but not the intermediate transit route.
Permit constrained award: transit route permit · case 05
Auction shipment permit covers the destination but not the intermediate transit route.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗