Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Bid disclosure: distinct bidder suppression · case 01
Repeated bids satisfy a publication anonymity threshold.
Bid disclosure: distinct bidder suppression · case 02
Repeated bids satisfy a publication anonymity threshold.
Bid disclosure: distinct bidder suppression · case 03
Repeated bids satisfy a publication anonymity threshold.
Bid disclosure: distinct bidder suppression · case 04
Repeated bids satisfy a publication anonymity threshold.
Bid disclosure: distinct bidder suppression · case 05
Repeated bids satisfy a publication anonymity threshold.
Bid disclosure: alias result view · case 01
Result views expose identity or lose the stable pseudonym needed to follow awards.
Bid disclosure: alias result view · case 02
Result views expose identity or lose the stable pseudonym needed to follow awards.
Bid disclosure: alias result view · case 03
Result views expose identity or lose the stable pseudonym needed to follow awards.
Bid disclosure: alias result view · case 04
Result views expose identity or lose the stable pseudonym needed to follow awards.
Bid disclosure: alias result view · case 05
Result views expose identity or lose the stable pseudonym needed to follow awards.
Bid disclosure: auditor linkage · case 01
Closing the auction releases private bidder-alias linkage.
Bid disclosure: auditor linkage · case 02
Closing the auction releases private bidder-alias linkage.
Bid disclosure: auditor linkage · case 03
Closing the auction releases private bidder-alias linkage.
Bid disclosure: auditor linkage · case 04
Closing the auction releases private bidder-alias linkage.
Bid disclosure: auditor linkage · case 05
Closing the auction releases private bidder-alias linkage.
Bid disclosure: consent qualified disclosure · case 01
Revoked identity publication consent remains effective.
Bid disclosure: consent qualified disclosure · case 02
Revoked identity publication consent remains effective.
Bid disclosure: consent qualified disclosure · case 03
Revoked identity publication consent remains effective.
Bid disclosure: consent qualified disclosure · case 04
Revoked identity publication consent remains effective.
Bid disclosure: consent qualified disclosure · case 05
Revoked identity publication consent remains effective.
Bid disclosure: withdrawn demand statistic · case 01
Public live demand includes withdrawn auction offers.
Bid disclosure: withdrawn demand statistic · case 02
Public live demand includes withdrawn auction offers.
Bid disclosure: withdrawn demand statistic · case 03
Public live demand includes withdrawn auction offers.
Bid disclosure: withdrawn demand statistic · case 04
Public live demand includes withdrawn auction offers.
Bid disclosure: withdrawn demand statistic · case 05
Public live demand includes withdrawn auction offers.
Bid disclosure: field projection · case 01
Disclosure projection ignores which offer fields are approved for publication.
Bid disclosure: field projection · case 02
Disclosure projection ignores which offer fields are approved for publication.
Bid disclosure: field projection · case 03
Disclosure projection ignores which offer fields are approved for publication.
Bid disclosure: field projection · case 04
Disclosure projection ignores which offer fields are approved for publication.
Bid disclosure: field projection · case 05
Disclosure projection ignores which offer fields are approved for publication.
Bid disclosure: embargo final result · case 01
Closed-auction results leak during an explicit publication embargo.
Bid disclosure: embargo final result · case 02
Closed-auction results leak during an explicit publication embargo.
Bid disclosure: embargo final result · case 03
Closed-auction results leak during an explicit publication embargo.
Bid disclosure: embargo final result · case 04
Closed-auction results leak during an explicit publication embargo.
Bid disclosure: embargo final result · case 05
Closed-auction results leak during an explicit publication embargo.
Bid disclosure: appeal audit retention · case 01
Bid evidence is purged while an auction appeal is open.
Bid disclosure: appeal audit retention · case 02
Bid evidence is purged while an auction appeal is open.
Bid disclosure: appeal audit retention · case 03
Bid evidence is purged while an auction appeal is open.
Bid disclosure: appeal audit retention · case 04
Bid evidence is purged while an auction appeal is open.
Bid disclosure: appeal audit retention · case 05
Bid evidence is purged while an auction appeal is open.
Contingent awards: alternative trigger bundles · case 01
An alternative activation bundle fires on a partial bundle or fails to consider a later complete alternative.
Contingent awards: alternative trigger bundles · case 02
An alternative activation bundle fires on a partial bundle or fails to consider a later complete alternative.
Contingent awards: alternative trigger bundles · case 03
An alternative activation bundle fires on a partial bundle or fails to consider a later complete alternative.
Contingent awards: alternative trigger bundles · case 04
An alternative activation bundle fires on a partial bundle or fails to consider a later complete alternative.
Contingent awards: alternative trigger bundles · case 05
An alternative activation bundle fires on a partial bundle or fails to consider a later complete alternative.
Contingent awards: conditional exclusion exception · case 01
A bidder-specific exclusion waiver is ignored or applied to every other contingent offer.
Contingent awards: conditional exclusion exception · case 02
A bidder-specific exclusion waiver is ignored or applied to every other contingent offer.
Contingent awards: conditional exclusion exception · case 03
A bidder-specific exclusion waiver is ignored or applied to every other contingent offer.
Contingent awards: conditional exclusion exception · case 04
A bidder-specific exclusion waiver is ignored or applied to every other contingent offer.
Contingent awards: conditional exclusion exception · case 05
A bidder-specific exclusion waiver is ignored or applied to every other contingent offer.
Contingent awards: same owner companion · case 01
A companion condition is satisfied by awards to different bidders.
Contingent awards: same owner companion · case 02
A companion condition is satisfied by awards to different bidders.
Contingent awards: same owner companion · case 03
A companion condition is satisfied by awards to different bidders.
Contingent awards: same owner companion · case 04
A companion condition is satisfied by awards to different bidders.
Contingent awards: same owner companion · case 05
A companion condition is satisfied by awards to different bidders.
Contingent awards: release certificate revision · case 01
A seller release for a different award revision activates the current contingent award.
Contingent awards: release certificate revision · case 02
A seller release for a different award revision activates the current contingent award.
Contingent awards: release certificate revision · case 03
A seller release for a different award revision activates the current contingent award.
Contingent awards: release certificate revision · case 04
A seller release for a different award revision activates the current contingent award.
Contingent awards: release certificate revision · case 05
A seller release for a different award revision activates the current contingent award.
Contingent awards: option confirmation · case 01
One confirmed option activates every conditional award.
Contingent awards: option confirmation · case 02
One confirmed option activates every conditional award.
Contingent awards: option confirmation · case 03
One confirmed option activates every conditional award.
Contingent awards: option confirmation · case 04
One confirmed option activates every conditional award.
Contingent awards: option confirmation · case 05
One confirmed option activates every conditional award.
Contingent awards: minimum award set · case 01
A conditional award-set minimum is replaced with simple nonemptiness.
Contingent awards: minimum award set · case 02
A conditional award-set minimum is replaced with simple nonemptiness.
Contingent awards: minimum award set · case 03
A conditional award-set minimum is replaced with simple nonemptiness.
Contingent awards: minimum award set · case 04
A conditional award-set minimum is replaced with simple nonemptiness.
Contingent awards: minimum award set · case 05
A conditional award-set minimum is replaced with simple nonemptiness.
Contingent awards: maximum award set · case 01
Award-set maximum permits one additional contingent lot.
Contingent awards: maximum award set · case 02
Award-set maximum permits one additional contingent lot.
Contingent awards: maximum award set · case 03
Award-set maximum permits one additional contingent lot.
Contingent awards: maximum award set · case 04
Award-set maximum permits one additional contingent lot.
Contingent awards: maximum award set · case 05
Award-set maximum permits one additional contingent lot.
Contingent awards: locked condition waiver · case 01
A waiver removes a condition already locked into the awarded contract.
Contingent awards: locked condition waiver · case 02
A waiver removes a condition already locked into the awarded contract.
Contingent awards: locked condition waiver · case 03
A waiver removes a condition already locked into the awarded contract.
Contingent awards: locked condition waiver · case 04
A waiver removes a condition already locked into the awarded contract.
Contingent awards: locked condition waiver · case 05
A waiver removes a condition already locked into the awarded contract.
Contingent awards: activation presence · case 01
An inactive contingent offer is certified without its triggering award.
Contingent awards: activation presence · case 02
An inactive contingent offer is certified without its triggering award.
Contingent awards: activation presence · case 03
An inactive contingent offer is certified without its triggering award.
Contingent awards: activation presence · case 04
An inactive contingent offer is certified without its triggering award.
Contingent awards: activation presence · case 05
An inactive contingent offer is certified without its triggering award.
Contingent awards: expired option veto · case 01
Expired underlying options still support final contingent awards.
Contingent awards: expired option veto · case 02
Expired underlying options still support final contingent awards.
Contingent awards: expired option veto · case 03
Expired underlying options still support final contingent awards.
Contingent awards: expired option veto · case 04
Expired underlying options still support final contingent awards.
Contingent awards: expired option veto · case 05
Expired underlying options still support final contingent awards.
Qualification stages: submitted is not approved · case 01
Uploaded qualification evidence is treated as reviewed approval.
Qualification stages: submitted is not approved · case 02
Uploaded qualification evidence is treated as reviewed approval.
Qualification stages: submitted is not approved · case 03
Uploaded qualification evidence is treated as reviewed approval.
Qualification stages: submitted is not approved · case 04
Uploaded qualification evidence is treated as reviewed approval.
Qualification stages: submitted is not approved · case 05
Uploaded qualification evidence is treated as reviewed approval.
Qualification stages: rejected required evidence · case 01
A required rejected qualification item does not veto admission.
Qualification stages: rejected required evidence · case 02
A required rejected qualification item does not veto admission.
Qualification stages: rejected required evidence · case 03
A required rejected qualification item does not veto admission.
Qualification stages: rejected required evidence · case 04
A required rejected qualification item does not veto admission.
Qualification stages: rejected required evidence · case 05
A required rejected qualification item does not veto admission.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗