Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Amendment priority: filled floor · case 01
An amendment retroactively deletes executed units.
Amendment priority: filled floor · case 02
An amendment retroactively deletes executed units.
Amendment priority: filled floor · case 03
An amendment retroactively deletes executed units.
Amendment priority: filled floor · case 04
An amendment retroactively deletes executed units.
Amendment priority: filled floor · case 05
An amendment retroactively deletes executed units.
Amendment priority: remaining recalculation · case 01
Replacement remaining quantity ignores already executed units.
Amendment priority: remaining recalculation · case 02
Replacement remaining quantity ignores already executed units.
Amendment priority: remaining recalculation · case 03
Replacement remaining quantity ignores already executed units.
Amendment priority: remaining recalculation · case 04
Replacement remaining quantity ignores already executed units.
Amendment priority: remaining recalculation · case 05
Replacement remaining quantity ignores already executed units.
Amendment priority: cancel ack gate · case 01
Requesting cancellation is confused with acknowledgment of cancellation.
Amendment priority: cancel ack gate · case 02
Requesting cancellation is confused with acknowledgment of cancellation.
Amendment priority: cancel ack gate · case 03
Requesting cancellation is confused with acknowledgment of cancellation.
Amendment priority: cancel ack gate · case 04
Requesting cancellation is confused with acknowledgment of cancellation.
Amendment priority: cancel ack gate · case 05
Requesting cancellation is confused with acknowledgment of cancellation.
Amendment priority: revision compare · case 01
An amendment targets a superseded or future revision.
Amendment priority: revision compare · case 02
An amendment targets a superseded or future revision.
Amendment priority: revision compare · case 03
An amendment targets a superseded or future revision.
Amendment priority: revision compare · case 04
An amendment targets a superseded or future revision.
Amendment priority: revision compare · case 05
An amendment targets a superseded or future revision.
Amendment priority: lot immutability · case 01
An order replacement switches the auction lot while retaining its identity.
Amendment priority: lot immutability · case 02
An order replacement switches the auction lot while retaining its identity.
Amendment priority: lot immutability · case 03
An order replacement switches the auction lot while retaining its identity.
Amendment priority: lot immutability · case 04
An order replacement switches the auction lot while retaining its identity.
Amendment priority: lot immutability · case 05
An order replacement switches the auction lot while retaining its identity.
Amendment priority: owner immutability · case 01
Amendment changes who owes obligations already reserved by the order.
Amendment priority: owner immutability · case 02
Amendment changes who owes obligations already reserved by the order.
Amendment priority: owner immutability · case 03
Amendment changes who owes obligations already reserved by the order.
Amendment priority: owner immutability · case 04
Amendment changes who owes obligations already reserved by the order.
Amendment priority: owner immutability · case 05
Amendment changes who owes obligations already reserved by the order.
Amendment priority: freeze restriction · case 01
A freeze patch permits repricing merely because quantity decreases.
Amendment priority: freeze restriction · case 02
A freeze patch permits repricing merely because quantity decreases.
Amendment priority: freeze restriction · case 03
A freeze patch permits repricing merely because quantity decreases.
Amendment priority: freeze restriction · case 04
A freeze patch permits repricing merely because quantity decreases.
Amendment priority: freeze restriction · case 05
A freeze patch permits repricing merely because quantity decreases.
Amendment priority: request replay · case 01
Replayed replacement requests create additional order revisions.
Amendment priority: request replay · case 02
Replayed replacement requests create additional order revisions.
Amendment priority: request replay · case 03
Replayed replacement requests create additional order revisions.
Amendment priority: request replay · case 04
Replayed replacement requests create additional order revisions.
Amendment priority: request replay · case 05
Replayed replacement requests create additional order revisions.
Escrow reservation: replace credit · case 01
Replacement affordability double-counts its own existing hold.
Escrow reservation: replace credit · case 02
Replacement affordability double-counts its own existing hold.
Escrow reservation: replace credit · case 03
Replacement affordability double-counts its own existing hold.
Escrow reservation: replace credit · case 04
Replacement affordability double-counts its own existing hold.
Escrow reservation: replace credit · case 05
Replacement affordability double-counts its own existing hold.
Escrow reservation: atomic replacement · case 01
A failed collateral amendment destroys the previous valid reservation.
Escrow reservation: atomic replacement · case 02
A failed collateral amendment destroys the previous valid reservation.
Escrow reservation: atomic replacement · case 03
A failed collateral amendment destroys the previous valid reservation.
Escrow reservation: atomic replacement · case 04
A failed collateral amendment destroys the previous valid reservation.
Escrow reservation: atomic replacement · case 05
A failed collateral amendment destroys the previous valid reservation.
Escrow reservation: capture release · case 01
Captured fills remain reserved or are released using historical captures.
Escrow reservation: capture release · case 02
Captured fills remain reserved or are released using historical captures.
Escrow reservation: capture release · case 03
Captured fills remain reserved or are released using historical captures.
Escrow reservation: capture release · case 04
Captured fills remain reserved or are released using historical captures.
Escrow reservation: capture release · case 05
Captured fills remain reserved or are released using historical captures.
Escrow reservation: pending release availability · case 01
Unconfirmed hold releases become spendable.
Escrow reservation: pending release availability · case 02
Unconfirmed hold releases become spendable.
Escrow reservation: pending release availability · case 03
Unconfirmed hold releases become spendable.
Escrow reservation: pending release availability · case 04
Unconfirmed hold releases become spendable.
Escrow reservation: pending release availability · case 05
Unconfirmed hold releases become spendable.
Escrow reservation: refund ceiling · case 01
An auction refund may exceed captured proceeds.
Escrow reservation: refund ceiling · case 02
An auction refund may exceed captured proceeds.
Escrow reservation: refund ceiling · case 03
An auction refund may exceed captured proceeds.
Escrow reservation: refund ceiling · case 04
An auction refund may exceed captured proceeds.
Escrow reservation: refund ceiling · case 05
An auction refund may exceed captured proceeds.
Escrow reservation: bond separation · case 01
Bid bond and payment collateral are wrongly netted.
Escrow reservation: bond separation · case 02
Bid bond and payment collateral are wrongly netted.
Escrow reservation: bond separation · case 03
Bid bond and payment collateral are wrongly netted.
Escrow reservation: bond separation · case 04
Bid bond and payment collateral are wrongly netted.
Escrow reservation: bond separation · case 05
Bid bond and payment collateral are wrongly netted.
Escrow reservation: close release · case 01
Auction closure returns collateral already consumed by the final fill.
Escrow reservation: close release · case 02
Auction closure returns collateral already consumed by the final fill.
Escrow reservation: close release · case 03
Auction closure returns collateral already consumed by the final fill.
Escrow reservation: close release · case 04
Auction closure returns collateral already consumed by the final fill.
Escrow reservation: close release · case 05
Auction closure returns collateral already consumed by the final fill.
Escrow reservation: release clamp · case 01
A release command exceeds the reservation left after capture.
Escrow reservation: release clamp · case 02
A release command exceeds the reservation left after capture.
Escrow reservation: release clamp · case 03
A release command exceeds the reservation left after capture.
Escrow reservation: release clamp · case 04
A release command exceeds the reservation left after capture.
Escrow reservation: release clamp · case 05
A release command exceeds the reservation left after capture.
Escrow reservation: seller net remittance · case 01
Seller remittance omits the fee or charges refundable bidder collateral.
Escrow reservation: seller net remittance · case 02
Seller remittance omits the fee or charges refundable bidder collateral.
Escrow reservation: seller net remittance · case 03
Seller remittance omits the fee or charges refundable bidder collateral.
Escrow reservation: seller net remittance · case 04
Seller remittance omits the fee or charges refundable bidder collateral.
Escrow reservation: seller net remittance · case 05
Seller remittance omits the fee or charges refundable bidder collateral.
Escrow reservation: unreserved fee check · case 01
Admission approves a fee using funds already committed to the replacement bid.
Escrow reservation: unreserved fee check · case 02
Admission approves a fee using funds already committed to the replacement bid.
Escrow reservation: unreserved fee check · case 03
Admission approves a fee using funds already committed to the replacement bid.
Escrow reservation: unreserved fee check · case 04
Admission approves a fee using funds already committed to the replacement bid.
Escrow reservation: unreserved fee check · case 05
Admission approves a fee using funds already committed to the replacement bid.
Package conditions: must link completeness · case 01
Package admission accepts a fragment of an all-linked offer.
Package conditions: must link completeness · case 02
Package admission accepts a fragment of an all-linked offer.
Package conditions: must link completeness · case 03
Package admission accepts a fragment of an all-linked offer.
Package conditions: must link completeness · case 04
Package admission accepts a fragment of an all-linked offer.
Package conditions: must link completeness · case 05
Package admission accepts a fragment of an all-linked offer.
Package conditions: negative package clause · case 01
An exclusion clause checks complete forbidden bundles instead of any forbidden item.
Package conditions: negative package clause · case 02
An exclusion clause checks complete forbidden bundles instead of any forbidden item.
Package conditions: negative package clause · case 03
An exclusion clause checks complete forbidden bundles instead of any forbidden item.
Package conditions: negative package clause · case 04
An exclusion clause checks complete forbidden bundles instead of any forbidden item.
Package conditions: negative package clause · case 05
An exclusion clause checks complete forbidden bundles instead of any forbidden item.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗