Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Package conditions: offered inventory · case 01
Unlisted auction lots enter a certified package.
Package conditions: offered inventory · case 02
Unlisted auction lots enter a certified package.
Package conditions: offered inventory · case 03
Unlisted auction lots enter a certified package.
Package conditions: offered inventory · case 04
Unlisted auction lots enter a certified package.
Package conditions: offered inventory · case 05
Unlisted auction lots enter a certified package.
Package conditions: dependency closure · case 01
Package prerequisites use overlap instead of complete closure.
Package conditions: dependency closure · case 02
Package prerequisites use overlap instead of complete closure.
Package conditions: dependency closure · case 03
Package prerequisites use overlap instead of complete closure.
Package conditions: dependency closure · case 04
Package prerequisites use overlap instead of complete closure.
Package conditions: dependency closure · case 05
Package prerequisites use overlap instead of complete closure.
Package conditions: exact quantity contract · case 01
A fixed package quantity silently permits over-delivery.
Package conditions: exact quantity contract · case 02
A fixed package quantity silently permits over-delivery.
Package conditions: exact quantity contract · case 03
A fixed package quantity silently permits over-delivery.
Package conditions: exact quantity contract · case 04
A fixed package quantity silently permits over-delivery.
Package conditions: exact quantity contract · case 05
A fixed package quantity silently permits over-delivery.
Package conditions: alternative activation · case 01
Package alternatives are activated by partial intersections or multiple complete alternatives.
Package conditions: alternative activation · case 02
Package alternatives are activated by partial intersections or multiple complete alternatives.
Package conditions: alternative activation · case 03
Package alternatives are activated by partial intersections or multiple complete alternatives.
Package conditions: alternative activation · case 04
Package alternatives are activated by partial intersections or multiple complete alternatives.
Package conditions: alternative activation · case 05
Package alternatives are activated by partial intersections or multiple complete alternatives.
Package conditions: seller consent scope · case 01
Consent for one seller item approves all bundled items.
Package conditions: seller consent scope · case 02
Consent for one seller item approves all bundled items.
Package conditions: seller consent scope · case 03
Consent for one seller item approves all bundled items.
Package conditions: seller consent scope · case 04
Consent for one seller item approves all bundled items.
Package conditions: seller consent scope · case 05
Consent for one seller item approves all bundled items.
Package conditions: substitute collision · case 01
Substitute sets may deliver two mutually substitutable items.
Package conditions: substitute collision · case 02
Substitute sets may deliver two mutually substitutable items.
Package conditions: substitute collision · case 03
Substitute sets may deliver two mutually substitutable items.
Package conditions: substitute collision · case 04
Substitute sets may deliver two mutually substitutable items.
Package conditions: substitute collision · case 05
Substitute sets may deliver two mutually substitutable items.
Package conditions: divisibility certificate · case 01
Package splitting assumes that any divisible component makes the entire split valid.
Package conditions: divisibility certificate · case 02
Package splitting assumes that any divisible component makes the entire split valid.
Package conditions: divisibility certificate · case 03
Package splitting assumes that any divisible component makes the entire split valid.
Package conditions: divisibility certificate · case 04
Package splitting assumes that any divisible component makes the entire split valid.
Package conditions: divisibility certificate · case 05
Package splitting assumes that any divisible component makes the entire split valid.
Package conditions: prior package encumbrance · case 01
Previously awarded package inventory is reused when whole sets differ.
Package conditions: prior package encumbrance · case 02
Previously awarded package inventory is reused when whole sets differ.
Package conditions: prior package encumbrance · case 03
Previously awarded package inventory is reused when whole sets differ.
Package conditions: prior package encumbrance · case 04
Previously awarded package inventory is reused when whole sets differ.
Package conditions: prior package encumbrance · case 05
Previously awarded package inventory is reused when whole sets differ.
Activity eligibility: withdrawn activity · case 01
Withdrawn lots continue earning activity points.
Activity eligibility: withdrawn activity · case 02
Withdrawn lots continue earning activity points.
Activity eligibility: withdrawn activity · case 03
Withdrawn lots continue earning activity points.
Activity eligibility: withdrawn activity · case 04
Withdrawn lots continue earning activity points.
Activity eligibility: withdrawn activity · case 05
Withdrawn lots continue earning activity points.
Activity eligibility: standing credit dedup · case 01
Standing and new demand double-credit one lot.
Activity eligibility: standing credit dedup · case 02
Standing and new demand double-credit one lot.
Activity eligibility: standing credit dedup · case 03
Standing and new demand double-credit one lot.
Activity eligibility: standing credit dedup · case 04
Standing and new demand double-credit one lot.
Activity eligibility: standing credit dedup · case 05
Standing and new demand double-credit one lot.
Activity eligibility: waiver availability · case 01
An exhausted or unrequested waiver becomes effective.
Activity eligibility: waiver availability · case 02
An exhausted or unrequested waiver becomes effective.
Activity eligibility: waiver availability · case 03
An exhausted or unrequested waiver becomes effective.
Activity eligibility: waiver availability · case 04
An exhausted or unrequested waiver becomes effective.
Activity eligibility: waiver availability · case 05
An exhausted or unrequested waiver becomes effective.
Activity eligibility: waiver consumption · case 01
Waiver accounting can go negative or fail to consume a used waiver.
Activity eligibility: waiver consumption · case 02
Waiver accounting can go negative or fail to consume a used waiver.
Activity eligibility: waiver consumption · case 03
Waiver accounting can go negative or fail to consume a used waiver.
Activity eligibility: waiver consumption · case 04
Waiver accounting can go negative or fail to consume a used waiver.
Activity eligibility: waiver consumption · case 05
Waiver accounting can go negative or fail to consume a used waiver.
Activity eligibility: eligibility monotonicity · case 01
A new round restores eligibility that earlier inactivity removed.
Activity eligibility: eligibility monotonicity · case 02
A new round restores eligibility that earlier inactivity removed.
Activity eligibility: eligibility monotonicity · case 03
A new round restores eligibility that earlier inactivity removed.
Activity eligibility: eligibility monotonicity · case 04
A new round restores eligibility that earlier inactivity removed.
Activity eligibility: eligibility monotonicity · case 05
A new round restores eligibility that earlier inactivity removed.
Activity eligibility: waiver preservation · case 01
A valid waiver fails to preserve prior eligibility.
Activity eligibility: waiver preservation · case 02
A valid waiver fails to preserve prior eligibility.
Activity eligibility: waiver preservation · case 03
A valid waiver fails to preserve prior eligibility.
Activity eligibility: waiver preservation · case 04
A valid waiver fails to preserve prior eligibility.
Activity eligibility: waiver preservation · case 05
A valid waiver fails to preserve prior eligibility.
Activity eligibility: round advance · case 01
Replaying a round adds another eligibility-history decision.
Activity eligibility: round advance · case 02
Replaying a round adds another eligibility-history decision.
Activity eligibility: round advance · case 03
Replaying a round adds another eligibility-history decision.
Activity eligibility: round advance · case 04
Replaying a round adds another eligibility-history decision.
Activity eligibility: round advance · case 05
Replaying a round adds another eligibility-history decision.
Activity eligibility: stage ceiling · case 01
Stage transition uses the initial ceiling or increases existing eligibility.
Activity eligibility: stage ceiling · case 02
Stage transition uses the initial ceiling or increases existing eligibility.
Activity eligibility: stage ceiling · case 03
Stage transition uses the initial ceiling or increases existing eligibility.
Activity eligibility: stage ceiling · case 04
Stage transition uses the initial ceiling or increases existing eligibility.
Activity eligibility: stage ceiling · case 05
Stage transition uses the initial ceiling or increases existing eligibility.
Activity eligibility: transfer cap · case 01
Transferred eligibility bypasses the bidder qualification cap.
Activity eligibility: transfer cap · case 02
Transferred eligibility bypasses the bidder qualification cap.
Activity eligibility: transfer cap · case 03
Transferred eligibility bypasses the bidder qualification cap.
Activity eligibility: transfer cap · case 04
Transferred eligibility bypasses the bidder qualification cap.
Activity eligibility: transfer cap · case 05
Transferred eligibility bypasses the bidder qualification cap.
Activity eligibility: revocation · case 01
Revocation preserves residual eligibility or requalification restores lost points.
Activity eligibility: revocation · case 02
Revocation preserves residual eligibility or requalification restores lost points.
Activity eligibility: revocation · case 03
Revocation preserves residual eligibility or requalification restores lost points.
Activity eligibility: revocation · case 04
Revocation preserves residual eligibility or requalification restores lost points.
Activity eligibility: revocation · case 05
Revocation preserves residual eligibility or requalification restores lost points.
Clock demand: accepted reduction · case 01
Unaccepted demand reductions change the binding clock quantity.
Clock demand: accepted reduction · case 02
Unaccepted demand reductions change the binding clock quantity.
Clock demand: accepted reduction · case 03
Unaccepted demand reductions change the binding clock quantity.
Clock demand: accepted reduction · case 04
Unaccepted demand reductions change the binding clock quantity.
Clock demand: accepted reduction · case 05
Unaccepted demand reductions change the binding clock quantity.
Clock demand: irreversible exit · case 01
A previously exited lot silently reacquires demand after reopening.
Clock demand: irreversible exit · case 02
A previously exited lot silently reacquires demand after reopening.
Clock demand: irreversible exit · case 03
A previously exited lot silently reacquires demand after reopening.
Clock demand: irreversible exit · case 04
A previously exited lot silently reacquires demand after reopening.
Clock demand: irreversible exit · case 05
A previously exited lot silently reacquires demand after reopening.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗