Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Permit constrained award: unreserved permit quota · case 01
Concurrent award reservations double-use permit quota.
Permit constrained award: unreserved permit quota · case 02
Concurrent award reservations double-use permit quota.
Permit constrained award: unreserved permit quota · case 03
Concurrent award reservations double-use permit quota.
Permit constrained award: unreserved permit quota · case 04
Concurrent award reservations double-use permit quota.
Permit constrained award: unreserved permit quota · case 05
Concurrent award reservations double-use permit quota.
Permit constrained award: accepted quota consumption · case 01
A provisional award consumes quota before acceptance or never consumes it.
Permit constrained award: accepted quota consumption · case 02
A provisional award consumes quota before acceptance or never consumes it.
Permit constrained award: accepted quota consumption · case 03
A provisional award consumes quota before acceptance or never consumes it.
Permit constrained award: accepted quota consumption · case 04
A provisional award consumes quota before acceptance or never consumes it.
Permit constrained award: accepted quota consumption · case 05
A provisional award consumes quota before acceptance or never consumes it.
Permit constrained award: acknowledged quota restoration · case 01
Unacknowledged returned award units restore regulated quota.
Permit constrained award: acknowledged quota restoration · case 02
Unacknowledged returned award units restore regulated quota.
Permit constrained award: acknowledged quota restoration · case 03
Unacknowledged returned award units restore regulated quota.
Permit constrained award: acknowledged quota restoration · case 04
Unacknowledged returned award units restore regulated quota.
Permit constrained award: acknowledged quota restoration · case 05
Unacknowledged returned award units restore regulated quota.
Permit constrained award: award time permit validity · case 01
Delivery timing replaces the stipulated permit validity at award.
Permit constrained award: award time permit validity · case 02
Delivery timing replaces the stipulated permit validity at award.
Permit constrained award: award time permit validity · case 03
Delivery timing replaces the stipulated permit validity at award.
Permit constrained award: award time permit validity · case 04
Delivery timing replaces the stipulated permit validity at award.
Permit constrained award: award time permit validity · case 05
Delivery timing replaces the stipulated permit validity at award.
Permit constrained award: delivery permit recheck · case 01
Delivery release relies solely on permit validity when awarded.
Permit constrained award: delivery permit recheck · case 02
Delivery release relies solely on permit validity when awarded.
Permit constrained award: delivery permit recheck · case 03
Delivery release relies solely on permit validity when awarded.
Permit constrained award: delivery permit recheck · case 04
Delivery release relies solely on permit validity when awarded.
Permit constrained award: delivery permit recheck · case 05
Delivery release relies solely on permit validity when awarded.
Permit constrained award: revoked permit selection · case 01
An assigned revoked permit is accepted or replaced with an unassigned permit.
Permit constrained award: revoked permit selection · case 02
An assigned revoked permit is accepted or replaced with an unassigned permit.
Permit constrained award: revoked permit selection · case 03
An assigned revoked permit is accepted or replaced with an unassigned permit.
Permit constrained award: revoked permit selection · case 04
An assigned revoked permit is accepted or replaced with an unassigned permit.
Permit constrained award: revoked permit selection · case 05
An assigned revoked permit is accepted or replaced with an unassigned permit.
Permit constrained award: two party license · case 01
Only one licensed party suffices for a bilateral regulated award.
Permit constrained award: two party license · case 02
Only one licensed party suffices for a bilateral regulated award.
Permit constrained award: two party license · case 03
Only one licensed party suffices for a bilateral regulated award.
Permit constrained award: two party license · case 04
Only one licensed party suffices for a bilateral regulated award.
Permit constrained award: two party license · case 05
Only one licensed party suffices for a bilateral regulated award.
Permit constrained award: permit owner transfer · case 01
An unrelated permit holder covers the award without an approved transfer.
Permit constrained award: permit owner transfer · case 02
An unrelated permit holder covers the award without an approved transfer.
Permit constrained award: permit owner transfer · case 03
An unrelated permit holder covers the award without an approved transfer.
Permit constrained award: permit owner transfer · case 04
An unrelated permit holder covers the award without an approved transfer.
Permit constrained award: permit owner transfer · case 05
An unrelated permit holder covers the award without an approved transfer.
Seller supply amendment: award inventory floor · case 01
Supply reduction removes already awarded inventory or prevents every reduction.
Seller supply amendment: award inventory floor · case 02
Supply reduction removes already awarded inventory or prevents every reduction.
Seller supply amendment: award inventory floor · case 03
Supply reduction removes already awarded inventory or prevents every reduction.
Seller supply amendment: award inventory floor · case 04
Supply reduction removes already awarded inventory or prevents every reduction.
Seller supply amendment: award inventory floor · case 05
Supply reduction removes already awarded inventory or prevents every reduction.
Seller supply amendment: reservation inventory floor · case 01
A supply amendment preserves awards but removes separately reserved stock.
Seller supply amendment: reservation inventory floor · case 02
A supply amendment preserves awards but removes separately reserved stock.
Seller supply amendment: reservation inventory floor · case 03
A supply amendment preserves awards but removes separately reserved stock.
Seller supply amendment: reservation inventory floor · case 04
A supply amendment preserves awards but removes separately reserved stock.
Seller supply amendment: reservation inventory floor · case 05
A supply amendment preserves awards but removes separately reserved stock.
Seller supply amendment: freeze supply increase · case 01
Frozen supply permits increases or blocks permitted decreases.
Seller supply amendment: freeze supply increase · case 02
Frozen supply permits increases or blocks permitted decreases.
Seller supply amendment: freeze supply increase · case 03
Frozen supply permits increases or blocks permitted decreases.
Seller supply amendment: freeze supply increase · case 04
Frozen supply permits increases or blocks permitted decreases.
Seller supply amendment: freeze supply increase · case 05
Frozen supply permits increases or blocks permitted decreases.
Seller supply amendment: supply approval atomicity · case 01
Rejected supply replacement erases the prior offered inventory.
Seller supply amendment: supply approval atomicity · case 02
Rejected supply replacement erases the prior offered inventory.
Seller supply amendment: supply approval atomicity · case 03
Rejected supply replacement erases the prior offered inventory.
Seller supply amendment: supply approval atomicity · case 04
Rejected supply replacement erases the prior offered inventory.
Seller supply amendment: supply approval atomicity · case 05
Rejected supply replacement erases the prior offered inventory.
Seller supply amendment: withdrawal unawarded stock · case 01
Seller withdrawal includes firm reserved auction stock.
Seller supply amendment: withdrawal unawarded stock · case 02
Seller withdrawal includes firm reserved auction stock.
Seller supply amendment: withdrawal unawarded stock · case 03
Seller withdrawal includes firm reserved auction stock.
Seller supply amendment: withdrawal unawarded stock · case 04
Seller withdrawal includes firm reserved auction stock.
Seller supply amendment: withdrawal unawarded stock · case 05
Seller withdrawal includes firm reserved auction stock.
Seller supply amendment: delivered stock accounting · case 01
Inventory remaining on site is confused with unawarded inventory.
Seller supply amendment: delivered stock accounting · case 02
Inventory remaining on site is confused with unawarded inventory.
Seller supply amendment: delivered stock accounting · case 03
Inventory remaining on site is confused with unawarded inventory.
Seller supply amendment: delivered stock accounting · case 04
Inventory remaining on site is confused with unawarded inventory.
Seller supply amendment: delivered stock accounting · case 05
Inventory remaining on site is confused with unawarded inventory.
Seller supply amendment: certified added quantity · case 01
A certificate for one added unit authorizes a larger supply increase.
Seller supply amendment: certified added quantity · case 02
A certificate for one added unit authorizes a larger supply increase.
Seller supply amendment: certified added quantity · case 03
A certificate for one added unit authorizes a larger supply increase.
Seller supply amendment: certified added quantity · case 04
A certificate for one added unit authorizes a larger supply increase.
Seller supply amendment: certified added quantity · case 05
A certificate for one added unit authorizes a larger supply increase.
Seller supply amendment: seller amendment ownership · case 01
One seller edits another seller auction lot inventory.
Seller supply amendment: seller amendment ownership · case 02
One seller edits another seller auction lot inventory.
Seller supply amendment: seller amendment ownership · case 03
One seller edits another seller auction lot inventory.
Seller supply amendment: seller amendment ownership · case 04
One seller edits another seller auction lot inventory.
Seller supply amendment: seller amendment ownership · case 05
One seller edits another seller auction lot inventory.
Seller supply amendment: consented supply change · case 01
Supply changes ignore the per-lot seller consent schedule.
Seller supply amendment: consented supply change · case 02
Supply changes ignore the per-lot seller consent schedule.
Seller supply amendment: consented supply change · case 03
Supply changes ignore the per-lot seller consent schedule.
Seller supply amendment: consented supply change · case 04
Supply changes ignore the per-lot seller consent schedule.
Seller supply amendment: consented supply change · case 05
Supply changes ignore the per-lot seller consent schedule.
Seller supply amendment: inventory revision guard · case 01
A stale seller inventory amendment overwrites later reservations.
Seller supply amendment: inventory revision guard · case 02
A stale seller inventory amendment overwrites later reservations.
Seller supply amendment: inventory revision guard · case 03
A stale seller inventory amendment overwrites later reservations.
Seller supply amendment: inventory revision guard · case 04
A stale seller inventory amendment overwrites later reservations.
Seller supply amendment: inventory revision guard · case 05
A stale seller inventory amendment overwrites later reservations.
Reserve schedule: effective reserve step · case 01
Reserve lookup uses the final scheduled value before it takes effect.
Reserve schedule: effective reserve step · case 02
Reserve lookup uses the final scheduled value before it takes effect.
Reserve schedule: effective reserve step · case 03
Reserve lookup uses the final scheduled value before it takes effect.
Reserve schedule: effective reserve step · case 04
Reserve lookup uses the final scheduled value before it takes effect.
Reserve schedule: effective reserve step · case 05
Reserve lookup uses the final scheduled value before it takes effect.
Reserve schedule: approved reserve step · case 01
Unapproved scheduled reserve reductions become effective.
Reserve schedule: approved reserve step · case 02
Unapproved scheduled reserve reductions become effective.
Reserve schedule: approved reserve step · case 03
Unapproved scheduled reserve reductions become effective.
Reserve schedule: approved reserve step · case 04
Unapproved scheduled reserve reductions become effective.
Reserve schedule: approved reserve step · case 05
Unapproved scheduled reserve reductions become effective.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗