Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Discrete range order follows option order and permits a single option · case 01
Discrete range order follows option order and permits a single option is violated by the widget projection.
Discrete range order follows option order and permits a single option · case 02
Discrete range order follows option order and permits a single option is violated by the widget projection.
Discrete range order follows option order and permits a single option · case 03
Discrete range order follows option order and permits a single option is violated by the widget projection.
Discrete range order follows option order and permits a single option · case 04
Discrete range order follows option order and permits a single option is violated by the widget projection.
Discrete range order follows option order and permits a single option · case 05
Discrete range order follows option order and permits a single option is violated by the widget projection.
Filter payloads retain discrete endpoint identities instead of display indices · case 01
Filter payloads retain discrete endpoint identities instead of display indices is violated by the widget projection.
Filter payloads retain discrete endpoint identities instead of display indices · case 02
Filter payloads retain discrete endpoint identities instead of display indices is violated by the widget projection.
Filter payloads retain discrete endpoint identities instead of display indices · case 03
Filter payloads retain discrete endpoint identities instead of display indices is violated by the widget projection.
Filter payloads retain discrete endpoint identities instead of display indices · case 04
Filter payloads retain discrete endpoint identities instead of display indices is violated by the widget projection.
Filter payloads retain discrete endpoint identities instead of display indices · case 05
Filter payloads retain discrete endpoint identities instead of display indices is violated by the widget projection.
Removed endpoint options are explicitly marked unresolved · case 01
Removed endpoint options are explicitly marked unresolved is violated by the widget projection.
Removed endpoint options are explicitly marked unresolved · case 02
Removed endpoint options are explicitly marked unresolved is violated by the widget projection.
Removed endpoint options are explicitly marked unresolved · case 03
Removed endpoint options are explicitly marked unresolved is violated by the widget projection.
Removed endpoint options are explicitly marked unresolved · case 04
Removed endpoint options are explicitly marked unresolved is violated by the widget projection.
Removed endpoint options are explicitly marked unresolved · case 05
Removed endpoint options are explicitly marked unresolved is violated by the widget projection.
Only both extreme endpoints represent the full discrete domain · case 01
Only both extreme endpoints represent the full discrete domain is violated by the widget projection.
Only both extreme endpoints represent the full discrete domain · case 02
Only both extreme endpoints represent the full discrete domain is violated by the widget projection.
Only both extreme endpoints represent the full discrete domain · case 03
Only both extreme endpoints represent the full discrete domain is violated by the widget projection.
Only both extreme endpoints represent the full discrete domain · case 04
Only both extreme endpoints represent the full discrete domain is violated by the widget projection.
Only both extreme endpoints represent the full discrete domain · case 05
Only both extreme endpoints represent the full discrete domain is violated by the widget projection.
Pinned facet choices lead without dropping unpinned values · case 01
Pinned facet choices lead without dropping unpinned values is violated by the widget projection.
Pinned facet choices lead without dropping unpinned values · case 02
Pinned facet choices lead without dropping unpinned values is violated by the widget projection.
Pinned facet choices lead without dropping unpinned values · case 03
Pinned facet choices lead without dropping unpinned values is violated by the widget projection.
Pinned facet choices lead without dropping unpinned values · case 04
Pinned facet choices lead without dropping unpinned values is violated by the widget projection.
Pinned facet choices lead without dropping unpinned values · case 05
Pinned facet choices lead without dropping unpinned values is violated by the widget projection.
Selected-first facet presentation retains server order inside partitions · case 01
Selected-first facet presentation retains server order inside partitions is violated by the widget projection.
Selected-first facet presentation retains server order inside partitions · case 02
Selected-first facet presentation retains server order inside partitions is violated by the widget projection.
Selected-first facet presentation retains server order inside partitions · case 03
Selected-first facet presentation retains server order inside partitions is violated by the widget projection.
Selected-first facet presentation retains server order inside partitions · case 04
Selected-first facet presentation retains server order inside partitions is violated by the widget projection.
Selected-first facet presentation retains server order inside partitions · case 05
Selected-first facet presentation retains server order inside partitions is violated by the widget projection.
Unknown count options follow all known counts including zero · case 01
Unknown count options follow all known counts including zero is violated by the widget projection.
Unknown count options follow all known counts including zero · case 02
Unknown count options follow all known counts including zero is violated by the widget projection.
Unknown count options follow all known counts including zero · case 03
Unknown count options follow all known counts including zero is violated by the widget projection.
Unknown count options follow all known counts including zero · case 04
Unknown count options follow all known counts including zero is violated by the widget projection.
Unknown count options follow all known counts including zero · case 05
Unknown count options follow all known counts including zero is violated by the widget projection.
Descending count order does not merge unknown with exact zero · case 01
Descending count order does not merge unknown with exact zero is violated by the widget projection.
Descending count order does not merge unknown with exact zero · case 02
Descending count order does not merge unknown with exact zero is violated by the widget projection.
Descending count order does not merge unknown with exact zero · case 03
Descending count order does not merge unknown with exact zero is violated by the widget projection.
Descending count order does not merge unknown with exact zero · case 04
Descending count order does not merge unknown with exact zero is violated by the widget projection.
Descending count order does not merge unknown with exact zero · case 05
Descending count order does not merge unknown with exact zero is violated by the widget projection.
Equal-count facets retain the supplied option order · case 01
Equal-count facets retain the supplied option order is violated by the widget projection.
Equal-count facets retain the supplied option order · case 02
Equal-count facets retain the supplied option order is violated by the widget projection.
Equal-count facets retain the supplied option order · case 03
Equal-count facets retain the supplied option order is violated by the widget projection.
Equal-count facets retain the supplied option order · case 04
Equal-count facets retain the supplied option order is violated by the widget projection.
Equal-count facets retain the supplied option order · case 05
Equal-count facets retain the supplied option order is violated by the widget projection.
Pinned headers keep user pin order and exclude absent options · case 01
Pinned headers keep user pin order and exclude absent options is violated by the widget projection.
Pinned headers keep user pin order and exclude absent options · case 02
Pinned headers keep user pin order and exclude absent options is violated by the widget projection.
Pinned headers keep user pin order and exclude absent options · case 03
Pinned headers keep user pin order and exclude absent options is violated by the widget projection.
Pinned headers keep user pin order and exclude absent options · case 04
Pinned headers keep user pin order and exclude absent options is violated by the widget projection.
Pinned headers keep user pin order and exclude absent options · case 05
Pinned headers keep user pin order and exclude absent options is violated by the widget projection.
Preset picker selection follows a present stable identifier · case 01
Preset picker selection follows a present stable identifier is violated by the widget projection.
Preset picker selection follows a present stable identifier · case 02
Preset picker selection follows a present stable identifier is violated by the widget projection.
Preset picker selection follows a present stable identifier · case 03
Preset picker selection follows a present stable identifier is violated by the widget projection.
Preset picker selection follows a present stable identifier · case 04
Preset picker selection follows a present stable identifier is violated by the widget projection.
Preset picker selection follows a present stable identifier · case 05
Preset picker selection follows a present stable identifier is violated by the widget projection.
Preset choices use exact compatible scope · case 01
Preset choices use exact compatible scope is violated by the widget projection.
Preset choices use exact compatible scope · case 02
Preset choices use exact compatible scope is violated by the widget projection.
Preset choices use exact compatible scope · case 03
Preset choices use exact compatible scope is violated by the widget projection.
Preset choices use exact compatible scope · case 04
Preset choices use exact compatible scope is violated by the widget projection.
Preset choices use exact compatible scope · case 05
Preset choices use exact compatible scope is violated by the widget projection.
Dirty preset selection is visibly marked modified · case 01
Dirty preset selection is visibly marked modified is violated by the widget projection.
Dirty preset selection is visibly marked modified · case 02
Dirty preset selection is visibly marked modified is violated by the widget projection.
Dirty preset selection is visibly marked modified · case 03
Dirty preset selection is visibly marked modified is violated by the widget projection.
Dirty preset selection is visibly marked modified · case 04
Dirty preset selection is visibly marked modified is violated by the widget projection.
Dirty preset selection is visibly marked modified · case 05
Dirty preset selection is visibly marked modified is violated by the widget projection.
Unavailable preset warnings exclude the no-preset state · case 01
Unavailable preset warnings exclude the no-preset state is violated by the widget projection.
Unavailable preset warnings exclude the no-preset state · case 02
Unavailable preset warnings exclude the no-preset state is violated by the widget projection.
Unavailable preset warnings exclude the no-preset state · case 03
Unavailable preset warnings exclude the no-preset state is violated by the widget projection.
Unavailable preset warnings exclude the no-preset state · case 04
Unavailable preset warnings exclude the no-preset state is violated by the widget projection.
Unavailable preset warnings exclude the no-preset state · case 05
Unavailable preset warnings exclude the no-preset state is violated by the widget projection.
Caption disambiguation activates only for duplicate preset labels · case 01
Caption disambiguation activates only for duplicate preset labels is violated by the widget projection.
Caption disambiguation activates only for duplicate preset labels · case 02
Caption disambiguation activates only for duplicate preset labels is violated by the widget projection.
Caption disambiguation activates only for duplicate preset labels · case 03
Caption disambiguation activates only for duplicate preset labels is violated by the widget projection.
Caption disambiguation activates only for duplicate preset labels · case 04
Caption disambiguation activates only for duplicate preset labels is violated by the widget projection.
Caption disambiguation activates only for duplicate preset labels · case 05
Caption disambiguation activates only for duplicate preset labels is violated by the widget projection.
Preset application reads the chosen stable-ID configuration · case 01
Preset application reads the chosen stable-ID configuration is violated by the widget projection.
Preset application reads the chosen stable-ID configuration · case 02
Preset application reads the chosen stable-ID configuration is violated by the widget projection.
Preset application reads the chosen stable-ID configuration · case 03
Preset application reads the chosen stable-ID configuration is violated by the widget projection.
Preset application reads the chosen stable-ID configuration · case 04
Preset application reads the chosen stable-ID configuration is violated by the widget projection.
Preset application reads the chosen stable-ID configuration · case 05
Preset application reads the chosen stable-ID configuration is violated by the widget projection.
Preview requests require a valid draft in an open editor · case 01
Preview requests require a valid draft in an open editor is violated by the widget projection.
Preview requests require a valid draft in an open editor · case 02
Preview requests require a valid draft in an open editor is violated by the widget projection.
Preview requests require a valid draft in an open editor · case 03
Preview requests require a valid draft in an open editor is violated by the widget projection.
Preview requests require a valid draft in an open editor · case 04
Preview requests require a valid draft in an open editor is violated by the widget projection.
Preview requests require a valid draft in an open editor · case 05
Preview requests require a valid draft in an open editor is violated by the widget projection.
Preview replies match both current draft revision and scope · case 01
Preview replies match both current draft revision and scope is violated by the widget projection.
Preview replies match both current draft revision and scope · case 02
Preview replies match both current draft revision and scope is violated by the widget projection.
Preview replies match both current draft revision and scope · case 03
Preview replies match both current draft revision and scope is violated by the widget projection.
Preview replies match both current draft revision and scope · case 04
Preview replies match both current draft revision and scope is violated by the widget projection.
Preview replies match both current draft revision and scope · case 05
Preview replies match both current draft revision and scope is violated by the widget projection.
Preview completion never applies draft criteria · case 01
Preview completion never applies draft criteria is violated by the widget projection.
Preview completion never applies draft criteria · case 02
Preview completion never applies draft criteria is violated by the widget projection.
Preview completion never applies draft criteria · case 03
Preview completion never applies draft criteria is violated by the widget projection.
Preview completion never applies draft criteria · case 04
Preview completion never applies draft criteria is violated by the widget projection.
Preview completion never applies draft criteria · case 05
Preview completion never applies draft criteria is violated by the widget projection.
Only valid current-draft estimates display a count · case 01
Only valid current-draft estimates display a count is violated by the widget projection.
Only valid current-draft estimates display a count · case 02
Only valid current-draft estimates display a count is violated by the widget projection.
Only valid current-draft estimates display a count · case 03
Only valid current-draft estimates display a count is violated by the widget projection.
Only valid current-draft estimates display a count · case 04
Only valid current-draft estimates display a count is violated by the widget projection.
Only valid current-draft estimates display a count · case 05
Only valid current-draft estimates display a count is violated by the widget projection.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗