Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Suggestion identity reconciliation: result reconciliation marks retained identifiers as newly arrived · case 01
The added completion transition produces an incorrect observable state.
Suggestion identity reconciliation: result reconciliation marks retained identifiers as newly arrived · case 02
The added completion transition produces an incorrect observable state.
Suggestion identity reconciliation: result reconciliation marks retained identifiers as newly arrived · case 03
The added completion transition produces an incorrect observable state.
Suggestion identity reconciliation: result reconciliation marks retained identifiers as newly arrived · case 04
The added completion transition produces an incorrect observable state.
Suggestion identity reconciliation: result reconciliation marks retained identifiers as newly arrived · case 05
The added completion transition produces an incorrect observable state.
Suggestion identity reconciliation: removed suggestions are computed against labels · case 01
The removed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: removed suggestions are computed against labels · case 02
The removed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: removed suggestions are computed against labels · case 03
The removed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: removed suggestions are computed against labels · case 04
The removed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: removed suggestions are computed against labels · case 05
The removed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: a response drops a committed value absent from suggestions · case 01
The committed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: a response drops a committed value absent from suggestions · case 02
The committed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: a response drops a committed value absent from suggestions · case 03
The committed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: a response drops a committed value absent from suggestions · case 04
The committed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: a response drops a committed value absent from suggestions · case 05
The committed completion transition produces an incorrect observable state.
Suggestion identity reconciliation: retained active option displays its obsolete label · case 01
The active-label completion transition produces an incorrect observable state.
Suggestion identity reconciliation: retained active option displays its obsolete label · case 02
The active-label completion transition produces an incorrect observable state.
Suggestion identity reconciliation: retained active option displays its obsolete label · case 03
The active-label completion transition produces an incorrect observable state.
Suggestion identity reconciliation: retained active option displays its obsolete label · case 04
The active-label completion transition produces an incorrect observable state.
Suggestion identity reconciliation: retained active option displays its obsolete label · case 05
The active-label completion transition produces an incorrect observable state.
Suggestion identity reconciliation: stale-query suggestions become selectable · case 01
The render-query completion transition produces an incorrect observable state.
Suggestion identity reconciliation: stale-query suggestions become selectable · case 02
The render-query completion transition produces an incorrect observable state.
Suggestion identity reconciliation: stale-query suggestions become selectable · case 03
The render-query completion transition produces an incorrect observable state.
Suggestion identity reconciliation: stale-query suggestions become selectable · case 04
The render-query completion transition produces an incorrect observable state.
Suggestion identity reconciliation: stale-query suggestions become selectable · case 05
The render-query completion transition produces an incorrect observable state.
Suggestion identity reconciliation: query replacement retains the former result highlight · case 01
The replacement completion transition produces an incorrect observable state.
Suggestion identity reconciliation: query replacement retains the former result highlight · case 02
The replacement completion transition produces an incorrect observable state.
Suggestion identity reconciliation: query replacement retains the former result highlight · case 03
The replacement completion transition produces an incorrect observable state.
Suggestion identity reconciliation: query replacement retains the former result highlight · case 04
The replacement completion transition produces an incorrect observable state.
Suggestion identity reconciliation: query replacement retains the former result highlight · case 05
The replacement completion transition produces an incorrect observable state.
Suggestion identity reconciliation: row identity uses a mutable display label · case 01
The row-key completion transition produces an incorrect observable state.
Suggestion identity reconciliation: row identity uses a mutable display label · case 02
The row-key completion transition produces an incorrect observable state.
Suggestion identity reconciliation: row identity uses a mutable display label · case 03
The row-key completion transition produces an incorrect observable state.
Suggestion identity reconciliation: row identity uses a mutable display label · case 04
The row-key completion transition produces an incorrect observable state.
Suggestion identity reconciliation: row identity uses a mutable display label · case 05
The row-key completion transition produces an incorrect observable state.
Suggestion identity reconciliation: missing committed suggestion is mistaken for empty selection · case 01
The selection-visible completion transition produces an incorrect observable state.
Suggestion identity reconciliation: missing committed suggestion is mistaken for empty selection · case 02
The selection-visible completion transition produces an incorrect observable state.
Suggestion identity reconciliation: missing committed suggestion is mistaken for empty selection · case 03
The selection-visible completion transition produces an incorrect observable state.
Suggestion identity reconciliation: missing committed suggestion is mistaken for empty selection · case 04
The selection-visible completion transition produces an incorrect observable state.
Suggestion identity reconciliation: missing committed suggestion is mistaken for empty selection · case 05
The selection-visible completion transition produces an incorrect observable state.
Autocomplete commit payload: commit submits a suggestion label instead of its identifier · case 01
The value completion transition produces an incorrect observable state.
Autocomplete commit payload: commit submits a suggestion label instead of its identifier · case 02
The value completion transition produces an incorrect observable state.
Autocomplete commit payload: commit submits a suggestion label instead of its identifier · case 03
The value completion transition produces an incorrect observable state.
Autocomplete commit payload: commit submits a suggestion label instead of its identifier · case 04
The value completion transition produces an incorrect observable state.
Autocomplete commit payload: commit submits a suggestion label instead of its identifier · case 05
The value completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion keeps the partial search text · case 01
The display completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion keeps the partial search text · case 02
The display completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion keeps the partial search text · case 03
The display completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion keeps the partial search text · case 04
The display completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion keeps the partial search text · case 05
The display completion transition produces an incorrect observable state.
Autocomplete commit payload: deferred commit reads the newly highlighted suggestion · case 01
The snapshot completion transition produces an incorrect observable state.
Autocomplete commit payload: deferred commit reads the newly highlighted suggestion · case 02
The snapshot completion transition produces an incorrect observable state.
Autocomplete commit payload: deferred commit reads the newly highlighted suggestion · case 03
The snapshot completion transition produces an incorrect observable state.
Autocomplete commit payload: deferred commit reads the newly highlighted suggestion · case 04
The snapshot completion transition produces an incorrect observable state.
Autocomplete commit payload: deferred commit reads the newly highlighted suggestion · case 05
The snapshot completion transition produces an incorrect observable state.
Autocomplete commit payload: commit attributes a remote suggestion to local history · case 01
The source completion transition produces an incorrect observable state.
Autocomplete commit payload: commit attributes a remote suggestion to local history · case 02
The source completion transition produces an incorrect observable state.
Autocomplete commit payload: commit attributes a remote suggestion to local history · case 03
The source completion transition produces an incorrect observable state.
Autocomplete commit payload: commit attributes a remote suggestion to local history · case 04
The source completion transition produces an incorrect observable state.
Autocomplete commit payload: commit attributes a remote suggestion to local history · case 05
The source completion transition produces an incorrect observable state.
Autocomplete commit payload: commit drops accepted option metadata · case 01
The metadata completion transition produces an incorrect observable state.
Autocomplete commit payload: commit drops accepted option metadata · case 02
The metadata completion transition produces an incorrect observable state.
Autocomplete commit payload: commit drops accepted option metadata · case 03
The metadata completion transition produces an incorrect observable state.
Autocomplete commit payload: commit drops accepted option metadata · case 04
The metadata completion transition produces an incorrect observable state.
Autocomplete commit payload: commit drops accepted option metadata · case 05
The metadata completion transition produces an incorrect observable state.
Autocomplete commit payload: reaccepting the current option emits a spurious value change · case 01
The reaccept-change completion transition produces an incorrect observable state.
Autocomplete commit payload: reaccepting the current option emits a spurious value change · case 02
The reaccept-change completion transition produces an incorrect observable state.
Autocomplete commit payload: reaccepting the current option emits a spurious value change · case 03
The reaccept-change completion transition produces an incorrect observable state.
Autocomplete commit payload: reaccepting the current option emits a spurious value change · case 04
The reaccept-change completion transition produces an incorrect observable state.
Autocomplete commit payload: reaccepting the current option emits a spurious value change · case 05
The reaccept-change completion transition produces an incorrect observable state.
Autocomplete commit payload: change payload reports the current highlight as previous value · case 01
The change completion transition produces an incorrect observable state.
Autocomplete commit payload: change payload reports the current highlight as previous value · case 02
The change completion transition produces an incorrect observable state.
Autocomplete commit payload: change payload reports the current highlight as previous value · case 03
The change completion transition produces an incorrect observable state.
Autocomplete commit payload: change payload reports the current highlight as previous value · case 04
The change completion transition produces an incorrect observable state.
Autocomplete commit payload: change payload reports the current highlight as previous value · case 05
The change completion transition produces an incorrect observable state.
Autocomplete commit payload: commit analytics lose the actual acceptance gesture · case 01
The reason completion transition produces an incorrect observable state.
Autocomplete commit payload: commit analytics lose the actual acceptance gesture · case 02
The reason completion transition produces an incorrect observable state.
Autocomplete commit payload: commit analytics lose the actual acceptance gesture · case 03
The reason completion transition produces an incorrect observable state.
Autocomplete commit payload: commit analytics lose the actual acceptance gesture · case 04
The reason completion transition produces an incorrect observable state.
Autocomplete commit payload: commit analytics lose the actual acceptance gesture · case 05
The reason completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion remains a transient selectable candidate · case 01
The cleanup completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion remains a transient selectable candidate · case 02
The cleanup completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion remains a transient selectable candidate · case 03
The cleanup completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion remains a transient selectable candidate · case 04
The cleanup completion transition produces an incorrect observable state.
Autocomplete commit payload: accepted suggestion remains a transient selectable candidate · case 05
The cleanup completion transition produces an incorrect observable state.
Autocomplete commit payload: acceptance compares the option snapshot to the preceding query · case 01
The freshness completion transition produces an incorrect observable state.
Autocomplete commit payload: acceptance compares the option snapshot to the preceding query · case 02
The freshness completion transition produces an incorrect observable state.
Autocomplete commit payload: acceptance compares the option snapshot to the preceding query · case 03
The freshness completion transition produces an incorrect observable state.
Autocomplete commit payload: acceptance compares the option snapshot to the preceding query · case 04
The freshness completion transition produces an incorrect observable state.
Autocomplete commit payload: acceptance compares the option snapshot to the preceding query · case 05
The freshness completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting an existing token duplicates a selected identifier · case 01
The repeat completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting an existing token duplicates a selected identifier · case 02
The repeat completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting an existing token duplicates a selected identifier · case 03
The repeat completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting an existing token duplicates a selected identifier · case 04
The repeat completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting an existing token duplicates a selected identifier · case 05
The repeat completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: a newly selected completion is prepended to prior values · case 01
The append completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: a newly selected completion is prepended to prior values · case 02
The append completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: a newly selected completion is prepended to prior values · case 03
The append completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: a newly selected completion is prepended to prior values · case 04
The append completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: a newly selected completion is prepended to prior values · case 05
The append completion transition produces an incorrect observable state.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗