Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Hierarchical path autocomplete: path completion drops ancestors when replacing the final segment · case 01
The replace completion transition produces an incorrect observable state.
Hierarchical path autocomplete: path completion drops ancestors when replacing the final segment · case 02
The replace completion transition produces an incorrect observable state.
Hierarchical path autocomplete: path completion drops ancestors when replacing the final segment · case 03
The replace completion transition produces an incorrect observable state.
Hierarchical path autocomplete: path completion drops ancestors when replacing the final segment · case 04
The replace completion transition produces an incorrect observable state.
Hierarchical path autocomplete: path completion drops ancestors when replacing the final segment · case 05
The replace completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory omits the next-segment separator · case 01
The directory-suffix completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory omits the next-segment separator · case 02
The directory-suffix completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory omits the next-segment separator · case 03
The directory-suffix completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory omits the next-segment separator · case 04
The directory-suffix completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory omits the next-segment separator · case 05
The directory-suffix completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory traversal is submitted as a final leaf selection · case 01
The commit completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory traversal is submitted as a final leaf selection · case 02
The commit completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory traversal is submitted as a final leaf selection · case 03
The commit completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory traversal is submitted as a final leaf selection · case 04
The commit completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory traversal is submitted as a final leaf selection · case 05
The commit completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory closes further path completion · case 01
The continue completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory closes further path completion · case 02
The continue completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory closes further path completion · case 03
The continue completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory closes further path completion · case 04
The continue completion transition produces an incorrect observable state.
Hierarchical path autocomplete: accepting a directory closes further path completion · case 05
The continue completion transition produces an incorrect observable state.
Hierarchical path autocomplete: child suggestions arrive under a different parent path · case 01
The response-parent completion transition produces an incorrect observable state.
Hierarchical path autocomplete: child suggestions arrive under a different parent path · case 02
The response-parent completion transition produces an incorrect observable state.
Hierarchical path autocomplete: child suggestions arrive under a different parent path · case 03
The response-parent completion transition produces an incorrect observable state.
Hierarchical path autocomplete: child suggestions arrive under a different parent path · case 04
The response-parent completion transition produces an incorrect observable state.
Hierarchical path autocomplete: child suggestions arrive under a different parent path · case 05
The response-parent completion transition produces an incorrect observable state.
Hierarchical path autocomplete: trailing slash is treated as an empty search with no suggestions · case 01
The empty-segment completion transition produces an incorrect observable state.
Hierarchical path autocomplete: trailing slash is treated as an empty search with no suggestions · case 02
The empty-segment completion transition produces an incorrect observable state.
Hierarchical path autocomplete: trailing slash is treated as an empty search with no suggestions · case 03
The empty-segment completion transition produces an incorrect observable state.
Hierarchical path autocomplete: trailing slash is treated as an empty search with no suggestions · case 04
The empty-segment completion transition produces an incorrect observable state.
Hierarchical path autocomplete: trailing slash is treated as an empty search with no suggestions · case 05
The empty-segment completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory acceptance searches the old parent again · case 01
The next-scope completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory acceptance searches the old parent again · case 02
The next-scope completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory acceptance searches the old parent again · case 03
The next-scope completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory acceptance searches the old parent again · case 04
The next-scope completion transition produces an incorrect observable state.
Hierarchical path autocomplete: directory acceptance searches the old parent again · case 05
The next-scope completion transition produces an incorrect observable state.
Hierarchical path autocomplete: leaf acceptance carries a directory-only continuation marker · case 01
The leaf-continuation completion transition produces an incorrect observable state.
Hierarchical path autocomplete: leaf acceptance carries a directory-only continuation marker · case 02
The leaf-continuation completion transition produces an incorrect observable state.
Hierarchical path autocomplete: leaf acceptance carries a directory-only continuation marker · case 03
The leaf-continuation completion transition produces an incorrect observable state.
Hierarchical path autocomplete: leaf acceptance carries a directory-only continuation marker · case 04
The leaf-continuation completion transition produces an incorrect observable state.
Hierarchical path autocomplete: leaf acceptance carries a directory-only continuation marker · case 05
The leaf-continuation completion transition produces an incorrect observable state.
Command argument suggestions: argument lookup uses total argument count instead of caret position · case 01
The position completion transition produces an incorrect observable state.
Command argument suggestions: argument lookup uses total argument count instead of caret position · case 02
The position completion transition produces an incorrect observable state.
Command argument suggestions: argument lookup uses total argument count instead of caret position · case 03
The position completion transition produces an incorrect observable state.
Command argument suggestions: argument lookup uses total argument count instead of caret position · case 04
The position completion transition produces an incorrect observable state.
Command argument suggestions: argument lookup uses total argument count instead of caret position · case 05
The position completion transition produces an incorrect observable state.
Command argument suggestions: argument suggestion provider is selected from the wrong command · case 01
The command completion transition produces an incorrect observable state.
Command argument suggestions: argument suggestion provider is selected from the wrong command · case 02
The command completion transition produces an incorrect observable state.
Command argument suggestions: argument suggestion provider is selected from the wrong command · case 03
The command completion transition produces an incorrect observable state.
Command argument suggestions: argument suggestion provider is selected from the wrong command · case 04
The command completion transition produces an incorrect observable state.
Command argument suggestions: argument suggestion provider is selected from the wrong command · case 05
The command completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance discards subsequent command arguments · case 01
The replace completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance discards subsequent command arguments · case 02
The replace completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance discards subsequent command arguments · case 03
The replace completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance discards subsequent command arguments · case 04
The replace completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance discards subsequent command arguments · case 05
The replace completion transition produces an incorrect observable state.
Command argument suggestions: space-containing completion is inserted as multiple arguments · case 01
The quote completion transition produces an incorrect observable state.
Command argument suggestions: space-containing completion is inserted as multiple arguments · case 02
The quote completion transition produces an incorrect observable state.
Command argument suggestions: space-containing completion is inserted as multiple arguments · case 03
The quote completion transition produces an incorrect observable state.
Command argument suggestions: space-containing completion is inserted as multiple arguments · case 04
The quote completion transition produces an incorrect observable state.
Command argument suggestions: space-containing completion is inserted as multiple arguments · case 05
The quote completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance replaces the command verb · case 01
The verb completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance replaces the command verb · case 02
The verb completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance replaces the command verb · case 03
The verb completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance replaces the command verb · case 04
The verb completion transition produces an incorrect observable state.
Command argument suggestions: argument acceptance replaces the command verb · case 05
The verb completion transition produces an incorrect observable state.
Command argument suggestions: already supplied named argument remains in completions · case 01
The names completion transition produces an incorrect observable state.
Command argument suggestions: already supplied named argument remains in completions · case 02
The names completion transition produces an incorrect observable state.
Command argument suggestions: already supplied named argument remains in completions · case 03
The names completion transition produces an incorrect observable state.
Command argument suggestions: already supplied named argument remains in completions · case 04
The names completion transition produces an incorrect observable state.
Command argument suggestions: already supplied named argument remains in completions · case 05
The names completion transition produces an incorrect observable state.
Command argument suggestions: argument results from a previous command are admitted · case 01
The response-command completion transition produces an incorrect observable state.
Command argument suggestions: argument results from a previous command are admitted · case 02
The response-command completion transition produces an incorrect observable state.
Command argument suggestions: argument results from a previous command are admitted · case 03
The response-command completion transition produces an incorrect observable state.
Command argument suggestions: argument results from a previous command are admitted · case 04
The response-command completion transition produces an incorrect observable state.
Command argument suggestions: argument results from a previous command are admitted · case 05
The response-command completion transition produces an incorrect observable state.
Command argument suggestions: results for a different argument position become selectable · case 01
The response-position completion transition produces an incorrect observable state.
Command argument suggestions: results for a different argument position become selectable · case 02
The response-position completion transition produces an incorrect observable state.
Command argument suggestions: results for a different argument position become selectable · case 03
The response-position completion transition produces an incorrect observable state.
Command argument suggestions: results for a different argument position become selectable · case 04
The response-position completion transition produces an incorrect observable state.
Command argument suggestions: results for a different argument position become selectable · case 05
The response-position completion transition produces an incorrect observable state.
Command argument suggestions: accepted argument leaves completion targeting the same slot · case 01
The next-position completion transition produces an incorrect observable state.
Command argument suggestions: accepted argument leaves completion targeting the same slot · case 02
The next-position completion transition produces an incorrect observable state.
Command argument suggestions: accepted argument leaves completion targeting the same slot · case 03
The next-position completion transition produces an incorrect observable state.
Command argument suggestions: accepted argument leaves completion targeting the same slot · case 04
The next-position completion transition produces an incorrect observable state.
Command argument suggestions: accepted argument leaves completion targeting the same slot · case 05
The next-position completion transition produces an incorrect observable state.
Command argument suggestions: completed argument separator is duplicated before an existing tail argument · case 01
The argument-separator completion transition produces an incorrect observable state.
Command argument suggestions: completed argument separator is duplicated before an existing tail argument · case 02
The argument-separator completion transition produces an incorrect observable state.
Command argument suggestions: completed argument separator is duplicated before an existing tail argument · case 03
The argument-separator completion transition produces an incorrect observable state.
Command argument suggestions: completed argument separator is duplicated before an existing tail argument · case 04
The argument-separator completion transition produces an incorrect observable state.
Command argument suggestions: completed argument separator is duplicated before an existing tail argument · case 05
The argument-separator completion transition produces an incorrect observable state.
Autocomplete query activation policy: short query is submitted before minimum completion length · case 01
The threshold completion transition produces an incorrect observable state.
Autocomplete query activation policy: short query is submitted before minimum completion length · case 02
The threshold completion transition produces an incorrect observable state.
Autocomplete query activation policy: short query is submitted before minimum completion length · case 03
The threshold completion transition produces an incorrect observable state.
Autocomplete query activation policy: short query is submitted before minimum completion length · case 04
The threshold completion transition produces an incorrect observable state.
Autocomplete query activation policy: short query is submitted before minimum completion length · case 05
The threshold completion transition produces an incorrect observable state.
Autocomplete query activation policy: explicit browse still requires a nonempty typed query · case 01
The browse completion transition produces an incorrect observable state.
Autocomplete query activation policy: explicit browse still requires a nonempty typed query · case 02
The browse completion transition produces an incorrect observable state.
Autocomplete query activation policy: explicit browse still requires a nonempty typed query · case 03
The browse completion transition produces an incorrect observable state.
Autocomplete query activation policy: explicit browse still requires a nonempty typed query · case 04
The browse completion transition produces an incorrect observable state.
Autocomplete query activation policy: explicit browse still requires a nonempty typed query · case 05
The browse completion transition produces an incorrect observable state.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗