Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Multi-value autocomplete tokens: token removal clears all selected suggestions · case 01
The remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: token removal clears all selected suggestions · case 02
The remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: token removal clears all selected suggestions · case 03
The remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: token removal clears all selected suggestions · case 04
The remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: token removal clears all selected suggestions · case 05
The remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: selected suggestions remain available for duplicate acceptance · case 01
The filter completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: selected suggestions remain available for duplicate acceptance · case 02
The filter completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: selected suggestions remain available for duplicate acceptance · case 03
The filter completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: selected suggestions remain available for duplicate acceptance · case 04
The filter completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: selected suggestions remain available for duplicate acceptance · case 05
The filter completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: equal token labels collapse distinct selected identities · case 01
The labels completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: equal token labels collapse distinct selected identities · case 02
The labels completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: equal token labels collapse distinct selected identities · case 03
The labels completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: equal token labels collapse distinct selected identities · case 04
The labels completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: equal token labels collapse distinct selected identities · case 05
The labels completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: capacity counts search characters rather than selected tokens · case 01
The capacity completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: capacity counts search characters rather than selected tokens · case 02
The capacity completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: capacity counts search characters rather than selected tokens · case 03
The capacity completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: capacity counts search characters rather than selected tokens · case 04
The capacity completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: capacity counts search characters rather than selected tokens · case 05
The capacity completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: zero-capacity picker still permits one selection · case 01
The at-limit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: zero-capacity picker still permits one selection · case 02
The at-limit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: zero-capacity picker still permits one selection · case 03
The at-limit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: zero-capacity picker still permits one selection · case 04
The at-limit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: zero-capacity picker still permits one selection · case 05
The at-limit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: partial query text is submitted as another selected value · case 01
The submit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: partial query text is submitted as another selected value · case 02
The submit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: partial query text is submitted as another selected value · case 03
The submit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: partial query text is submitted as another selected value · case 04
The submit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: partial query text is submitted as another selected value · case 05
The submit completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting a token leaves its search fragment in the input · case 01
The after-accept completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting a token leaves its search fragment in the input · case 02
The after-accept completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting a token leaves its search fragment in the input · case 03
The after-accept completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting a token leaves its search fragment in the input · case 04
The after-accept completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: accepting a token leaves its search fragment in the input · case 05
The after-accept completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: restoring a removed token discards surviving selections · case 01
The undo-remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: restoring a removed token discards surviving selections · case 02
The undo-remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: restoring a removed token discards surviving selections · case 03
The undo-remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: restoring a removed token discards surviving selections · case 04
The undo-remove completion transition produces an incorrect observable state.
Multi-value autocomplete tokens: restoring a removed token discards surviving selections · case 05
The undo-remove completion transition produces an incorrect observable state.
Completion replacement spans: completion overwrites text outside the token span · case 01
The replace completion transition produces an incorrect observable state.
Completion replacement spans: completion overwrites text outside the token span · case 02
The replace completion transition produces an incorrect observable state.
Completion replacement spans: completion overwrites text outside the token span · case 03
The replace completion transition produces an incorrect observable state.
Completion replacement spans: completion overwrites text outside the token span · case 04
The replace completion transition produces an incorrect observable state.
Completion replacement spans: completion overwrites text outside the token span · case 05
The replace completion transition produces an incorrect observable state.
Completion replacement spans: replacement prefix extends to the caret inside the token · case 01
The prefix completion transition produces an incorrect observable state.
Completion replacement spans: replacement prefix extends to the caret inside the token · case 02
The prefix completion transition produces an incorrect observable state.
Completion replacement spans: replacement prefix extends to the caret inside the token · case 03
The prefix completion transition produces an incorrect observable state.
Completion replacement spans: replacement prefix extends to the caret inside the token · case 04
The prefix completion transition produces an incorrect observable state.
Completion replacement spans: replacement prefix extends to the caret inside the token · case 05
The prefix completion transition produces an incorrect observable state.
Completion replacement spans: replacement retains the last character of the old token · case 01
The suffix completion transition produces an incorrect observable state.
Completion replacement spans: replacement retains the last character of the old token · case 02
The suffix completion transition produces an incorrect observable state.
Completion replacement spans: replacement retains the last character of the old token · case 03
The suffix completion transition produces an incorrect observable state.
Completion replacement spans: replacement retains the last character of the old token · case 04
The suffix completion transition produces an incorrect observable state.
Completion replacement spans: replacement retains the last character of the old token · case 05
The suffix completion transition produces an incorrect observable state.
Completion replacement spans: caret uses replaced token length instead of inserted length · case 01
The caret completion transition produces an incorrect observable state.
Completion replacement spans: caret uses replaced token length instead of inserted length · case 02
The caret completion transition produces an incorrect observable state.
Completion replacement spans: caret uses replaced token length instead of inserted length · case 03
The caret completion transition produces an incorrect observable state.
Completion replacement spans: caret uses replaced token length instead of inserted length · case 04
The caret completion transition produces an incorrect observable state.
Completion replacement spans: caret uses replaced token length instead of inserted length · case 05
The caret completion transition produces an incorrect observable state.
Completion replacement spans: nonempty selection is ignored when accepting a completion · case 01
The selection completion transition produces an incorrect observable state.
Completion replacement spans: nonempty selection is ignored when accepting a completion · case 02
The selection completion transition produces an incorrect observable state.
Completion replacement spans: nonempty selection is ignored when accepting a completion · case 03
The selection completion transition produces an incorrect observable state.
Completion replacement spans: nonempty selection is ignored when accepting a completion · case 04
The selection completion transition produces an incorrect observable state.
Completion replacement spans: nonempty selection is ignored when accepting a completion · case 05
The selection completion transition produces an incorrect observable state.
Completion replacement spans: a token span from an earlier edit is still applied · case 01
The stale-span completion transition produces an incorrect observable state.
Completion replacement spans: a token span from an earlier edit is still applied · case 02
The stale-span completion transition produces an incorrect observable state.
Completion replacement spans: a token span from an earlier edit is still applied · case 03
The stale-span completion transition produces an incorrect observable state.
Completion replacement spans: a token span from an earlier edit is still applied · case 04
The stale-span completion transition produces an incorrect observable state.
Completion replacement spans: a token span from an earlier edit is still applied · case 05
The stale-span completion transition produces an incorrect observable state.
Completion replacement spans: completion leaves the replaced query selected · case 01
The collapse completion transition produces an incorrect observable state.
Completion replacement spans: completion leaves the replaced query selected · case 02
The collapse completion transition produces an incorrect observable state.
Completion replacement spans: completion leaves the replaced query selected · case 03
The collapse completion transition produces an incorrect observable state.
Completion replacement spans: completion leaves the replaced query selected · case 04
The collapse completion transition produces an incorrect observable state.
Completion replacement spans: completion leaves the replaced query selected · case 05
The collapse completion transition produces an incorrect observable state.
Completion replacement spans: completion delimiter is inserted before the completed token · case 01
The delimiter completion transition produces an incorrect observable state.
Completion replacement spans: completion delimiter is inserted before the completed token · case 02
The delimiter completion transition produces an incorrect observable state.
Completion replacement spans: completion delimiter is inserted before the completed token · case 03
The delimiter completion transition produces an incorrect observable state.
Completion replacement spans: completion delimiter is inserted before the completed token · case 04
The delimiter completion transition produces an incorrect observable state.
Completion replacement spans: completion delimiter is inserted before the completed token · case 05
The delimiter completion transition produces an incorrect observable state.
Completion replacement spans: replacement length accounting ignores the removed fragment · case 01
The delta completion transition produces an incorrect observable state.
Completion replacement spans: replacement length accounting ignores the removed fragment · case 02
The delta completion transition produces an incorrect observable state.
Completion replacement spans: replacement length accounting ignores the removed fragment · case 03
The delta completion transition produces an incorrect observable state.
Completion replacement spans: replacement length accounting ignores the removed fragment · case 04
The delta completion transition produces an incorrect observable state.
Completion replacement spans: replacement length accounting ignores the removed fragment · case 05
The delta completion transition produces an incorrect observable state.
Completion replacement spans: completion range snapshot captures the full text as its query · case 01
The capture completion transition produces an incorrect observable state.
Completion replacement spans: completion range snapshot captures the full text as its query · case 02
The capture completion transition produces an incorrect observable state.
Completion replacement spans: completion range snapshot captures the full text as its query · case 03
The capture completion transition produces an incorrect observable state.
Completion replacement spans: completion range snapshot captures the full text as its query · case 04
The capture completion transition produces an incorrect observable state.
Completion replacement spans: completion range snapshot captures the full text as its query · case 05
The capture completion transition produces an incorrect observable state.
Inline completion preview: ghost preview repeats the already typed prefix · case 01
The suffix completion transition produces an incorrect observable state.
Inline completion preview: ghost preview repeats the already typed prefix · case 02
The suffix completion transition produces an incorrect observable state.
Inline completion preview: ghost preview repeats the already typed prefix · case 03
The suffix completion transition produces an incorrect observable state.
Inline completion preview: ghost preview repeats the already typed prefix · case 04
The suffix completion transition produces an incorrect observable state.
Inline completion preview: ghost preview repeats the already typed prefix · case 05
The suffix completion transition produces an incorrect observable state.
Inline completion preview: unaccepted ghost text is submitted as actual input · case 01
The submit completion transition produces an incorrect observable state.
Inline completion preview: unaccepted ghost text is submitted as actual input · case 02
The submit completion transition produces an incorrect observable state.
Inline completion preview: unaccepted ghost text is submitted as actual input · case 03
The submit completion transition produces an incorrect observable state.
Inline completion preview: unaccepted ghost text is submitted as actual input · case 04
The submit completion transition produces an incorrect observable state.
Inline completion preview: unaccepted ghost text is submitted as actual input · case 05
The submit completion transition produces an incorrect observable state.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗