Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Inline completion preview: hover preview changes the committed identifier · case 01
The value completion transition produces an incorrect observable state.
Inline completion preview: hover preview changes the committed identifier · case 02
The value completion transition produces an incorrect observable state.
Inline completion preview: hover preview changes the committed identifier · case 03
The value completion transition produces an incorrect observable state.
Inline completion preview: hover preview changes the committed identifier · case 04
The value completion transition produces an incorrect observable state.
Inline completion preview: hover preview changes the committed identifier · case 05
The value completion transition produces an incorrect observable state.
Inline completion preview: ghost text overlays a noncollapsed input selection · case 01
The selected completion transition produces an incorrect observable state.
Inline completion preview: ghost text overlays a noncollapsed input selection · case 02
The selected completion transition produces an incorrect observable state.
Inline completion preview: ghost text overlays a noncollapsed input selection · case 03
The selected completion transition produces an incorrect observable state.
Inline completion preview: ghost text overlays a noncollapsed input selection · case 04
The selected completion transition produces an incorrect observable state.
Inline completion preview: ghost text overlays a noncollapsed input selection · case 05
The selected completion transition produces an incorrect observable state.
Inline completion preview: ghost preview survives a text epoch change · case 01
The fresh completion transition produces an incorrect observable state.
Inline completion preview: ghost preview survives a text epoch change · case 02
The fresh completion transition produces an incorrect observable state.
Inline completion preview: ghost preview survives a text epoch change · case 03
The fresh completion transition produces an incorrect observable state.
Inline completion preview: ghost preview survives a text epoch change · case 04
The fresh completion transition produces an incorrect observable state.
Inline completion preview: ghost preview survives a text epoch change · case 05
The fresh completion transition produces an incorrect observable state.
Inline completion preview: explicit preview acceptance concatenates the full candidate · case 01
The accept completion transition produces an incorrect observable state.
Inline completion preview: explicit preview acceptance concatenates the full candidate · case 02
The accept completion transition produces an incorrect observable state.
Inline completion preview: explicit preview acceptance concatenates the full candidate · case 03
The accept completion transition produces an incorrect observable state.
Inline completion preview: explicit preview acceptance concatenates the full candidate · case 04
The accept completion transition produces an incorrect observable state.
Inline completion preview: explicit preview acceptance concatenates the full candidate · case 05
The accept completion transition produces an incorrect observable state.
Inline completion preview: rejecting inline preview clears the user-entered draft · case 01
The reject completion transition produces an incorrect observable state.
Inline completion preview: rejecting inline preview clears the user-entered draft · case 02
The reject completion transition produces an incorrect observable state.
Inline completion preview: rejecting inline preview clears the user-entered draft · case 03
The reject completion transition produces an incorrect observable state.
Inline completion preview: rejecting inline preview clears the user-entered draft · case 04
The reject completion transition produces an incorrect observable state.
Inline completion preview: rejecting inline preview clears the user-entered draft · case 05
The reject completion transition produces an incorrect observable state.
Inline completion preview: ghost range ends at draft length instead of candidate length · case 01
The visible-end completion transition produces an incorrect observable state.
Inline completion preview: ghost range ends at draft length instead of candidate length · case 02
The visible-end completion transition produces an incorrect observable state.
Inline completion preview: ghost range ends at draft length instead of candidate length · case 03
The visible-end completion transition produces an incorrect observable state.
Inline completion preview: ghost range ends at draft length instead of candidate length · case 04
The visible-end completion transition produces an incorrect observable state.
Inline completion preview: ghost range ends at draft length instead of candidate length · case 05
The visible-end completion transition produces an incorrect observable state.
Inline completion preview: typing over a preview retains its superseded suffix · case 01
The edit completion transition produces an incorrect observable state.
Inline completion preview: typing over a preview retains its superseded suffix · case 02
The edit completion transition produces an incorrect observable state.
Inline completion preview: typing over a preview retains its superseded suffix · case 03
The edit completion transition produces an incorrect observable state.
Inline completion preview: typing over a preview retains its superseded suffix · case 04
The edit completion transition produces an incorrect observable state.
Inline completion preview: typing over a preview retains its superseded suffix · case 05
The edit completion transition produces an incorrect observable state.
Inline completion preview: copying input includes unaccepted completion decoration · case 01
The copy completion transition produces an incorrect observable state.
Inline completion preview: copying input includes unaccepted completion decoration · case 02
The copy completion transition produces an incorrect observable state.
Inline completion preview: copying input includes unaccepted completion decoration · case 03
The copy completion transition produces an incorrect observable state.
Inline completion preview: copying input includes unaccepted completion decoration · case 04
The copy completion transition produces an incorrect observable state.
Inline completion preview: copying input includes unaccepted completion decoration · case 05
The copy completion transition produces an incorrect observable state.
Free-text option creation: created option preserves accidental surrounding query whitespace · case 01
The trim completion transition produces an incorrect observable state.
Free-text option creation: created option preserves accidental surrounding query whitespace · case 02
The trim completion transition produces an incorrect observable state.
Free-text option creation: created option preserves accidental surrounding query whitespace · case 03
The trim completion transition produces an incorrect observable state.
Free-text option creation: created option preserves accidental surrounding query whitespace · case 04
The trim completion transition produces an incorrect observable state.
Free-text option creation: created option preserves accidental surrounding query whitespace · case 05
The trim completion transition produces an incorrect observable state.
Free-text option creation: create row duplicates an existing case-insensitive label · case 01
The exact completion transition produces an incorrect observable state.
Free-text option creation: create row duplicates an existing case-insensitive label · case 02
The exact completion transition produces an incorrect observable state.
Free-text option creation: create row duplicates an existing case-insensitive label · case 03
The exact completion transition produces an incorrect observable state.
Free-text option creation: create row duplicates an existing case-insensitive label · case 04
The exact completion transition produces an incorrect observable state.
Free-text option creation: create row duplicates an existing case-insensitive label · case 05
The exact completion transition produces an incorrect observable state.
Free-text option creation: whitespace-only draft becomes a newly created option · case 01
The nonempty completion transition produces an incorrect observable state.
Free-text option creation: whitespace-only draft becomes a newly created option · case 02
The nonempty completion transition produces an incorrect observable state.
Free-text option creation: whitespace-only draft becomes a newly created option · case 03
The nonempty completion transition produces an incorrect observable state.
Free-text option creation: whitespace-only draft becomes a newly created option · case 04
The nonempty completion transition produces an incorrect observable state.
Free-text option creation: whitespace-only draft becomes a newly created option · case 05
The nonempty completion transition produces an incorrect observable state.
Free-text option creation: create affordance ignores the picker creation setting · case 01
The permission completion transition produces an incorrect observable state.
Free-text option creation: create affordance ignores the picker creation setting · case 02
The permission completion transition produces an incorrect observable state.
Free-text option creation: create affordance ignores the picker creation setting · case 03
The permission completion transition produces an incorrect observable state.
Free-text option creation: create affordance ignores the picker creation setting · case 04
The permission completion transition produces an incorrect observable state.
Free-text option creation: create affordance ignores the picker creation setting · case 05
The permission completion transition produces an incorrect observable state.
Free-text option creation: duplicate create requests can be issued while one is pending · case 01
The busy completion transition produces an incorrect observable state.
Free-text option creation: duplicate create requests can be issued while one is pending · case 02
The busy completion transition produces an incorrect observable state.
Free-text option creation: duplicate create requests can be issued while one is pending · case 03
The busy completion transition produces an incorrect observable state.
Free-text option creation: duplicate create requests can be issued while one is pending · case 04
The busy completion transition produces an incorrect observable state.
Free-text option creation: duplicate create requests can be issued while one is pending · case 05
The busy completion transition produces an incorrect observable state.
Free-text option creation: create row collides with a persisted suggestion identifier · case 01
The row-id completion transition produces an incorrect observable state.
Free-text option creation: create row collides with a persisted suggestion identifier · case 02
The row-id completion transition produces an incorrect observable state.
Free-text option creation: create row collides with a persisted suggestion identifier · case 03
The row-id completion transition produces an incorrect observable state.
Free-text option creation: create row collides with a persisted suggestion identifier · case 04
The row-id completion transition produces an incorrect observable state.
Free-text option creation: create row collides with a persisted suggestion identifier · case 05
The row-id completion transition produces an incorrect observable state.
Free-text option creation: created option retains the temporary identifier after persistence · case 01
The resolve completion transition produces an incorrect observable state.
Free-text option creation: created option retains the temporary identifier after persistence · case 02
The resolve completion transition produces an incorrect observable state.
Free-text option creation: created option retains the temporary identifier after persistence · case 03
The resolve completion transition produces an incorrect observable state.
Free-text option creation: created option retains the temporary identifier after persistence · case 04
The resolve completion transition produces an incorrect observable state.
Free-text option creation: created option retains the temporary identifier after persistence · case 05
The resolve completion transition produces an incorrect observable state.
Free-text option creation: failed creation erases the draft required for correction · case 01
The failure completion transition produces an incorrect observable state.
Free-text option creation: failed creation erases the draft required for correction · case 02
The failure completion transition produces an incorrect observable state.
Free-text option creation: failed creation erases the draft required for correction · case 03
The failure completion transition produces an incorrect observable state.
Free-text option creation: failed creation erases the draft required for correction · case 04
The failure completion transition produces an incorrect observable state.
Free-text option creation: failed creation erases the draft required for correction · case 05
The failure completion transition produces an incorrect observable state.
Free-text option creation: optimistic create submits an unpersisted temporary identifier · case 01
The pending-value completion transition produces an incorrect observable state.
Free-text option creation: optimistic create submits an unpersisted temporary identifier · case 02
The pending-value completion transition produces an incorrect observable state.
Free-text option creation: optimistic create submits an unpersisted temporary identifier · case 03
The pending-value completion transition produces an incorrect observable state.
Free-text option creation: optimistic create submits an unpersisted temporary identifier · case 04
The pending-value completion transition produces an incorrect observable state.
Free-text option creation: optimistic create submits an unpersisted temporary identifier · case 05
The pending-value completion transition produces an incorrect observable state.
Free-text option creation: create retry retains the query epoch of the failed creation · case 01
The retry completion transition produces an incorrect observable state.
Free-text option creation: create retry retains the query epoch of the failed creation · case 02
The retry completion transition produces an incorrect observable state.
Free-text option creation: create retry retains the query epoch of the failed creation · case 03
The retry completion transition produces an incorrect observable state.
Free-text option creation: create retry retains the query epoch of the failed creation · case 04
The retry completion transition produces an incorrect observable state.
Free-text option creation: create retry retains the query epoch of the failed creation · case 05
The retry completion transition produces an incorrect observable state.
Cached autocomplete presentation: autocomplete cache omits the dependency scope · case 01
The key completion transition produces an incorrect observable state.
Cached autocomplete presentation: autocomplete cache omits the dependency scope · case 02
The key completion transition produces an incorrect observable state.
Cached autocomplete presentation: autocomplete cache omits the dependency scope · case 03
The key completion transition produces an incorrect observable state.
Cached autocomplete presentation: autocomplete cache omits the dependency scope · case 04
The key completion transition produces an incorrect observable state.
Cached autocomplete presentation: autocomplete cache omits the dependency scope · case 05
The key completion transition produces an incorrect observable state.
Cached autocomplete presentation: prefix cache entry masquerades as an exact query hit · case 01
The query-match completion transition produces an incorrect observable state.
Cached autocomplete presentation: prefix cache entry masquerades as an exact query hit · case 02
The query-match completion transition produces an incorrect observable state.
Cached autocomplete presentation: prefix cache entry masquerades as an exact query hit · case 03
The query-match completion transition produces an incorrect observable state.
Cached autocomplete presentation: prefix cache entry masquerades as an exact query hit · case 04
The query-match completion transition produces an incorrect observable state.
Cached autocomplete presentation: prefix cache entry masquerades as an exact query hit · case 05
The query-match completion transition produces an incorrect observable state.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗