Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Braille disable acknowledges speech instead of braille · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Braille disable acknowledges speech instead of braille · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Braille disable acknowledges speech instead of braille · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Braille disable acknowledges speech instead of braille · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Braille disable acknowledges speech instead of braille · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Re-enabling braille erases completed receipts on pending deliveries · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Re-enabling braille erases completed receipts on pending deliveries · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Re-enabling braille erases completed receipts on pending deliveries · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Re-enabling braille erases completed receipts on pending deliveries · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Re-enabling braille erases completed receipts on pending deliveries · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Canceling one coupled announcement cancels every delivery · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Canceling one coupled announcement cancels every delivery · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Canceling one coupled announcement cancels every delivery · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Canceling one coupled announcement cancels every delivery · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Canceling one coupled announcement cancels every delivery · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Speech acknowledgment marks both channels complete · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Speech acknowledgment marks both channels complete · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Speech acknowledgment marks both channels complete · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Speech acknowledgment marks both channels complete · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Speech acknowledgment marks both channels complete · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Braille acknowledgment authorizes missing speech completion · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Braille acknowledgment authorizes missing speech completion · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Braille acknowledgment authorizes missing speech completion · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Braille acknowledgment authorizes missing speech completion · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Braille acknowledgment authorizes missing speech completion · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Edited announcement inherits receipts for the prior text · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Edited announcement inherits receipts for the prior text · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Edited announcement inherits receipts for the prior text · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Edited announcement inherits receipts for the prior text · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Edited announcement inherits receipts for the prior text · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Completion is announced after only one output channel · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Completion is announced after only one output channel · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Completion is announced after only one output channel · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Completion is announced after only one output channel · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Completion is announced after only one output channel · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Completed dual-channel announcement remains pending · case 01
The announcement trace violates the stated dual-channel-barrier contract.
Completed dual-channel announcement remains pending · case 02
The announcement trace violates the stated dual-channel-barrier contract.
Completed dual-channel announcement remains pending · case 03
The announcement trace violates the stated dual-channel-barrier contract.
Completed dual-channel announcement remains pending · case 04
The announcement trace violates the stated dual-channel-barrier contract.
Completed dual-channel announcement remains pending · case 05
The announcement trace violates the stated dual-channel-barrier contract.
Composition-aware suggestion lifecycle: composition start loses the pre-composition draft · case 01
The start completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start loses the pre-composition draft · case 02
The start completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start loses the pre-composition draft · case 03
The start completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start loses the pre-composition draft · case 04
The start completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start loses the pre-composition draft · case 05
The start completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: preedit text becomes a submitted query · case 01
The preedit completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: preedit text becomes a submitted query · case 02
The preedit completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: preedit text becomes a submitted query · case 03
The preedit completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: preedit text becomes a submitted query · case 04
The preedit completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: preedit text becomes a submitted query · case 05
The preedit completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: provisional composition schedules remote suggestions · case 01
The schedule completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: provisional composition schedules remote suggestions · case 02
The schedule completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: provisional composition schedules remote suggestions · case 03
The schedule completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: provisional composition schedules remote suggestions · case 04
The schedule completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: provisional composition schedules remote suggestions · case 05
The schedule completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition end searches the last preedit instead of final text · case 01
The finalize completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition end searches the last preedit instead of final text · case 02
The finalize completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition end searches the last preedit instead of final text · case 03
The finalize completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition end searches the last preedit instead of final text · case 04
The finalize completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition end searches the last preedit instead of final text · case 05
The finalize completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition cancellation cannot restore the saved query · case 01
The cancel completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition cancellation cannot restore the saved query · case 02
The cancel completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition cancellation cannot restore the saved query · case 03
The cancel completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition cancellation cannot restore the saved query · case 04
The cancel completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition cancellation cannot restore the saved query · case 05
The cancel completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: IME candidate acceptance commits an autocomplete option · case 01
The candidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: IME candidate acceptance commits an autocomplete option · case 02
The candidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: IME candidate acceptance commits an autocomplete option · case 03
The candidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: IME candidate acceptance commits an autocomplete option · case 04
The candidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: IME candidate acceptance commits an autocomplete option · case 05
The candidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: stale completion results remain visible under preedit · case 01
The visibility completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: stale completion results remain visible under preedit · case 02
The visibility completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: stale completion results remain visible under preedit · case 03
The visibility completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: stale completion results remain visible under preedit · case 04
The visibility completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: stale completion results remain visible under preedit · case 05
The visibility completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start leaves an older search queued · case 01
The invalidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start leaves an older search queued · case 02
The invalidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start leaves an older search queued · case 03
The invalidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start leaves an older search queued · case 04
The invalidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: composition start leaves an older search queued · case 05
The invalidate completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: final display duplicates the committed preedit · case 01
The display-end completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: final display duplicates the committed preedit · case 02
The display-end completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: final display duplicates the committed preedit · case 03
The display-end completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: final display duplicates the committed preedit · case 04
The display-end completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: final display duplicates the committed preedit · case 05
The display-end completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: post-composition matching retains the provisional highlight · case 01
The rebase completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: post-composition matching retains the provisional highlight · case 02
The rebase completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: post-composition matching retains the provisional highlight · case 03
The rebase completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: post-composition matching retains the provisional highlight · case 04
The rebase completion transition produces an incorrect observable state.
Composition-aware suggestion lifecycle: post-composition matching retains the provisional highlight · case 05
The rebase completion transition produces an incorrect observable state.
Suggestion request context: request reads the committed label instead of the draft · case 01
The query completion transition produces an incorrect observable state.
Suggestion request context: request reads the committed label instead of the draft · case 02
The query completion transition produces an incorrect observable state.
Suggestion request context: request reads the committed label instead of the draft · case 03
The query completion transition produces an incorrect observable state.
Suggestion request context: request reads the committed label instead of the draft · case 04
The query completion transition produces an incorrect observable state.
Suggestion request context: request reads the committed label instead of the draft · case 05
The query completion transition produces an incorrect observable state.
Suggestion request context: outgoing search is tagged with the next unissued epoch · case 01
The epoch completion transition produces an incorrect observable state.
Suggestion request context: outgoing search is tagged with the next unissued epoch · case 02
The epoch completion transition produces an incorrect observable state.
Suggestion request context: outgoing search is tagged with the next unissued epoch · case 03
The epoch completion transition produces an incorrect observable state.
Suggestion request context: outgoing search is tagged with the next unissued epoch · case 04
The epoch completion transition produces an incorrect observable state.
Suggestion request context: outgoing search is tagged with the next unissued epoch · case 05
The epoch completion transition produces an incorrect observable state.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗