Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Normal speech preempts an active urgent job · case 01
The announcement trace violates the stated interrupt-resumption contract.
Normal speech preempts an active urgent job · case 02
The announcement trace violates the stated interrupt-resumption contract.
Normal speech preempts an active urgent job · case 03
The announcement trace violates the stated interrupt-resumption contract.
Normal speech preempts an active urgent job · case 04
The announcement trace violates the stated interrupt-resumption contract.
Normal speech preempts an active urgent job · case 05
The announcement trace violates the stated interrupt-resumption contract.
Canceling another job also stops current speech · case 01
The announcement trace violates the stated interrupt-resumption contract.
Canceling another job also stops current speech · case 02
The announcement trace violates the stated interrupt-resumption contract.
Canceling another job also stops current speech · case 03
The announcement trace violates the stated interrupt-resumption contract.
Canceling another job also stops current speech · case 04
The announcement trace violates the stated interrupt-resumption contract.
Canceling another job also stops current speech · case 05
The announcement trace violates the stated interrupt-resumption contract.
Canceled suspended speech resumes after urgent completion · case 01
The announcement trace violates the stated interrupt-resumption contract.
Canceled suspended speech resumes after urgent completion · case 02
The announcement trace violates the stated interrupt-resumption contract.
Canceled suspended speech resumes after urgent completion · case 03
The announcement trace violates the stated interrupt-resumption contract.
Canceled suspended speech resumes after urgent completion · case 04
The announcement trace violates the stated interrupt-resumption contract.
Canceled suspended speech resumes after urgent completion · case 05
The announcement trace violates the stated interrupt-resumption contract.
Canceling waiting speech compares text instead of ID · case 01
The announcement trace violates the stated interrupt-resumption contract.
Canceling waiting speech compares text instead of ID · case 02
The announcement trace violates the stated interrupt-resumption contract.
Canceling waiting speech compares text instead of ID · case 03
The announcement trace violates the stated interrupt-resumption contract.
Canceling waiting speech compares text instead of ID · case 04
The announcement trace violates the stated interrupt-resumption contract.
Canceling waiting speech compares text instead of ID · case 05
The announcement trace violates the stated interrupt-resumption contract.
Clear leaves suspended utterances available to resume · case 01
The announcement trace violates the stated interrupt-resumption contract.
Clear leaves suspended utterances available to resume · case 02
The announcement trace violates the stated interrupt-resumption contract.
Clear leaves suspended utterances available to resume · case 03
The announcement trace violates the stated interrupt-resumption contract.
Clear leaves suspended utterances available to resume · case 04
The announcement trace violates the stated interrupt-resumption contract.
Clear leaves suspended utterances available to resume · case 05
The announcement trace violates the stated interrupt-resumption contract.
Speech step repeats the current word · case 01
The announcement trace violates the stated interrupt-resumption contract.
Speech step repeats the current word · case 02
The announcement trace violates the stated interrupt-resumption contract.
Speech step repeats the current word · case 03
The announcement trace violates the stated interrupt-resumption contract.
Speech step repeats the current word · case 04
The announcement trace violates the stated interrupt-resumption contract.
Speech step repeats the current word · case 05
The announcement trace violates the stated interrupt-resumption contract.
Nested interruption resumes the oldest suspended utterance · case 01
The announcement trace violates the stated interrupt-resumption contract.
Nested interruption resumes the oldest suspended utterance · case 02
The announcement trace violates the stated interrupt-resumption contract.
Nested interruption resumes the oldest suspended utterance · case 03
The announcement trace violates the stated interrupt-resumption contract.
Nested interruption resumes the oldest suspended utterance · case 04
The announcement trace violates the stated interrupt-resumption contract.
Nested interruption resumes the oldest suspended utterance · case 05
The announcement trace violates the stated interrupt-resumption contract.
Completed speech promotes newest normal message first · case 01
The announcement trace violates the stated interrupt-resumption contract.
Completed speech promotes newest normal message first · case 02
The announcement trace violates the stated interrupt-resumption contract.
Completed speech promotes newest normal message first · case 03
The announcement trace violates the stated interrupt-resumption contract.
Completed speech promotes newest normal message first · case 04
The announcement trace violates the stated interrupt-resumption contract.
Completed speech promotes newest normal message first · case 05
The announcement trace violates the stated interrupt-resumption contract.
Listener re-registration keeps old language and mode · case 01
The announcement trace violates the stated listener-delivery contract.
Listener re-registration keeps old language and mode · case 02
The announcement trace violates the stated listener-delivery contract.
Listener re-registration keeps old language and mode · case 03
The announcement trace violates the stated listener-delivery contract.
Listener re-registration keeps old language and mode · case 04
The announcement trace violates the stated listener-delivery contract.
Listener re-registration keeps old language and mode · case 05
The announcement trace violates the stated listener-delivery contract.
Re-registered listener suppresses new-session event IDs · case 01
The announcement trace violates the stated listener-delivery contract.
Re-registered listener suppresses new-session event IDs · case 02
The announcement trace violates the stated listener-delivery contract.
Re-registered listener suppresses new-session event IDs · case 03
The announcement trace violates the stated listener-delivery contract.
Re-registered listener suppresses new-session event IDs · case 04
The announcement trace violates the stated listener-delivery contract.
Re-registered listener suppresses new-session event IDs · case 05
The announcement trace violates the stated listener-delivery contract.
Removing listener drops every subscription · case 01
The announcement trace violates the stated listener-delivery contract.
Removing listener drops every subscription · case 02
The announcement trace violates the stated listener-delivery contract.
Removing listener drops every subscription · case 03
The announcement trace violates the stated listener-delivery contract.
Removing listener drops every subscription · case 04
The announcement trace violates the stated listener-delivery contract.
Removing listener drops every subscription · case 05
The announcement trace violates the stated listener-delivery contract.
Muting one listener mutes all registered listeners · case 01
The announcement trace violates the stated listener-delivery contract.
Muting one listener mutes all registered listeners · case 02
The announcement trace violates the stated listener-delivery contract.
Muting one listener mutes all registered listeners · case 03
The announcement trace violates the stated listener-delivery contract.
Muting one listener mutes all registered listeners · case 04
The announcement trace violates the stated listener-delivery contract.
Muting one listener mutes all registered listeners · case 05
The announcement trace violates the stated listener-delivery contract.
Unmuting one listener clears all mute settings · case 01
The announcement trace violates the stated listener-delivery contract.
Unmuting one listener clears all mute settings · case 02
The announcement trace violates the stated listener-delivery contract.
Unmuting one listener clears all mute settings · case 03
The announcement trace violates the stated listener-delivery contract.
Unmuting one listener clears all mute settings · case 04
The announcement trace violates the stated listener-delivery contract.
Unmuting one listener clears all mute settings · case 05
The announcement trace violates the stated listener-delivery contract.
Muted delivery consumes the listener event receipt · case 01
The announcement trace violates the stated listener-delivery contract.
Muted delivery consumes the listener event receipt · case 02
The announcement trace violates the stated listener-delivery contract.
Muted delivery consumes the listener event receipt · case 03
The announcement trace violates the stated listener-delivery contract.
Muted delivery consumes the listener event receipt · case 04
The announcement trace violates the stated listener-delivery contract.
Muted delivery consumes the listener event receipt · case 05
The announcement trace violates the stated listener-delivery contract.
Wildcard listener fails to receive localized announcements · case 01
The announcement trace violates the stated listener-delivery contract.
Wildcard listener fails to receive localized announcements · case 02
The announcement trace violates the stated listener-delivery contract.
Wildcard listener fails to receive localized announcements · case 03
The announcement trace violates the stated listener-delivery contract.
Wildcard listener fails to receive localized announcements · case 04
The announcement trace violates the stated listener-delivery contract.
Wildcard listener fails to receive localized announcements · case 05
The announcement trace violates the stated listener-delivery contract.
Speech-only announcement leaks to braille subscriptions · case 01
The announcement trace violates the stated listener-delivery contract.
Speech-only announcement leaks to braille subscriptions · case 02
The announcement trace violates the stated listener-delivery contract.
Speech-only announcement leaks to braille subscriptions · case 03
The announcement trace violates the stated listener-delivery contract.
Speech-only announcement leaks to braille subscriptions · case 04
The announcement trace violates the stated listener-delivery contract.
Speech-only announcement leaks to braille subscriptions · case 05
The announcement trace violates the stated listener-delivery contract.
Event identity is deduplicated across all listeners · case 01
The announcement trace violates the stated listener-delivery contract.
Event identity is deduplicated across all listeners · case 02
The announcement trace violates the stated listener-delivery contract.
Event identity is deduplicated across all listeners · case 03
The announcement trace violates the stated listener-delivery contract.
Event identity is deduplicated across all listeners · case 04
The announcement trace violates the stated listener-delivery contract.
Event identity is deduplicated across all listeners · case 05
The announcement trace violates the stated listener-delivery contract.
Delivered event does not enter the receipt ledger · case 01
The announcement trace violates the stated listener-delivery contract.
Delivered event does not enter the receipt ledger · case 02
The announcement trace violates the stated listener-delivery contract.
Delivered event does not enter the receipt ledger · case 03
The announcement trace violates the stated listener-delivery contract.
Delivered event does not enter the receipt ledger · case 04
The announcement trace violates the stated listener-delivery contract.
Delivered event does not enter the receipt ledger · case 05
The announcement trace violates the stated listener-delivery contract.
Restarting task keeps prior progress status · case 01
The announcement trace violates the stated progress-narration contract.
Restarting task keeps prior progress status · case 02
The announcement trace violates the stated progress-narration contract.
Restarting task keeps prior progress status · case 03
The announcement trace violates the stated progress-narration contract.
Restarting task keeps prior progress status · case 04
The announcement trace violates the stated progress-narration contract.
Restarting task keeps prior progress status · case 05
The announcement trace violates the stated progress-narration contract.
Canceling one narrated task drops all progress tracking · case 01
The announcement trace violates the stated progress-narration contract.
Canceling one narrated task drops all progress tracking · case 02
The announcement trace violates the stated progress-narration contract.
Canceling one narrated task drops all progress tracking · case 03
The announcement trace violates the stated progress-narration contract.
Canceling one narrated task drops all progress tracking · case 04
The announcement trace violates the stated progress-narration contract.
Canceling one narrated task drops all progress tracking · case 05
The announcement trace violates the stated progress-narration contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗