Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Beginning handoff immediately changes output route · case 01
The announcement trace violates the stated device-handoff contract.
Beginning handoff immediately changes output route · case 02
The announcement trace violates the stated device-handoff contract.
Beginning handoff immediately changes output route · case 03
The announcement trace violates the stated device-handoff contract.
Beginning handoff immediately changes output route · case 04
The announcement trace violates the stated device-handoff contract.
Beginning handoff immediately changes output route · case 05
The announcement trace violates the stated device-handoff contract.
Canceled handoff discards already queued speech · case 01
The announcement trace violates the stated device-handoff contract.
Canceled handoff discards already queued speech · case 02
The announcement trace violates the stated device-handoff contract.
Canceled handoff discards already queued speech · case 03
The announcement trace violates the stated device-handoff contract.
Canceled handoff discards already queued speech · case 04
The announcement trace violates the stated device-handoff contract.
Canceled handoff discards already queued speech · case 05
The announcement trace violates the stated device-handoff contract.
Handoff commits to unavailable device · case 01
The announcement trace violates the stated device-handoff contract.
Handoff commits to unavailable device · case 02
The announcement trace violates the stated device-handoff contract.
Handoff commits to unavailable device · case 03
The announcement trace violates the stated device-handoff contract.
Handoff commits to unavailable device · case 04
The announcement trace violates the stated device-handoff contract.
Handoff commits to unavailable device · case 05
The announcement trace violates the stated device-handoff contract.
Committed handoff leaves pending speech on previous device · case 01
The announcement trace violates the stated device-handoff contract.
Committed handoff leaves pending speech on previous device · case 02
The announcement trace violates the stated device-handoff contract.
Committed handoff leaves pending speech on previous device · case 03
The announcement trace violates the stated device-handoff contract.
Committed handoff leaves pending speech on previous device · case 04
The announcement trace violates the stated device-handoff contract.
Committed handoff leaves pending speech on previous device · case 05
The announcement trace violates the stated device-handoff contract.
Successful handoff retains a stale target for later commits · case 01
The announcement trace violates the stated device-handoff contract.
Successful handoff retains a stale target for later commits · case 02
The announcement trace violates the stated device-handoff contract.
Successful handoff retains a stale target for later commits · case 03
The announcement trace violates the stated device-handoff contract.
Successful handoff retains a stale target for later commits · case 04
The announcement trace violates the stated device-handoff contract.
Successful handoff retains a stale target for later commits · case 05
The announcement trace violates the stated device-handoff contract.
Disconnected device remains eligible for speech · case 01
The announcement trace violates the stated device-handoff contract.
Disconnected device remains eligible for speech · case 02
The announcement trace violates the stated device-handoff contract.
Disconnected device remains eligible for speech · case 03
The announcement trace violates the stated device-handoff contract.
Disconnected device remains eligible for speech · case 04
The announcement trace violates the stated device-handoff contract.
Disconnected device remains eligible for speech · case 05
The announcement trace violates the stated device-handoff contract.
Device removal drops pending speech for every output · case 01
The announcement trace violates the stated device-handoff contract.
Device removal drops pending speech for every output · case 02
The announcement trace violates the stated device-handoff contract.
Device removal drops pending speech for every output · case 03
The announcement trace violates the stated device-handoff contract.
Device removal drops pending speech for every output · case 04
The announcement trace violates the stated device-handoff contract.
Device removal drops pending speech for every output · case 05
The announcement trace violates the stated device-handoff contract.
Removing active device leaves route pointing to disconnected output · case 01
The announcement trace violates the stated device-handoff contract.
Removing active device leaves route pointing to disconnected output · case 02
The announcement trace violates the stated device-handoff contract.
Removing active device leaves route pointing to disconnected output · case 03
The announcement trace violates the stated device-handoff contract.
Removing active device leaves route pointing to disconnected output · case 04
The announcement trace violates the stated device-handoff contract.
Removing active device leaves route pointing to disconnected output · case 05
The announcement trace violates the stated device-handoff contract.
Updated voice capabilities retain the old inventory row · case 01
The announcement trace violates the stated voice-negotiation contract.
Updated voice capabilities retain the old inventory row · case 02
The announcement trace violates the stated voice-negotiation contract.
Updated voice capabilities retain the old inventory row · case 03
The announcement trace violates the stated voice-negotiation contract.
Updated voice capabilities retain the old inventory row · case 04
The announcement trace violates the stated voice-negotiation contract.
Updated voice capabilities retain the old inventory row · case 05
The announcement trace violates the stated voice-negotiation contract.
Unavailable voice remains selectable · case 01
The announcement trace violates the stated voice-negotiation contract.
Unavailable voice remains selectable · case 02
The announcement trace violates the stated voice-negotiation contract.
Unavailable voice remains selectable · case 03
The announcement trace violates the stated voice-negotiation contract.
Unavailable voice remains selectable · case 04
The announcement trace violates the stated voice-negotiation contract.
Unavailable voice remains selectable · case 05
The announcement trace violates the stated voice-negotiation contract.
Enabling one voice re-enables every unavailable voice · case 01
The announcement trace violates the stated voice-negotiation contract.
Enabling one voice re-enables every unavailable voice · case 02
The announcement trace violates the stated voice-negotiation contract.
Enabling one voice re-enables every unavailable voice · case 03
The announcement trace violates the stated voice-negotiation contract.
Enabling one voice re-enables every unavailable voice · case 04
The announcement trace violates the stated voice-negotiation contract.
Enabling one voice re-enables every unavailable voice · case 05
The announcement trace violates the stated voice-negotiation contract.
Offline speech selects network-only synthesis · case 01
The announcement trace violates the stated voice-negotiation contract.
Offline speech selects network-only synthesis · case 02
The announcement trace violates the stated voice-negotiation contract.
Offline speech selects network-only synthesis · case 03
The announcement trace violates the stated voice-negotiation contract.
Offline speech selects network-only synthesis · case 04
The announcement trace violates the stated voice-negotiation contract.
Offline speech selects network-only synthesis · case 05
The announcement trace violates the stated voice-negotiation contract.
Voice with only one required capability is treated as compatible · case 01
The announcement trace violates the stated voice-negotiation contract.
Voice with only one required capability is treated as compatible · case 02
The announcement trace violates the stated voice-negotiation contract.
Voice with only one required capability is treated as compatible · case 03
The announcement trace violates the stated voice-negotiation contract.
Voice with only one required capability is treated as compatible · case 04
The announcement trace violates the stated voice-negotiation contract.
Voice with only one required capability is treated as compatible · case 05
The announcement trace violates the stated voice-negotiation contract.
Unrelated voice language enters fallback candidates · case 01
The announcement trace violates the stated voice-negotiation contract.
Unrelated voice language enters fallback candidates · case 02
The announcement trace violates the stated voice-negotiation contract.
Unrelated voice language enters fallback candidates · case 03
The announcement trace violates the stated voice-negotiation contract.
Unrelated voice language enters fallback candidates · case 04
The announcement trace violates the stated voice-negotiation contract.
Unrelated voice language enters fallback candidates · case 05
The announcement trace violates the stated voice-negotiation contract.
Eligible explicit voice preference is ignored · case 01
The announcement trace violates the stated voice-negotiation contract.
Eligible explicit voice preference is ignored · case 02
The announcement trace violates the stated voice-negotiation contract.
Eligible explicit voice preference is ignored · case 03
The announcement trace violates the stated voice-negotiation contract.
Eligible explicit voice preference is ignored · case 04
The announcement trace violates the stated voice-negotiation contract.
Eligible explicit voice preference is ignored · case 05
The announcement trace violates the stated voice-negotiation contract.
Base-language match beats an exact speech locale · case 01
The announcement trace violates the stated voice-negotiation contract.
Base-language match beats an exact speech locale · case 02
The announcement trace violates the stated voice-negotiation contract.
Base-language match beats an exact speech locale · case 03
The announcement trace violates the stated voice-negotiation contract.
Base-language match beats an exact speech locale · case 04
The announcement trace violates the stated voice-negotiation contract.
Base-language match beats an exact speech locale · case 05
The announcement trace violates the stated voice-negotiation contract.
Remote voice outranks equally suitable local voice · case 01
The announcement trace violates the stated voice-negotiation contract.
Remote voice outranks equally suitable local voice · case 02
The announcement trace violates the stated voice-negotiation contract.
Remote voice outranks equally suitable local voice · case 03
The announcement trace violates the stated voice-negotiation contract.
Remote voice outranks equally suitable local voice · case 04
The announcement trace violates the stated voice-negotiation contract.
Remote voice outranks equally suitable local voice · case 05
The announcement trace violates the stated voice-negotiation contract.
Lowest-quality eligible voice is selected · case 01
The announcement trace violates the stated voice-negotiation contract.
Lowest-quality eligible voice is selected · case 02
The announcement trace violates the stated voice-negotiation contract.
Lowest-quality eligible voice is selected · case 03
The announcement trace violates the stated voice-negotiation contract.
Lowest-quality eligible voice is selected · case 04
The announcement trace violates the stated voice-negotiation contract.
Lowest-quality eligible voice is selected · case 05
The announcement trace violates the stated voice-negotiation contract.
Nested language replaces outer speech context · case 01
The announcement trace violates the stated speech-markup contract.
Nested language replaces outer speech context · case 02
The announcement trace violates the stated speech-markup contract.
Nested language replaces outer speech context · case 03
The announcement trace violates the stated speech-markup contract.
Nested language replaces outer speech context · case 04
The announcement trace violates the stated speech-markup contract.
Nested language replaces outer speech context · case 05
The announcement trace violates the stated speech-markup contract.
Closing language scope resets all nesting · case 01
The announcement trace violates the stated speech-markup contract.
Closing language scope resets all nesting · case 02
The announcement trace violates the stated speech-markup contract.
Closing language scope resets all nesting · case 03
The announcement trace violates the stated speech-markup contract.
Closing language scope resets all nesting · case 04
The announcement trace violates the stated speech-markup contract.
Closing language scope resets all nesting · case 05
The announcement trace violates the stated speech-markup contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗