Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Record-stream checkpoint fence controller: draining / record after cut · case 01
While draining, event record_after_cut produces draining/deliver_post_cut instead of draining/buffer_post_cut.
Record-stream checkpoint fence controller: draining / record after cut · case 02
While draining, event record_after_cut produces draining/deliver_post_cut instead of draining/buffer_post_cut.
Record-stream checkpoint fence controller: draining / record after cut · case 03
While draining, event record_after_cut produces draining/deliver_post_cut instead of draining/buffer_post_cut.
Record-stream checkpoint fence controller: draining / record after cut · case 04
While draining, event record_after_cut produces draining/deliver_post_cut instead of draining/buffer_post_cut.
Record-stream checkpoint fence controller: draining / record after cut · case 05
While draining, event record_after_cut produces draining/deliver_post_cut instead of draining/buffer_post_cut.
Record-stream checkpoint fence controller: draining / pre cut drained · case 01
While draining, event pre_cut_drained produces streaming/deliver_all instead of fenced/ack_fence.
Record-stream checkpoint fence controller: draining / pre cut drained · case 02
While draining, event pre_cut_drained produces streaming/deliver_all instead of fenced/ack_fence.
Record-stream checkpoint fence controller: draining / pre cut drained · case 03
While draining, event pre_cut_drained produces streaming/deliver_all instead of fenced/ack_fence.
Record-stream checkpoint fence controller: draining / pre cut drained · case 04
While draining, event pre_cut_drained produces streaming/deliver_all instead of fenced/ack_fence.
Record-stream checkpoint fence controller: draining / pre cut drained · case 05
While draining, event pre_cut_drained produces streaming/deliver_all instead of fenced/ack_fence.
Record-stream checkpoint fence controller: fenced / checkpoint request · case 01
While fenced, event checkpoint_request produces streaming/deliver_all instead of checkpointing/snapshot_cut.
Record-stream checkpoint fence controller: fenced / checkpoint request · case 02
While fenced, event checkpoint_request produces streaming/deliver_all instead of checkpointing/snapshot_cut.
Record-stream checkpoint fence controller: fenced / checkpoint request · case 03
While fenced, event checkpoint_request produces streaming/deliver_all instead of checkpointing/snapshot_cut.
Record-stream checkpoint fence controller: fenced / checkpoint request · case 04
While fenced, event checkpoint_request produces streaming/deliver_all instead of checkpointing/snapshot_cut.
Record-stream checkpoint fence controller: fenced / checkpoint request · case 05
While fenced, event checkpoint_request produces streaming/deliver_all instead of checkpointing/snapshot_cut.
Record-stream checkpoint fence controller: checkpointing / checkpoint saved · case 01
While checkpointing, event checkpoint_saved produces streaming/resume instead of saved/report_checkpoint.
Record-stream checkpoint fence controller: checkpointing / checkpoint saved · case 02
While checkpointing, event checkpoint_saved produces streaming/resume instead of saved/report_checkpoint.
Record-stream checkpoint fence controller: checkpointing / checkpoint saved · case 03
While checkpointing, event checkpoint_saved produces streaming/resume instead of saved/report_checkpoint.
Record-stream checkpoint fence controller: checkpointing / checkpoint saved · case 04
While checkpointing, event checkpoint_saved produces streaming/resume instead of saved/report_checkpoint.
Record-stream checkpoint fence controller: checkpointing / checkpoint saved · case 05
While checkpointing, event checkpoint_saved produces streaming/resume instead of saved/report_checkpoint.
Record-stream checkpoint fence controller: saved / resume · case 01
While saved, event resume produces saved/wait instead of streaming/release_buffer_in_order.
Record-stream checkpoint fence controller: saved / resume · case 02
While saved, event resume produces saved/wait instead of streaming/release_buffer_in_order.
Record-stream checkpoint fence controller: saved / resume · case 03
While saved, event resume produces saved/wait instead of streaming/release_buffer_in_order.
Record-stream checkpoint fence controller: saved / resume · case 04
While saved, event resume produces saved/wait instead of streaming/release_buffer_in_order.
Record-stream checkpoint fence controller: saved / resume · case 05
While saved, event resume produces saved/wait instead of streaming/release_buffer_in_order.
Record-stream checkpoint fence controller: checkpointing / checkpoint failed · case 01
While checkpointing, event checkpoint_failed produces streaming/drop_buffer instead of fenced/report_failure_keep_buffer.
Record-stream checkpoint fence controller: checkpointing / checkpoint failed · case 02
While checkpointing, event checkpoint_failed produces streaming/drop_buffer instead of fenced/report_failure_keep_buffer.
Record-stream checkpoint fence controller: checkpointing / checkpoint failed · case 03
While checkpointing, event checkpoint_failed produces streaming/drop_buffer instead of fenced/report_failure_keep_buffer.
Record-stream checkpoint fence controller: checkpointing / checkpoint failed · case 04
While checkpointing, event checkpoint_failed produces streaming/drop_buffer instead of fenced/report_failure_keep_buffer.
Record-stream checkpoint fence controller: checkpointing / checkpoint failed · case 05
While checkpointing, event checkpoint_failed produces streaming/drop_buffer instead of fenced/report_failure_keep_buffer.
Record-stream checkpoint fence controller: fenced / record after cut · case 01
While fenced, event record_after_cut produces streaming/deliver instead of fenced/buffer_post_cut.
Record-stream checkpoint fence controller: fenced / record after cut · case 02
While fenced, event record_after_cut produces streaming/deliver instead of fenced/buffer_post_cut.
Record-stream checkpoint fence controller: fenced / record after cut · case 03
While fenced, event record_after_cut produces streaming/deliver instead of fenced/buffer_post_cut.
Record-stream checkpoint fence controller: fenced / record after cut · case 04
While fenced, event record_after_cut produces streaming/deliver instead of fenced/buffer_post_cut.
Record-stream checkpoint fence controller: fenced / record after cut · case 05
While fenced, event record_after_cut produces streaming/deliver instead of fenced/buffer_post_cut.
Record-stream checkpoint fence controller: streaming / unsolicited resume · case 01
While streaming, event unsolicited_resume produces streaming/replay_previous instead of streaming/reject_unfenced.
Record-stream checkpoint fence controller: streaming / unsolicited resume · case 02
While streaming, event unsolicited_resume produces streaming/replay_previous instead of streaming/reject_unfenced.
Record-stream checkpoint fence controller: streaming / unsolicited resume · case 03
While streaming, event unsolicited_resume produces streaming/replay_previous instead of streaming/reject_unfenced.
Record-stream checkpoint fence controller: streaming / unsolicited resume · case 04
While streaming, event unsolicited_resume produces streaming/replay_previous instead of streaming/reject_unfenced.
Record-stream checkpoint fence controller: streaming / unsolicited resume · case 05
While streaming, event unsolicited_resume produces streaming/replay_previous instead of streaming/reject_unfenced.
New utterance reuses an outstanding delivery serial · case 01
The announcement trace violates the stated delivery-receipts contract.
New utterance reuses an outstanding delivery serial · case 02
The announcement trace violates the stated delivery-receipts contract.
New utterance reuses an outstanding delivery serial · case 03
The announcement trace violates the stated delivery-receipts contract.
New utterance reuses an outstanding delivery serial · case 04
The announcement trace violates the stated delivery-receipts contract.
New utterance reuses an outstanding delivery serial · case 05
The announcement trace violates the stated delivery-receipts contract.
A replacement keeps the old utterance payload · case 01
The announcement trace violates the stated delivery-receipts contract.
A replacement keeps the old utterance payload · case 02
The announcement trace violates the stated delivery-receipts contract.
A replacement keeps the old utterance payload · case 03
The announcement trace violates the stated delivery-receipts contract.
A replacement keeps the old utterance payload · case 04
The announcement trace violates the stated delivery-receipts contract.
A replacement keeps the old utterance payload · case 05
The announcement trace violates the stated delivery-receipts contract.
A receipt from a disconnected session is accepted · case 01
The announcement trace violates the stated delivery-receipts contract.
A receipt from a disconnected session is accepted · case 02
The announcement trace violates the stated delivery-receipts contract.
A receipt from a disconnected session is accepted · case 03
The announcement trace violates the stated delivery-receipts contract.
A receipt from a disconnected session is accepted · case 04
The announcement trace violates the stated delivery-receipts contract.
A receipt from a disconnected session is accepted · case 05
The announcement trace violates the stated delivery-receipts contract.
Reconnect suppresses a fresh ticket already retired by the old session · case 01
The announcement trace violates the stated delivery-receipts contract.
Reconnect suppresses a fresh ticket already retired by the old session · case 02
The announcement trace violates the stated delivery-receipts contract.
Reconnect suppresses a fresh ticket already retired by the old session · case 03
The announcement trace violates the stated delivery-receipts contract.
Reconnect suppresses a fresh ticket already retired by the old session · case 04
The announcement trace violates the stated delivery-receipts contract.
Reconnect suppresses a fresh ticket already retired by the old session · case 05
The announcement trace violates the stated delivery-receipts contract.
An obsolete receipt acknowledges replacement speech · case 01
The announcement trace violates the stated delivery-receipts contract.
An obsolete receipt acknowledges replacement speech · case 02
The announcement trace violates the stated delivery-receipts contract.
An obsolete receipt acknowledges replacement speech · case 03
The announcement trace violates the stated delivery-receipts contract.
An obsolete receipt acknowledges replacement speech · case 04
The announcement trace violates the stated delivery-receipts contract.
An obsolete receipt acknowledges replacement speech · case 05
The announcement trace violates the stated delivery-receipts contract.
Receipt speaks the utterance identifier · case 01
The announcement trace violates the stated delivery-receipts contract.
Receipt speaks the utterance identifier · case 02
The announcement trace violates the stated delivery-receipts contract.
Receipt speaks the utterance identifier · case 03
The announcement trace violates the stated delivery-receipts contract.
Receipt speaks the utterance identifier · case 04
The announcement trace violates the stated delivery-receipts contract.
Receipt speaks the utterance identifier · case 05
The announcement trace violates the stated delivery-receipts contract.
Acknowledged utterance stays pending · case 01
The announcement trace violates the stated delivery-receipts contract.
Acknowledged utterance stays pending · case 02
The announcement trace violates the stated delivery-receipts contract.
Acknowledged utterance stays pending · case 03
The announcement trace violates the stated delivery-receipts contract.
Acknowledged utterance stays pending · case 04
The announcement trace violates the stated delivery-receipts contract.
Acknowledged utterance stays pending · case 05
The announcement trace violates the stated delivery-receipts contract.
Disconnected speech is retained for later receipts · case 01
The announcement trace violates the stated delivery-receipts contract.
Disconnected speech is retained for later receipts · case 02
The announcement trace violates the stated delivery-receipts contract.
Disconnected speech is retained for later receipts · case 03
The announcement trace violates the stated delivery-receipts contract.
Disconnected speech is retained for later receipts · case 04
The announcement trace violates the stated delivery-receipts contract.
Disconnected speech is retained for later receipts · case 05
The announcement trace violates the stated delivery-receipts contract.
Reconnect keeps the old receipt namespace · case 01
The announcement trace violates the stated delivery-receipts contract.
Reconnect keeps the old receipt namespace · case 02
The announcement trace violates the stated delivery-receipts contract.
Reconnect keeps the old receipt namespace · case 03
The announcement trace violates the stated delivery-receipts contract.
Reconnect keeps the old receipt namespace · case 04
The announcement trace violates the stated delivery-receipts contract.
Reconnect keeps the old receipt namespace · case 05
The announcement trace violates the stated delivery-receipts contract.
Reconnect fails to restart the receipt sequence · case 01
The announcement trace violates the stated delivery-receipts contract.
Reconnect fails to restart the receipt sequence · case 02
The announcement trace violates the stated delivery-receipts contract.
Reconnect fails to restart the receipt sequence · case 03
The announcement trace violates the stated delivery-receipts contract.
Reconnect fails to restart the receipt sequence · case 04
The announcement trace violates the stated delivery-receipts contract.
Reconnect fails to restart the receipt sequence · case 05
The announcement trace violates the stated delivery-receipts contract.
Replacement speech resumes at the prior cursor · case 01
The announcement trace violates the stated speech-cursor contract.
Replacement speech resumes at the prior cursor · case 02
The announcement trace violates the stated speech-cursor contract.
Replacement speech resumes at the prior cursor · case 03
The announcement trace violates the stated speech-cursor contract.
Replacement speech resumes at the prior cursor · case 04
The announcement trace violates the stated speech-cursor contract.
Replacement speech resumes at the prior cursor · case 05
The announcement trace violates the stated speech-cursor contract.
Pause request fails to suspend the announcement · case 01
The announcement trace violates the stated speech-cursor contract.
Pause request fails to suspend the announcement · case 02
The announcement trace violates the stated speech-cursor contract.
Pause request fails to suspend the announcement · case 03
The announcement trace violates the stated speech-cursor contract.
Pause request fails to suspend the announcement · case 04
The announcement trace violates the stated speech-cursor contract.
Pause request fails to suspend the announcement · case 05
The announcement trace violates the stated speech-cursor contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗