Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Notification digest assembly presentation: show-digest from ready · case 01
The show-digest event leaves a notification in published instead of publishing.
Notification digest assembly presentation: show-digest from ready · case 02
The show-digest event leaves a notification in published instead of publishing.
Notification digest assembly presentation: show-digest from ready · case 03
The show-digest event leaves a notification in published instead of publishing.
Notification digest assembly presentation: show-digest from ready · case 04
The show-digest event leaves a notification in published instead of publishing.
Notification digest assembly presentation: show-digest from ready · case 05
The show-digest event leaves a notification in published instead of publishing.
Notification digest assembly presentation: paint-success from publishing · case 01
The paint-success event leaves a notification in ready instead of published.
Notification digest assembly presentation: paint-success from publishing · case 02
The paint-success event leaves a notification in ready instead of published.
Notification digest assembly presentation: paint-success from publishing · case 03
The paint-success event leaves a notification in ready instead of published.
Notification digest assembly presentation: paint-success from publishing · case 04
The paint-success event leaves a notification in ready instead of published.
Notification digest assembly presentation: paint-success from publishing · case 05
The paint-success event leaves a notification in ready instead of published.
Notification digest assembly presentation: paint-failure from publishing · case 01
The paint-failure event leaves a notification in published instead of publish-error.
Notification digest assembly presentation: paint-failure from publishing · case 02
The paint-failure event leaves a notification in published instead of publish-error.
Notification digest assembly presentation: paint-failure from publishing · case 03
The paint-failure event leaves a notification in published instead of publish-error.
Notification digest assembly presentation: paint-failure from publishing · case 04
The paint-failure event leaves a notification in published instead of publish-error.
Notification digest assembly presentation: paint-failure from publishing · case 05
The paint-failure event leaves a notification in published instead of publish-error.
Notification digest assembly presentation: retry-show from publish-error · case 01
The retry-show event leaves a notification in published instead of publishing.
Notification digest assembly presentation: retry-show from publish-error · case 02
The retry-show event leaves a notification in published instead of publishing.
Notification digest assembly presentation: retry-show from publish-error · case 03
The retry-show event leaves a notification in published instead of publishing.
Notification digest assembly presentation: retry-show from publish-error · case 04
The retry-show event leaves a notification in published instead of publishing.
Notification digest assembly presentation: retry-show from publish-error · case 05
The retry-show event leaves a notification in published instead of publishing.
Notification digest assembly presentation: expand-digest from published · case 01
The expand-digest event leaves a notification in collecting instead of expanded.
Notification digest assembly presentation: expand-digest from published · case 02
The expand-digest event leaves a notification in collecting instead of expanded.
Notification digest assembly presentation: expand-digest from published · case 03
The expand-digest event leaves a notification in collecting instead of expanded.
Notification digest assembly presentation: expand-digest from published · case 04
The expand-digest event leaves a notification in collecting instead of expanded.
Notification digest assembly presentation: expand-digest from published · case 05
The expand-digest event leaves a notification in collecting instead of expanded.
Notification digest assembly presentation: collapse-digest from expanded · case 01
The collapse-digest event leaves a notification in empty instead of published.
Notification digest assembly presentation: collapse-digest from expanded · case 02
The collapse-digest event leaves a notification in empty instead of published.
Notification digest assembly presentation: collapse-digest from expanded · case 03
The collapse-digest event leaves a notification in empty instead of published.
Notification digest assembly presentation: collapse-digest from expanded · case 04
The collapse-digest event leaves a notification in empty instead of published.
Notification digest assembly presentation: collapse-digest from expanded · case 05
The collapse-digest event leaves a notification in empty instead of published.
Notification digest assembly presentation: late-item from sealing · case 01
The late-item event leaves a notification in collecting instead of sealing.
Notification digest assembly presentation: late-item from sealing · case 02
The late-item event leaves a notification in collecting instead of sealing.
Notification digest assembly presentation: late-item from sealing · case 03
The late-item event leaves a notification in collecting instead of sealing.
Notification digest assembly presentation: late-item from sealing · case 04
The late-item event leaves a notification in collecting instead of sealing.
Notification digest assembly presentation: late-item from sealing · case 05
The late-item event leaves a notification in collecting instead of sealing.
Notification digest assembly presentation: close-empty-window from collecting · case 01
The close-empty-window event leaves a notification in published instead of empty.
Notification digest assembly presentation: close-empty-window from collecting · case 02
The close-empty-window event leaves a notification in published instead of empty.
Notification digest assembly presentation: close-empty-window from collecting · case 03
The close-empty-window event leaves a notification in published instead of empty.
Notification digest assembly presentation: close-empty-window from collecting · case 04
The close-empty-window event leaves a notification in published instead of empty.
Notification digest assembly presentation: close-empty-window from collecting · case 05
The close-empty-window event leaves a notification in published instead of empty.
Notification attachment preview: preview-click from thumbnail · case 01
The preview-click event leaves a notification in open instead of fetching.
Notification attachment preview: preview-click from thumbnail · case 02
The preview-click event leaves a notification in open instead of fetching.
Notification attachment preview: preview-click from thumbnail · case 03
The preview-click event leaves a notification in open instead of fetching.
Notification attachment preview: preview-click from thumbnail · case 04
The preview-click event leaves a notification in open instead of fetching.
Notification attachment preview: preview-click from thumbnail · case 05
The preview-click event leaves a notification in open instead of fetching.
Notification attachment preview: content-ready from fetching · case 01
The content-ready event leaves a notification in open instead of decoding.
Notification attachment preview: content-ready from fetching · case 02
The content-ready event leaves a notification in open instead of decoding.
Notification attachment preview: content-ready from fetching · case 03
The content-ready event leaves a notification in open instead of decoding.
Notification attachment preview: content-ready from fetching · case 04
The content-ready event leaves a notification in open instead of decoding.
Notification attachment preview: content-ready from fetching · case 05
The content-ready event leaves a notification in open instead of decoding.
Notification attachment preview: decode-success from decoding · case 01
The decode-success event leaves a notification in thumbnail instead of open.
Notification attachment preview: decode-success from decoding · case 02
The decode-success event leaves a notification in thumbnail instead of open.
Notification attachment preview: decode-success from decoding · case 03
The decode-success event leaves a notification in thumbnail instead of open.
Notification attachment preview: decode-success from decoding · case 04
The decode-success event leaves a notification in thumbnail instead of open.
Notification attachment preview: decode-success from decoding · case 05
The decode-success event leaves a notification in thumbnail instead of open.
Notification attachment preview: decode-failure from decoding · case 01
The decode-failure event leaves a notification in open instead of decode-error.
Notification attachment preview: decode-failure from decoding · case 02
The decode-failure event leaves a notification in open instead of decode-error.
Notification attachment preview: decode-failure from decoding · case 03
The decode-failure event leaves a notification in open instead of decode-error.
Notification attachment preview: decode-failure from decoding · case 04
The decode-failure event leaves a notification in open instead of decode-error.
Notification attachment preview: decode-failure from decoding · case 05
The decode-failure event leaves a notification in open instead of decode-error.
Notification attachment preview: fetch-failure from fetching · case 01
The fetch-failure event leaves a notification in open instead of fetch-error.
Notification attachment preview: fetch-failure from fetching · case 02
The fetch-failure event leaves a notification in open instead of fetch-error.
Notification attachment preview: fetch-failure from fetching · case 03
The fetch-failure event leaves a notification in open instead of fetch-error.
Notification attachment preview: fetch-failure from fetching · case 04
The fetch-failure event leaves a notification in open instead of fetch-error.
Notification attachment preview: fetch-failure from fetching · case 05
The fetch-failure event leaves a notification in open instead of fetch-error.
Notification attachment preview: retry-fetch from fetch-error · case 01
The retry-fetch event leaves a notification in decoding instead of fetching.
Notification attachment preview: retry-fetch from fetch-error · case 02
The retry-fetch event leaves a notification in decoding instead of fetching.
Notification attachment preview: retry-fetch from fetch-error · case 03
The retry-fetch event leaves a notification in decoding instead of fetching.
Notification attachment preview: retry-fetch from fetch-error · case 04
The retry-fetch event leaves a notification in decoding instead of fetching.
Notification attachment preview: retry-fetch from fetch-error · case 05
The retry-fetch event leaves a notification in decoding instead of fetching.
Notification attachment preview: close-preview from open · case 01
The close-preview event leaves a notification in fetching instead of thumbnail.
Notification attachment preview: close-preview from open · case 02
The close-preview event leaves a notification in fetching instead of thumbnail.
Notification attachment preview: close-preview from open · case 03
The close-preview event leaves a notification in fetching instead of thumbnail.
Notification attachment preview: close-preview from open · case 04
The close-preview event leaves a notification in fetching instead of thumbnail.
Notification attachment preview: close-preview from open · case 05
The close-preview event leaves a notification in fetching instead of thumbnail.
Notification attachment preview: close-preview from fetching · case 01
The close-preview event leaves a notification in thumbnail instead of canceled.
Notification attachment preview: close-preview from fetching · case 02
The close-preview event leaves a notification in thumbnail instead of canceled.
Notification attachment preview: close-preview from fetching · case 03
The close-preview event leaves a notification in thumbnail instead of canceled.
Notification attachment preview: close-preview from fetching · case 04
The close-preview event leaves a notification in thumbnail instead of canceled.
Notification attachment preview: close-preview from fetching · case 05
The close-preview event leaves a notification in thumbnail instead of canceled.
Notification attachment preview: late-content-ready from canceled · case 01
The late-content-ready event leaves a notification in decoding instead of thumbnail.
Notification attachment preview: late-content-ready from canceled · case 02
The late-content-ready event leaves a notification in decoding instead of thumbnail.
Notification attachment preview: late-content-ready from canceled · case 03
The late-content-ready event leaves a notification in decoding instead of thumbnail.
Notification attachment preview: late-content-ready from canceled · case 04
The late-content-ready event leaves a notification in decoding instead of thumbnail.
Notification attachment preview: late-content-ready from canceled · case 05
The late-content-ready event leaves a notification in decoding instead of thumbnail.
Notification attachment preview: download-original from decode-error · case 01
The download-original event leaves a notification in open instead of download-pending.
Notification attachment preview: download-original from decode-error · case 02
The download-original event leaves a notification in open instead of download-pending.
Notification attachment preview: download-original from decode-error · case 03
The download-original event leaves a notification in open instead of download-pending.
Notification attachment preview: download-original from decode-error · case 04
The download-original event leaves a notification in open instead of download-pending.
Notification attachment preview: download-original from decode-error · case 05
The download-original event leaves a notification in open instead of download-pending.
Long-running notification progress: worker-start from queued · case 01
The worker-start event leaves a notification in complete instead of running.
Long-running notification progress: worker-start from queued · case 02
The worker-start event leaves a notification in complete instead of running.
Long-running notification progress: worker-start from queued · case 03
The worker-start event leaves a notification in complete instead of running.
Long-running notification progress: worker-start from queued · case 04
The worker-start event leaves a notification in complete instead of running.
Long-running notification progress: worker-start from queued · case 05
The worker-start event leaves a notification in complete instead of running.
Long-running notification progress: request-pause from running · case 01
The request-pause event leaves a notification in paused instead of pause-pending.
Long-running notification progress: request-pause from running · case 02
The request-pause event leaves a notification in paused instead of pause-pending.
Long-running notification progress: request-pause from running · case 03
The request-pause event leaves a notification in paused instead of pause-pending.
Long-running notification progress: request-pause from running · case 04
The request-pause event leaves a notification in paused instead of pause-pending.
Long-running notification progress: request-pause from running · case 05
The request-pause event leaves a notification in paused instead of pause-pending.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗