Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Notification visual impression qualification: leaves-viewport from qualifying · case 01
The leaves-viewport event leaves a notification in reporting instead of offscreen.
Notification visual impression qualification: leaves-viewport from qualifying · case 02
The leaves-viewport event leaves a notification in reporting instead of offscreen.
Notification visual impression qualification: leaves-viewport from qualifying · case 03
The leaves-viewport event leaves a notification in reporting instead of offscreen.
Notification visual impression qualification: leaves-viewport from qualifying · case 04
The leaves-viewport event leaves a notification in reporting instead of offscreen.
Notification visual impression qualification: leaves-viewport from qualifying · case 05
The leaves-viewport event leaves a notification in reporting instead of offscreen.
Notification visual impression qualification: report-success from reporting · case 01
The report-success event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: report-success from reporting · case 02
The report-success event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: report-success from reporting · case 03
The report-success event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: report-success from reporting · case 04
The report-success event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: report-success from reporting · case 05
The report-success event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: report-failure from reporting · case 01
The report-failure event leaves a notification in counted instead of report-error.
Notification visual impression qualification: report-failure from reporting · case 02
The report-failure event leaves a notification in counted instead of report-error.
Notification visual impression qualification: report-failure from reporting · case 03
The report-failure event leaves a notification in counted instead of report-error.
Notification visual impression qualification: report-failure from reporting · case 04
The report-failure event leaves a notification in counted instead of report-error.
Notification visual impression qualification: report-failure from reporting · case 05
The report-failure event leaves a notification in counted instead of report-error.
Notification visual impression qualification: retry-report from report-error · case 01
The retry-report event leaves a notification in counted instead of reporting.
Notification visual impression qualification: retry-report from report-error · case 02
The retry-report event leaves a notification in counted instead of reporting.
Notification visual impression qualification: retry-report from report-error · case 03
The retry-report event leaves a notification in counted instead of reporting.
Notification visual impression qualification: retry-report from report-error · case 04
The retry-report event leaves a notification in counted instead of reporting.
Notification visual impression qualification: retry-report from report-error · case 05
The retry-report event leaves a notification in counted instead of reporting.
Notification visual impression qualification: covered-by-overlay from qualifying · case 01
The covered-by-overlay event leaves a notification in reporting instead of occluded.
Notification visual impression qualification: covered-by-overlay from qualifying · case 02
The covered-by-overlay event leaves a notification in reporting instead of occluded.
Notification visual impression qualification: covered-by-overlay from qualifying · case 03
The covered-by-overlay event leaves a notification in reporting instead of occluded.
Notification visual impression qualification: covered-by-overlay from qualifying · case 04
The covered-by-overlay event leaves a notification in reporting instead of occluded.
Notification visual impression qualification: covered-by-overlay from qualifying · case 05
The covered-by-overlay event leaves a notification in reporting instead of occluded.
Notification visual impression qualification: overlay-removed from occluded · case 01
The overlay-removed event leaves a notification in counted instead of qualifying.
Notification visual impression qualification: overlay-removed from occluded · case 02
The overlay-removed event leaves a notification in counted instead of qualifying.
Notification visual impression qualification: overlay-removed from occluded · case 03
The overlay-removed event leaves a notification in counted instead of qualifying.
Notification visual impression qualification: overlay-removed from occluded · case 04
The overlay-removed event leaves a notification in counted instead of qualifying.
Notification visual impression qualification: overlay-removed from occluded · case 05
The overlay-removed event leaves a notification in counted instead of qualifying.
Notification visual impression qualification: reenter-viewport from counted · case 01
The reenter-viewport event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: reenter-viewport from counted · case 02
The reenter-viewport event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: reenter-viewport from counted · case 03
The reenter-viewport event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: reenter-viewport from counted · case 04
The reenter-viewport event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: reenter-viewport from counted · case 05
The reenter-viewport event leaves a notification in qualifying instead of counted.
Notification visual impression qualification: leaves-viewport from reporting · case 01
The leaves-viewport event leaves a notification in offscreen instead of reporting.
Notification visual impression qualification: leaves-viewport from reporting · case 02
The leaves-viewport event leaves a notification in offscreen instead of reporting.
Notification visual impression qualification: leaves-viewport from reporting · case 03
The leaves-viewport event leaves a notification in offscreen instead of reporting.
Notification visual impression qualification: leaves-viewport from reporting · case 04
The leaves-viewport event leaves a notification in offscreen instead of reporting.
Notification visual impression qualification: leaves-viewport from reporting · case 05
The leaves-viewport event leaves a notification in offscreen instead of reporting.
Notification content revision review: revision-two-arrives from revision-one-read · case 01
The revision-two-arrives event leaves a notification in revision-one-read instead of revision-two-unread.
Notification content revision review: revision-two-arrives from revision-one-read · case 02
The revision-two-arrives event leaves a notification in revision-one-read instead of revision-two-unread.
Notification content revision review: revision-two-arrives from revision-one-read · case 03
The revision-two-arrives event leaves a notification in revision-one-read instead of revision-two-unread.
Notification content revision review: revision-two-arrives from revision-one-read · case 04
The revision-two-arrives event leaves a notification in revision-one-read instead of revision-two-unread.
Notification content revision review: revision-two-arrives from revision-one-read · case 05
The revision-two-arrives event leaves a notification in revision-one-read instead of revision-two-unread.
Notification content revision review: open-revision from revision-two-unread · case 01
The open-revision event leaves a notification in revision-two-read instead of revision-two-preview.
Notification content revision review: open-revision from revision-two-unread · case 02
The open-revision event leaves a notification in revision-two-read instead of revision-two-preview.
Notification content revision review: open-revision from revision-two-unread · case 03
The open-revision event leaves a notification in revision-two-read instead of revision-two-preview.
Notification content revision review: open-revision from revision-two-unread · case 04
The open-revision event leaves a notification in revision-two-read instead of revision-two-preview.
Notification content revision review: open-revision from revision-two-unread · case 05
The open-revision event leaves a notification in revision-two-read instead of revision-two-preview.
Notification content revision review: ack-revision from revision-two-preview · case 01
The ack-revision event leaves a notification in revision-one-read instead of revision-two-read.
Notification content revision review: ack-revision from revision-two-preview · case 02
The ack-revision event leaves a notification in revision-one-read instead of revision-two-read.
Notification content revision review: ack-revision from revision-two-preview · case 03
The ack-revision event leaves a notification in revision-one-read instead of revision-two-read.
Notification content revision review: ack-revision from revision-two-preview · case 04
The ack-revision event leaves a notification in revision-one-read instead of revision-two-read.
Notification content revision review: ack-revision from revision-two-preview · case 05
The ack-revision event leaves a notification in revision-one-read instead of revision-two-read.
Notification content revision review: revision-three-arrives from revision-two-preview · case 01
The revision-three-arrives event leaves a notification in revision-two-read instead of revision-three-pending-review.
Notification content revision review: revision-three-arrives from revision-two-preview · case 02
The revision-three-arrives event leaves a notification in revision-two-read instead of revision-three-pending-review.
Notification content revision review: revision-three-arrives from revision-two-preview · case 03
The revision-three-arrives event leaves a notification in revision-two-read instead of revision-three-pending-review.
Notification content revision review: revision-three-arrives from revision-two-preview · case 04
The revision-three-arrives event leaves a notification in revision-two-read instead of revision-three-pending-review.
Notification content revision review: revision-three-arrives from revision-two-preview · case 05
The revision-three-arrives event leaves a notification in revision-two-read instead of revision-three-pending-review.
Notification content revision review: accept-update from revision-three-pending-review · case 01
The accept-update event leaves a notification in revision-three-read instead of revision-three-preview.
Notification content revision review: accept-update from revision-three-pending-review · case 02
The accept-update event leaves a notification in revision-three-read instead of revision-three-preview.
Notification content revision review: accept-update from revision-three-pending-review · case 03
The accept-update event leaves a notification in revision-three-read instead of revision-three-preview.
Notification content revision review: accept-update from revision-three-pending-review · case 04
The accept-update event leaves a notification in revision-three-read instead of revision-three-preview.
Notification content revision review: accept-update from revision-three-pending-review · case 05
The accept-update event leaves a notification in revision-three-read instead of revision-three-preview.
Notification content revision review: ack-revision from revision-three-preview · case 01
The ack-revision event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: ack-revision from revision-three-preview · case 02
The ack-revision event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: ack-revision from revision-three-preview · case 03
The ack-revision event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: ack-revision from revision-three-preview · case 04
The ack-revision event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: ack-revision from revision-three-preview · case 05
The ack-revision event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: late-revision-two from revision-three-read · case 01
The late-revision-two event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: late-revision-two from revision-three-read · case 02
The late-revision-two event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: late-revision-two from revision-three-read · case 03
The late-revision-two event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: late-revision-two from revision-three-read · case 04
The late-revision-two event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: late-revision-two from revision-three-read · case 05
The late-revision-two event leaves a notification in revision-two-read instead of revision-three-read.
Notification content revision review: close-preview from revision-three-pending-review · case 01
The close-preview event leaves a notification in revision-three-read instead of revision-three-unread.
Notification content revision review: close-preview from revision-three-pending-review · case 02
The close-preview event leaves a notification in revision-three-read instead of revision-three-unread.
Notification content revision review: close-preview from revision-three-pending-review · case 03
The close-preview event leaves a notification in revision-three-read instead of revision-three-unread.
Notification content revision review: close-preview from revision-three-pending-review · case 04
The close-preview event leaves a notification in revision-three-read instead of revision-three-unread.
Notification content revision review: close-preview from revision-three-pending-review · case 05
The close-preview event leaves a notification in revision-three-read instead of revision-three-unread.
Notification content revision review: open-revision from revision-three-unread · case 01
The open-revision event leaves a notification in revision-two-preview instead of revision-three-preview.
Notification content revision review: open-revision from revision-three-unread · case 02
The open-revision event leaves a notification in revision-two-preview instead of revision-three-preview.
Notification content revision review: open-revision from revision-three-unread · case 03
The open-revision event leaves a notification in revision-two-preview instead of revision-three-preview.
Notification content revision review: open-revision from revision-three-unread · case 04
The open-revision event leaves a notification in revision-two-preview instead of revision-three-preview.
Notification content revision review: open-revision from revision-three-unread · case 05
The open-revision event leaves a notification in revision-two-preview instead of revision-three-preview.
Notification content revision review: revision-withdrawn from revision-two-unread · case 01
The revision-withdrawn event leaves a notification in revision-two-read instead of withdrawn.
Notification content revision review: revision-withdrawn from revision-two-unread · case 02
The revision-withdrawn event leaves a notification in revision-two-read instead of withdrawn.
Notification content revision review: revision-withdrawn from revision-two-unread · case 03
The revision-withdrawn event leaves a notification in revision-two-read instead of withdrawn.
Notification content revision review: revision-withdrawn from revision-two-unread · case 04
The revision-withdrawn event leaves a notification in revision-two-read instead of withdrawn.
Notification content revision review: revision-withdrawn from revision-two-unread · case 05
The revision-withdrawn event leaves a notification in revision-two-read instead of withdrawn.
Notification target opening feedback: open-target from actionable · case 01
The open-target event leaves a notification in opened instead of resolving.
Notification target opening feedback: open-target from actionable · case 02
The open-target event leaves a notification in opened instead of resolving.
Notification target opening feedback: open-target from actionable · case 03
The open-target event leaves a notification in opened instead of resolving.
Notification target opening feedback: open-target from actionable · case 04
The open-target event leaves a notification in opened instead of resolving.
Notification target opening feedback: open-target from actionable · case 05
The open-target event leaves a notification in opened instead of resolving.
Notification target opening feedback: target-found from resolving · case 01
The target-found event leaves a notification in opened instead of navigating.
Notification target opening feedback: target-found from resolving · case 02
The target-found event leaves a notification in opened instead of navigating.
Notification target opening feedback: target-found from resolving · case 03
The target-found event leaves a notification in opened instead of navigating.
Notification target opening feedback: target-found from resolving · case 04
The target-found event leaves a notification in opened instead of navigating.
Notification target opening feedback: target-found from resolving · case 05
The target-found event leaves a notification in opened instead of navigating.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗