Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Transactional clip edit: subtract base · case 01
A second subtraction restarts from committed coverage and revives previously removed samples.
Transactional clip edit: subtract base · case 02
A second subtraction restarts from committed coverage and revives previously removed samples.
Transactional clip edit: subtract base · case 03
A second subtraction restarts from committed coverage and revives previously removed samples.
Transactional clip edit: subtract base · case 04
A second subtraction restarts from committed coverage and revives previously removed samples.
Transactional clip edit: subtract base · case 05
A second subtraction restarts from committed coverage and revives previously removed samples.
Transactional clip edit: add escape · case 01
Staged additions admit sample indices outside the render surface.
Transactional clip edit: add escape · case 02
Staged additions admit sample indices outside the render surface.
Transactional clip edit: add escape · case 03
Staged additions admit sample indices outside the render surface.
Transactional clip edit: add escape · case 04
Staged additions admit sample indices outside the render surface.
Transactional clip edit: add escape · case 05
Staged additions admit sample indices outside the render surface.
Transactional clip edit: replace intersection · case 01
Replacement cannot restore samples removed earlier in the transaction.
Transactional clip edit: replace intersection · case 02
Replacement cannot restore samples removed earlier in the transaction.
Transactional clip edit: replace intersection · case 03
Replacement cannot restore samples removed earlier in the transaction.
Transactional clip edit: replace intersection · case 04
Replacement cannot restore samples removed earlier in the transaction.
Transactional clip edit: replace intersection · case 05
Replacement cannot restore samples removed earlier in the transaction.
Transactional clip edit: commit union · case 01
Commit unions old and pending coverage instead of replacing committed coverage.
Transactional clip edit: commit union · case 02
Commit unions old and pending coverage instead of replacing committed coverage.
Transactional clip edit: commit union · case 03
Commit unions old and pending coverage instead of replacing committed coverage.
Transactional clip edit: commit union · case 04
Commit unions old and pending coverage instead of replacing committed coverage.
Transactional clip edit: commit union · case 05
Commit unions old and pending coverage instead of replacing committed coverage.
Transactional clip edit: commit open · case 01
Commit leaves a transaction active and later unstaged edits unexpectedly commit.
Transactional clip edit: commit open · case 02
Commit leaves a transaction active and later unstaged edits unexpectedly commit.
Transactional clip edit: commit open · case 03
Commit leaves a transaction active and later unstaged edits unexpectedly commit.
Transactional clip edit: commit open · case 04
Commit leaves a transaction active and later unstaged edits unexpectedly commit.
Transactional clip edit: commit open · case 05
Commit leaves a transaction active and later unstaged edits unexpectedly commit.
Transactional clip edit: abort publishes · case 01
Abort publishes coverage intended to be discarded.
Transactional clip edit: abort publishes · case 02
Abort publishes coverage intended to be discarded.
Transactional clip edit: abort publishes · case 03
Abort publishes coverage intended to be discarded.
Transactional clip edit: abort publishes · case 04
Abort publishes coverage intended to be discarded.
Transactional clip edit: abort publishes · case 05
Abort publishes coverage intended to be discarded.
Transactional clip edit: resize current · case 01
Resizing expands the clip to the entire new target instead of preserving exclusions.
Transactional clip edit: resize current · case 02
Resizing expands the clip to the entire new target instead of preserving exclusions.
Transactional clip edit: resize current · case 03
Resizing expands the clip to the entire new target instead of preserving exclusions.
Transactional clip edit: resize current · case 04
Resizing expands the clip to the entire new target instead of preserving exclusions.
Transactional clip edit: resize current · case 05
Resizing expands the clip to the entire new target instead of preserving exclusions.
Transactional clip edit: resize pending · case 01
Resizing resets staged edits before commit.
Transactional clip edit: resize pending · case 02
Resizing resets staged edits before commit.
Transactional clip edit: resize pending · case 03
Resizing resets staged edits before commit.
Transactional clip edit: resize pending · case 04
Resizing resets staged edits before commit.
Transactional clip edit: resize pending · case 05
Resizing resets staged edits before commit.
Named mask registry: define outside · case 01
Mask definition accepts sample positions outside the surface.
Named mask registry: define outside · case 02
Mask definition accepts sample positions outside the surface.
Named mask registry: define outside · case 03
Mask definition accepts sample positions outside the surface.
Named mask registry: define outside · case 04
Mask definition accepts sample positions outside the surface.
Named mask registry: define outside · case 05
Mask definition accepts sample positions outside the surface.
Named mask registry: bind first · case 01
Binding never switches away from the first clip mask.
Named mask registry: bind first · case 02
Binding never switches away from the first clip mask.
Named mask registry: bind first · case 03
Binding never switches away from the first clip mask.
Named mask registry: bind first · case 04
Binding never switches away from the first clip mask.
Named mask registry: bind first · case 05
Binding never switches away from the first clip mask.
Named mask registry: delete active only · case 01
Deleting an inactive mask destroys the mask currently used for clipping.
Named mask registry: delete active only · case 02
Deleting an inactive mask destroys the mask currently used for clipping.
Named mask registry: delete active only · case 03
Deleting an inactive mask destroys the mask currently used for clipping.
Named mask registry: delete active only · case 04
Deleting an inactive mask destroys the mask currently used for clipping.
Named mask registry: delete active only · case 05
Deleting an inactive mask destroys the mask currently used for clipping.
Named mask registry: clone alias · case 01
Clone aliases mutable coverage and changes when the original mask is edited.
Named mask registry: clone alias · case 02
Clone aliases mutable coverage and changes when the original mask is edited.
Named mask registry: clone alias · case 03
Clone aliases mutable coverage and changes when the original mask is edited.
Named mask registry: clone alias · case 04
Clone aliases mutable coverage and changes when the original mask is edited.
Named mask registry: clone alias · case 05
Clone aliases mutable coverage and changes when the original mask is edited.
Named mask registry: subtract other · case 01
Mask subtraction retains the removed samples instead of their complement.
Named mask registry: subtract other · case 02
Mask subtraction retains the removed samples instead of their complement.
Named mask registry: subtract other · case 03
Mask subtraction retains the removed samples instead of their complement.
Named mask registry: subtract other · case 04
Mask subtraction retains the removed samples instead of their complement.
Named mask registry: subtract other · case 05
Mask subtraction retains the removed samples instead of their complement.
Named mask registry: rename retains source · case 01
Renaming leaves the old name live and allows stale commands to keep drawing the mask.
Named mask registry: rename retains source · case 02
Renaming leaves the old name live and allows stale commands to keep drawing the mask.
Named mask registry: rename retains source · case 03
Renaming leaves the old name live and allows stale commands to keep drawing the mask.
Named mask registry: rename retains source · case 04
Renaming leaves the old name live and allows stale commands to keep drawing the mask.
Named mask registry: rename retains source · case 05
Renaming leaves the old name live and allows stale commands to keep drawing the mask.
Named mask registry: rename binding · case 01
Rename updates the wrong active-name condition and loses the active mask.
Named mask registry: rename binding · case 02
Rename updates the wrong active-name condition and loses the active mask.
Named mask registry: rename binding · case 03
Rename updates the wrong active-name condition and loses the active mask.
Named mask registry: rename binding · case 04
Rename updates the wrong active-name condition and loses the active mask.
Named mask registry: rename binding · case 05
Rename updates the wrong active-name condition and loses the active mask.
Named mask registry: reset retains · case 01
Reset keeps mask definitions so a later bind resurrects old clipping state.
Named mask registry: reset retains · case 02
Reset keeps mask definitions so a later bind resurrects old clipping state.
Named mask registry: reset retains · case 03
Reset keeps mask definitions so a later bind resurrects old clipping state.
Named mask registry: reset retains · case 04
Reset keeps mask definitions so a later bind resurrects old clipping state.
Named mask registry: reset retains · case 05
Reset keeps mask definitions so a later bind resurrects old clipping state.
Named mask registry: missing full · case 01
Binding an undefined mask exposes the full surface instead of empty coverage.
Named mask registry: missing full · case 02
Binding an undefined mask exposes the full surface instead of empty coverage.
Named mask registry: missing full · case 03
Binding an undefined mask exposes the full surface instead of empty coverage.
Named mask registry: missing full · case 04
Binding an undefined mask exposes the full surface instead of empty coverage.
Named mask registry: missing full · case 05
Binding an undefined mask exposes the full surface instead of empty coverage.
Named mask registry: redefine union · case 01
Redefining a mask retains samples from its previous version.
Named mask registry: redefine union · case 02
Redefining a mask retains samples from its previous version.
Named mask registry: redefine union · case 03
Redefining a mask retains samples from its previous version.
Named mask registry: redefine union · case 04
Redefining a mask retains samples from its previous version.
Named mask registry: redefine union · case 05
Redefining a mask retains samples from its previous version.
Clip mask cache: revision not bumped · case 01
Updating coverage does not change its revision so cached old coverage is reused.
Clip mask cache: revision not bumped · case 02
Updating coverage does not change its revision so cached old coverage is reused.
Clip mask cache: revision not bumped · case 03
Updating coverage does not change its revision so cached old coverage is reused.
Clip mask cache: revision not bumped · case 04
Updating coverage does not change its revision so cached old coverage is reused.
Clip mask cache: revision not bumped · case 05
Updating coverage does not change its revision so cached old coverage is reused.
Clip mask cache: cache key global · case 01
Cache population reads the first defined mask instead of the active mask.
Clip mask cache: cache key global · case 02
Cache population reads the first defined mask instead of the active mask.
Clip mask cache: cache key global · case 03
Cache population reads the first defined mask instead of the active mask.
Clip mask cache: cache key global · case 04
Cache population reads the first defined mask instead of the active mask.
Clip mask cache: cache key global · case 05
Cache population reads the first defined mask instead of the active mask.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗