FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-50701

Layer clip isolation: clear clip · case 01

Clearing a layer also clears its clipping region, preventing subsequent draws.

Raster clipping● Open access↗
FA-50702

Layer clip isolation: clear clip · case 02

Clearing a layer also clears its clipping region, preventing subsequent draws.

Raster clipping◈ Members↗
FA-50703

Layer clip isolation: clear clip · case 03

Clearing a layer also clears its clipping region, preventing subsequent draws.

Raster clipping◈ Members↗
FA-50704

Layer clip isolation: clear clip · case 04

Clearing a layer also clears its clipping region, preventing subsequent draws.

Raster clipping◈ Members↗
FA-50705

Layer clip isolation: clear clip · case 05

Clearing a layer also clears its clipping region, preventing subsequent draws.

Raster clipping◈ Members↗
FA-50706

Layer clip isolation: end unmasked · case 01

Layer composition publishes child coverage outside the saved parent clip.

Raster clipping● Open access↗
FA-50707

Layer clip isolation: end unmasked · case 02

Layer composition publishes child coverage outside the saved parent clip.

Raster clipping◈ Members↗
FA-50708

Layer clip isolation: end unmasked · case 03

Layer composition publishes child coverage outside the saved parent clip.

Raster clipping◈ Members↗
FA-50709

Layer clip isolation: end unmasked · case 04

Layer composition publishes child coverage outside the saved parent clip.

Raster clipping◈ Members↗
FA-50710

Layer clip isolation: end unmasked · case 05

Layer composition publishes child coverage outside the saved parent clip.

Raster clipping◈ Members↗
FA-50711

Layer clip isolation: end erases parent · case 01

Resolving a child replaces previously drawn parent samples.

Raster clipping● Open access↗
FA-50712

Layer clip isolation: end erases parent · case 02

Resolving a child replaces previously drawn parent samples.

Raster clipping◈ Members↗
FA-50713

Layer clip isolation: end erases parent · case 03

Resolving a child replaces previously drawn parent samples.

Raster clipping◈ Members↗
FA-50714

Layer clip isolation: end erases parent · case 04

Resolving a child replaces previously drawn parent samples.

Raster clipping◈ Members↗
FA-50715

Layer clip isolation: end erases parent · case 05

Resolving a child replaces previously drawn parent samples.

Raster clipping◈ Members↗
FA-50716

Layer clip isolation: end restore region · case 01

Ending a layer loses the enclosing clip for later parent drawing.

Raster clipping● Open access↗
FA-50717

Layer clip isolation: end restore region · case 02

Ending a layer loses the enclosing clip for later parent drawing.

Raster clipping◈ Members↗
FA-50718

Layer clip isolation: end restore region · case 03

Ending a layer loses the enclosing clip for later parent drawing.

Raster clipping◈ Members↗
FA-50719

Layer clip isolation: end restore region · case 04

Ending a layer loses the enclosing clip for later parent drawing.

Raster clipping◈ Members↗
FA-50720

Layer clip isolation: end restore region · case 05

Ending a layer loses the enclosing clip for later parent drawing.

Raster clipping◈ Members↗
FA-50721

Layer clip isolation: discard publishes · case 01

Discarding a layer leaks its temporary coverage into the parent.

Raster clipping● Open access↗
FA-50722

Layer clip isolation: discard publishes · case 02

Discarding a layer leaks its temporary coverage into the parent.

Raster clipping◈ Members↗
FA-50723

Layer clip isolation: discard publishes · case 03

Discarding a layer leaks its temporary coverage into the parent.

Raster clipping◈ Members↗
FA-50724

Layer clip isolation: discard publishes · case 04

Discarding a layer leaks its temporary coverage into the parent.

Raster clipping◈ Members↗
FA-50725

Layer clip isolation: discard publishes · case 05

Discarding a layer leaks its temporary coverage into the parent.

Raster clipping◈ Members↗
FA-50726

Layer clip isolation: nested order · case 01

Nested layer completion resolves into the outermost parent first.

Raster clipping● Open access↗
FA-50727

Layer clip isolation: nested order · case 02

Nested layer completion resolves into the outermost parent first.

Raster clipping◈ Members↗
FA-50728

Layer clip isolation: nested order · case 03

Nested layer completion resolves into the outermost parent first.

Raster clipping◈ Members↗
FA-50729

Layer clip isolation: nested order · case 04

Nested layer completion resolves into the outermost parent first.

Raster clipping◈ Members↗
FA-50730

Layer clip isolation: nested order · case 05

Nested layer completion resolves into the outermost parent first.

Raster clipping◈ Members↗
FA-50731

Deferred draw clip: snapshot current · case 01

Flush clips old submissions with the current clip rather than the submit-time snapshot.

Raster clipping● Open access↗
FA-50732

Deferred draw clip: snapshot current · case 02

Flush clips old submissions with the current clip rather than the submit-time snapshot.

Raster clipping◈ Members↗
FA-50733

Deferred draw clip: snapshot current · case 03

Flush clips old submissions with the current clip rather than the submit-time snapshot.

Raster clipping◈ Members↗
FA-50734

Deferred draw clip: snapshot current · case 04

Flush clips old submissions with the current clip rather than the submit-time snapshot.

Raster clipping◈ Members↗
FA-50735

Deferred draw clip: snapshot current · case 05

Flush clips old submissions with the current clip rather than the submit-time snapshot.

Raster clipping◈ Members↗
FA-50736

Deferred draw clip: submit disable · case 01

A disabled clipping test suppresses drawing instead of passing full target coverage.

Raster clipping● Open access↗
FA-50737

Deferred draw clip: submit disable · case 02

A disabled clipping test suppresses drawing instead of passing full target coverage.

Raster clipping◈ Members↗
FA-50738

Deferred draw clip: submit disable · case 03

A disabled clipping test suppresses drawing instead of passing full target coverage.

Raster clipping◈ Members↗
FA-50739

Deferred draw clip: submit disable · case 04

A disabled clipping test suppresses drawing instead of passing full target coverage.

Raster clipping◈ Members↗
FA-50740

Deferred draw clip: submit disable · case 05

A disabled clipping test suppresses drawing instead of passing full target coverage.

Raster clipping◈ Members↗
FA-50741

Deferred draw clip: submit inverted · case 01

Queue capture reverses normal and inverse-clip polarity.

Raster clipping● Open access↗
FA-50742

Deferred draw clip: submit inverted · case 02

Queue capture reverses normal and inverse-clip polarity.

Raster clipping◈ Members↗
FA-50743

Deferred draw clip: submit inverted · case 03

Queue capture reverses normal and inverse-clip polarity.

Raster clipping◈ Members↗
FA-50744

Deferred draw clip: submit inverted · case 04

Queue capture reverses normal and inverse-clip polarity.

Raster clipping◈ Members↗
FA-50745

Deferred draw clip: submit inverted · case 05

Queue capture reverses normal and inverse-clip polarity.

Raster clipping◈ Members↗
FA-50746

Deferred draw clip: queue overwrite · case 01

A second deferred draw overwrites the first pending submission.

Raster clipping● Open access↗
FA-50747

Deferred draw clip: queue overwrite · case 02

A second deferred draw overwrites the first pending submission.

Raster clipping◈ Members↗
FA-50748

Deferred draw clip: queue overwrite · case 03

A second deferred draw overwrites the first pending submission.

Raster clipping◈ Members↗
FA-50749

Deferred draw clip: queue overwrite · case 04

A second deferred draw overwrites the first pending submission.

Raster clipping◈ Members↗
FA-50750

Deferred draw clip: queue overwrite · case 05

A second deferred draw overwrites the first pending submission.

Raster clipping◈ Members↗
FA-50751

Deferred draw clip: cancel keeps · case 01

Cancellation keeps only the draw requested for removal.

Raster clipping● Open access↗
FA-50752

Deferred draw clip: cancel keeps · case 02

Cancellation keeps only the draw requested for removal.

Raster clipping◈ Members↗
FA-50753

Deferred draw clip: cancel keeps · case 03

Cancellation keeps only the draw requested for removal.

Raster clipping◈ Members↗
FA-50754

Deferred draw clip: cancel keeps · case 04

Cancellation keeps only the draw requested for removal.

Raster clipping◈ Members↗
FA-50755

Deferred draw clip: cancel keeps · case 05

Cancellation keeps only the draw requested for removal.

Raster clipping◈ Members↗
FA-50756

Deferred draw clip: resize queued · case 01

Queued coverage outside a resized target survives into flush.

Raster clipping● Open access↗
FA-50757

Deferred draw clip: resize queued · case 02

Queued coverage outside a resized target survives into flush.

Raster clipping◈ Members↗
FA-50758

Deferred draw clip: resize queued · case 03

Queued coverage outside a resized target survives into flush.

Raster clipping◈ Members↗
FA-50759

Deferred draw clip: resize queued · case 04

Queued coverage outside a resized target survives into flush.

Raster clipping◈ Members↗
FA-50760

Deferred draw clip: resize queued · case 05

Queued coverage outside a resized target survives into flush.

Raster clipping◈ Members↗
FA-50761

Deferred draw clip: resize expands · case 01

Resizing expands the remembered clip used by later submissions.

Raster clipping● Open access↗
FA-50762

Deferred draw clip: resize expands · case 02

Resizing expands the remembered clip used by later submissions.

Raster clipping◈ Members↗
FA-50763

Deferred draw clip: resize expands · case 03

Resizing expands the remembered clip used by later submissions.

Raster clipping◈ Members↗
FA-50764

Deferred draw clip: resize expands · case 04

Resizing expands the remembered clip used by later submissions.

Raster clipping◈ Members↗
FA-50765

Deferred draw clip: resize expands · case 05

Resizing expands the remembered clip used by later submissions.

Raster clipping◈ Members↗
FA-50766

Deferred draw clip: flush reverses · case 01

Batch flushing reverses the order of submitted clipped draws.

Raster clipping● Open access↗
FA-50767

Deferred draw clip: flush reverses · case 02

Batch flushing reverses the order of submitted clipped draws.

Raster clipping◈ Members↗
FA-50768

Deferred draw clip: flush reverses · case 03

Batch flushing reverses the order of submitted clipped draws.

Raster clipping◈ Members↗
FA-50769

Deferred draw clip: flush reverses · case 04

Batch flushing reverses the order of submitted clipped draws.

Raster clipping◈ Members↗
FA-50770

Deferred draw clip: flush reverses · case 05

Batch flushing reverses the order of submitted clipped draws.

Raster clipping◈ Members↗
FA-50771

Deferred draw clip: flush retains · case 01

Flushed submissions remain pending and are emitted again at the next barrier.

Raster clipping● Open access↗
FA-50772

Deferred draw clip: flush retains · case 02

Flushed submissions remain pending and are emitted again at the next barrier.

Raster clipping◈ Members↗
FA-50773

Deferred draw clip: flush retains · case 03

Flushed submissions remain pending and are emitted again at the next barrier.

Raster clipping◈ Members↗
FA-50774

Deferred draw clip: flush retains · case 04

Flushed submissions remain pending and are emitted again at the next barrier.

Raster clipping◈ Members↗
FA-50775

Deferred draw clip: flush retains · case 05

Flushed submissions remain pending and are emitted again at the next barrier.

Raster clipping◈ Members↗
FA-50776

Deferred draw clip: barrier ignored · case 01

A clip-state barrier fails to emit pending coverage before following work.

Raster clipping● Open access↗
FA-50777

Deferred draw clip: barrier ignored · case 02

A clip-state barrier fails to emit pending coverage before following work.

Raster clipping◈ Members↗
FA-50778

Deferred draw clip: barrier ignored · case 03

A clip-state barrier fails to emit pending coverage before following work.

Raster clipping◈ Members↗
FA-50779

Deferred draw clip: barrier ignored · case 04

A clip-state barrier fails to emit pending coverage before following work.

Raster clipping◈ Members↗
FA-50780

Deferred draw clip: barrier ignored · case 05

A clip-state barrier fails to emit pending coverage before following work.

Raster clipping◈ Members↗
FA-50781

Run length clip stream: seek relative · case 01

An absolute stream seek is decoded as a relative skip.

Raster clipping● Open access↗
FA-50782

Run length clip stream: seek relative · case 02

An absolute stream seek is decoded as a relative skip.

Raster clipping◈ Members↗
FA-50783

Run length clip stream: seek relative · case 03

An absolute stream seek is decoded as a relative skip.

Raster clipping◈ Members↗
FA-50784

Run length clip stream: seek relative · case 04

An absolute stream seek is decoded as a relative skip.

Raster clipping◈ Members↗
FA-50785

Run length clip stream: seek relative · case 05

An absolute stream seek is decoded as a relative skip.

Raster clipping◈ Members↗
FA-50786

Run length clip stream: move clamped · case 01

A negative skip is clamped before the following run can be clipped correctly.

Raster clipping● Open access↗
FA-50787

Run length clip stream: move clamped · case 02

A negative skip is clamped before the following run can be clipped correctly.

Raster clipping◈ Members↗
FA-50788

Run length clip stream: move clamped · case 03

A negative skip is clamped before the following run can be clipped correctly.

Raster clipping◈ Members↗
FA-50789

Run length clip stream: move clamped · case 04

A negative skip is clamped before the following run can be clipped correctly.

Raster clipping◈ Members↗
FA-50790

Run length clip stream: move clamped · case 05

A negative skip is clamped before the following run can be clipped correctly.

Raster clipping◈ Members↗
FA-50791

Run length clip stream: gap no advance · case 01

Uncovered runs fail to advance the clip stream cursor.

Raster clipping● Open access↗
FA-50792

Run length clip stream: gap no advance · case 02

Uncovered runs fail to advance the clip stream cursor.

Raster clipping◈ Members↗
FA-50793

Run length clip stream: gap no advance · case 03

Uncovered runs fail to advance the clip stream cursor.

Raster clipping◈ Members↗
FA-50794

Run length clip stream: gap no advance · case 04

Uncovered runs fail to advance the clip stream cursor.

Raster clipping◈ Members↗
FA-50795

Run length clip stream: gap no advance · case 05

Uncovered runs fail to advance the clip stream cursor.

Raster clipping◈ Members↗
FA-50796

Run length clip stream: negative run advance · case 01

An invalid negative run silently rewinds the cursor instead of consuming zero samples.

Raster clipping● Open access↗
FA-50797

Run length clip stream: negative run advance · case 02

An invalid negative run silently rewinds the cursor instead of consuming zero samples.

Raster clipping◈ Members↗
FA-50798

Run length clip stream: negative run advance · case 03

An invalid negative run silently rewinds the cursor instead of consuming zero samples.

Raster clipping◈ Members↗
FA-50799

Run length clip stream: negative run advance · case 04

An invalid negative run silently rewinds the cursor instead of consuming zero samples.

Raster clipping◈ Members↗
FA-50800

Run length clip stream: negative run advance · case 05

An invalid negative run silently rewinds the cursor instead of consuming zero samples.

Raster clipping◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗