FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-50601

Stencil clip pass: less operands · case 01

The less comparison reverses reference and stored stencil operands.

Raster clipping● Open access↗
FA-50602

Stencil clip pass: less operands · case 02

The less comparison reverses reference and stored stencil operands.

Raster clipping◈ Members↗
FA-50603

Stencil clip pass: less operands · case 03

The less comparison reverses reference and stored stencil operands.

Raster clipping◈ Members↗
FA-50604

Stencil clip pass: less operands · case 04

The less comparison reverses reference and stored stencil operands.

Raster clipping◈ Members↗
FA-50605

Stencil clip pass: less operands · case 05

The less comparison reverses reference and stored stencil operands.

Raster clipping◈ Members↗
FA-50606

Stencil clip pass: fail operation · case 01

Failed stencil comparisons execute the success operation.

Raster clipping● Open access↗
FA-50607

Stencil clip pass: fail operation · case 02

Failed stencil comparisons execute the success operation.

Raster clipping◈ Members↗
FA-50608

Stencil clip pass: fail operation · case 03

Failed stencil comparisons execute the success operation.

Raster clipping◈ Members↗
FA-50609

Stencil clip pass: fail operation · case 04

Failed stencil comparisons execute the success operation.

Raster clipping◈ Members↗
FA-50610

Stencil clip pass: fail operation · case 05

Failed stencil comparisons execute the success operation.

Raster clipping◈ Members↗
FA-50611

Stencil clip pass: keep clears · case 01

The keep operation clears clip nesting counts.

Raster clipping● Open access↗
FA-50612

Stencil clip pass: keep clears · case 02

The keep operation clears clip nesting counts.

Raster clipping◈ Members↗
FA-50613

Stencil clip pass: keep clears · case 03

The keep operation clears clip nesting counts.

Raster clipping◈ Members↗
FA-50614

Stencil clip pass: keep clears · case 04

The keep operation clears clip nesting counts.

Raster clipping◈ Members↗
FA-50615

Stencil clip pass: keep clears · case 05

The keep operation clears clip nesting counts.

Raster clipping◈ Members↗
FA-50616

Stencil clip pass: replace masked reference · case 01

Replace writes the comparison-masked reference rather than the full write-masked reference.

Raster clipping● Open access↗
FA-50617

Stencil clip pass: replace masked reference · case 02

Replace writes the comparison-masked reference rather than the full write-masked reference.

Raster clipping◈ Members↗
FA-50618

Stencil clip pass: replace masked reference · case 03

Replace writes the comparison-masked reference rather than the full write-masked reference.

Raster clipping◈ Members↗
FA-50619

Stencil clip pass: replace masked reference · case 04

Replace writes the comparison-masked reference rather than the full write-masked reference.

Raster clipping◈ Members↗
FA-50620

Stencil clip pass: replace masked reference · case 05

Replace writes the comparison-masked reference rather than the full write-masked reference.

Raster clipping◈ Members↗
FA-50621

Stencil clip pass: decrement wrap · case 01

Saturating decrement underflows an empty clip depth to the maximum.

Raster clipping● Open access↗
FA-50622

Stencil clip pass: decrement wrap · case 02

Saturating decrement underflows an empty clip depth to the maximum.

Raster clipping◈ Members↗
FA-50623

Stencil clip pass: decrement wrap · case 03

Saturating decrement underflows an empty clip depth to the maximum.

Raster clipping◈ Members↗
FA-50624

Stencil clip pass: decrement wrap · case 04

Saturating decrement underflows an empty clip depth to the maximum.

Raster clipping◈ Members↗
FA-50625

Stencil clip pass: decrement wrap · case 05

Saturating decrement underflows an empty clip depth to the maximum.

Raster clipping◈ Members↗
FA-50626

Stencil clip pass: invert logical · case 01

Inversion performs Boolean negation instead of complementing all stencil planes.

Raster clipping● Open access↗
FA-50627

Stencil clip pass: invert logical · case 02

Inversion performs Boolean negation instead of complementing all stencil planes.

Raster clipping◈ Members↗
FA-50628

Stencil clip pass: invert logical · case 03

Inversion performs Boolean negation instead of complementing all stencil planes.

Raster clipping◈ Members↗
FA-50629

Stencil clip pass: invert logical · case 04

Inversion performs Boolean negation instead of complementing all stencil planes.

Raster clipping◈ Members↗
FA-50630

Stencil clip pass: invert logical · case 05

Inversion performs Boolean negation instead of complementing all stencil planes.

Raster clipping◈ Members↗
FA-50631

Damage history clip: damage overwrites · case 01

Multiple damage reports overwrite each other before the next frame.

Raster clipping● Open access↗
FA-50632

Damage history clip: damage overwrites · case 02

Multiple damage reports overwrite each other before the next frame.

Raster clipping◈ Members↗
FA-50633

Damage history clip: damage overwrites · case 03

Multiple damage reports overwrite each other before the next frame.

Raster clipping◈ Members↗
FA-50634

Damage history clip: damage overwrites · case 04

Multiple damage reports overwrite each other before the next frame.

Raster clipping◈ Members↗
FA-50635

Damage history clip: damage overwrites · case 05

Multiple damage reports overwrite each other before the next frame.

Raster clipping◈ Members↗
FA-50636

Damage history clip: unknown age empty · case 01

Uninitialized or missing backbuffer history is treated as incremental damage.

Raster clipping● Open access↗
FA-50637

Damage history clip: unknown age empty · case 02

Uninitialized or missing backbuffer history is treated as incremental damage.

Raster clipping◈ Members↗
FA-50638

Damage history clip: unknown age empty · case 03

Uninitialized or missing backbuffer history is treated as incremental damage.

Raster clipping◈ Members↗
FA-50639

Damage history clip: unknown age empty · case 04

Uninitialized or missing backbuffer history is treated as incremental damage.

Raster clipping◈ Members↗
FA-50640

Damage history clip: unknown age empty · case 05

Uninitialized or missing backbuffer history is treated as incremental damage.

Raster clipping◈ Members↗
FA-50641

Damage history clip: history window · case 01

Damage reconstruction includes one frame older than the backbuffer.

Raster clipping● Open access↗
FA-50642

Damage history clip: history window · case 02

Damage reconstruction includes one frame older than the backbuffer.

Raster clipping◈ Members↗
FA-50643

Damage history clip: history window · case 03

Damage reconstruction includes one frame older than the backbuffer.

Raster clipping◈ Members↗
FA-50644

Damage history clip: history window · case 04

Damage reconstruction includes one frame older than the backbuffer.

Raster clipping◈ Members↗
FA-50645

Damage history clip: history window · case 05

Damage reconstruction includes one frame older than the backbuffer.

Raster clipping◈ Members↗
FA-50646

Damage history clip: oldest first · case 01

Damage history is searched oldest first after multiple swaps.

Raster clipping● Open access↗
FA-50647

Damage history clip: oldest first · case 02

Damage history is searched oldest first after multiple swaps.

Raster clipping◈ Members↗
FA-50648

Damage history clip: oldest first · case 03

Damage history is searched oldest first after multiple swaps.

Raster clipping◈ Members↗
FA-50649

Damage history clip: oldest first · case 04

Damage history is searched oldest first after multiple swaps.

Raster clipping◈ Members↗
FA-50650

Damage history clip: oldest first · case 05

Damage history is searched oldest first after multiple swaps.

Raster clipping◈ Members↗
FA-50651

Damage history clip: history alias · case 01

The newly stored damage history is cleared through the current-damage alias.

Raster clipping● Open access↗
FA-50652

Damage history clip: history alias · case 02

The newly stored damage history is cleared through the current-damage alias.

Raster clipping◈ Members↗
FA-50653

Damage history clip: history alias · case 03

The newly stored damage history is cleared through the current-damage alias.

Raster clipping◈ Members↗
FA-50654

Damage history clip: history alias · case 04

The newly stored damage history is cleared through the current-damage alias.

Raster clipping◈ Members↗
FA-50655

Damage history clip: history alias · case 05

The newly stored damage history is cleared through the current-damage alias.

Raster clipping◈ Members↗
FA-50656

Damage history clip: failed present · case 01

Failed presentation advances history even though the backbuffer was not swapped.

Raster clipping● Open access↗
FA-50657

Damage history clip: failed present · case 02

Failed presentation advances history even though the backbuffer was not swapped.

Raster clipping◈ Members↗
FA-50658

Damage history clip: failed present · case 03

Failed presentation advances history even though the backbuffer was not swapped.

Raster clipping◈ Members↗
FA-50659

Damage history clip: failed present · case 04

Failed presentation advances history even though the backbuffer was not swapped.

Raster clipping◈ Members↗
FA-50660

Damage history clip: failed present · case 05

Failed presentation advances history even though the backbuffer was not swapped.

Raster clipping◈ Members↗
FA-50661

Damage history clip: damage retained · case 01

Successfully presented damage remains in the next frame current-damage set.

Raster clipping● Open access↗
FA-50662

Damage history clip: damage retained · case 02

Successfully presented damage remains in the next frame current-damage set.

Raster clipping◈ Members↗
FA-50663

Damage history clip: damage retained · case 03

Successfully presented damage remains in the next frame current-damage set.

Raster clipping◈ Members↗
FA-50664

Damage history clip: damage retained · case 04

Successfully presented damage remains in the next frame current-damage set.

Raster clipping◈ Members↗
FA-50665

Damage history clip: damage retained · case 05

Successfully presented damage remains in the next frame current-damage set.

Raster clipping◈ Members↗
FA-50666

Damage history clip: history eviction · case 01

The history cache evicts a damage frame still needed by supported backbuffer ages.

Raster clipping● Open access↗
FA-50667

Damage history clip: history eviction · case 02

The history cache evicts a damage frame still needed by supported backbuffer ages.

Raster clipping◈ Members↗
FA-50668

Damage history clip: history eviction · case 03

The history cache evicts a damage frame still needed by supported backbuffer ages.

Raster clipping◈ Members↗
FA-50669

Damage history clip: history eviction · case 04

The history cache evicts a damage frame still needed by supported backbuffer ages.

Raster clipping◈ Members↗
FA-50670

Damage history clip: history eviction · case 05

The history cache evicts a damage frame still needed by supported backbuffer ages.

Raster clipping◈ Members↗
FA-50671

Damage history clip: resize incremental · case 01

Resize fails to mark newly allocated samples dirty.

Raster clipping● Open access↗
FA-50672

Damage history clip: resize incremental · case 02

Resize fails to mark newly allocated samples dirty.

Raster clipping◈ Members↗
FA-50673

Damage history clip: resize incremental · case 03

Resize fails to mark newly allocated samples dirty.

Raster clipping◈ Members↗
FA-50674

Damage history clip: resize incremental · case 04

Resize fails to mark newly allocated samples dirty.

Raster clipping◈ Members↗
FA-50675

Damage history clip: resize incremental · case 05

Resize fails to mark newly allocated samples dirty.

Raster clipping◈ Members↗
FA-50676

Damage history clip: bounds damage · case 01

Damage commands retain nonexistent surface samples in the redraw clip.

Raster clipping● Open access↗
FA-50677

Damage history clip: bounds damage · case 02

Damage commands retain nonexistent surface samples in the redraw clip.

Raster clipping◈ Members↗
FA-50678

Damage history clip: bounds damage · case 03

Damage commands retain nonexistent surface samples in the redraw clip.

Raster clipping◈ Members↗
FA-50679

Damage history clip: bounds damage · case 04

Damage commands retain nonexistent surface samples in the redraw clip.

Raster clipping◈ Members↗
FA-50680

Damage history clip: bounds damage · case 05

Damage commands retain nonexistent surface samples in the redraw clip.

Raster clipping◈ Members↗
FA-50681

Layer clip isolation: begin inherits · case 01

A child layer inherits parent clipping early instead of clipping its resolved result.

Raster clipping● Open access↗
FA-50682

Layer clip isolation: begin inherits · case 02

A child layer inherits parent clipping early instead of clipping its resolved result.

Raster clipping◈ Members↗
FA-50683

Layer clip isolation: begin inherits · case 03

A child layer inherits parent clipping early instead of clipping its resolved result.

Raster clipping◈ Members↗
FA-50684

Layer clip isolation: begin inherits · case 04

A child layer inherits parent clipping early instead of clipping its resolved result.

Raster clipping◈ Members↗
FA-50685

Layer clip isolation: begin inherits · case 05

A child layer inherits parent clipping early instead of clipping its resolved result.

Raster clipping◈ Members↗
FA-50686

Layer clip isolation: begin keeps pixels · case 01

A child layer starts with the parent accumulated samples already present.

Raster clipping● Open access↗
FA-50687

Layer clip isolation: begin keeps pixels · case 02

A child layer starts with the parent accumulated samples already present.

Raster clipping◈ Members↗
FA-50688

Layer clip isolation: begin keeps pixels · case 03

A child layer starts with the parent accumulated samples already present.

Raster clipping◈ Members↗
FA-50689

Layer clip isolation: begin keeps pixels · case 04

A child layer starts with the parent accumulated samples already present.

Raster clipping◈ Members↗
FA-50690

Layer clip isolation: begin keeps pixels · case 05

A child layer starts with the parent accumulated samples already present.

Raster clipping◈ Members↗
FA-50691

Layer clip isolation: draw replace · case 01

Successive child draws erase previous layer coverage.

Raster clipping● Open access↗
FA-50692

Layer clip isolation: draw replace · case 02

Successive child draws erase previous layer coverage.

Raster clipping◈ Members↗
FA-50693

Layer clip isolation: draw replace · case 03

Successive child draws erase previous layer coverage.

Raster clipping◈ Members↗
FA-50694

Layer clip isolation: draw replace · case 04

Successive child draws erase previous layer coverage.

Raster clipping◈ Members↗
FA-50695

Layer clip isolation: draw replace · case 05

Successive child draws erase previous layer coverage.

Raster clipping◈ Members↗
FA-50696

Layer clip isolation: draw clip bypass · case 01

Layer draws bypass the local clip region.

Raster clipping● Open access↗
FA-50697

Layer clip isolation: draw clip bypass · case 02

Layer draws bypass the local clip region.

Raster clipping◈ Members↗
FA-50698

Layer clip isolation: draw clip bypass · case 03

Layer draws bypass the local clip region.

Raster clipping◈ Members↗
FA-50699

Layer clip isolation: draw clip bypass · case 04

Layer draws bypass the local clip region.

Raster clipping◈ Members↗
FA-50700

Layer clip isolation: draw clip bypass · case 05

Layer draws bypass the local clip region.

Raster clipping◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗