FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-25601

Disabled but unlocked criteria remain editable · case 01

Disabled but unlocked criteria remain editable is violated by the widget projection.

Filter interfaces● Open access↗
FA-25602

Disabled but unlocked criteria remain editable · case 02

Disabled but unlocked criteria remain editable is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25603

Disabled but unlocked criteria remain editable · case 03

Disabled but unlocked criteria remain editable is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25604

Disabled but unlocked criteria remain editable · case 04

Disabled but unlocked criteria remain editable is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25605

Disabled but unlocked criteria remain editable · case 05

Disabled but unlocked criteria remain editable is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25606

Mandatory and locked criteria both reject disable toggles · case 01

Mandatory and locked criteria both reject disable toggles is violated by the widget projection.

Filter interfaces● Open access↗
FA-25607

Mandatory and locked criteria both reject disable toggles · case 02

Mandatory and locked criteria both reject disable toggles is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25608

Mandatory and locked criteria both reject disable toggles · case 03

Mandatory and locked criteria both reject disable toggles is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25609

Mandatory and locked criteria both reject disable toggles · case 04

Mandatory and locked criteria both reject disable toggles is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25610

Mandatory and locked criteria both reject disable toggles · case 05

Mandatory and locked criteria both reject disable toggles is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25611

Disabled presentation does not strike through active locked criteria · case 01

Disabled presentation does not strike through active locked criteria is violated by the widget projection.

Filter interfaces● Open access↗
FA-25612

Disabled presentation does not strike through active locked criteria · case 02

Disabled presentation does not strike through active locked criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25613

Disabled presentation does not strike through active locked criteria · case 03

Disabled presentation does not strike through active locked criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25614

Disabled presentation does not strike through active locked criteria · case 04

Disabled presentation does not strike through active locked criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25615

Disabled presentation does not strike through active locked criteria · case 05

Disabled presentation does not strike through active locked criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25616

Only active invalid criteria block application including locked ones · case 01

Only active invalid criteria block application including locked ones is violated by the widget projection.

Filter interfaces● Open access↗
FA-25617

Only active invalid criteria block application including locked ones · case 02

Only active invalid criteria block application including locked ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25618

Only active invalid criteria block application including locked ones · case 03

Only active invalid criteria block application including locked ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25619

Only active invalid criteria block application including locked ones · case 04

Only active invalid criteria block application including locked ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25620

Only active invalid criteria block application including locked ones · case 05

Only active invalid criteria block application including locked ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25621

Global user reset retains system constraints by provenance · case 01

Global user reset retains system constraints by provenance is violated by the widget projection.

Filter interfaces● Open access↗
FA-25622

Global user reset retains system constraints by provenance · case 02

Global user reset retains system constraints by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25623

Global user reset retains system constraints by provenance · case 03

Global user reset retains system constraints by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25624

Global user reset retains system constraints by provenance · case 04

Global user reset retains system constraints by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25625

Global user reset retains system constraints by provenance · case 05

Global user reset retains system constraints by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25626

Removal controls follow criterion provenance rather than field names · case 01

Removal controls follow criterion provenance rather than field names is violated by the widget projection.

Filter interfaces● Open access↗
FA-25627

Removal controls follow criterion provenance rather than field names · case 02

Removal controls follow criterion provenance rather than field names is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25628

Removal controls follow criterion provenance rather than field names · case 03

Removal controls follow criterion provenance rather than field names is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25629

Removal controls follow criterion provenance rather than field names · case 04

Removal controls follow criterion provenance rather than field names is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25630

Removal controls follow criterion provenance rather than field names · case 05

Removal controls follow criterion provenance rather than field names is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25631

Same-field user constraints do not overwrite enforced scope operands · case 01

Same-field user constraints do not overwrite enforced scope operands is violated by the widget projection.

Filter interfaces● Open access↗
FA-25632

Same-field user constraints do not overwrite enforced scope operands · case 02

Same-field user constraints do not overwrite enforced scope operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25633

Same-field user constraints do not overwrite enforced scope operands · case 03

Same-field user constraints do not overwrite enforced scope operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25634

Same-field user constraints do not overwrite enforced scope operands · case 04

Same-field user constraints do not overwrite enforced scope operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25635

Same-field user constraints do not overwrite enforced scope operands · case 05

Same-field user constraints do not overwrite enforced scope operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25636

Portable preset export excludes enforced rows by provenance · case 01

Portable preset export excludes enforced rows by provenance is violated by the widget projection.

Filter interfaces● Open access↗
FA-25637

Portable preset export excludes enforced rows by provenance · case 02

Portable preset export excludes enforced rows by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25638

Portable preset export excludes enforced rows by provenance · case 03

Portable preset export excludes enforced rows by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25639

Portable preset export excludes enforced rows by provenance · case 04

Portable preset export excludes enforced rows by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25640

Portable preset export excludes enforced rows by provenance · case 05

Portable preset export excludes enforced rows by provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25641

Required badges identify actual enforced rows · case 01

Required badges identify actual enforced rows is violated by the widget projection.

Filter interfaces● Open access↗
FA-25642

Required badges identify actual enforced rows · case 02

Required badges identify actual enforced rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25643

Required badges identify actual enforced rows · case 03

Required badges identify actual enforced rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25644

Required badges identify actual enforced rows · case 04

Required badges identify actual enforced rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25645

Required badges identify actual enforced rows · case 05

Required badges identify actual enforced rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25646

User filter counts exclude enforced constraints without collapsing repeated fields · case 01

User filter counts exclude enforced constraints without collapsing repeated fields is violated by the widget projection.

Filter interfaces● Open access↗
FA-25647

User filter counts exclude enforced constraints without collapsing repeated fields · case 02

User filter counts exclude enforced constraints without collapsing repeated fields is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25648

User filter counts exclude enforced constraints without collapsing repeated fields · case 03

User filter counts exclude enforced constraints without collapsing repeated fields is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25649

User filter counts exclude enforced constraints without collapsing repeated fields · case 04

User filter counts exclude enforced constraints without collapsing repeated fields is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25650

User filter counts exclude enforced constraints without collapsing repeated fields · case 05

User filter counts exclude enforced constraints without collapsing repeated fields is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25651

Explicit empty user filters suppress initial defaults · case 01

Explicit empty user filters suppress initial defaults is violated by the widget projection.

Filter interfaces● Open access↗
FA-25652

Explicit empty user filters suppress initial defaults · case 02

Explicit empty user filters suppress initial defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25653

Explicit empty user filters suppress initial defaults · case 03

Explicit empty user filters suppress initial defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25654

Explicit empty user filters suppress initial defaults · case 04

Explicit empty user filters suppress initial defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25655

Explicit empty user filters suppress initial defaults · case 05

Explicit empty user filters suppress initial defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25656

Default refreshes replace only default-owned constraints · case 01

Default refreshes replace only default-owned constraints is violated by the widget projection.

Filter interfaces● Open access↗
FA-25657

Default refreshes replace only default-owned constraints · case 02

Default refreshes replace only default-owned constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25658

Default refreshes replace only default-owned constraints · case 03

Default refreshes replace only default-owned constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25659

Default refreshes replace only default-owned constraints · case 04

Default refreshes replace only default-owned constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25660

Default refreshes replace only default-owned constraints · case 05

Default refreshes replace only default-owned constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25661

Explicit clearing transfers ownership away from defaults · case 01

Explicit clearing transfers ownership away from defaults is violated by the widget projection.

Filter interfaces● Open access↗
FA-25662

Explicit clearing transfers ownership away from defaults · case 02

Explicit clearing transfers ownership away from defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25663

Explicit clearing transfers ownership away from defaults · case 03

Explicit clearing transfers ownership away from defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25664

Explicit clearing transfers ownership away from defaults · case 04

Explicit clearing transfers ownership away from defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25665

Explicit clearing transfers ownership away from defaults · case 05

Explicit clearing transfers ownership away from defaults is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25666

Reset-to-default replaces rather than merges user operands · case 01

Reset-to-default replaces rather than merges user operands is violated by the widget projection.

Filter interfaces● Open access↗
FA-25667

Reset-to-default replaces rather than merges user operands · case 02

Reset-to-default replaces rather than merges user operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25668

Reset-to-default replaces rather than merges user operands · case 03

Reset-to-default replaces rather than merges user operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25669

Reset-to-default replaces rather than merges user operands · case 04

Reset-to-default replaces rather than merges user operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25670

Reset-to-default replaces rather than merges user operands · case 05

Reset-to-default replaces rather than merges user operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25671

Default badges reflect provenance rather than coincidental equality · case 01

Default badges reflect provenance rather than coincidental equality is violated by the widget projection.

Filter interfaces● Open access↗
FA-25672

Default badges reflect provenance rather than coincidental equality · case 02

Default badges reflect provenance rather than coincidental equality is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25673

Default badges reflect provenance rather than coincidental equality · case 03

Default badges reflect provenance rather than coincidental equality is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25674

Default badges reflect provenance rather than coincidental equality · case 04

Default badges reflect provenance rather than coincidental equality is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25675

Default badges reflect provenance rather than coincidental equality · case 05

Default badges reflect provenance rather than coincidental equality is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25676

Persistence records an explicitly cleared filter state · case 01

Persistence records an explicitly cleared filter state is violated by the widget projection.

Filter interfaces● Open access↗
FA-25677

Persistence records an explicitly cleared filter state · case 02

Persistence records an explicitly cleared filter state is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25678

Persistence records an explicitly cleared filter state · case 03

Persistence records an explicitly cleared filter state is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25679

Persistence records an explicitly cleared filter state · case 04

Persistence records an explicitly cleared filter state is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25680

Persistence records an explicitly cleared filter state · case 05

Persistence records an explicitly cleared filter state is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25681

Undo restores the immediately preceding constraint snapshot · case 01

Undo restores the immediately preceding constraint snapshot is violated by the widget projection.

Filter interfaces● Open access↗
FA-25682

Undo restores the immediately preceding constraint snapshot · case 02

Undo restores the immediately preceding constraint snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25683

Undo restores the immediately preceding constraint snapshot · case 03

Undo restores the immediately preceding constraint snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25684

Undo restores the immediately preceding constraint snapshot · case 04

Undo restores the immediately preceding constraint snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25685

Undo restores the immediately preceding constraint snapshot · case 05

Undo restores the immediately preceding constraint snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25686

Undo removes only the latest past snapshot · case 01

Undo removes only the latest past snapshot is violated by the widget projection.

Filter interfaces● Open access↗
FA-25687

Undo removes only the latest past snapshot · case 02

Undo removes only the latest past snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25688

Undo removes only the latest past snapshot · case 03

Undo removes only the latest past snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25689

Undo removes only the latest past snapshot · case 04

Undo removes only the latest past snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25690

Undo removes only the latest past snapshot · case 05

Undo removes only the latest past snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25691

Redo restores the first future filter snapshot · case 01

Redo restores the first future filter snapshot is violated by the widget projection.

Filter interfaces● Open access↗
FA-25692

Redo restores the first future filter snapshot · case 02

Redo restores the first future filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25693

Redo restores the first future filter snapshot · case 03

Redo restores the first future filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25694

Redo restores the first future filter snapshot · case 04

Redo restores the first future filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25695

Redo restores the first future filter snapshot · case 05

Redo restores the first future filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25696

A new criterion edit invalidates only the branched redo history · case 01

A new criterion edit invalidates only the branched redo history is violated by the widget projection.

Filter interfaces● Open access↗
FA-25697

A new criterion edit invalidates only the branched redo history · case 02

A new criterion edit invalidates only the branched redo history is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25698

A new criterion edit invalidates only the branched redo history · case 03

A new criterion edit invalidates only the branched redo history is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25699

A new criterion edit invalidates only the branched redo history · case 04

A new criterion edit invalidates only the branched redo history is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25700

A new criterion edit invalidates only the branched redo history · case 05

A new criterion edit invalidates only the branched redo history is violated by the widget projection.

Filter interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗