FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-25501

False-only filtering remains an active constraint · case 01

False-only filtering remains an active constraint is violated by the widget projection.

Filter interfaces● Open access↗
FA-25502

False-only filtering remains an active constraint · case 02

False-only filtering remains an active constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25503

False-only filtering remains an active constraint · case 03

False-only filtering remains an active constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25504

False-only filtering remains an active constraint · case 04

False-only filtering remains an active constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25505

False-only filtering remains an active constraint · case 05

False-only filtering remains an active constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25506

Boolean filter operands preserve the absent state separately from false · case 01

Boolean filter operands preserve the absent state separately from false is violated by the widget projection.

Filter interfaces● Open access↗
FA-25507

Boolean filter operands preserve the absent state separately from false · case 02

Boolean filter operands preserve the absent state separately from false is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25508

Boolean filter operands preserve the absent state separately from false · case 03

Boolean filter operands preserve the absent state separately from false is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25509

Boolean filter operands preserve the absent state separately from false · case 04

Boolean filter operands preserve the absent state separately from false is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25510

Boolean filter operands preserve the absent state separately from false · case 05

Boolean filter operands preserve the absent state separately from false is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25511

Boolean captions distinguish no restriction from false restriction · case 01

Boolean captions distinguish no restriction from false restriction is violated by the widget projection.

Filter interfaces● Open access↗
FA-25512

Boolean captions distinguish no restriction from false restriction · case 02

Boolean captions distinguish no restriction from false restriction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25513

Boolean captions distinguish no restriction from false restriction · case 03

Boolean captions distinguish no restriction from false restriction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25514

Boolean captions distinguish no restriction from false restriction · case 04

Boolean captions distinguish no restriction from false restriction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25515

Boolean captions distinguish no restriction from false restriction · case 05

Boolean captions distinguish no restriction from false restriction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25516

Inverting a boolean criterion leaves the unrestricted state unchanged · case 01

Inverting a boolean criterion leaves the unrestricted state unchanged is violated by the widget projection.

Filter interfaces● Open access↗
FA-25517

Inverting a boolean criterion leaves the unrestricted state unchanged · case 02

Inverting a boolean criterion leaves the unrestricted state unchanged is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25518

Inverting a boolean criterion leaves the unrestricted state unchanged · case 03

Inverting a boolean criterion leaves the unrestricted state unchanged is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25519

Inverting a boolean criterion leaves the unrestricted state unchanged · case 04

Inverting a boolean criterion leaves the unrestricted state unchanged is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25520

Inverting a boolean criterion leaves the unrestricted state unchanged · case 05

Inverting a boolean criterion leaves the unrestricted state unchanged is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25521

Hydration accepts explicit boolean strings and rejects unknown tokens · case 01

Hydration accepts explicit boolean strings and rejects unknown tokens is violated by the widget projection.

Filter interfaces● Open access↗
FA-25522

Hydration accepts explicit boolean strings and rejects unknown tokens · case 02

Hydration accepts explicit boolean strings and rejects unknown tokens is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25523

Hydration accepts explicit boolean strings and rejects unknown tokens · case 03

Hydration accepts explicit boolean strings and rejects unknown tokens is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25524

Hydration accepts explicit boolean strings and rejects unknown tokens · case 04

Hydration accepts explicit boolean strings and rejects unknown tokens is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25525

Hydration accepts explicit boolean strings and rejects unknown tokens · case 05

Hydration accepts explicit boolean strings and rejects unknown tokens is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25526

False restrictions receive negative polarity badges · case 01

False restrictions receive negative polarity badges is violated by the widget projection.

Filter interfaces● Open access↗
FA-25527

False restrictions receive negative polarity badges · case 02

False restrictions receive negative polarity badges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25528

False restrictions receive negative polarity badges · case 03

False restrictions receive negative polarity badges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25529

False restrictions receive negative polarity badges · case 04

False restrictions receive negative polarity badges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25530

False restrictions receive negative polarity badges · case 05

False restrictions receive negative polarity badges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25531

Retired selected enums remain visible for inspection · case 01

Retired selected enums remain visible for inspection is violated by the widget projection.

Filter interfaces● Open access↗
FA-25532

Retired selected enums remain visible for inspection · case 02

Retired selected enums remain visible for inspection is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25533

Retired selected enums remain visible for inspection · case 03

Retired selected enums remain visible for inspection is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25534

Retired selected enums remain visible for inspection · case 04

Retired selected enums remain visible for inspection is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25535

Retired selected enums remain visible for inspection · case 05

Retired selected enums remain visible for inspection is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25536

New enum additions require an active unblocked option · case 01

New enum additions require an active unblocked option is violated by the widget projection.

Filter interfaces● Open access↗
FA-25537

New enum additions require an active unblocked option · case 02

New enum additions require an active unblocked option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25538

New enum additions require an active unblocked option · case 03

New enum additions require an active unblocked option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25539

New enum additions require an active unblocked option · case 04

New enum additions require an active unblocked option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25540

New enum additions require an active unblocked option · case 05

New enum additions require an active unblocked option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25541

A retired selection remains removable unless the criterion is locked · case 01

A retired selection remains removable unless the criterion is locked is violated by the widget projection.

Filter interfaces● Open access↗
FA-25542

A retired selection remains removable unless the criterion is locked · case 02

A retired selection remains removable unless the criterion is locked is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25543

A retired selection remains removable unless the criterion is locked · case 03

A retired selection remains removable unless the criterion is locked is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25544

A retired selection remains removable unless the criterion is locked · case 04

A retired selection remains removable unless the criterion is locked is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25545

A retired selection remains removable unless the criterion is locked · case 05

A retired selection remains removable unless the criterion is locked is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25546

Missing enum labels fall back to identity without replacing an explicit empty caption · case 01

Missing enum labels fall back to identity without replacing an explicit empty caption is violated by the widget projection.

Filter interfaces● Open access↗
FA-25547

Missing enum labels fall back to identity without replacing an explicit empty caption · case 02

Missing enum labels fall back to identity without replacing an explicit empty caption is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25548

Missing enum labels fall back to identity without replacing an explicit empty caption · case 03

Missing enum labels fall back to identity without replacing an explicit empty caption is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25549

Missing enum labels fall back to identity without replacing an explicit empty caption · case 04

Missing enum labels fall back to identity without replacing an explicit empty caption is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25550

Missing enum labels fall back to identity without replacing an explicit empty caption · case 05

Missing enum labels fall back to identity without replacing an explicit empty caption is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25551

Retired badges apply to retained selections rather than all unavailable choices · case 01

Retired badges apply to retained selections rather than all unavailable choices is violated by the widget projection.

Filter interfaces● Open access↗
FA-25552

Retired badges apply to retained selections rather than all unavailable choices · case 02

Retired badges apply to retained selections rather than all unavailable choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25553

Retired badges apply to retained selections rather than all unavailable choices · case 03

Retired badges apply to retained selections rather than all unavailable choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25554

Retired badges apply to retained selections rather than all unavailable choices · case 04

Retired badges apply to retained selections rather than all unavailable choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25555

Retired badges apply to retained selections rather than all unavailable choices · case 05

Retired badges apply to retained selections rather than all unavailable choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25556

Serialization retains stable IDs for selected retired options · case 01

Serialization retains stable IDs for selected retired options is violated by the widget projection.

Filter interfaces● Open access↗
FA-25557

Serialization retains stable IDs for selected retired options · case 02

Serialization retains stable IDs for selected retired options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25558

Serialization retains stable IDs for selected retired options · case 03

Serialization retains stable IDs for selected retired options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25559

Serialization retains stable IDs for selected retired options · case 04

Serialization retains stable IDs for selected retired options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25560

Serialization retains stable IDs for selected retired options · case 05

Serialization retains stable IDs for selected retired options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25561

Disabled visible choices are excluded from bulk targets · case 01

Disabled visible choices are excluded from bulk targets is violated by the widget projection.

Filter interfaces● Open access↗
FA-25562

Disabled visible choices are excluded from bulk targets · case 02

Disabled visible choices are excluded from bulk targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25563

Disabled visible choices are excluded from bulk targets · case 03

Disabled visible choices are excluded from bulk targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25564

Disabled visible choices are excluded from bulk targets · case 04

Disabled visible choices are excluded from bulk targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25565

Disabled visible choices are excluded from bulk targets · case 05

Disabled visible choices are excluded from bulk targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25566

Select-visible preserves hidden choices and excludes disabled additions · case 01

Select-visible preserves hidden choices and excludes disabled additions is violated by the widget projection.

Filter interfaces● Open access↗
FA-25567

Select-visible preserves hidden choices and excludes disabled additions · case 02

Select-visible preserves hidden choices and excludes disabled additions is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25568

Select-visible preserves hidden choices and excludes disabled additions · case 03

Select-visible preserves hidden choices and excludes disabled additions is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25569

Select-visible preserves hidden choices and excludes disabled additions · case 04

Select-visible preserves hidden choices and excludes disabled additions is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25570

Select-visible preserves hidden choices and excludes disabled additions · case 05

Select-visible preserves hidden choices and excludes disabled additions is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25571

Clear-visible preserves hidden and disabled selections · case 01

Clear-visible preserves hidden and disabled selections is violated by the widget projection.

Filter interfaces● Open access↗
FA-25572

Clear-visible preserves hidden and disabled selections · case 02

Clear-visible preserves hidden and disabled selections is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25573

Clear-visible preserves hidden and disabled selections · case 03

Clear-visible preserves hidden and disabled selections is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25574

Clear-visible preserves hidden and disabled selections · case 04

Clear-visible preserves hidden and disabled selections is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25575

Clear-visible preserves hidden and disabled selections · case 05

Clear-visible preserves hidden and disabled selections is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25576

An empty eligible set is not displayed as all selected · case 01

An empty eligible set is not displayed as all selected is violated by the widget projection.

Filter interfaces● Open access↗
FA-25577

An empty eligible set is not displayed as all selected · case 02

An empty eligible set is not displayed as all selected is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25578

An empty eligible set is not displayed as all selected · case 03

An empty eligible set is not displayed as all selected is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25579

An empty eligible set is not displayed as all selected · case 04

An empty eligible set is not displayed as all selected is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25580

An empty eligible set is not displayed as all selected · case 05

An empty eligible set is not displayed as all selected is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25581

Mixed state measures eligible visible membership only · case 01

Mixed state measures eligible visible membership only is violated by the widget projection.

Filter interfaces● Open access↗
FA-25582

Mixed state measures eligible visible membership only · case 02

Mixed state measures eligible visible membership only is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25583

Mixed state measures eligible visible membership only · case 03

Mixed state measures eligible visible membership only is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25584

Mixed state measures eligible visible membership only · case 04

Mixed state measures eligible visible membership only is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25585

Mixed state measures eligible visible membership only · case 05

Mixed state measures eligible visible membership only is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25586

Bulk-change counts report newly added eligible choices · case 01

Bulk-change counts report newly added eligible choices is violated by the widget projection.

Filter interfaces● Open access↗
FA-25587

Bulk-change counts report newly added eligible choices · case 02

Bulk-change counts report newly added eligible choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25588

Bulk-change counts report newly added eligible choices · case 03

Bulk-change counts report newly added eligible choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25589

Bulk-change counts report newly added eligible choices · case 04

Bulk-change counts report newly added eligible choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25590

Bulk-change counts report newly added eligible choices · case 05

Bulk-change counts report newly added eligible choices is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25591

Disabled criteria do not enter active query payloads · case 01

Disabled criteria do not enter active query payloads is violated by the widget projection.

Filter interfaces● Open access↗
FA-25592

Disabled criteria do not enter active query payloads · case 02

Disabled criteria do not enter active query payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25593

Disabled criteria do not enter active query payloads · case 03

Disabled criteria do not enter active query payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25594

Disabled criteria do not enter active query payloads · case 04

Disabled criteria do not enter active query payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25595

Disabled criteria do not enter active query payloads · case 05

Disabled criteria do not enter active query payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25596

Saved filters retain disabled operands and their enabled flag · case 01

Saved filters retain disabled operands and their enabled flag is violated by the widget projection.

Filter interfaces● Open access↗
FA-25597

Saved filters retain disabled operands and their enabled flag · case 02

Saved filters retain disabled operands and their enabled flag is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25598

Saved filters retain disabled operands and their enabled flag · case 03

Saved filters retain disabled operands and their enabled flag is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25599

Saved filters retain disabled operands and their enabled flag · case 04

Saved filters retain disabled operands and their enabled flag is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25600

Saved filters retain disabled operands and their enabled flag · case 05

Saved filters retain disabled operands and their enabled flag is violated by the widget projection.

Filter interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗