FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-26001

Zero-result preview warnings require a current valid estimate · case 01

Zero-result preview warnings require a current valid estimate is violated by the widget projection.

Filter interfaces● Open access↗
FA-26002

Zero-result preview warnings require a current valid estimate · case 02

Zero-result preview warnings require a current valid estimate is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26003

Zero-result preview warnings require a current valid estimate · case 03

Zero-result preview warnings require a current valid estimate is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26004

Zero-result preview warnings require a current valid estimate · case 04

Zero-result preview warnings require a current valid estimate is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26005

Zero-result preview warnings require a current valid estimate · case 05

Zero-result preview warnings require a current valid estimate is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26006

Preview spinners disappear for closed or invalid filter drafts · case 01

Preview spinners disappear for closed or invalid filter drafts is violated by the widget projection.

Filter interfaces● Open access↗
FA-26007

Preview spinners disappear for closed or invalid filter drafts · case 02

Preview spinners disappear for closed or invalid filter drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26008

Preview spinners disappear for closed or invalid filter drafts · case 03

Preview spinners disappear for closed or invalid filter drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26009

Preview spinners disappear for closed or invalid filter drafts · case 04

Preview spinners disappear for closed or invalid filter drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26010

Preview spinners disappear for closed or invalid filter drafts · case 05

Preview spinners disappear for closed or invalid filter drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26011

Further typing cannot mutate the in-flight filter snapshot · case 01

Further typing cannot mutate the in-flight filter snapshot is violated by the widget projection.

Filter interfaces● Open access↗
FA-26012

Further typing cannot mutate the in-flight filter snapshot · case 02

Further typing cannot mutate the in-flight filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26013

Further typing cannot mutate the in-flight filter snapshot · case 03

Further typing cannot mutate the in-flight filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26014

Further typing cannot mutate the in-flight filter snapshot · case 04

Further typing cannot mutate the in-flight filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26015

Further typing cannot mutate the in-flight filter snapshot · case 05

Further typing cannot mutate the in-flight filter snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26016

Busy filter application replaces the unsent queued draft · case 01

Busy filter application replaces the unsent queued draft is violated by the widget projection.

Filter interfaces● Open access↗
FA-26017

Busy filter application replaces the unsent queued draft · case 02

Busy filter application replaces the unsent queued draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26018

Busy filter application replaces the unsent queued draft · case 03

Busy filter application replaces the unsent queued draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26019

Busy filter application replaces the unsent queued draft · case 04

Busy filter application replaces the unsent queued draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26020

Busy filter application replaces the unsent queued draft · case 05

Busy filter application replaces the unsent queued draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26021

Only the matching apply acknowledgment settles the in-flight revision · case 01

Only the matching apply acknowledgment settles the in-flight revision is violated by the widget projection.

Filter interfaces● Open access↗
FA-26022

Only the matching apply acknowledgment settles the in-flight revision · case 02

Only the matching apply acknowledgment settles the in-flight revision is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26023

Only the matching apply acknowledgment settles the in-flight revision · case 03

Only the matching apply acknowledgment settles the in-flight revision is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26024

Only the matching apply acknowledgment settles the in-flight revision · case 04

Only the matching apply acknowledgment settles the in-flight revision is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26025

Only the matching apply acknowledgment settles the in-flight revision · case 05

Only the matching apply acknowledgment settles the in-flight revision is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26026

Matching completion promotes the queued snapshot rather than current editor contents · case 01

Matching completion promotes the queued snapshot rather than current editor contents is violated by the widget projection.

Filter interfaces● Open access↗
FA-26027

Matching completion promotes the queued snapshot rather than current editor contents · case 02

Matching completion promotes the queued snapshot rather than current editor contents is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26028

Matching completion promotes the queued snapshot rather than current editor contents · case 03

Matching completion promotes the queued snapshot rather than current editor contents is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26029

Matching completion promotes the queued snapshot rather than current editor contents · case 04

Matching completion promotes the queued snapshot rather than current editor contents is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26030

Matching completion promotes the queued snapshot rather than current editor contents · case 05

Matching completion promotes the queued snapshot rather than current editor contents is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26031

Failed-apply review retains the rejected snapshot · case 01

Failed-apply review retains the rejected snapshot is violated by the widget projection.

Filter interfaces● Open access↗
FA-26032

Failed-apply review retains the rejected snapshot · case 02

Failed-apply review retains the rejected snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26033

Failed-apply review retains the rejected snapshot · case 03

Failed-apply review retains the rejected snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26034

Failed-apply review retains the rejected snapshot · case 04

Failed-apply review retains the rejected snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26035

Failed-apply review retains the rejected snapshot · case 05

Failed-apply review retains the rejected snapshot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26036

Immediate filter sends require an idle queue and valid draft · case 01

Immediate filter sends require an idle queue and valid draft is violated by the widget projection.

Filter interfaces● Open access↗
FA-26037

Immediate filter sends require an idle queue and valid draft · case 02

Immediate filter sends require an idle queue and valid draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26038

Immediate filter sends require an idle queue and valid draft · case 03

Immediate filter sends require an idle queue and valid draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26039

Immediate filter sends require an idle queue and valid draft · case 04

Immediate filter sends require an idle queue and valid draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26040

Immediate filter sends require an idle queue and valid draft · case 05

Immediate filter sends require an idle queue and valid draft is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26041

Validation messages follow criterion identity rather than visible row index · case 01

Validation messages follow criterion identity rather than visible row index is violated by the widget projection.

Filter interfaces● Open access↗
FA-26042

Validation messages follow criterion identity rather than visible row index · case 02

Validation messages follow criterion identity rather than visible row index is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26043

Validation messages follow criterion identity rather than visible row index · case 03

Validation messages follow criterion identity rather than visible row index is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26044

Validation messages follow criterion identity rather than visible row index · case 04

Validation messages follow criterion identity rather than visible row index is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26045

Validation messages follow criterion identity rather than visible row index · case 05

Validation messages follow criterion identity rather than visible row index is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26046

Endpoint validation matches both row identity and operand slot · case 01

Endpoint validation matches both row identity and operand slot is violated by the widget projection.

Filter interfaces● Open access↗
FA-26047

Endpoint validation matches both row identity and operand slot · case 02

Endpoint validation matches both row identity and operand slot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26048

Endpoint validation matches both row identity and operand slot · case 03

Endpoint validation matches both row identity and operand slot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26049

Endpoint validation matches both row identity and operand slot · case 04

Endpoint validation matches both row identity and operand slot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26050

Endpoint validation matches both row identity and operand slot · case 05

Endpoint validation matches both row identity and operand slot is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26051

Removing a criterion discards its orphaned validation messages · case 01

Removing a criterion discards its orphaned validation messages is violated by the widget projection.

Filter interfaces● Open access↗
FA-26052

Removing a criterion discards its orphaned validation messages · case 02

Removing a criterion discards its orphaned validation messages is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26053

Removing a criterion discards its orphaned validation messages · case 03

Removing a criterion discards its orphaned validation messages is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26054

Removing a criterion discards its orphaned validation messages · case 04

Removing a criterion discards its orphaned validation messages is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26055

Removing a criterion discards its orphaned validation messages · case 05

Removing a criterion discards its orphaned validation messages is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26056

Validation from older submitted filter revisions is not attached to edited drafts · case 01

Validation from older submitted filter revisions is not attached to edited drafts is violated by the widget projection.

Filter interfaces● Open access↗
FA-26057

Validation from older submitted filter revisions is not attached to edited drafts · case 02

Validation from older submitted filter revisions is not attached to edited drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26058

Validation from older submitted filter revisions is not attached to edited drafts · case 03

Validation from older submitted filter revisions is not attached to edited drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26059

Validation from older submitted filter revisions is not attached to edited drafts · case 04

Validation from older submitted filter revisions is not attached to edited drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26060

Validation from older submitted filter revisions is not attached to edited drafts · case 05

Validation from older submitted filter revisions is not attached to edited drafts is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26061

First-error navigation follows current criterion display order · case 01

First-error navigation follows current criterion display order is violated by the widget projection.

Filter interfaces● Open access↗
FA-26062

First-error navigation follows current criterion display order · case 02

First-error navigation follows current criterion display order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26063

First-error navigation follows current criterion display order · case 03

First-error navigation follows current criterion display order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26064

First-error navigation follows current criterion display order · case 04

First-error navigation follows current criterion display order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26065

First-error navigation follows current criterion display order · case 05

First-error navigation follows current criterion display order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26066

Invalid criterion totals deduplicate slot errors and ignore removed rows · case 01

Invalid criterion totals deduplicate slot errors and ignore removed rows is violated by the widget projection.

Filter interfaces● Open access↗
FA-26067

Invalid criterion totals deduplicate slot errors and ignore removed rows · case 02

Invalid criterion totals deduplicate slot errors and ignore removed rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26068

Invalid criterion totals deduplicate slot errors and ignore removed rows · case 03

Invalid criterion totals deduplicate slot errors and ignore removed rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26069

Invalid criterion totals deduplicate slot errors and ignore removed rows · case 04

Invalid criterion totals deduplicate slot errors and ignore removed rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26070

Invalid criterion totals deduplicate slot errors and ignore removed rows · case 05

Invalid criterion totals deduplicate slot errors and ignore removed rows is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26071

Required labels do not consume the user-summary display budget · case 01

Required labels do not consume the user-summary display budget is violated by the widget projection.

Filter interfaces● Open access↗
FA-26072

Required labels do not consume the user-summary display budget · case 02

Required labels do not consume the user-summary display budget is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26073

Required labels do not consume the user-summary display budget · case 03

Required labels do not consume the user-summary display budget is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26074

Required labels do not consume the user-summary display budget · case 04

Required labels do not consume the user-summary display budget is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26075

Required labels do not consume the user-summary display budget · case 05

Required labels do not consume the user-summary display budget is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26076

Mandatory filter scope remains visible when user labels collapse · case 01

Mandatory filter scope remains visible when user labels collapse is violated by the widget projection.

Filter interfaces● Open access↗
FA-26077

Mandatory filter scope remains visible when user labels collapse · case 02

Mandatory filter scope remains visible when user labels collapse is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26078

Mandatory filter scope remains visible when user labels collapse · case 03

Mandatory filter scope remains visible when user labels collapse is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26079

Mandatory filter scope remains visible when user labels collapse · case 04

Mandatory filter scope remains visible when user labels collapse is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26080

Mandatory filter scope remains visible when user labels collapse · case 05

Mandatory filter scope remains visible when user labels collapse is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26081

Overflow badges count only omitted user criteria · case 01

Overflow badges count only omitted user criteria is violated by the widget projection.

Filter interfaces● Open access↗
FA-26082

Overflow badges count only omitted user criteria · case 02

Overflow badges count only omitted user criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26083

Overflow badges count only omitted user criteria · case 03

Overflow badges count only omitted user criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26084

Overflow badges count only omitted user criteria · case 04

Overflow badges count only omitted user criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26085

Overflow badges count only omitted user criteria · case 05

Overflow badges count only omitted user criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26086

Expanded summaries reveal all labels while collapsed ones honor the limit · case 01

Expanded summaries reveal all labels while collapsed ones honor the limit is violated by the widget projection.

Filter interfaces● Open access↗
FA-26087

Expanded summaries reveal all labels while collapsed ones honor the limit · case 02

Expanded summaries reveal all labels while collapsed ones honor the limit is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26088

Expanded summaries reveal all labels while collapsed ones honor the limit · case 03

Expanded summaries reveal all labels while collapsed ones honor the limit is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26089

Expanded summaries reveal all labels while collapsed ones honor the limit · case 04

Expanded summaries reveal all labels while collapsed ones honor the limit is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26090

Expanded summaries reveal all labels while collapsed ones honor the limit · case 05

Expanded summaries reveal all labels while collapsed ones honor the limit is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26091

Summary expanders appear only when user criteria actually overflow · case 01

Summary expanders appear only when user criteria actually overflow is violated by the widget projection.

Filter interfaces● Open access↗
FA-26092

Summary expanders appear only when user criteria actually overflow · case 02

Summary expanders appear only when user criteria actually overflow is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26093

Summary expanders appear only when user criteria actually overflow · case 03

Summary expanders appear only when user criteria actually overflow is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26094

Summary expanders appear only when user criteria actually overflow · case 04

Summary expanders appear only when user criteria actually overflow is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26095

Summary expanders appear only when user criteria actually overflow · case 05

Summary expanders appear only when user criteria actually overflow is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26096

Applied summaries include active enforced operands but omit disabled ones · case 01

Applied summaries include active enforced operands but omit disabled ones is violated by the widget projection.

Filter interfaces● Open access↗
FA-26097

Applied summaries include active enforced operands but omit disabled ones · case 02

Applied summaries include active enforced operands but omit disabled ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26098

Applied summaries include active enforced operands but omit disabled ones · case 03

Applied summaries include active enforced operands but omit disabled ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26099

Applied summaries include active enforced operands but omit disabled ones · case 04

Applied summaries include active enforced operands but omit disabled ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26100

Applied summaries include active enforced operands but omit disabled ones · case 05

Applied summaries include active enforced operands but omit disabled ones is violated by the widget projection.

Filter interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗