FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-24901

A blank lower bound is open while zero remains closed · case 01

A blank lower bound is open while zero remains closed is violated by the widget projection.

Filter interfaces● Open access↗
FA-24902

A blank lower bound is open while zero remains closed · case 02

A blank lower bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24903

A blank lower bound is open while zero remains closed · case 03

A blank lower bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24904

A blank lower bound is open while zero remains closed · case 04

A blank lower bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24905

A blank lower bound is open while zero remains closed · case 05

A blank lower bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24906

A blank upper bound is open while zero remains closed · case 01

A blank upper bound is open while zero remains closed is violated by the widget projection.

Filter interfaces● Open access↗
FA-24907

A blank upper bound is open while zero remains closed · case 02

A blank upper bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24908

A blank upper bound is open while zero remains closed · case 03

A blank upper bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24909

A blank upper bound is open while zero remains closed · case 04

A blank upper bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24910

A blank upper bound is open while zero remains closed · case 05

A blank upper bound is open while zero remains closed is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24911

Range validation compares numeric endpoints and accepts point ranges · case 01

Range validation compares numeric endpoints and accepts point ranges is violated by the widget projection.

Filter interfaces● Open access↗
FA-24912

Range validation compares numeric endpoints and accepts point ranges · case 02

Range validation compares numeric endpoints and accepts point ranges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24913

Range validation compares numeric endpoints and accepts point ranges · case 03

Range validation compares numeric endpoints and accepts point ranges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24914

Range validation compares numeric endpoints and accepts point ranges · case 04

Range validation compares numeric endpoints and accepts point ranges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24915

Range validation compares numeric endpoints and accepts point ranges · case 05

Range validation compares numeric endpoints and accepts point ranges is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24916

Only two blank endpoints remove the range constraint · case 01

Only two blank endpoints remove the range constraint is violated by the widget projection.

Filter interfaces● Open access↗
FA-24917

Only two blank endpoints remove the range constraint · case 02

Only two blank endpoints remove the range constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24918

Only two blank endpoints remove the range constraint · case 03

Only two blank endpoints remove the range constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24919

Only two blank endpoints remove the range constraint · case 04

Only two blank endpoints remove the range constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24920

Only two blank endpoints remove the range constraint · case 05

Only two blank endpoints remove the range constraint is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24921

An open lower endpoint renders the domain minimum handle · case 01

An open lower endpoint renders the domain minimum handle is violated by the widget projection.

Filter interfaces● Open access↗
FA-24922

An open lower endpoint renders the domain minimum handle · case 02

An open lower endpoint renders the domain minimum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24923

An open lower endpoint renders the domain minimum handle · case 03

An open lower endpoint renders the domain minimum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24924

An open lower endpoint renders the domain minimum handle · case 04

An open lower endpoint renders the domain minimum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24925

An open lower endpoint renders the domain minimum handle · case 05

An open lower endpoint renders the domain minimum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24926

An open upper endpoint renders the domain maximum handle · case 01

An open upper endpoint renders the domain maximum handle is violated by the widget projection.

Filter interfaces● Open access↗
FA-24927

An open upper endpoint renders the domain maximum handle · case 02

An open upper endpoint renders the domain maximum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24928

An open upper endpoint renders the domain maximum handle · case 03

An open upper endpoint renders the domain maximum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24929

An open upper endpoint renders the domain maximum handle · case 04

An open upper endpoint renders the domain maximum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24930

An open upper endpoint renders the domain maximum handle · case 05

An open upper endpoint renders the domain maximum handle is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24931

Presence operators omit stale operand values · case 01

Presence operators omit stale operand values is violated by the widget projection.

Filter interfaces● Open access↗
FA-24932

Presence operators omit stale operand values · case 02

Presence operators omit stale operand values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24933

Presence operators omit stale operand values · case 03

Presence operators omit stale operand values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24934

Presence operators omit stale operand values · case 04

Presence operators omit stale operand values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24935

Presence operators omit stale operand values · case 05

Presence operators omit stale operand values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24936

Membership wraps scalars without nesting existing lists · case 01

Membership wraps scalars without nesting existing lists is violated by the widget projection.

Filter interfaces● Open access↗
FA-24937

Membership wraps scalars without nesting existing lists · case 02

Membership wraps scalars without nesting existing lists is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24938

Membership wraps scalars without nesting existing lists · case 03

Membership wraps scalars without nesting existing lists is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24939

Membership wraps scalars without nesting existing lists · case 04

Membership wraps scalars without nesting existing lists is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24940

Membership wraps scalars without nesting existing lists · case 05

Membership wraps scalars without nesting existing lists is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24941

Equality conversion retains the first set operand · case 01

Equality conversion retains the first set operand is violated by the widget projection.

Filter interfaces● Open access↗
FA-24942

Equality conversion retains the first set operand · case 02

Equality conversion retains the first set operand is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24943

Equality conversion retains the first set operand · case 03

Equality conversion retains the first set operand is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24944

Equality conversion retains the first set operand · case 04

Equality conversion retains the first set operand is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24945

Equality conversion retains the first set operand · case 05

Equality conversion retains the first set operand is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24946

Both unary operators hide the value editor · case 01

Both unary operators hide the value editor is violated by the widget projection.

Filter interfaces● Open access↗
FA-24947

Both unary operators hide the value editor · case 02

Both unary operators hide the value editor is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24948

Both unary operators hide the value editor · case 03

Both unary operators hide the value editor is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24949

Both unary operators hide the value editor · case 04

Both unary operators hide the value editor is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24950

Both unary operators hide the value editor · case 05

Both unary operators hide the value editor is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24951

Only an empty membership list triggers the empty-set validation · case 01

Only an empty membership list triggers the empty-set validation is violated by the widget projection.

Filter interfaces● Open access↗
FA-24952

Only an empty membership list triggers the empty-set validation · case 02

Only an empty membership list triggers the empty-set validation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24953

Only an empty membership list triggers the empty-set validation · case 03

Only an empty membership list triggers the empty-set validation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24954

Only an empty membership list triggers the empty-set validation · case 04

Only an empty membership list triggers the empty-set validation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24955

Only an empty membership list triggers the empty-set validation · case 05

Only an empty membership list triggers the empty-set validation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24956

Null equality is distinct from empty text and zero-valued operands · case 01

Null equality is distinct from empty text and zero-valued operands is violated by the widget projection.

Filter interfaces● Open access↗
FA-24957

Null equality is distinct from empty text and zero-valued operands · case 02

Null equality is distinct from empty text and zero-valued operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24958

Null equality is distinct from empty text and zero-valued operands · case 03

Null equality is distinct from empty text and zero-valued operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24959

Null equality is distinct from empty text and zero-valued operands · case 04

Null equality is distinct from empty text and zero-valued operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24960

Null equality is distinct from empty text and zero-valued operands · case 05

Null equality is distinct from empty text and zero-valued operands is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24961

Facet search uses case-insensitive substring matching · case 01

Facet search uses case-insensitive substring matching is violated by the widget projection.

Filter interfaces● Open access↗
FA-24962

Facet search uses case-insensitive substring matching · case 02

Facet search uses case-insensitive substring matching is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24963

Facet search uses case-insensitive substring matching · case 03

Facet search uses case-insensitive substring matching is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24964

Facet search uses case-insensitive substring matching · case 04

Facet search uses case-insensitive substring matching is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24965

Facet search uses case-insensitive substring matching · case 05

Facet search uses case-insensitive substring matching is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24966

Searching options never rewrites selected criteria · case 01

Searching options never rewrites selected criteria is violated by the widget projection.

Filter interfaces● Open access↗
FA-24967

Searching options never rewrites selected criteria · case 02

Searching options never rewrites selected criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24968

Searching options never rewrites selected criteria · case 03

Searching options never rewrites selected criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24969

Searching options never rewrites selected criteria · case 04

Searching options never rewrites selected criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24970

Searching options never rewrites selected criteria · case 05

Searching options never rewrites selected criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24971

Clearing a facet search restores all offered values · case 01

Clearing a facet search restores all offered values is violated by the widget projection.

Filter interfaces● Open access↗
FA-24972

Clearing a facet search restores all offered values · case 02

Clearing a facet search restores all offered values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24973

Clearing a facet search restores all offered values · case 03

Clearing a facet search restores all offered values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24974

Clearing a facet search restores all offered values · case 04

Clearing a facet search restores all offered values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24975

Clearing a facet search restores all offered values · case 05

Clearing a facet search restores all offered values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24976

Hidden-selection badges count selected values outside the search · case 01

Hidden-selection badges count selected values outside the search is violated by the widget projection.

Filter interfaces● Open access↗
FA-24977

Hidden-selection badges count selected values outside the search · case 02

Hidden-selection badges count selected values outside the search is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24978

Hidden-selection badges count selected values outside the search · case 03

Hidden-selection badges count selected values outside the search is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24979

Hidden-selection badges count selected values outside the search · case 04

Hidden-selection badges count selected values outside the search is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24980

Hidden-selection badges count selected values outside the search · case 05

Hidden-selection badges count selected values outside the search is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24981

No-options messaging depends on searchable options rather than selected values · case 01

No-options messaging depends on searchable options rather than selected values is violated by the widget projection.

Filter interfaces● Open access↗
FA-24982

No-options messaging depends on searchable options rather than selected values · case 02

No-options messaging depends on searchable options rather than selected values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24983

No-options messaging depends on searchable options rather than selected values · case 03

No-options messaging depends on searchable options rather than selected values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24984

No-options messaging depends on searchable options rather than selected values · case 04

No-options messaging depends on searchable options rather than selected values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24985

No-options messaging depends on searchable options rather than selected values · case 05

No-options messaging depends on searchable options rather than selected values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24986

Select-visible search targets exclude disabled options · case 01

Select-visible search targets exclude disabled options is violated by the widget projection.

Filter interfaces● Open access↗
FA-24987

Select-visible search targets exclude disabled options · case 02

Select-visible search targets exclude disabled options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24988

Select-visible search targets exclude disabled options · case 03

Select-visible search targets exclude disabled options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24989

Select-visible search targets exclude disabled options · case 04

Select-visible search targets exclude disabled options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24990

Select-visible search targets exclude disabled options · case 05

Select-visible search targets exclude disabled options is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24991

The summary describes the configured conjunction · case 01

The summary describes the configured conjunction is violated by the widget projection.

Filter interfaces● Open access↗
FA-24992

The summary describes the configured conjunction · case 02

The summary describes the configured conjunction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24993

The summary describes the configured conjunction · case 03

The summary describes the configured conjunction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24994

The summary describes the configured conjunction · case 04

The summary describes the configured conjunction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24995

The summary describes the configured conjunction · case 05

The summary describes the configured conjunction is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24996

A negated group advertises its polarity · case 01

A negated group advertises its polarity is violated by the widget projection.

Filter interfaces● Open access↗
FA-24997

A negated group advertises its polarity · case 02

A negated group advertises its polarity is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24998

A negated group advertises its polarity · case 03

A negated group advertises its polarity is violated by the widget projection.

Filter interfaces◈ Members↗
FA-24999

A negated group advertises its polarity · case 04

A negated group advertises its polarity is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25000

A negated group advertises its polarity · case 05

A negated group advertises its polarity is violated by the widget projection.

Filter interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗