FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-3001

Delimited empty fields vanish · case 01

Delimited empty fields vanish.

Text processing● Open access↗
FA-3002

Delimited empty fields vanish · case 02

Delimited empty fields vanish.

Text processing◈ Members↗
FA-3003

Delimited empty fields vanish · case 03

Delimited empty fields vanish.

Text processing◈ Members↗
FA-3004

Delimited empty fields vanish · case 04

Delimited empty fields vanish.

Text processing◈ Members↗
FA-3005

Delimited empty fields vanish · case 05

Delimited empty fields vanish.

Text processing◈ Members↗
FA-3006

A terminal line break invents a blank record · case 01

A terminal line break invents a blank record.

Text processing● Open access↗
FA-3007

A terminal line break invents a blank record · case 02

A terminal line break invents a blank record.

Text processing◈ Members↗
FA-3008

A terminal line break invents a blank record · case 03

A terminal line break invents a blank record.

Text processing◈ Members↗
FA-3009

A terminal line break invents a blank record · case 04

A terminal line break invents a blank record.

Text processing◈ Members↗
FA-3010

A terminal line break invents a blank record · case 05

A terminal line break invents a blank record.

Text processing◈ Members↗
FA-3011

Line terminators lose their original spelling · case 01

Line terminators lose their original spelling.

Text processing● Open access↗
FA-3012

Line terminators lose their original spelling · case 02

Line terminators lose their original spelling.

Text processing◈ Members↗
FA-3013

Line terminators lose their original spelling · case 03

Line terminators lose their original spelling.

Text processing◈ Members↗
FA-3014

Line terminators lose their original spelling · case 04

Line terminators lose their original spelling.

Text processing◈ Members↗
FA-3015

Line terminators lose their original spelling · case 05

Line terminators lose their original spelling.

Text processing◈ Members↗
FA-3016

Tabs expand without considering current column · case 01

Tabs expand without considering current column.

Text processing● Open access↗
FA-3017

Tabs expand without considering current column · case 02

Tabs expand without considering current column.

Text processing◈ Members↗
FA-3018

Tabs expand without considering current column · case 03

Tabs expand without considering current column.

Text processing◈ Members↗
FA-3019

Tabs expand without considering current column · case 04

Tabs expand without considering current column.

Text processing◈ Members↗
FA-3020

Tabs expand without considering current column · case 05

Tabs expand without considering current column.

Text processing◈ Members↗
FA-3021

Substring frequency counts overlapping matches · case 01

Substring frequency counts overlapping matches.

Text processing● Open access↗
FA-3022

Substring frequency counts overlapping matches · case 02

Substring frequency counts overlapping matches.

Text processing◈ Members↗
FA-3023

Substring frequency counts overlapping matches · case 03

Substring frequency counts overlapping matches.

Text processing◈ Members↗
FA-3024

Substring frequency counts overlapping matches · case 04

Substring frequency counts overlapping matches.

Text processing◈ Members↗
FA-3025

Substring frequency counts overlapping matches · case 05

Substring frequency counts overlapping matches.

Text processing◈ Members↗
FA-3026

Empty-pattern replacement misses text boundaries · case 01

Empty-pattern replacement misses text boundaries.

Text processing● Open access↗
FA-3027

Empty-pattern replacement misses text boundaries · case 02

Empty-pattern replacement misses text boundaries.

Text processing◈ Members↗
FA-3028

Empty-pattern replacement misses text boundaries · case 03

Empty-pattern replacement misses text boundaries.

Text processing◈ Members↗
FA-3029

Empty-pattern replacement misses text boundaries · case 04

Empty-pattern replacement misses text boundaries.

Text processing◈ Members↗
FA-3030

Empty-pattern replacement misses text boundaries · case 05

Empty-pattern replacement misses text boundaries.

Text processing◈ Members↗
FA-3031

A bounded replacement modifies every occurrence · case 01

A bounded replacement modifies every occurrence.

Text processing● Open access↗
FA-3032

A bounded replacement modifies every occurrence · case 02

A bounded replacement modifies every occurrence.

Text processing◈ Members↗
FA-3033

A bounded replacement modifies every occurrence · case 03

A bounded replacement modifies every occurrence.

Text processing◈ Members↗
FA-3034

A bounded replacement modifies every occurrence · case 04

A bounded replacement modifies every occurrence.

Text processing◈ Members↗
FA-3035

A bounded replacement modifies every occurrence · case 05

A bounded replacement modifies every occurrence.

Text processing◈ Members↗
FA-3036

Character translation cannot expand or delete · case 01

Character translation cannot expand or delete.

Text processing● Open access↗
FA-3037

Character translation cannot expand or delete · case 02

Character translation cannot expand or delete.

Text processing◈ Members↗
FA-3038

Character translation cannot expand or delete · case 03

Character translation cannot expand or delete.

Text processing◈ Members↗
FA-3039

Character translation cannot expand or delete · case 04

Character translation cannot expand or delete.

Text processing◈ Members↗
FA-3040

Character translation cannot expand or delete · case 05

Character translation cannot expand or delete.

Text processing◈ Members↗
FA-3041

Zero padding precedes the sign · case 01

Zero padding precedes the sign.

Text processing● Open access↗
FA-3042

Zero padding precedes the sign · case 02

Zero padding precedes the sign.

Text processing◈ Members↗
FA-3043

Zero padding precedes the sign · case 03

Zero padding precedes the sign.

Text processing◈ Members↗
FA-3044

Zero padding precedes the sign · case 04

Zero padding precedes the sign.

Text processing◈ Members↗
FA-3045

Zero padding precedes the sign · case 05

Zero padding precedes the sign.

Text processing◈ Members↗
FA-3046

Odd center padding goes to the wrong side · case 01

Odd center padding goes to the wrong side.

Text processing● Open access↗
FA-3047

Odd center padding goes to the wrong side · case 02

Odd center padding goes to the wrong side.

Text processing◈ Members↗
FA-3048

Odd center padding goes to the wrong side · case 03

Odd center padding goes to the wrong side.

Text processing◈ Members↗
FA-3049

Odd center padding goes to the wrong side · case 04

Odd center padding goes to the wrong side.

Text processing◈ Members↗
FA-3050

Odd center padding goes to the wrong side · case 05

Odd center padding goes to the wrong side.

Text processing◈ Members↗
FA-3051

Protocol trimming erases significant Unicode whitespace · case 01

Protocol trimming erases significant Unicode whitespace.

Text processing● Open access↗
FA-3052

Protocol trimming erases significant Unicode whitespace · case 02

Protocol trimming erases significant Unicode whitespace.

Text processing◈ Members↗
FA-3053

Protocol trimming erases significant Unicode whitespace · case 03

Protocol trimming erases significant Unicode whitespace.

Text processing◈ Members↗
FA-3054

Protocol trimming erases significant Unicode whitespace · case 04

Protocol trimming erases significant Unicode whitespace.

Text processing◈ Members↗
FA-3055

Protocol trimming erases significant Unicode whitespace · case 05

Protocol trimming erases significant Unicode whitespace.

Text processing◈ Members↗
FA-3056

Indent removal destroys relative indentation · case 01

Indent removal destroys relative indentation.

Text processing● Open access↗
FA-3057

Indent removal destroys relative indentation · case 02

Indent removal destroys relative indentation.

Text processing◈ Members↗
FA-3058

Indent removal destroys relative indentation · case 03

Indent removal destroys relative indentation.

Text processing◈ Members↗
FA-3059

Indent removal destroys relative indentation · case 04

Indent removal destroys relative indentation.

Text processing◈ Members↗
FA-3060

Indent removal destroys relative indentation · case 05

Indent removal destroys relative indentation.

Text processing◈ Members↗
FA-3061

A blank line receives an unwanted prefix · case 01

A blank line receives an unwanted prefix.

Text processing● Open access↗
FA-3062

A blank line receives an unwanted prefix · case 02

A blank line receives an unwanted prefix.

Text processing◈ Members↗
FA-3063

A blank line receives an unwanted prefix · case 03

A blank line receives an unwanted prefix.

Text processing◈ Members↗
FA-3064

A blank line receives an unwanted prefix · case 04

A blank line receives an unwanted prefix.

Text processing◈ Members↗
FA-3065

A blank line receives an unwanted prefix · case 05

A blank line receives an unwanted prefix.

Text processing◈ Members↗
FA-3066

A shortened label cuts through a word · case 01

A shortened label cuts through a word.

Text processing● Open access↗
FA-3067

A shortened label cuts through a word · case 02

A shortened label cuts through a word.

Text processing◈ Members↗
FA-3068

A shortened label cuts through a word · case 03

A shortened label cuts through a word.

Text processing◈ Members↗
FA-3069

A shortened label cuts through a word · case 04

A shortened label cuts through a word.

Text processing◈ Members↗
FA-3070

A shortened label cuts through a word · case 05

A shortened label cuts through a word.

Text processing◈ Members↗
FA-3071

Non-ASCII diagnostic characters remain literal · case 01

Non-ASCII diagnostic characters remain literal.

Serialization● Open access↗
FA-3072

Non-ASCII diagnostic characters remain literal · case 02

Non-ASCII diagnostic characters remain literal.

Serialization◈ Members↗
FA-3073

Non-ASCII diagnostic characters remain literal · case 03

Non-ASCII diagnostic characters remain literal.

Serialization◈ Members↗
FA-3074

Non-ASCII diagnostic characters remain literal · case 04

Non-ASCII diagnostic characters remain literal.

Serialization◈ Members↗
FA-3075

Non-ASCII diagnostic characters remain literal · case 05

Non-ASCII diagnostic characters remain literal.

Serialization◈ Members↗
FA-3076

A literal search term executes regex syntax · case 01

A literal search term executes regex syntax.

Regular expressions● Open access↗
FA-3077

A literal search term executes regex syntax · case 02

A literal search term executes regex syntax.

Regular expressions◈ Members↗
FA-3078

A literal search term executes regex syntax · case 03

A literal search term executes regex syntax.

Regular expressions◈ Members↗
FA-3079

A literal search term executes regex syntax · case 04

A literal search term executes regex syntax.

Regular expressions◈ Members↗
FA-3080

A literal search term executes regex syntax · case 05

A literal search term executes regex syntax.

Regular expressions◈ Members↗
FA-3081

A token validator accepts a suffix after a match · case 01

A token validator accepts a suffix after a match.

Regular expressions● Open access↗
FA-3082

A token validator accepts a suffix after a match · case 02

A token validator accepts a suffix after a match.

Regular expressions◈ Members↗
FA-3083

A token validator accepts a suffix after a match · case 03

A token validator accepts a suffix after a match.

Regular expressions◈ Members↗
FA-3084

A token validator accepts a suffix after a match · case 04

A token validator accepts a suffix after a match.

Regular expressions◈ Members↗
FA-3085

A token validator accepts a suffix after a match · case 05

A token validator accepts a suffix after a match.

Regular expressions◈ Members↗
FA-3086

A multiline quoted block stops at a newline · case 01

A multiline quoted block stops at a newline.

Regular expressions● Open access↗
FA-3087

A multiline quoted block stops at a newline · case 02

A multiline quoted block stops at a newline.

Regular expressions◈ Members↗
FA-3088

A multiline quoted block stops at a newline · case 03

A multiline quoted block stops at a newline.

Regular expressions◈ Members↗
FA-3089

A multiline quoted block stops at a newline · case 04

A multiline quoted block stops at a newline.

Regular expressions◈ Members↗
FA-3090

A multiline quoted block stops at a newline · case 05

A multiline quoted block stops at a newline.

Regular expressions◈ Members↗
FA-3091

One tag match consumes neighboring tags · case 01

One tag match consumes neighboring tags.

Regular expressions● Open access↗
FA-3092

One tag match consumes neighboring tags · case 02

One tag match consumes neighboring tags.

Regular expressions◈ Members↗
FA-3093

One tag match consumes neighboring tags · case 03

One tag match consumes neighboring tags.

Regular expressions◈ Members↗
FA-3094

One tag match consumes neighboring tags · case 04

One tag match consumes neighboring tags.

Regular expressions◈ Members↗
FA-3095

One tag match consumes neighboring tags · case 05

One tag match consumes neighboring tags.

Regular expressions◈ Members↗
FA-3096

Split delimiters unexpectedly enter the result · case 01

Split delimiters unexpectedly enter the result.

Regular expressions● Open access↗
FA-3097

Split delimiters unexpectedly enter the result · case 02

Split delimiters unexpectedly enter the result.

Regular expressions◈ Members↗
FA-3098

Split delimiters unexpectedly enter the result · case 03

Split delimiters unexpectedly enter the result.

Regular expressions◈ Members↗
FA-3099

Split delimiters unexpectedly enter the result · case 04

Split delimiters unexpectedly enter the result.

Regular expressions◈ Members↗
FA-3100

Split delimiters unexpectedly enter the result · case 05

Split delimiters unexpectedly enter the result.

Regular expressions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗