Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
A final terminator becomes an extra numbered line · case 01
A final terminator becomes an extra numbered line.
A final terminator becomes an extra numbered line · case 02
A final terminator becomes an extra numbered line.
A final terminator becomes an extra numbered line · case 03
A final terminator becomes an extra numbered line.
A final terminator becomes an extra numbered line · case 04
A final terminator becomes an extra numbered line.
A final terminator becomes an extra numbered line · case 05
A final terminator becomes an extra numbered line.
An inline comment marker truncates quoted data · case 01
An inline comment marker truncates quoted data.
An inline comment marker truncates quoted data · case 02
An inline comment marker truncates quoted data.
An inline comment marker truncates quoted data · case 03
An inline comment marker truncates quoted data.
An inline comment marker truncates quoted data · case 04
An inline comment marker truncates quoted data.
An inline comment marker truncates quoted data · case 05
An inline comment marker truncates quoted data.
A nested comment ends at its first inner terminator · case 01
A nested comment ends at its first inner terminator.
A nested comment ends at its first inner terminator · case 02
A nested comment ends at its first inner terminator.
A nested comment ends at its first inner terminator · case 03
A nested comment ends at its first inner terminator.
A nested comment ends at its first inner terminator · case 04
A nested comment ends at its first inner terminator.
A nested comment ends at its first inner terminator · case 05
A nested comment ends at its first inner terminator.
Unknown template fields are deleted · case 01
Unknown template fields are deleted.
Unknown template fields are deleted · case 02
Unknown template fields are deleted.
Unknown template fields are deleted · case 03
Unknown template fields are deleted.
Unknown template fields are deleted · case 04
Unknown template fields are deleted.
Unknown template fields are deleted · case 05
Unknown template fields are deleted.
Escaped template braces are treated as placeholders · case 01
Escaped template braces are treated as placeholders.
Escaped template braces are treated as placeholders · case 02
Escaped template braces are treated as placeholders.
Escaped template braces are treated as placeholders · case 03
Escaped template braces are treated as placeholders.
Escaped template braces are treated as placeholders · case 04
Escaped template braces are treated as placeholders.
Escaped template braces are treated as placeholders · case 05
Escaped template braces are treated as placeholders.
A repr conversion is replaced by ordinary string conversion · case 01
A repr conversion is replaced by ordinary string conversion.
A repr conversion is replaced by ordinary string conversion · case 02
A repr conversion is replaced by ordinary string conversion.
A repr conversion is replaced by ordinary string conversion · case 03
A repr conversion is replaced by ordinary string conversion.
A repr conversion is replaced by ordinary string conversion · case 04
A repr conversion is replaced by ordinary string conversion.
A repr conversion is replaced by ordinary string conversion · case 05
A repr conversion is replaced by ordinary string conversion.
String precision pads rather than truncates · case 01
String precision pads rather than truncates.
String precision pads rather than truncates · case 02
String precision pads rather than truncates.
String precision pads rather than truncates · case 03
String precision pads rather than truncates.
String precision pads rather than truncates · case 04
String precision pads rather than truncates.
String precision pads rather than truncates · case 05
String precision pads rather than truncates.
A positional template confuses zero-based argument indexes · case 01
A positional template confuses zero-based argument indexes.
A positional template confuses zero-based argument indexes · case 02
A positional template confuses zero-based argument indexes.
A positional template confuses zero-based argument indexes · case 03
A positional template confuses zero-based argument indexes.
A positional template confuses zero-based argument indexes · case 04
A positional template confuses zero-based argument indexes.
A positional template confuses zero-based argument indexes · case 05
A positional template confuses zero-based argument indexes.
Escaping quotes causes generated backslashes to be escaped twice · case 01
Escaping quotes causes generated backslashes to be escaped twice.
Escaping quotes causes generated backslashes to be escaped twice · case 02
Escaping quotes causes generated backslashes to be escaped twice.
Escaping quotes causes generated backslashes to be escaped twice · case 03
Escaping quotes causes generated backslashes to be escaped twice.
Escaping quotes causes generated backslashes to be escaped twice · case 04
Escaping quotes causes generated backslashes to be escaped twice.
Escaping quotes causes generated backslashes to be escaped twice · case 05
Escaping quotes causes generated backslashes to be escaped twice.
Unknown backslash escapes are silently discarded · case 01
Unknown backslash escapes are silently discarded.
Unknown backslash escapes are silently discarded · case 02
Unknown backslash escapes are silently discarded.
Unknown backslash escapes are silently discarded · case 03
Unknown backslash escapes are silently discarded.
Unknown backslash escapes are silently discarded · case 04
Unknown backslash escapes are silently discarded.
Unknown backslash escapes are silently discarded · case 05
Unknown backslash escapes are silently discarded.
Removing outer brackets strips unrelated nested delimiters · case 01
Removing outer brackets strips unrelated nested delimiters.
Removing outer brackets strips unrelated nested delimiters · case 02
Removing outer brackets strips unrelated nested delimiters.
Removing outer brackets strips unrelated nested delimiters · case 03
Removing outer brackets strips unrelated nested delimiters.
Removing outer brackets strips unrelated nested delimiters · case 04
Removing outer brackets strips unrelated nested delimiters.
Removing outer brackets strips unrelated nested delimiters · case 05
Removing outer brackets strips unrelated nested delimiters.
An equals sign in quoted text becomes the assignment operator · case 01
An equals sign in quoted text becomes the assignment operator.
An equals sign in quoted text becomes the assignment operator · case 02
An equals sign in quoted text becomes the assignment operator.
An equals sign in quoted text becomes the assignment operator · case 03
An equals sign in quoted text becomes the assignment operator.
An equals sign in quoted text becomes the assignment operator · case 04
An equals sign in quoted text becomes the assignment operator.
An equals sign in quoted text becomes the assignment operator · case 05
An equals sign in quoted text becomes the assignment operator.
Line deduplication sorts instead of preserving encounter order · case 01
Line deduplication sorts instead of preserving encounter order.
Line deduplication sorts instead of preserving encounter order · case 02
Line deduplication sorts instead of preserving encounter order.
Line deduplication sorts instead of preserving encounter order · case 03
Line deduplication sorts instead of preserving encounter order.
Line deduplication sorts instead of preserving encounter order · case 04
Line deduplication sorts instead of preserving encounter order.
Line deduplication sorts instead of preserving encounter order · case 05
Line deduplication sorts instead of preserving encounter order.
Whitespace collapsing changes significant line boundaries · case 01
Whitespace collapsing changes significant line boundaries.
Whitespace collapsing changes significant line boundaries · case 02
Whitespace collapsing changes significant line boundaries.
Whitespace collapsing changes significant line boundaries · case 03
Whitespace collapsing changes significant line boundaries.
Whitespace collapsing changes significant line boundaries · case 04
Whitespace collapsing changes significant line boundaries.
Whitespace collapsing changes significant line boundaries · case 05
Whitespace collapsing changes significant line boundaries.
Removing a record terminator erases empty trailing records · case 01
Removing a record terminator erases empty trailing records.
Removing a record terminator erases empty trailing records · case 02
Removing a record terminator erases empty trailing records.
Removing a record terminator erases empty trailing records · case 03
Removing a record terminator erases empty trailing records.
Removing a record terminator erases empty trailing records · case 04
Removing a record terminator erases empty trailing records.
Removing a record terminator erases empty trailing records · case 05
Removing a record terminator erases empty trailing records.
A prefix tokenizer chooses the first rather than longest keyword · case 01
A prefix tokenizer chooses the first rather than longest keyword.
A prefix tokenizer chooses the first rather than longest keyword · case 02
A prefix tokenizer chooses the first rather than longest keyword.
A prefix tokenizer chooses the first rather than longest keyword · case 03
A prefix tokenizer chooses the first rather than longest keyword.
A prefix tokenizer chooses the first rather than longest keyword · case 04
A prefix tokenizer chooses the first rather than longest keyword.
A prefix tokenizer chooses the first rather than longest keyword · case 05
A prefix tokenizer chooses the first rather than longest keyword.
A suffix classifier chooses a shorter compound extension · case 01
A suffix classifier chooses a shorter compound extension.
A suffix classifier chooses a shorter compound extension · case 02
A suffix classifier chooses a shorter compound extension.
A suffix classifier chooses a shorter compound extension · case 03
A suffix classifier chooses a shorter compound extension.
A suffix classifier chooses a shorter compound extension · case 04
A suffix classifier chooses a shorter compound extension.
A suffix classifier chooses a shorter compound extension · case 05
A suffix classifier chooses a shorter compound extension.
Tokenization drops punctuation needed by the parser · case 01
Tokenization drops punctuation needed by the parser.
Tokenization drops punctuation needed by the parser · case 02
Tokenization drops punctuation needed by the parser.
Tokenization drops punctuation needed by the parser · case 03
Tokenization drops punctuation needed by the parser.
Tokenization drops punctuation needed by the parser · case 04
Tokenization drops punctuation needed by the parser.
Tokenization drops punctuation needed by the parser · case 05
Tokenization drops punctuation needed by the parser.
A folded text header is treated as a separate field · case 01
A folded text header is treated as a separate field.
A folded text header is treated as a separate field · case 02
A folded text header is treated as a separate field.
A folded text header is treated as a separate field · case 03
A folded text header is treated as a separate field.
A folded text header is treated as a separate field · case 04
A folded text header is treated as a separate field.
A folded text header is treated as a separate field · case 05
A folded text header is treated as a separate field.
Quoted empty list entries are discarded · case 01
Quoted empty list entries are discarded.
Quoted empty list entries are discarded · case 02
Quoted empty list entries are discarded.
Quoted empty list entries are discarded · case 03
Quoted empty list entries are discarded.
Quoted empty list entries are discarded · case 04
Quoted empty list entries are discarded.
Quoted empty list entries are discarded · case 05
Quoted empty list entries are discarded.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗