FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-3201

Overflow CSV columns overwrite the final header · case 01

Overflow CSV columns overwrite the final header.

Delimited text● Open access↗
FA-3202

Overflow CSV columns overwrite the final header · case 02

Overflow CSV columns overwrite the final header.

Delimited text◈ Members↗
FA-3203

Overflow CSV columns overwrite the final header · case 03

Overflow CSV columns overwrite the final header.

Delimited text◈ Members↗
FA-3204

Overflow CSV columns overwrite the final header · case 04

Overflow CSV columns overwrite the final header.

Delimited text◈ Members↗
FA-3205

Overflow CSV columns overwrite the final header · case 05

Overflow CSV columns overwrite the final header.

Delimited text◈ Members↗
FA-3206

An unclosed quoted CSV field is accepted · case 01

An unclosed quoted CSV field is accepted.

Delimited text● Open access↗
FA-3207

An unclosed quoted CSV field is accepted · case 02

An unclosed quoted CSV field is accepted.

Delimited text◈ Members↗
FA-3208

An unclosed quoted CSV field is accepted · case 03

An unclosed quoted CSV field is accepted.

Delimited text◈ Members↗
FA-3209

An unclosed quoted CSV field is accepted · case 04

An unclosed quoted CSV field is accepted.

Delimited text◈ Members↗
FA-3210

An unclosed quoted CSV field is accepted · case 05

An unclosed quoted CSV field is accepted.

Delimited text◈ Members↗
FA-3211

Attribute escaping leaves quote delimiters active · case 01

Attribute escaping leaves quote delimiters active.

Markup● Open access↗
FA-3212

Attribute escaping leaves quote delimiters active · case 02

Attribute escaping leaves quote delimiters active.

Markup◈ Members↗
FA-3213

Attribute escaping leaves quote delimiters active · case 03

Attribute escaping leaves quote delimiters active.

Markup◈ Members↗
FA-3214

Attribute escaping leaves quote delimiters active · case 04

Attribute escaping leaves quote delimiters active.

Markup◈ Members↗
FA-3215

Attribute escaping leaves quote delimiters active · case 05

Attribute escaping leaves quote delimiters active.

Markup◈ Members↗
FA-3216

Text-node escaping rewrites ordinary quotes · case 01

Text-node escaping rewrites ordinary quotes.

Markup● Open access↗
FA-3217

Text-node escaping rewrites ordinary quotes · case 02

Text-node escaping rewrites ordinary quotes.

Markup◈ Members↗
FA-3218

Text-node escaping rewrites ordinary quotes · case 03

Text-node escaping rewrites ordinary quotes.

Markup◈ Members↗
FA-3219

Text-node escaping rewrites ordinary quotes · case 04

Text-node escaping rewrites ordinary quotes.

Markup◈ Members↗
FA-3220

Text-node escaping rewrites ordinary quotes · case 05

Text-node escaping rewrites ordinary quotes.

Markup◈ Members↗
FA-3221

Entity decoding recursively changes literal entity text · case 01

Entity decoding recursively changes literal entity text.

Markup● Open access↗
FA-3222

Entity decoding recursively changes literal entity text · case 02

Entity decoding recursively changes literal entity text.

Markup◈ Members↗
FA-3223

Entity decoding recursively changes literal entity text · case 03

Entity decoding recursively changes literal entity text.

Markup◈ Members↗
FA-3224

Entity decoding recursively changes literal entity text · case 04

Entity decoding recursively changes literal entity text.

Markup◈ Members↗
FA-3225

Entity decoding recursively changes literal entity text · case 05

Entity decoding recursively changes literal entity text.

Markup◈ Members↗
FA-3226

Legacy HTML numeric references decode as raw controls · case 01

Legacy HTML numeric references decode as raw controls.

Markup● Open access↗
FA-3227

Legacy HTML numeric references decode as raw controls · case 02

Legacy HTML numeric references decode as raw controls.

Markup◈ Members↗
FA-3228

Legacy HTML numeric references decode as raw controls · case 03

Legacy HTML numeric references decode as raw controls.

Markup◈ Members↗
FA-3229

Legacy HTML numeric references decode as raw controls · case 04

Legacy HTML numeric references decode as raw controls.

Markup◈ Members↗
FA-3230

Legacy HTML numeric references decode as raw controls · case 05

Legacy HTML numeric references decode as raw controls.

Markup◈ Members↗
FA-3231

Text extraction drops child tails · case 01

Text extraction drops child tails.

Markup● Open access↗
FA-3232

Text extraction drops child tails · case 02

Text extraction drops child tails.

Markup◈ Members↗
FA-3233

Text extraction drops child tails · case 03

Text extraction drops child tails.

Markup◈ Members↗
FA-3234

Text extraction drops child tails · case 04

Text extraction drops child tails.

Markup◈ Members↗
FA-3235

Text extraction drops child tails · case 05

Text extraction drops child tails.

Markup◈ Members↗
FA-3236

Namespace prefixes are treated as part of element identity · case 01

Namespace prefixes are treated as part of element identity.

Markup● Open access↗
FA-3237

Namespace prefixes are treated as part of element identity · case 02

Namespace prefixes are treated as part of element identity.

Markup◈ Members↗
FA-3238

Namespace prefixes are treated as part of element identity · case 03

Namespace prefixes are treated as part of element identity.

Markup◈ Members↗
FA-3239

Namespace prefixes are treated as part of element identity · case 04

Namespace prefixes are treated as part of element identity.

Markup◈ Members↗
FA-3240

Namespace prefixes are treated as part of element identity · case 05

Namespace prefixes are treated as part of element identity.

Markup◈ Members↗
FA-3241

An empty XML element is treated as absent · case 01

An empty XML element is treated as absent.

Markup● Open access↗
FA-3242

An empty XML element is treated as absent · case 02

An empty XML element is treated as absent.

Markup◈ Members↗
FA-3243

An empty XML element is treated as absent · case 03

An empty XML element is treated as absent.

Markup◈ Members↗
FA-3244

An empty XML element is treated as absent · case 04

An empty XML element is treated as absent.

Markup◈ Members↗
FA-3245

An empty XML element is treated as absent · case 05

An empty XML element is treated as absent.

Markup◈ Members↗
FA-3246

A direct-child query misses nested elements · case 01

A direct-child query misses nested elements.

Markup● Open access↗
FA-3247

A direct-child query misses nested elements · case 02

A direct-child query misses nested elements.

Markup◈ Members↗
FA-3248

A direct-child query misses nested elements · case 03

A direct-child query misses nested elements.

Markup◈ Members↗
FA-3249

A direct-child query misses nested elements · case 04

A direct-child query misses nested elements.

Markup◈ Members↗
FA-3250

A direct-child query misses nested elements · case 05

A direct-child query misses nested elements.

Markup◈ Members↗
FA-3251

An empty XML attribute collapses into a missing attribute · case 01

An empty XML attribute collapses into a missing attribute.

Markup● Open access↗
FA-3252

An empty XML attribute collapses into a missing attribute · case 02

An empty XML attribute collapses into a missing attribute.

Markup◈ Members↗
FA-3253

An empty XML attribute collapses into a missing attribute · case 03

An empty XML attribute collapses into a missing attribute.

Markup◈ Members↗
FA-3254

An empty XML attribute collapses into a missing attribute · case 04

An empty XML attribute collapses into a missing attribute.

Markup◈ Members↗
FA-3255

An empty XML attribute collapses into a missing attribute · case 05

An empty XML attribute collapses into a missing attribute.

Markup◈ Members↗
FA-3256

Comment content leaks into extracted XML text · case 01

Comment content leaks into extracted XML text.

Markup● Open access↗
FA-3257

Comment content leaks into extracted XML text · case 02

Comment content leaks into extracted XML text.

Markup◈ Members↗
FA-3258

Comment content leaks into extracted XML text · case 03

Comment content leaks into extracted XML text.

Markup◈ Members↗
FA-3259

Comment content leaks into extracted XML text · case 04

Comment content leaks into extracted XML text.

Markup◈ Members↗
FA-3260

Comment content leaks into extracted XML text · case 05

Comment content leaks into extracted XML text.

Markup◈ Members↗
FA-3261

Whitespace splitting ignores shell quote boundaries · case 01

Whitespace splitting ignores shell quote boundaries.

Tokenization● Open access↗
FA-3262

Whitespace splitting ignores shell quote boundaries · case 02

Whitespace splitting ignores shell quote boundaries.

Tokenization◈ Members↗
FA-3263

Whitespace splitting ignores shell quote boundaries · case 03

Whitespace splitting ignores shell quote boundaries.

Tokenization◈ Members↗
FA-3264

Whitespace splitting ignores shell quote boundaries · case 04

Whitespace splitting ignores shell quote boundaries.

Tokenization◈ Members↗
FA-3265

Whitespace splitting ignores shell quote boundaries · case 05

Whitespace splitting ignores shell quote boundaries.

Tokenization◈ Members↗
FA-3266

A hash inside quotes begins a shell comment · case 01

A hash inside quotes begins a shell comment.

Tokenization● Open access↗
FA-3267

A hash inside quotes begins a shell comment · case 02

A hash inside quotes begins a shell comment.

Tokenization◈ Members↗
FA-3268

A hash inside quotes begins a shell comment · case 03

A hash inside quotes begins a shell comment.

Tokenization◈ Members↗
FA-3269

A hash inside quotes begins a shell comment · case 04

A hash inside quotes begins a shell comment.

Tokenization◈ Members↗
FA-3270

A hash inside quotes begins a shell comment · case 05

A hash inside quotes begins a shell comment.

Tokenization◈ Members↗
FA-3271

An empty shell argument disappears · case 01

An empty shell argument disappears.

Serialization● Open access↗
FA-3272

An empty shell argument disappears · case 02

An empty shell argument disappears.

Serialization◈ Members↗
FA-3273

An empty shell argument disappears · case 03

An empty shell argument disappears.

Serialization◈ Members↗
FA-3274

An empty shell argument disappears · case 04

An empty shell argument disappears.

Serialization◈ Members↗
FA-3275

An empty shell argument disappears · case 05

An empty shell argument disappears.

Serialization◈ Members↗
FA-3276

A form plus sign remains literal · case 01

A form plus sign remains literal.

Encodings● Open access↗
FA-3277

A form plus sign remains literal · case 02

A form plus sign remains literal.

Encodings◈ Members↗
FA-3278

A form plus sign remains literal · case 03

A form plus sign remains literal.

Encodings◈ Members↗
FA-3279

A form plus sign remains literal · case 04

A form plus sign remains literal.

Encodings◈ Members↗
FA-3280

A form plus sign remains literal · case 05

A form plus sign remains literal.

Encodings◈ Members↗
FA-3281

Percent decoding destroys non-UTF8 bytes · case 01

Percent decoding destroys non-UTF8 bytes.

Encodings● Open access↗
FA-3282

Percent decoding destroys non-UTF8 bytes · case 02

Percent decoding destroys non-UTF8 bytes.

Encodings◈ Members↗
FA-3283

Percent decoding destroys non-UTF8 bytes · case 03

Percent decoding destroys non-UTF8 bytes.

Encodings◈ Members↗
FA-3284

Percent decoding destroys non-UTF8 bytes · case 04

Percent decoding destroys non-UTF8 bytes.

Encodings◈ Members↗
FA-3285

Percent decoding destroys non-UTF8 bytes · case 05

Percent decoding destroys non-UTF8 bytes.

Encodings◈ Members↗
FA-3286

A data value retains a structural slash · case 01

A data value retains a structural slash.

Encodings● Open access↗
FA-3287

A data value retains a structural slash · case 02

A data value retains a structural slash.

Encodings◈ Members↗
FA-3288

A data value retains a structural slash · case 03

A data value retains a structural slash.

Encodings◈ Members↗
FA-3289

A data value retains a structural slash · case 04

A data value retains a structural slash.

Encodings◈ Members↗
FA-3290

A data value retains a structural slash · case 05

A data value retains a structural slash.

Encodings◈ Members↗
FA-3291

A list-valued query field becomes a Python representation · case 01

A list-valued query field becomes a Python representation.

Serialization● Open access↗
FA-3292

A list-valued query field becomes a Python representation · case 02

A list-valued query field becomes a Python representation.

Serialization◈ Members↗
FA-3293

A list-valued query field becomes a Python representation · case 03

A list-valued query field becomes a Python representation.

Serialization◈ Members↗
FA-3294

A list-valued query field becomes a Python representation · case 04

A list-valued query field becomes a Python representation.

Serialization◈ Members↗
FA-3295

A list-valued query field becomes a Python representation · case 05

A list-valued query field becomes a Python representation.

Serialization◈ Members↗
FA-3296

A semicolon inside a query value becomes a separator · case 01

A semicolon inside a query value becomes a separator.

Delimited text● Open access↗
FA-3297

A semicolon inside a query value becomes a separator · case 02

A semicolon inside a query value becomes a separator.

Delimited text◈ Members↗
FA-3298

A semicolon inside a query value becomes a separator · case 03

A semicolon inside a query value becomes a separator.

Delimited text◈ Members↗
FA-3299

A semicolon inside a query value becomes a separator · case 04

A semicolon inside a query value becomes a separator.

Delimited text◈ Members↗
FA-3300

A semicolon inside a query value becomes a separator · case 05

A semicolon inside a query value becomes a separator.

Delimited text◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗