FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-3401

Percentage text admits values beyond its grammar · case 01

Percentage text admits values beyond its grammar.

Lexical grammars● Open access↗
FA-3402

Percentage text admits values beyond its grammar · case 02

Percentage text admits values beyond its grammar.

Lexical grammars◈ Members↗
FA-3403

Percentage text admits values beyond its grammar · case 03

Percentage text admits values beyond its grammar.

Lexical grammars◈ Members↗
FA-3404

Percentage text admits values beyond its grammar · case 04

Percentage text admits values beyond its grammar.

Lexical grammars◈ Members↗
FA-3405

Percentage text admits values beyond its grammar · case 05

Percentage text admits values beyond its grammar.

Lexical grammars◈ Members↗
FA-3406

A UUID-shaped identifier accepts misplaced separators · case 01

A UUID-shaped identifier accepts misplaced separators.

Lexical grammars● Open access↗
FA-3407

A UUID-shaped identifier accepts misplaced separators · case 02

A UUID-shaped identifier accepts misplaced separators.

Lexical grammars◈ Members↗
FA-3408

A UUID-shaped identifier accepts misplaced separators · case 03

A UUID-shaped identifier accepts misplaced separators.

Lexical grammars◈ Members↗
FA-3409

A UUID-shaped identifier accepts misplaced separators · case 04

A UUID-shaped identifier accepts misplaced separators.

Lexical grammars◈ Members↗
FA-3410

A UUID-shaped identifier accepts misplaced separators · case 05

A UUID-shaped identifier accepts misplaced separators.

Lexical grammars◈ Members↗
FA-3411

A byte address mixes colon and hyphen separators · case 01

A byte address mixes colon and hyphen separators.

Lexical grammars● Open access↗
FA-3412

A byte address mixes colon and hyphen separators · case 02

A byte address mixes colon and hyphen separators.

Lexical grammars◈ Members↗
FA-3413

A byte address mixes colon and hyphen separators · case 03

A byte address mixes colon and hyphen separators.

Lexical grammars◈ Members↗
FA-3414

A byte address mixes colon and hyphen separators · case 04

A byte address mixes colon and hyphen separators.

Lexical grammars◈ Members↗
FA-3415

A byte address mixes colon and hyphen separators · case 05

A byte address mixes colon and hyphen separators.

Lexical grammars◈ Members↗
FA-3416

A slug contains adjacent or terminal separators · case 01

A slug contains adjacent or terminal separators.

Lexical grammars● Open access↗
FA-3417

A slug contains adjacent or terminal separators · case 02

A slug contains adjacent or terminal separators.

Lexical grammars◈ Members↗
FA-3418

A slug contains adjacent or terminal separators · case 03

A slug contains adjacent or terminal separators.

Lexical grammars◈ Members↗
FA-3419

A slug contains adjacent or terminal separators · case 04

A slug contains adjacent or terminal separators.

Lexical grammars◈ Members↗
FA-3420

A slug contains adjacent or terminal separators · case 05

A slug contains adjacent or terminal separators.

Lexical grammars◈ Members↗
FA-3421

A dotted name admits empty identifiers · case 01

A dotted name admits empty identifiers.

Lexical grammars● Open access↗
FA-3422

A dotted name admits empty identifiers · case 02

A dotted name admits empty identifiers.

Lexical grammars◈ Members↗
FA-3423

A dotted name admits empty identifiers · case 03

A dotted name admits empty identifiers.

Lexical grammars◈ Members↗
FA-3424

A dotted name admits empty identifiers · case 04

A dotted name admits empty identifiers.

Lexical grammars◈ Members↗
FA-3425

A dotted name admits empty identifiers · case 05

A dotted name admits empty identifiers.

Lexical grammars◈ Members↗
FA-3426

A reserved word passes lexical identifier validation · case 01

A reserved word passes lexical identifier validation.

Lexical grammars● Open access↗
FA-3427

A reserved word passes lexical identifier validation · case 02

A reserved word passes lexical identifier validation.

Lexical grammars◈ Members↗
FA-3428

A reserved word passes lexical identifier validation · case 03

A reserved word passes lexical identifier validation.

Lexical grammars◈ Members↗
FA-3429

A reserved word passes lexical identifier validation · case 04

A reserved word passes lexical identifier validation.

Lexical grammars◈ Members↗
FA-3430

A reserved word passes lexical identifier validation · case 05

A reserved word passes lexical identifier validation.

Lexical grammars◈ Members↗
FA-3431

An unknown escape is admitted in a quoted token · case 01

An unknown escape is admitted in a quoted token.

Lexical grammars● Open access↗
FA-3432

An unknown escape is admitted in a quoted token · case 02

An unknown escape is admitted in a quoted token.

Lexical grammars◈ Members↗
FA-3433

An unknown escape is admitted in a quoted token · case 03

An unknown escape is admitted in a quoted token.

Lexical grammars◈ Members↗
FA-3434

An unknown escape is admitted in a quoted token · case 04

An unknown escape is admitted in a quoted token.

Lexical grammars◈ Members↗
FA-3435

An unknown escape is admitted in a quoted token · case 05

An unknown escape is admitted in a quoted token.

Lexical grammars◈ Members↗
FA-3436

SQL-style strings treat backslash as a quote escape · case 01

SQL-style strings treat backslash as a quote escape.

Lexical grammars● Open access↗
FA-3437

SQL-style strings treat backslash as a quote escape · case 02

SQL-style strings treat backslash as a quote escape.

Lexical grammars◈ Members↗
FA-3438

SQL-style strings treat backslash as a quote escape · case 03

SQL-style strings treat backslash as a quote escape.

Lexical grammars◈ Members↗
FA-3439

SQL-style strings treat backslash as a quote escape · case 04

SQL-style strings treat backslash as a quote escape.

Lexical grammars◈ Members↗
FA-3440

SQL-style strings treat backslash as a quote escape · case 05

SQL-style strings treat backslash as a quote escape.

Lexical grammars◈ Members↗
FA-3441

A block comment terminates at the last closing marker · case 01

A block comment terminates at the last closing marker.

Lexical grammars● Open access↗
FA-3442

A block comment terminates at the last closing marker · case 02

A block comment terminates at the last closing marker.

Lexical grammars◈ Members↗
FA-3443

A block comment terminates at the last closing marker · case 03

A block comment terminates at the last closing marker.

Lexical grammars◈ Members↗
FA-3444

A block comment terminates at the last closing marker · case 04

A block comment terminates at the last closing marker.

Lexical grammars◈ Members↗
FA-3445

A block comment terminates at the last closing marker · case 05

A block comment terminates at the last closing marker.

Lexical grammars◈ Members↗
FA-3446

A line comment swallows the following record · case 01

A line comment swallows the following record.

Lexical grammars● Open access↗
FA-3447

A line comment swallows the following record · case 02

A line comment swallows the following record.

Lexical grammars◈ Members↗
FA-3448

A line comment swallows the following record · case 03

A line comment swallows the following record.

Lexical grammars◈ Members↗
FA-3449

A line comment swallows the following record · case 04

A line comment swallows the following record.

Lexical grammars◈ Members↗
FA-3450

A line comment swallows the following record · case 05

A line comment swallows the following record.

Lexical grammars◈ Members↗
FA-3451

A code fence closes with a shorter delimiter · case 01

A code fence closes with a shorter delimiter.

Lexical grammars● Open access↗
FA-3452

A code fence closes with a shorter delimiter · case 02

A code fence closes with a shorter delimiter.

Lexical grammars◈ Members↗
FA-3453

A code fence closes with a shorter delimiter · case 03

A code fence closes with a shorter delimiter.

Lexical grammars◈ Members↗
FA-3454

A code fence closes with a shorter delimiter · case 04

A code fence closes with a shorter delimiter.

Lexical grammars◈ Members↗
FA-3455

A code fence closes with a shorter delimiter · case 05

A code fence closes with a shorter delimiter.

Lexical grammars◈ Members↗
FA-3456

A flat Markdown link allows an unmatched destination parenthesis · case 01

A flat Markdown link allows an unmatched destination parenthesis.

Lexical grammars● Open access↗
FA-3457

A flat Markdown link allows an unmatched destination parenthesis · case 02

A flat Markdown link allows an unmatched destination parenthesis.

Lexical grammars◈ Members↗
FA-3458

A flat Markdown link allows an unmatched destination parenthesis · case 03

A flat Markdown link allows an unmatched destination parenthesis.

Lexical grammars◈ Members↗
FA-3459

A flat Markdown link allows an unmatched destination parenthesis · case 04

A flat Markdown link allows an unmatched destination parenthesis.

Lexical grammars◈ Members↗
FA-3460

A flat Markdown link allows an unmatched destination parenthesis · case 05

A flat Markdown link allows an unmatched destination parenthesis.

Lexical grammars◈ Members↗
FA-3461

A hashtag begins with a digit or underscore · case 01

A hashtag begins with a digit or underscore.

Lexical grammars● Open access↗
FA-3462

A hashtag begins with a digit or underscore · case 02

A hashtag begins with a digit or underscore.

Lexical grammars◈ Members↗
FA-3463

A hashtag begins with a digit or underscore · case 03

A hashtag begins with a digit or underscore.

Lexical grammars◈ Members↗
FA-3464

A hashtag begins with a digit or underscore · case 04

A hashtag begins with a digit or underscore.

Lexical grammars◈ Members↗
FA-3465

A hashtag begins with a digit or underscore · case 05

A hashtag begins with a digit or underscore.

Lexical grammars◈ Members↗
FA-3466

An at-mention accepts punctuation inside its name · case 01

An at-mention accepts punctuation inside its name.

Lexical grammars● Open access↗
FA-3467

An at-mention accepts punctuation inside its name · case 02

An at-mention accepts punctuation inside its name.

Lexical grammars◈ Members↗
FA-3468

An at-mention accepts punctuation inside its name · case 03

An at-mention accepts punctuation inside its name.

Lexical grammars◈ Members↗
FA-3469

An at-mention accepts punctuation inside its name · case 04

An at-mention accepts punctuation inside its name.

Lexical grammars◈ Members↗
FA-3470

An at-mention accepts punctuation inside its name · case 05

An at-mention accepts punctuation inside its name.

Lexical grammars◈ Members↗
FA-3471

A language label has an empty or overlong subtag · case 01

A language label has an empty or overlong subtag.

Lexical grammars● Open access↗
FA-3472

A language label has an empty or overlong subtag · case 02

A language label has an empty or overlong subtag.

Lexical grammars◈ Members↗
FA-3473

A language label has an empty or overlong subtag · case 03

A language label has an empty or overlong subtag.

Lexical grammars◈ Members↗
FA-3474

A language label has an empty or overlong subtag · case 04

A language label has an empty or overlong subtag.

Lexical grammars◈ Members↗
FA-3475

A language label has an empty or overlong subtag · case 05

A language label has an empty or overlong subtag.

Lexical grammars◈ Members↗
FA-3476

A media type lacks exactly one separator · case 01

A media type lacks exactly one separator.

Lexical grammars● Open access↗
FA-3477

A media type lacks exactly one separator · case 02

A media type lacks exactly one separator.

Lexical grammars◈ Members↗
FA-3478

A media type lacks exactly one separator · case 03

A media type lacks exactly one separator.

Lexical grammars◈ Members↗
FA-3479

A media type lacks exactly one separator · case 04

A media type lacks exactly one separator.

Lexical grammars◈ Members↗
FA-3480

A media type lacks exactly one separator · case 05

A media type lacks exactly one separator.

Lexical grammars◈ Members↗
FA-3481

A key-value parameter permits an empty key · case 01

A key-value parameter permits an empty key.

Lexical grammars● Open access↗
FA-3482

A key-value parameter permits an empty key · case 02

A key-value parameter permits an empty key.

Lexical grammars◈ Members↗
FA-3483

A key-value parameter permits an empty key · case 03

A key-value parameter permits an empty key.

Lexical grammars◈ Members↗
FA-3484

A key-value parameter permits an empty key · case 04

A key-value parameter permits an empty key.

Lexical grammars◈ Members↗
FA-3485

A key-value parameter permits an empty key · case 05

A key-value parameter permits an empty key.

Lexical grammars◈ Members↗
FA-3486

A boolean token is accepted by truthiness · case 01

A boolean token is accepted by truthiness.

Lexical grammars● Open access↗
FA-3487

A boolean token is accepted by truthiness · case 02

A boolean token is accepted by truthiness.

Lexical grammars◈ Members↗
FA-3488

A boolean token is accepted by truthiness · case 03

A boolean token is accepted by truthiness.

Lexical grammars◈ Members↗
FA-3489

A boolean token is accepted by truthiness · case 04

A boolean token is accepted by truthiness.

Lexical grammars◈ Members↗
FA-3490

A boolean token is accepted by truthiness · case 05

A boolean token is accepted by truthiness.

Lexical grammars◈ Members↗
FA-3491

A null literal accepts aliases from another language · case 01

A null literal accepts aliases from another language.

Lexical grammars● Open access↗
FA-3492

A null literal accepts aliases from another language · case 02

A null literal accepts aliases from another language.

Lexical grammars◈ Members↗
FA-3493

A null literal accepts aliases from another language · case 03

A null literal accepts aliases from another language.

Lexical grammars◈ Members↗
FA-3494

A null literal accepts aliases from another language · case 04

A null literal accepts aliases from another language.

Lexical grammars◈ Members↗
FA-3495

A null literal accepts aliases from another language · case 05

A null literal accepts aliases from another language.

Lexical grammars◈ Members↗
FA-3496

A braced quantifier admits a missing lower bound · case 01

A braced quantifier admits a missing lower bound.

Lexical grammars● Open access↗
FA-3497

A braced quantifier admits a missing lower bound · case 02

A braced quantifier admits a missing lower bound.

Lexical grammars◈ Members↗
FA-3498

A braced quantifier admits a missing lower bound · case 03

A braced quantifier admits a missing lower bound.

Lexical grammars◈ Members↗
FA-3499

A braced quantifier admits a missing lower bound · case 04

A braced quantifier admits a missing lower bound.

Lexical grammars◈ Members↗
FA-3500

A braced quantifier admits a missing lower bound · case 05

A braced quantifier admits a missing lower bound.

Lexical grammars◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗