FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-3501

A character class accepts an empty body · case 01

A character class accepts an empty body.

Lexical grammars● Open access↗
FA-3502

A character class accepts an empty body · case 02

A character class accepts an empty body.

Lexical grammars◈ Members↗
FA-3503

A character class accepts an empty body · case 03

A character class accepts an empty body.

Lexical grammars◈ Members↗
FA-3504

A character class accepts an empty body · case 04

A character class accepts an empty body.

Lexical grammars◈ Members↗
FA-3505

A character class accepts an empty body · case 05

A character class accepts an empty body.

Lexical grammars◈ Members↗
FA-3506

A percent escape consumes an arbitrary pair · case 01

A percent escape consumes an arbitrary pair.

Lexical grammars● Open access↗
FA-3507

A percent escape consumes an arbitrary pair · case 02

A percent escape consumes an arbitrary pair.

Lexical grammars◈ Members↗
FA-3508

A percent escape consumes an arbitrary pair · case 03

A percent escape consumes an arbitrary pair.

Lexical grammars◈ Members↗
FA-3509

A percent escape consumes an arbitrary pair · case 04

A percent escape consumes an arbitrary pair.

Lexical grammars◈ Members↗
FA-3510

A percent escape consumes an arbitrary pair · case 05

A percent escape consumes an arbitrary pair.

Lexical grammars◈ Members↗
FA-3511

A Unicode escape has variable hexadecimal width · case 01

A Unicode escape has variable hexadecimal width.

Lexical grammars● Open access↗
FA-3512

A Unicode escape has variable hexadecimal width · case 02

A Unicode escape has variable hexadecimal width.

Lexical grammars◈ Members↗
FA-3513

A Unicode escape has variable hexadecimal width · case 03

A Unicode escape has variable hexadecimal width.

Lexical grammars◈ Members↗
FA-3514

A Unicode escape has variable hexadecimal width · case 04

A Unicode escape has variable hexadecimal width.

Lexical grammars◈ Members↗
FA-3515

A Unicode escape has variable hexadecimal width · case 05

A Unicode escape has variable hexadecimal width.

Lexical grammars◈ Members↗
FA-3516

A line continuation consumes a bare carriage return · case 01

A line continuation consumes a bare carriage return.

Lexical grammars● Open access↗
FA-3517

A line continuation consumes a bare carriage return · case 02

A line continuation consumes a bare carriage return.

Lexical grammars◈ Members↗
FA-3518

A line continuation consumes a bare carriage return · case 03

A line continuation consumes a bare carriage return.

Lexical grammars◈ Members↗
FA-3519

A line continuation consumes a bare carriage return · case 04

A line continuation consumes a bare carriage return.

Lexical grammars◈ Members↗
FA-3520

A line continuation consumes a bare carriage return · case 05

A line continuation consumes a bare carriage return.

Lexical grammars◈ Members↗
FA-3521

An INI section header accepts an empty section name · case 01

An INI section header accepts an empty section name.

Lexical grammars● Open access↗
FA-3522

An INI section header accepts an empty section name · case 02

An INI section header accepts an empty section name.

Lexical grammars◈ Members↗
FA-3523

An INI section header accepts an empty section name · case 03

An INI section header accepts an empty section name.

Lexical grammars◈ Members↗
FA-3524

An INI section header accepts an empty section name · case 04

An INI section header accepts an empty section name.

Lexical grammars◈ Members↗
FA-3525

An INI section header accepts an empty section name · case 05

An INI section header accepts an empty section name.

Lexical grammars◈ Members↗
FA-3526

An INI assignment incorrectly requires equals instead of colon · case 01

An INI assignment incorrectly requires equals instead of colon.

Lexical grammars● Open access↗
FA-3527

An INI assignment incorrectly requires equals instead of colon · case 02

An INI assignment incorrectly requires equals instead of colon.

Lexical grammars◈ Members↗
FA-3528

An INI assignment incorrectly requires equals instead of colon · case 03

An INI assignment incorrectly requires equals instead of colon.

Lexical grammars◈ Members↗
FA-3529

An INI assignment incorrectly requires equals instead of colon · case 04

An INI assignment incorrectly requires equals instead of colon.

Lexical grammars◈ Members↗
FA-3530

An INI assignment incorrectly requires equals instead of colon · case 05

An INI assignment incorrectly requires equals instead of colon.

Lexical grammars◈ Members↗
FA-3531

A document-start marker matches ordinary content · case 01

A document-start marker matches ordinary content.

Lexical grammars● Open access↗
FA-3532

A document-start marker matches ordinary content · case 02

A document-start marker matches ordinary content.

Lexical grammars◈ Members↗
FA-3533

A document-start marker matches ordinary content · case 03

A document-start marker matches ordinary content.

Lexical grammars◈ Members↗
FA-3534

A document-start marker matches ordinary content · case 04

A document-start marker matches ordinary content.

Lexical grammars◈ Members↗
FA-3535

A document-start marker matches ordinary content · case 05

A document-start marker matches ordinary content.

Lexical grammars◈ Members↗
FA-3536

A bare CSV field includes quote characters · case 01

A bare CSV field includes quote characters.

Lexical grammars● Open access↗
FA-3537

A bare CSV field includes quote characters · case 02

A bare CSV field includes quote characters.

Lexical grammars◈ Members↗
FA-3538

A bare CSV field includes quote characters · case 03

A bare CSV field includes quote characters.

Lexical grammars◈ Members↗
FA-3539

A bare CSV field includes quote characters · case 04

A bare CSV field includes quote characters.

Lexical grammars◈ Members↗
FA-3540

A bare CSV field includes quote characters · case 05

A bare CSV field includes quote characters.

Lexical grammars◈ Members↗
FA-3541

A tabular cell contains a structural tab · case 01

A tabular cell contains a structural tab.

Lexical grammars● Open access↗
FA-3542

A tabular cell contains a structural tab · case 02

A tabular cell contains a structural tab.

Lexical grammars◈ Members↗
FA-3543

A tabular cell contains a structural tab · case 03

A tabular cell contains a structural tab.

Lexical grammars◈ Members↗
FA-3544

A tabular cell contains a structural tab · case 04

A tabular cell contains a structural tab.

Lexical grammars◈ Members↗
FA-3545

A tabular cell contains a structural tab · case 05

A tabular cell contains a structural tab.

Lexical grammars◈ Members↗
FA-3546

An S-expression symbol absorbs structural punctuation · case 01

An S-expression symbol absorbs structural punctuation.

Lexical grammars● Open access↗
FA-3547

An S-expression symbol absorbs structural punctuation · case 02

An S-expression symbol absorbs structural punctuation.

Lexical grammars◈ Members↗
FA-3548

An S-expression symbol absorbs structural punctuation · case 03

An S-expression symbol absorbs structural punctuation.

Lexical grammars◈ Members↗
FA-3549

An S-expression symbol absorbs structural punctuation · case 04

An S-expression symbol absorbs structural punctuation.

Lexical grammars◈ Members↗
FA-3550

An S-expression symbol absorbs structural punctuation · case 05

An S-expression symbol absorbs structural punctuation.

Lexical grammars◈ Members↗
FA-3551

JSON numeric syntax accepts a leading plus · case 01

JSON numeric syntax accepts a leading plus.

Lexical grammars● Open access↗
FA-3552

JSON numeric syntax accepts a leading plus · case 02

JSON numeric syntax accepts a leading plus.

Lexical grammars◈ Members↗
FA-3553

JSON numeric syntax accepts a leading plus · case 03

JSON numeric syntax accepts a leading plus.

Lexical grammars◈ Members↗
FA-3554

JSON numeric syntax accepts a leading plus · case 04

JSON numeric syntax accepts a leading plus.

Lexical grammars◈ Members↗
FA-3555

JSON numeric syntax accepts a leading plus · case 05

JSON numeric syntax accepts a leading plus.

Lexical grammars◈ Members↗
FA-3556

A custom property omits its required double hyphen · case 01

A custom property omits its required double hyphen.

Lexical grammars● Open access↗
FA-3557

A custom property omits its required double hyphen · case 02

A custom property omits its required double hyphen.

Lexical grammars◈ Members↗
FA-3558

A custom property omits its required double hyphen · case 03

A custom property omits its required double hyphen.

Lexical grammars◈ Members↗
FA-3559

A custom property omits its required double hyphen · case 04

A custom property omits its required double hyphen.

Lexical grammars◈ Members↗
FA-3560

A custom property omits its required double hyphen · case 05

A custom property omits its required double hyphen.

Lexical grammars◈ Members↗
FA-3561

A hex color accepts unsupported digit counts · case 01

A hex color accepts unsupported digit counts.

Lexical grammars● Open access↗
FA-3562

A hex color accepts unsupported digit counts · case 02

A hex color accepts unsupported digit counts.

Lexical grammars◈ Members↗
FA-3563

A hex color accepts unsupported digit counts · case 03

A hex color accepts unsupported digit counts.

Lexical grammars◈ Members↗
FA-3564

A hex color accepts unsupported digit counts · case 04

A hex color accepts unsupported digit counts.

Lexical grammars◈ Members↗
FA-3565

A hex color accepts unsupported digit counts · case 05

A hex color accepts unsupported digit counts.

Lexical grammars◈ Members↗
FA-3566

A priority marker rejects allowed internal whitespace · case 01

A priority marker rejects allowed internal whitespace.

Lexical grammars● Open access↗
FA-3567

A priority marker rejects allowed internal whitespace · case 02

A priority marker rejects allowed internal whitespace.

Lexical grammars◈ Members↗
FA-3568

A priority marker rejects allowed internal whitespace · case 03

A priority marker rejects allowed internal whitespace.

Lexical grammars◈ Members↗
FA-3569

A priority marker rejects allowed internal whitespace · case 04

A priority marker rejects allowed internal whitespace.

Lexical grammars◈ Members↗
FA-3570

A priority marker rejects allowed internal whitespace · case 05

A priority marker rejects allowed internal whitespace.

Lexical grammars◈ Members↗
FA-3571

A local XML name accepts a namespace colon · case 01

A local XML name accepts a namespace colon.

Lexical grammars● Open access↗
FA-3572

A local XML name accepts a namespace colon · case 02

A local XML name accepts a namespace colon.

Lexical grammars◈ Members↗
FA-3573

A local XML name accepts a namespace colon · case 03

A local XML name accepts a namespace colon.

Lexical grammars◈ Members↗
FA-3574

A local XML name accepts a namespace colon · case 04

A local XML name accepts a namespace colon.

Lexical grammars◈ Members↗
FA-3575

A local XML name accepts a namespace colon · case 05

A local XML name accepts a namespace colon.

Lexical grammars◈ Members↗
FA-3576

An XML-style comment contains an illegal internal double hyphen · case 01

An XML-style comment contains an illegal internal double hyphen.

Lexical grammars● Open access↗
FA-3577

An XML-style comment contains an illegal internal double hyphen · case 02

An XML-style comment contains an illegal internal double hyphen.

Lexical grammars◈ Members↗
FA-3578

An XML-style comment contains an illegal internal double hyphen · case 03

An XML-style comment contains an illegal internal double hyphen.

Lexical grammars◈ Members↗
FA-3579

An XML-style comment contains an illegal internal double hyphen · case 04

An XML-style comment contains an illegal internal double hyphen.

Lexical grammars◈ Members↗
FA-3580

An XML-style comment contains an illegal internal double hyphen · case 05

An XML-style comment contains an illegal internal double hyphen.

Lexical grammars◈ Members↗
FA-3581

A simplified mailbox has empty dot-separated local segments · case 01

A simplified mailbox has empty dot-separated local segments.

Lexical grammars● Open access↗
FA-3582

A simplified mailbox has empty dot-separated local segments · case 02

A simplified mailbox has empty dot-separated local segments.

Lexical grammars◈ Members↗
FA-3583

A simplified mailbox has empty dot-separated local segments · case 03

A simplified mailbox has empty dot-separated local segments.

Lexical grammars◈ Members↗
FA-3584

A simplified mailbox has empty dot-separated local segments · case 04

A simplified mailbox has empty dot-separated local segments.

Lexical grammars◈ Members↗
FA-3585

A simplified mailbox has empty dot-separated local segments · case 05

A simplified mailbox has empty dot-separated local segments.

Lexical grammars◈ Members↗
FA-3586

A prerelease identifier is empty after a separator · case 01

A prerelease identifier is empty after a separator.

Lexical grammars● Open access↗
FA-3587

A prerelease identifier is empty after a separator · case 02

A prerelease identifier is empty after a separator.

Lexical grammars◈ Members↗
FA-3588

A prerelease identifier is empty after a separator · case 03

A prerelease identifier is empty after a separator.

Lexical grammars◈ Members↗
FA-3589

A prerelease identifier is empty after a separator · case 04

A prerelease identifier is empty after a separator.

Lexical grammars◈ Members↗
FA-3590

A prerelease identifier is empty after a separator · case 05

A prerelease identifier is empty after a separator.

Lexical grammars◈ Members↗
FA-3591

A Roman token accepts noncanonical subtractive notation · case 01

A Roman token accepts noncanonical subtractive notation.

Lexical grammars● Open access↗
FA-3592

A Roman token accepts noncanonical subtractive notation · case 02

A Roman token accepts noncanonical subtractive notation.

Lexical grammars◈ Members↗
FA-3593

A Roman token accepts noncanonical subtractive notation · case 03

A Roman token accepts noncanonical subtractive notation.

Lexical grammars◈ Members↗
FA-3594

A Roman token accepts noncanonical subtractive notation · case 04

A Roman token accepts noncanonical subtractive notation.

Lexical grammars◈ Members↗
FA-3595

A Roman token accepts noncanonical subtractive notation · case 05

A Roman token accepts noncanonical subtractive notation.

Lexical grammars◈ Members↗
FA-3596

An ISBN-like lexeme admits X outside its final position · case 01

An ISBN-like lexeme admits X outside its final position.

Lexical grammars● Open access↗
FA-3597

An ISBN-like lexeme admits X outside its final position · case 02

An ISBN-like lexeme admits X outside its final position.

Lexical grammars◈ Members↗
FA-3598

An ISBN-like lexeme admits X outside its final position · case 03

An ISBN-like lexeme admits X outside its final position.

Lexical grammars◈ Members↗
FA-3599

An ISBN-like lexeme admits X outside its final position · case 04

An ISBN-like lexeme admits X outside its final position.

Lexical grammars◈ Members↗
FA-3600

An ISBN-like lexeme admits X outside its final position · case 05

An ISBN-like lexeme admits X outside its final position.

Lexical grammars◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗