FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-80501

Line-end whitespace level reset: segment separator reset · case 01

Tabs inside right-to-left text keep the embedded level.

Bidirectional text layout● Open access↗
FA-80502

Line-end whitespace level reset: segment separator reset · case 02

Tabs inside right-to-left text keep the embedded level.

Bidirectional text layout◈ Members↗
FA-80503

Line-end whitespace level reset: segment separator reset · case 03

Tabs inside right-to-left text keep the embedded level.

Bidirectional text layout◈ Members↗
FA-80504

Line-end whitespace level reset: segment separator reset · case 04

Tabs inside right-to-left text keep the embedded level.

Bidirectional text layout◈ Members↗
FA-80505

Line-end whitespace level reset: segment separator reset · case 05

Tabs inside right-to-left text keep the embedded level.

Bidirectional text layout◈ Members↗
FA-80506

Line-end whitespace level reset: trailing run start · case 01

The final space on the line keeps its embedded level.

Bidirectional text layout● Open access↗
FA-80507

Line-end whitespace level reset: trailing run start · case 02

The final space on the line keeps its embedded level.

Bidirectional text layout◈ Members↗
FA-80508

Line-end whitespace level reset: trailing run start · case 03

The final space on the line keeps its embedded level.

Bidirectional text layout◈ Members↗
FA-80509

Line-end whitespace level reset: trailing run start · case 04

The final space on the line keeps its embedded level.

Bidirectional text layout◈ Members↗
FA-80510

Line-end whitespace level reset: trailing run start · case 05

The final space on the line keeps its embedded level.

Bidirectional text layout◈ Members↗
FA-80511

Line-end whitespace level reset: whitespace before separator · case 01

Only one space before a tab is reset.

Bidirectional text layout● Open access↗
FA-80512

Line-end whitespace level reset: whitespace before separator · case 02

Only one space before a tab is reset.

Bidirectional text layout◈ Members↗
FA-80513

Line-end whitespace level reset: whitespace before separator · case 03

Only one space before a tab is reset.

Bidirectional text layout◈ Members↗
FA-80514

Line-end whitespace level reset: whitespace before separator · case 04

Only one space before a tab is reset.

Bidirectional text layout◈ Members↗
FA-80515

Line-end whitespace level reset: whitespace before separator · case 05

Only one space before a tab is reset.

Bidirectional text layout◈ Members↗
FA-80516

Line-end whitespace level reset: reset target level · case 01

Trailing whitespace is reset to the lowest level on the line.

Bidirectional text layout● Open access↗
FA-80517

Line-end whitespace level reset: reset target level · case 02

Trailing whitespace is reset to the lowest level on the line.

Bidirectional text layout◈ Members↗
FA-80518

Line-end whitespace level reset: reset target level · case 03

Trailing whitespace is reset to the lowest level on the line.

Bidirectional text layout◈ Members↗
FA-80519

Line-end whitespace level reset: reset target level · case 04

Trailing whitespace is reset to the lowest level on the line.

Bidirectional text layout◈ Members↗
FA-80520

Line-end whitespace level reset: reset target level · case 05

Trailing whitespace is reset to the lowest level on the line.

Bidirectional text layout◈ Members↗
FA-80521

Explicit embedding stack: next odd level · case 01

RLE inside an RTL embedding produces an even level.

Bidirectional text layout● Open access↗
FA-80522

Explicit embedding stack: next odd level · case 02

RLE inside an RTL embedding produces an even level.

Bidirectional text layout◈ Members↗
FA-80523

Explicit embedding stack: next odd level · case 03

RLE inside an RTL embedding produces an even level.

Bidirectional text layout◈ Members↗
FA-80524

Explicit embedding stack: next odd level · case 04

RLE inside an RTL embedding produces an even level.

Bidirectional text layout◈ Members↗
FA-80525

Explicit embedding stack: next odd level · case 05

RLE inside an RTL embedding produces an even level.

Bidirectional text layout◈ Members↗
FA-80526

Explicit embedding stack: next even level · case 01

LRE inside an RTL embedding skips a level.

Bidirectional text layout● Open access↗
FA-80527

Explicit embedding stack: next even level · case 02

LRE inside an RTL embedding skips a level.

Bidirectional text layout◈ Members↗
FA-80528

Explicit embedding stack: next even level · case 03

LRE inside an RTL embedding skips a level.

Bidirectional text layout◈ Members↗
FA-80529

Explicit embedding stack: next even level · case 04

LRE inside an RTL embedding skips a level.

Bidirectional text layout◈ Members↗
FA-80530

Explicit embedding stack: next even level · case 05

LRE inside an RTL embedding skips a level.

Bidirectional text layout◈ Members↗
FA-80531

Explicit embedding stack: maximum depth bound · case 01

Embeddings exactly at the maximum depth are rejected.

Bidirectional text layout● Open access↗
FA-80532

Explicit embedding stack: maximum depth bound · case 02

Embeddings exactly at the maximum depth are rejected.

Bidirectional text layout◈ Members↗
FA-80533

Explicit embedding stack: maximum depth bound · case 03

Embeddings exactly at the maximum depth are rejected.

Bidirectional text layout◈ Members↗
FA-80534

Explicit embedding stack: maximum depth bound · case 04

Embeddings exactly at the maximum depth are rejected.

Bidirectional text layout◈ Members↗
FA-80535

Explicit embedding stack: maximum depth bound · case 05

Embeddings exactly at the maximum depth are rejected.

Bidirectional text layout◈ Members↗
FA-80536

Explicit embedding stack: overflow blocking · case 01

After an overflow, later shallower codes push levels that should be ignored.

Bidirectional text layout● Open access↗
FA-80537

Explicit embedding stack: overflow blocking · case 02

After an overflow, later shallower codes push levels that should be ignored.

Bidirectional text layout◈ Members↗
FA-80538

Explicit embedding stack: overflow blocking · case 03

After an overflow, later shallower codes push levels that should be ignored.

Bidirectional text layout◈ Members↗
FA-80539

Explicit embedding stack: overflow blocking · case 04

After an overflow, later shallower codes push levels that should be ignored.

Bidirectional text layout◈ Members↗
FA-80540

Explicit embedding stack: overflow blocking · case 05

After an overflow, later shallower codes push levels that should be ignored.

Bidirectional text layout◈ Members↗
FA-80541

Explicit embedding stack: PDF overflow priority · case 01

A PDF closes a real embedding while an overflowed one is still open.

Bidirectional text layout● Open access↗
FA-80542

Explicit embedding stack: PDF overflow priority · case 02

A PDF closes a real embedding while an overflowed one is still open.

Bidirectional text layout◈ Members↗
FA-80543

Explicit embedding stack: PDF overflow priority · case 03

A PDF closes a real embedding while an overflowed one is still open.

Bidirectional text layout◈ Members↗
FA-80544

Explicit embedding stack: PDF overflow priority · case 04

A PDF closes a real embedding while an overflowed one is still open.

Bidirectional text layout◈ Members↗
FA-80545

Explicit embedding stack: PDF overflow priority · case 05

A PDF closes a real embedding while an overflowed one is still open.

Bidirectional text layout◈ Members↗
FA-80546

Explicit embedding stack: override scope · case 01

Punctuation inside an override keeps its own class.

Bidirectional text layout● Open access↗
FA-80547

Explicit embedding stack: override scope · case 02

Punctuation inside an override keeps its own class.

Bidirectional text layout◈ Members↗
FA-80548

Explicit embedding stack: override scope · case 03

Punctuation inside an override keeps its own class.

Bidirectional text layout◈ Members↗
FA-80549

Explicit embedding stack: override scope · case 04

Punctuation inside an override keeps its own class.

Bidirectional text layout◈ Members↗
FA-80550

Explicit embedding stack: override scope · case 05

Punctuation inside an override keeps its own class.

Bidirectional text layout◈ Members↗
FA-80551

Explicit embedding stack: embedding clears override · case 01

Text inside an embedding nested in an override is still overridden.

Bidirectional text layout● Open access↗
FA-80552

Explicit embedding stack: embedding clears override · case 02

Text inside an embedding nested in an override is still overridden.

Bidirectional text layout◈ Members↗
FA-80553

Explicit embedding stack: embedding clears override · case 03

Text inside an embedding nested in an override is still overridden.

Bidirectional text layout◈ Members↗
FA-80554

Explicit embedding stack: embedding clears override · case 04

Text inside an embedding nested in an override is still overridden.

Bidirectional text layout◈ Members↗
FA-80555

Explicit embedding stack: embedding clears override · case 05

Text inside an embedding nested in an override is still overridden.

Bidirectional text layout◈ Members↗
FA-80556

Mirrored glyph rendering: mirroring parity · case 01

Brackets inside LTR embeddings of RTL text are flipped.

Bidirectional text layout● Open access↗
FA-80557

Mirrored glyph rendering: mirroring parity · case 02

Brackets inside LTR embeddings of RTL text are flipped.

Bidirectional text layout◈ Members↗
FA-80558

Mirrored glyph rendering: mirroring parity · case 03

Brackets inside LTR embeddings of RTL text are flipped.

Bidirectional text layout◈ Members↗
FA-80559

Mirrored glyph rendering: mirroring parity · case 04

Brackets inside LTR embeddings of RTL text are flipped.

Bidirectional text layout◈ Members↗
FA-80560

Mirrored glyph rendering: mirroring parity · case 05

Brackets inside LTR embeddings of RTL text are flipped.

Bidirectional text layout◈ Members↗
FA-80561

Mirrored glyph rendering: mirror table symmetry · case 01

Closing brackets in RTL text render unflipped.

Bidirectional text layout● Open access↗
FA-80562

Mirrored glyph rendering: mirror table symmetry · case 02

Closing brackets in RTL text render unflipped.

Bidirectional text layout◈ Members↗
FA-80563

Mirrored glyph rendering: mirror table symmetry · case 03

Closing brackets in RTL text render unflipped.

Bidirectional text layout◈ Members↗
FA-80564

Mirrored glyph rendering: mirror table symmetry · case 04

Closing brackets in RTL text render unflipped.

Bidirectional text layout◈ Members↗
FA-80565

Mirrored glyph rendering: mirror table symmetry · case 05

Closing brackets in RTL text render unflipped.

Bidirectional text layout◈ Members↗
FA-80566

Mirrored glyph rendering: mirror level lookup · case 01

Brackets are mirrored based on the level found at their visual slot.

Bidirectional text layout● Open access↗
FA-80567

Mirrored glyph rendering: mirror level lookup · case 02

Brackets are mirrored based on the level found at their visual slot.

Bidirectional text layout◈ Members↗
FA-80568

Mirrored glyph rendering: mirror level lookup · case 03

Brackets are mirrored based on the level found at their visual slot.

Bidirectional text layout◈ Members↗
FA-80569

Mirrored glyph rendering: mirror level lookup · case 04

Brackets are mirrored based on the level found at their visual slot.

Bidirectional text layout◈ Members↗
FA-80570

Mirrored glyph rendering: mirror level lookup · case 05

Brackets are mirrored based on the level found at their visual slot.

Bidirectional text layout◈ Members↗
FA-80571

Mirrored glyph rendering: reversal grouping key · case 01

Higher-level runs nested inside a reversal are left in place.

Bidirectional text layout● Open access↗
FA-80572

Mirrored glyph rendering: reversal grouping key · case 02

Higher-level runs nested inside a reversal are left in place.

Bidirectional text layout◈ Members↗
FA-80573

Mirrored glyph rendering: reversal grouping key · case 03

Higher-level runs nested inside a reversal are left in place.

Bidirectional text layout◈ Members↗
FA-80574

Mirrored glyph rendering: reversal grouping key · case 04

Higher-level runs nested inside a reversal are left in place.

Bidirectional text layout◈ Members↗
FA-80575

Mirrored glyph rendering: reversal grouping key · case 05

Higher-level runs nested inside a reversal are left in place.

Bidirectional text layout◈ Members↗
FA-80576

Bracket pair identification: bracket class filter · case 01

Brackets forced to R by an override are still paired.

Bidirectional text layout● Open access↗
FA-80577

Bracket pair identification: bracket class filter · case 02

Brackets forced to R by an override are still paired.

Bidirectional text layout◈ Members↗
FA-80578

Bracket pair identification: bracket class filter · case 03

Brackets forced to R by an override are still paired.

Bidirectional text layout◈ Members↗
FA-80579

Bracket pair identification: bracket class filter · case 04

Brackets forced to R by an override are still paired.

Bidirectional text layout◈ Members↗
FA-80580

Bracket pair identification: bracket class filter · case 05

Brackets forced to R by an override are still paired.

Bidirectional text layout◈ Members↗
FA-80581

Bracket pair identification: stack overflow handling · case 01

Pairs keep being found after the opener stack overflowed.

Bidirectional text layout● Open access↗
FA-80582

Bracket pair identification: stack overflow handling · case 02

Pairs keep being found after the opener stack overflowed.

Bidirectional text layout◈ Members↗
FA-80583

Bracket pair identification: stack overflow handling · case 03

Pairs keep being found after the opener stack overflowed.

Bidirectional text layout◈ Members↗
FA-80584

Bracket pair identification: stack overflow handling · case 04

Pairs keep being found after the opener stack overflowed.

Bidirectional text layout◈ Members↗
FA-80585

Bracket pair identification: stack overflow handling · case 05

Pairs keep being found after the opener stack overflowed.

Bidirectional text layout◈ Members↗
FA-80586

Bracket pair identification: mismatched closer search · case 01

A closer that does not match the top opener is dropped although its opener is deeper.

Bidirectional text layout● Open access↗
FA-80587

Bracket pair identification: mismatched closer search · case 02

A closer that does not match the top opener is dropped although its opener is deeper.

Bidirectional text layout◈ Members↗
FA-80588

Bracket pair identification: mismatched closer search · case 03

A closer that does not match the top opener is dropped although its opener is deeper.

Bidirectional text layout◈ Members↗
FA-80589

Bracket pair identification: mismatched closer search · case 04

A closer that does not match the top opener is dropped although its opener is deeper.

Bidirectional text layout◈ Members↗
FA-80590

Bracket pair identification: mismatched closer search · case 05

A closer that does not match the top opener is dropped although its opener is deeper.

Bidirectional text layout◈ Members↗
FA-80591

Bracket pair identification: pair ordering · case 01

Bracket pairs come back ordered by closing position.

Bidirectional text layout● Open access↗
FA-80592

Bracket pair identification: pair ordering · case 02

Bracket pairs come back ordered by closing position.

Bidirectional text layout◈ Members↗
FA-80593

Bracket pair identification: pair ordering · case 03

Bracket pairs come back ordered by closing position.

Bidirectional text layout◈ Members↗
FA-80594

Bracket pair identification: pair ordering · case 04

Bracket pairs come back ordered by closing position.

Bidirectional text layout◈ Members↗
FA-80595

Bracket pair identification: pair ordering · case 05

Bracket pairs come back ordered by closing position.

Bidirectional text layout◈ Members↗
FA-80596

Bracket pair identification: stack search direction · case 01

A closer pairs with the outermost matching opener.

Bidirectional text layout● Open access↗
FA-80597

Bracket pair identification: stack search direction · case 02

A closer pairs with the outermost matching opener.

Bidirectional text layout◈ Members↗
FA-80598

Bracket pair identification: stack search direction · case 03

A closer pairs with the outermost matching opener.

Bidirectional text layout◈ Members↗
FA-80599

Bracket pair identification: stack search direction · case 04

A closer pairs with the outermost matching opener.

Bidirectional text layout◈ Members↗
FA-80600

Bracket pair identification: stack search direction · case 05

A closer pairs with the outermost matching opener.

Bidirectional text layout◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗