FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-80601

Paired bracket direction: numbers inside brackets · case 01

Brackets around numbers in RTL text are not resolved as RTL.

Bidirectional text layout● Open access↗
FA-80602

Paired bracket direction: numbers inside brackets · case 02

Brackets around numbers in RTL text are not resolved as RTL.

Bidirectional text layout◈ Members↗
FA-80603

Paired bracket direction: numbers inside brackets · case 03

Brackets around numbers in RTL text are not resolved as RTL.

Bidirectional text layout◈ Members↗
FA-80604

Paired bracket direction: numbers inside brackets · case 04

Brackets around numbers in RTL text are not resolved as RTL.

Bidirectional text layout◈ Members↗
FA-80605

Paired bracket direction: numbers inside brackets · case 05

Brackets around numbers in RTL text are not resolved as RTL.

Bidirectional text layout◈ Members↗
FA-80606

Paired bracket direction: context from updated brackets · case 01

Nested brackets ignore the resolution of their enclosing pair.

Bidirectional text layout● Open access↗
FA-80607

Paired bracket direction: context from updated brackets · case 02

Nested brackets ignore the resolution of their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80608

Paired bracket direction: context from updated brackets · case 03

Nested brackets ignore the resolution of their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80609

Paired bracket direction: context from updated brackets · case 04

Nested brackets ignore the resolution of their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80610

Paired bracket direction: context from updated brackets · case 05

Nested brackets ignore the resolution of their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80611

Paired bracket direction: context fallback · case 01

Brackets at the start of a sequence ignore the sequence start type.

Bidirectional text layout● Open access↗
FA-80612

Paired bracket direction: context fallback · case 02

Brackets at the start of a sequence ignore the sequence start type.

Bidirectional text layout◈ Members↗
FA-80613

Paired bracket direction: context fallback · case 03

Brackets at the start of a sequence ignore the sequence start type.

Bidirectional text layout◈ Members↗
FA-80614

Paired bracket direction: context fallback · case 04

Brackets at the start of a sequence ignore the sequence start type.

Bidirectional text layout◈ Members↗
FA-80615

Paired bracket direction: context fallback · case 05

Brackets at the start of a sequence ignore the sequence start type.

Bidirectional text layout◈ Members↗
FA-80616

Paired bracket direction: embedding match test · case 01

A pair containing both directions resolves to the opposite direction.

Bidirectional text layout● Open access↗
FA-80617

Paired bracket direction: embedding match test · case 02

A pair containing both directions resolves to the opposite direction.

Bidirectional text layout◈ Members↗
FA-80618

Paired bracket direction: embedding match test · case 03

A pair containing both directions resolves to the opposite direction.

Bidirectional text layout◈ Members↗
FA-80619

Paired bracket direction: embedding match test · case 04

A pair containing both directions resolves to the opposite direction.

Bidirectional text layout◈ Members↗
FA-80620

Paired bracket direction: embedding match test · case 05

A pair containing both directions resolves to the opposite direction.

Bidirectional text layout◈ Members↗
FA-80621

Paired bracket direction: pair processing order · case 01

Nested brackets resolve before their enclosing pair.

Bidirectional text layout● Open access↗
FA-80622

Paired bracket direction: pair processing order · case 02

Nested brackets resolve before their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80623

Paired bracket direction: pair processing order · case 03

Nested brackets resolve before their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80624

Paired bracket direction: pair processing order · case 04

Nested brackets resolve before their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80625

Paired bracket direction: pair processing order · case 05

Nested brackets resolve before their enclosing pair.

Bidirectional text layout◈ Members↗
FA-80626

Paired bracket direction: empty pair handling · case 01

Brackets with no strong content are forced to the embedding direction.

Bidirectional text layout● Open access↗
FA-80627

Paired bracket direction: empty pair handling · case 02

Brackets with no strong content are forced to the embedding direction.

Bidirectional text layout◈ Members↗
FA-80628

Paired bracket direction: empty pair handling · case 03

Brackets with no strong content are forced to the embedding direction.

Bidirectional text layout◈ Members↗
FA-80629

Paired bracket direction: empty pair handling · case 04

Brackets with no strong content are forced to the embedding direction.

Bidirectional text layout◈ Members↗
FA-80630

Paired bracket direction: empty pair handling · case 05

Brackets with no strong content are forced to the embedding direction.

Bidirectional text layout◈ Members↗
FA-80631

Caret visual position: leading edge side · case 01

Carets attached to RTL characters appear on the wrong side.

Bidirectional text layout● Open access↗
FA-80632

Caret visual position: leading edge side · case 02

Carets attached to RTL characters appear on the wrong side.

Bidirectional text layout◈ Members↗
FA-80633

Caret visual position: leading edge side · case 03

Carets attached to RTL characters appear on the wrong side.

Bidirectional text layout◈ Members↗
FA-80634

Caret visual position: leading edge side · case 04

Carets attached to RTL characters appear on the wrong side.

Bidirectional text layout◈ Members↗
FA-80635

Caret visual position: leading edge side · case 05

Carets attached to RTL characters appear on the wrong side.

Bidirectional text layout◈ Members↗
FA-80636

Caret visual position: trailing edge side · case 01

Carets after RTL characters are drawn past them.

Bidirectional text layout● Open access↗
FA-80637

Caret visual position: trailing edge side · case 02

Carets after RTL characters are drawn past them.

Bidirectional text layout◈ Members↗
FA-80638

Caret visual position: trailing edge side · case 03

Carets after RTL characters are drawn past them.

Bidirectional text layout◈ Members↗
FA-80639

Caret visual position: trailing edge side · case 04

Carets after RTL characters are drawn past them.

Bidirectional text layout◈ Members↗
FA-80640

Caret visual position: trailing edge side · case 05

Carets after RTL characters are drawn past them.

Bidirectional text layout◈ Members↗
FA-80641

Caret visual position: affinity at line end · case 01

A caret before the last character jumps to the previous character.

Bidirectional text layout● Open access↗
FA-80642

Caret visual position: affinity at line end · case 02

A caret before the last character jumps to the previous character.

Bidirectional text layout◈ Members↗
FA-80643

Caret visual position: affinity at line end · case 03

A caret before the last character jumps to the previous character.

Bidirectional text layout◈ Members↗
FA-80644

Caret visual position: affinity at line end · case 04

A caret before the last character jumps to the previous character.

Bidirectional text layout◈ Members↗
FA-80645

Caret visual position: affinity at line end · case 05

A caret before the last character jumps to the previous character.

Bidirectional text layout◈ Members↗
FA-80646

Caret visual position: position inverse map · case 01

Carets are placed at the logical index instead of the visual slot.

Bidirectional text layout● Open access↗
FA-80647

Caret visual position: position inverse map · case 02

Carets are placed at the logical index instead of the visual slot.

Bidirectional text layout◈ Members↗
FA-80648

Caret visual position: position inverse map · case 03

Carets are placed at the logical index instead of the visual slot.

Bidirectional text layout◈ Members↗
FA-80649

Caret visual position: position inverse map · case 04

Carets are placed at the logical index instead of the visual slot.

Bidirectional text layout◈ Members↗
FA-80650

Caret visual position: position inverse map · case 05

Carets are placed at the logical index instead of the visual slot.

Bidirectional text layout◈ Members↗
FA-80651

Caret visual position: character direction test · case 01

Carets next to characters at level 2 are placed as if RTL.

Bidirectional text layout● Open access↗
FA-80652

Caret visual position: character direction test · case 02

Carets next to characters at level 2 are placed as if RTL.

Bidirectional text layout◈ Members↗
FA-80653

Caret visual position: character direction test · case 03

Carets next to characters at level 2 are placed as if RTL.

Bidirectional text layout◈ Members↗
FA-80654

Caret visual position: character direction test · case 04

Carets next to characters at level 2 are placed as if RTL.

Bidirectional text layout◈ Members↗
FA-80655

Caret visual position: character direction test · case 05

Carets next to characters at level 2 are placed as if RTL.

Bidirectional text layout◈ Members↗
FA-80656

Caret visual position: line start caret · case 01

A caret at offset 0 with backward affinity lands at the end of the line.

Bidirectional text layout● Open access↗
FA-80657

Caret visual position: line start caret · case 02

A caret at offset 0 with backward affinity lands at the end of the line.

Bidirectional text layout◈ Members↗
FA-80658

Caret visual position: line start caret · case 03

A caret at offset 0 with backward affinity lands at the end of the line.

Bidirectional text layout◈ Members↗
FA-80659

Caret visual position: line start caret · case 04

A caret at offset 0 with backward affinity lands at the end of the line.

Bidirectional text layout◈ Members↗
FA-80660

Caret visual position: line start caret · case 05

A caret at offset 0 with backward affinity lands at the end of the line.

Bidirectional text layout◈ Members↗
FA-80661

Bidi selection highlight: selection end exclusivity · case 01

Highlights include one character past the selection.

Bidirectional text layout● Open access↗
FA-80662

Bidi selection highlight: selection end exclusivity · case 02

Highlights include one character past the selection.

Bidirectional text layout◈ Members↗
FA-80663

Bidi selection highlight: selection end exclusivity · case 03

Highlights include one character past the selection.

Bidirectional text layout◈ Members↗
FA-80664

Bidi selection highlight: selection end exclusivity · case 04

Highlights include one character past the selection.

Bidirectional text layout◈ Members↗
FA-80665

Bidi selection highlight: selection end exclusivity · case 05

Highlights include one character past the selection.

Bidirectional text layout◈ Members↗
FA-80666

Bidi selection highlight: slot sorting · case 01

RTL selections are drawn as many one-unit fragments.

Bidirectional text layout● Open access↗
FA-80667

Bidi selection highlight: slot sorting · case 02

RTL selections are drawn as many one-unit fragments.

Bidirectional text layout◈ Members↗
FA-80668

Bidi selection highlight: slot sorting · case 03

RTL selections are drawn as many one-unit fragments.

Bidirectional text layout◈ Members↗
FA-80669

Bidi selection highlight: slot sorting · case 04

RTL selections are drawn as many one-unit fragments.

Bidirectional text layout◈ Members↗
FA-80670

Bidi selection highlight: slot sorting · case 05

RTL selections are drawn as many one-unit fragments.

Bidirectional text layout◈ Members↗
FA-80671

Bidi selection highlight: rectangle adjacency · case 01

Separate highlight fragments are fused across unselected gaps.

Bidirectional text layout● Open access↗
FA-80672

Bidi selection highlight: rectangle adjacency · case 02

Separate highlight fragments are fused across unselected gaps.

Bidirectional text layout◈ Members↗
FA-80673

Bidi selection highlight: rectangle adjacency · case 03

Separate highlight fragments are fused across unselected gaps.

Bidirectional text layout◈ Members↗
FA-80674

Bidi selection highlight: rectangle adjacency · case 04

Separate highlight fragments are fused across unselected gaps.

Bidirectional text layout◈ Members↗
FA-80675

Bidi selection highlight: rectangle adjacency · case 05

Separate highlight fragments are fused across unselected gaps.

Bidirectional text layout◈ Members↗
FA-80676

Bidi selection highlight: backward selection normalisation · case 01

Selections dragged right-to-left highlight nothing.

Bidirectional text layout● Open access↗
FA-80677

Bidi selection highlight: backward selection normalisation · case 02

Selections dragged right-to-left highlight nothing.

Bidirectional text layout◈ Members↗
FA-80678

Bidi selection highlight: backward selection normalisation · case 03

Selections dragged right-to-left highlight nothing.

Bidirectional text layout◈ Members↗
FA-80679

Bidi selection highlight: backward selection normalisation · case 04

Selections dragged right-to-left highlight nothing.

Bidirectional text layout◈ Members↗
FA-80680

Bidi selection highlight: backward selection normalisation · case 05

Selections dragged right-to-left highlight nothing.

Bidirectional text layout◈ Members↗
FA-80681

Bidi selection highlight: logical to visual mapping · case 01

Highlights follow the logical range as if the line were unidirectional.

Bidirectional text layout● Open access↗
FA-80682

Bidi selection highlight: logical to visual mapping · case 02

Highlights follow the logical range as if the line were unidirectional.

Bidirectional text layout◈ Members↗
FA-80683

Bidi selection highlight: logical to visual mapping · case 03

Highlights follow the logical range as if the line were unidirectional.

Bidirectional text layout◈ Members↗
FA-80684

Bidi selection highlight: logical to visual mapping · case 04

Highlights follow the logical range as if the line were unidirectional.

Bidirectional text layout◈ Members↗
FA-80685

Bidi selection highlight: logical to visual mapping · case 05

Highlights follow the logical range as if the line were unidirectional.

Bidirectional text layout◈ Members↗
FA-80686

Bidi hit testing: left clamp · case 01

Clicks left of the line hit characters at the far end.

Bidirectional text layout● Open access↗
FA-80687

Bidi hit testing: left clamp · case 02

Clicks left of the line hit characters at the far end.

Bidirectional text layout◈ Members↗
FA-80688

Bidi hit testing: left clamp · case 03

Clicks left of the line hit characters at the far end.

Bidirectional text layout◈ Members↗
FA-80689

Bidi hit testing: left clamp · case 04

Clicks left of the line hit characters at the far end.

Bidirectional text layout◈ Members↗
FA-80690

Bidi hit testing: left clamp · case 05

Clicks left of the line hit characters at the far end.

Bidirectional text layout◈ Members↗
FA-80691

Bidi hit testing: trailing side for RTL · case 01

Clicking the right half of an RTL character places the caret after it logically.

Bidirectional text layout● Open access↗
FA-80692

Bidi hit testing: trailing side for RTL · case 02

Clicking the right half of an RTL character places the caret after it logically.

Bidirectional text layout◈ Members↗
FA-80693

Bidi hit testing: trailing side for RTL · case 03

Clicking the right half of an RTL character places the caret after it logically.

Bidirectional text layout◈ Members↗
FA-80694

Bidi hit testing: trailing side for RTL · case 04

Clicking the right half of an RTL character places the caret after it logically.

Bidirectional text layout◈ Members↗
FA-80695

Bidi hit testing: trailing side for RTL · case 05

Clicking the right half of an RTL character places the caret after it logically.

Bidirectional text layout◈ Members↗
FA-80696

Bidi hit testing: visual slot lookup · case 01

Clicks hit the character with the logical index equal to the slot.

Bidirectional text layout● Open access↗
FA-80697

Bidi hit testing: visual slot lookup · case 02

Clicks hit the character with the logical index equal to the slot.

Bidirectional text layout◈ Members↗
FA-80698

Bidi hit testing: visual slot lookup · case 03

Clicks hit the character with the logical index equal to the slot.

Bidirectional text layout◈ Members↗
FA-80699

Bidi hit testing: visual slot lookup · case 04

Clicks hit the character with the logical index equal to the slot.

Bidirectional text layout◈ Members↗
FA-80700

Bidi hit testing: visual slot lookup · case 05

Clicks hit the character with the logical index equal to the slot.

Bidirectional text layout◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗