FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-80301

Balanced headline wrapping: final layout width · case 01

The balanced width is computed but lines are laid out at the full width.

Typography line breaking● Open access↗
FA-80302

Balanced headline wrapping: final layout width · case 02

The balanced width is computed but lines are laid out at the full width.

Typography line breaking◈ Members↗
FA-80303

Balanced headline wrapping: final layout width · case 03

The balanced width is computed but lines are laid out at the full width.

Typography line breaking◈ Members↗
FA-80304

Balanced headline wrapping: final layout width · case 04

The balanced width is computed but lines are laid out at the full width.

Typography line breaking◈ Members↗
FA-80305

Balanced headline wrapping: final layout width · case 05

The balanced width is computed but lines are laid out at the full width.

Typography line breaking◈ Members↗
FA-80306

Balanced headline wrapping: search termination · case 01

Balanced widths come out one column too wide.

Typography line breaking● Open access↗
FA-80307

Balanced headline wrapping: search termination · case 02

Balanced widths come out one column too wide.

Typography line breaking◈ Members↗
FA-80308

Balanced headline wrapping: search termination · case 03

Balanced widths come out one column too wide.

Typography line breaking◈ Members↗
FA-80309

Balanced headline wrapping: search termination · case 04

Balanced widths come out one column too wide.

Typography line breaking◈ Members↗
FA-80310

Balanced headline wrapping: search termination · case 05

Balanced widths come out one column too wide.

Typography line breaking◈ Members↗
FA-80311

URL line breaking: double slash integrity · case 01

URLs are broken between the two slashes of "//".

Typography line breaking● Open access↗
FA-80312

URL line breaking: double slash integrity · case 02

URLs are broken between the two slashes of "//".

Typography line breaking◈ Members↗
FA-80313

URL line breaking: double slash integrity · case 03

URLs are broken between the two slashes of "//".

Typography line breaking◈ Members↗
FA-80314

URL line breaking: double slash integrity · case 04

URLs are broken between the two slashes of "//".

Typography line breaking◈ Members↗
FA-80315

URL line breaking: double slash integrity · case 05

URLs are broken between the two slashes of "//".

Typography line breaking◈ Members↗
FA-80316

URL line breaking: after double slash · case 01

No break is offered right after "https://".

Typography line breaking● Open access↗
FA-80317

URL line breaking: after double slash · case 02

No break is offered right after "https://".

Typography line breaking◈ Members↗
FA-80318

URL line breaking: after double slash · case 03

No break is offered right after "https://".

Typography line breaking◈ Members↗
FA-80319

URL line breaking: after double slash · case 04

No break is offered right after "https://".

Typography line breaking◈ Members↗
FA-80320

URL line breaking: after double slash · case 05

No break is offered right after "https://".

Typography line breaking◈ Members↗
FA-80321

URL line breaking: period break side · case 01

Lines end with a dangling period instead of starting with it.

Typography line breaking● Open access↗
FA-80322

URL line breaking: period break side · case 02

Lines end with a dangling period instead of starting with it.

Typography line breaking◈ Members↗
FA-80323

URL line breaking: period break side · case 03

Lines end with a dangling period instead of starting with it.

Typography line breaking◈ Members↗
FA-80324

URL line breaking: period break side · case 04

Lines end with a dangling period instead of starting with it.

Typography line breaking◈ Members↗
FA-80325

URL line breaking: period break side · case 05

Lines end with a dangling period instead of starting with it.

Typography line breaking◈ Members↗
FA-80326

URL line breaking: equals and ampersand sides · case 01

Query strings only break on one side of = and &.

Typography line breaking● Open access↗
FA-80327

URL line breaking: equals and ampersand sides · case 02

Query strings only break on one side of = and &.

Typography line breaking◈ Members↗
FA-80328

URL line breaking: equals and ampersand sides · case 03

Query strings only break on one side of = and &.

Typography line breaking◈ Members↗
FA-80329

URL line breaking: equals and ampersand sides · case 04

Query strings only break on one side of = and &.

Typography line breaking◈ Members↗
FA-80330

URL line breaking: equals and ampersand sides · case 05

Query strings only break on one side of = and &.

Typography line breaking◈ Members↗
FA-80331

URL line breaking: candidate window · case 01

An opportunity exactly at the line end is ignored.

Typography line breaking● Open access↗
FA-80332

URL line breaking: candidate window · case 02

An opportunity exactly at the line end is ignored.

Typography line breaking◈ Members↗
FA-80333

URL line breaking: candidate window · case 03

An opportunity exactly at the line end is ignored.

Typography line breaking◈ Members↗
FA-80334

URL line breaking: candidate window · case 04

An opportunity exactly at the line end is ignored.

Typography line breaking◈ Members↗
FA-80335

URL line breaking: candidate window · case 05

An opportunity exactly at the line end is ignored.

Typography line breaking◈ Members↗
FA-80336

URL line breaking: hard break fallback · case 01

Unbreakable URL runs overflow the line.

Typography line breaking● Open access↗
FA-80337

URL line breaking: hard break fallback · case 02

Unbreakable URL runs overflow the line.

Typography line breaking◈ Members↗
FA-80338

URL line breaking: hard break fallback · case 03

Unbreakable URL runs overflow the line.

Typography line breaking◈ Members↗
FA-80339

URL line breaking: hard break fallback · case 04

Unbreakable URL runs overflow the line.

Typography line breaking◈ Members↗
FA-80340

URL line breaking: hard break fallback · case 05

Unbreakable URL runs overflow the line.

Typography line breaking◈ Members↗
FA-80341

First-strong paragraph direction: Arabic letter strength · case 01

Paragraphs starting with Arabic letters default to left-to-right.

Bidirectional text layout● Open access↗
FA-80342

First-strong paragraph direction: Arabic letter strength · case 02

Paragraphs starting with Arabic letters default to left-to-right.

Bidirectional text layout◈ Members↗
FA-80343

First-strong paragraph direction: Arabic letter strength · case 03

Paragraphs starting with Arabic letters default to left-to-right.

Bidirectional text layout◈ Members↗
FA-80344

First-strong paragraph direction: Arabic letter strength · case 04

Paragraphs starting with Arabic letters default to left-to-right.

Bidirectional text layout◈ Members↗
FA-80345

First-strong paragraph direction: Arabic letter strength · case 05

Paragraphs starting with Arabic letters default to left-to-right.

Bidirectional text layout◈ Members↗
FA-80346

First-strong paragraph direction: unmatched PDI · case 01

A stray PDI hides the rest of the paragraph from direction detection.

Bidirectional text layout● Open access↗
FA-80347

First-strong paragraph direction: unmatched PDI · case 02

A stray PDI hides the rest of the paragraph from direction detection.

Bidirectional text layout◈ Members↗
FA-80348

First-strong paragraph direction: unmatched PDI · case 03

A stray PDI hides the rest of the paragraph from direction detection.

Bidirectional text layout◈ Members↗
FA-80349

First-strong paragraph direction: unmatched PDI · case 04

A stray PDI hides the rest of the paragraph from direction detection.

Bidirectional text layout◈ Members↗
FA-80350

First-strong paragraph direction: unmatched PDI · case 05

A stray PDI hides the rest of the paragraph from direction detection.

Bidirectional text layout◈ Members↗
FA-80351

First-strong paragraph direction: first-strong isolate initiator · case 01

Letters inside an FSI isolate decide the paragraph direction.

Bidirectional text layout● Open access↗
FA-80352

First-strong paragraph direction: first-strong isolate initiator · case 02

Letters inside an FSI isolate decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80353

First-strong paragraph direction: first-strong isolate initiator · case 03

Letters inside an FSI isolate decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80354

First-strong paragraph direction: first-strong isolate initiator · case 04

Letters inside an FSI isolate decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80355

First-strong paragraph direction: first-strong isolate initiator · case 05

Letters inside an FSI isolate decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80356

First-strong paragraph direction: numbers as strong · case 01

Paragraphs that start with a number become left-to-right.

Bidirectional text layout● Open access↗
FA-80357

First-strong paragraph direction: numbers as strong · case 02

Paragraphs that start with a number become left-to-right.

Bidirectional text layout◈ Members↗
FA-80358

First-strong paragraph direction: numbers as strong · case 03

Paragraphs that start with a number become left-to-right.

Bidirectional text layout◈ Members↗
FA-80359

First-strong paragraph direction: numbers as strong · case 04

Paragraphs that start with a number become left-to-right.

Bidirectional text layout◈ Members↗
FA-80360

First-strong paragraph direction: numbers as strong · case 05

Paragraphs that start with a number become left-to-right.

Bidirectional text layout◈ Members↗
FA-80361

First-strong paragraph direction: nested isolate depth · case 01

Text after an inner PDI is treated as outside all isolates.

Bidirectional text layout● Open access↗
FA-80362

First-strong paragraph direction: nested isolate depth · case 02

Text after an inner PDI is treated as outside all isolates.

Bidirectional text layout◈ Members↗
FA-80363

First-strong paragraph direction: nested isolate depth · case 03

Text after an inner PDI is treated as outside all isolates.

Bidirectional text layout◈ Members↗
FA-80364

First-strong paragraph direction: nested isolate depth · case 04

Text after an inner PDI is treated as outside all isolates.

Bidirectional text layout◈ Members↗
FA-80365

First-strong paragraph direction: nested isolate depth · case 05

Text after an inner PDI is treated as outside all isolates.

Bidirectional text layout◈ Members↗
FA-80366

First-strong paragraph direction: isolate content skipping · case 01

Letters inside isolates decide the paragraph direction.

Bidirectional text layout● Open access↗
FA-80367

First-strong paragraph direction: isolate content skipping · case 02

Letters inside isolates decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80368

First-strong paragraph direction: isolate content skipping · case 03

Letters inside isolates decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80369

First-strong paragraph direction: isolate content skipping · case 04

Letters inside isolates decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80370

First-strong paragraph direction: isolate content skipping · case 05

Letters inside isolates decide the paragraph direction.

Bidirectional text layout◈ Members↗
FA-80371

Weak type resolution: nonspacing mark inheritance · case 01

Combining marks take the sequence start type instead of their base.

Bidirectional text layout● Open access↗
FA-80372

Weak type resolution: nonspacing mark inheritance · case 02

Combining marks take the sequence start type instead of their base.

Bidirectional text layout◈ Members↗
FA-80373

Weak type resolution: nonspacing mark inheritance · case 03

Combining marks take the sequence start type instead of their base.

Bidirectional text layout◈ Members↗
FA-80374

Weak type resolution: nonspacing mark inheritance · case 04

Combining marks take the sequence start type instead of their base.

Bidirectional text layout◈ Members↗
FA-80375

Weak type resolution: nonspacing mark inheritance · case 05

Combining marks take the sequence start type instead of their base.

Bidirectional text layout◈ Members↗
FA-80376

Weak type resolution: mark after isolate boundary · case 01

A combining mark after an isolate initiator or PDI inherits an isolate class.

Bidirectional text layout● Open access↗
FA-80377

Weak type resolution: mark after isolate boundary · case 02

A combining mark after an isolate initiator or PDI inherits an isolate class.

Bidirectional text layout◈ Members↗
FA-80378

Weak type resolution: mark after isolate boundary · case 03

A combining mark after an isolate initiator or PDI inherits an isolate class.

Bidirectional text layout◈ Members↗
FA-80379

Weak type resolution: mark after isolate boundary · case 04

A combining mark after an isolate initiator or PDI inherits an isolate class.

Bidirectional text layout◈ Members↗
FA-80380

Weak type resolution: mark after isolate boundary · case 05

A combining mark after an isolate initiator or PDI inherits an isolate class.

Bidirectional text layout◈ Members↗
FA-80381

Weak type resolution: Arabic context tracking · case 01

Numbers after Arabic letters stay European.

Bidirectional text layout● Open access↗
FA-80382

Weak type resolution: Arabic context tracking · case 02

Numbers after Arabic letters stay European.

Bidirectional text layout◈ Members↗
FA-80383

Weak type resolution: Arabic context tracking · case 03

Numbers after Arabic letters stay European.

Bidirectional text layout◈ Members↗
FA-80384

Weak type resolution: Arabic context tracking · case 04

Numbers after Arabic letters stay European.

Bidirectional text layout◈ Members↗
FA-80385

Weak type resolution: Arabic context tracking · case 05

Numbers after Arabic letters stay European.

Bidirectional text layout◈ Members↗
FA-80386

Weak type resolution: plus sign between numbers · case 01

A plus between Arabic numbers joins them, or European pairs split.

Bidirectional text layout● Open access↗
FA-80387

Weak type resolution: plus sign between numbers · case 02

A plus between Arabic numbers joins them, or European pairs split.

Bidirectional text layout◈ Members↗
FA-80388

Weak type resolution: plus sign between numbers · case 03

A plus between Arabic numbers joins them, or European pairs split.

Bidirectional text layout◈ Members↗
FA-80389

Weak type resolution: plus sign between numbers · case 04

A plus between Arabic numbers joins them, or European pairs split.

Bidirectional text layout◈ Members↗
FA-80390

Weak type resolution: plus sign between numbers · case 05

A plus between Arabic numbers joins them, or European pairs split.

Bidirectional text layout◈ Members↗
FA-80391

Weak type resolution: common separator number types · case 01

A comma between a European and an Arabic number is absorbed.

Bidirectional text layout● Open access↗
FA-80392

Weak type resolution: common separator number types · case 02

A comma between a European and an Arabic number is absorbed.

Bidirectional text layout◈ Members↗
FA-80393

Weak type resolution: common separator number types · case 03

A comma between a European and an Arabic number is absorbed.

Bidirectional text layout◈ Members↗
FA-80394

Weak type resolution: common separator number types · case 04

A comma between a European and an Arabic number is absorbed.

Bidirectional text layout◈ Members↗
FA-80395

Weak type resolution: common separator number types · case 05

A comma between a European and an Arabic number is absorbed.

Bidirectional text layout◈ Members↗
FA-80396

Weak type resolution: terminator adjacency · case 01

Currency signs before a number are not attached to it.

Bidirectional text layout● Open access↗
FA-80397

Weak type resolution: terminator adjacency · case 02

Currency signs before a number are not attached to it.

Bidirectional text layout◈ Members↗
FA-80398

Weak type resolution: terminator adjacency · case 03

Currency signs before a number are not attached to it.

Bidirectional text layout◈ Members↗
FA-80399

Weak type resolution: terminator adjacency · case 04

Currency signs before a number are not attached to it.

Bidirectional text layout◈ Members↗
FA-80400

Weak type resolution: terminator adjacency · case 05

Currency signs before a number are not attached to it.

Bidirectional text layout◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗