FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-21401

Undo restores the oldest edit instead of latest · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21402

Undo restores the oldest edit instead of latest · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21403

Undo restores the oldest edit instead of latest · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21404

Undo restores the oldest edit instead of latest · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21405

Undo restores the oldest edit instead of latest · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21406

Undo bookmark stores text length instead of editing cursor · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21407

Undo bookmark stores text length instead of editing cursor · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21408

Undo bookmark stores text length instead of editing cursor · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21409

Undo bookmark stores text length instead of editing cursor · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21410

Undo bookmark stores text length instead of editing cursor · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21411

Inserted speech is appended to document instead of cursor position · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21412

Inserted speech is appended to document instead of cursor position · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21413

Inserted speech is appended to document instead of cursor position · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21414

Inserted speech is appended to document instead of cursor position · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21415

Inserted speech is appended to document instead of cursor position · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21416

Backspace announcement includes one extra preceding character · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21417

Backspace announcement includes one extra preceding character · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21418

Backspace announcement includes one extra preceding character · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21419

Backspace announcement includes one extra preceding character · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21420

Backspace announcement includes one extra preceding character · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21421

Backspace leaves the speech cursor beyond removed text · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21422

Backspace leaves the speech cursor beyond removed text · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21423

Backspace leaves the speech cursor beyond removed text · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21424

Backspace leaves the speech cursor beyond removed text · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21425

Backspace leaves the speech cursor beyond removed text · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21426

Forward deletion starts after the cursor character · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21427

Forward deletion starts after the cursor character · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21428

Forward deletion starts after the cursor character · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21429

Forward deletion starts after the cursor character · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21430

Forward deletion starts after the cursor character · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21431

Reversed replacement endpoints are not normalized · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21432

Reversed replacement endpoints are not normalized · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21433

Reversed replacement endpoints are not normalized · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21434

Reversed replacement endpoints are not normalized · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21435

Reversed replacement endpoints are not normalized · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21436

Range replacement cursor points before inserted text · case 01

The announcement trace violates the stated edit-narration contract.

Assistive announcements● Open access↗
FA-21437

Range replacement cursor points before inserted text · case 02

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21438

Range replacement cursor points before inserted text · case 03

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21439

Range replacement cursor points before inserted text · case 04

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21440

Range replacement cursor points before inserted text · case 05

The announcement trace violates the stated edit-narration contract.

Assistive announcements◈ Members↗
FA-21441

Zero phrase budget survives configuration · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21442

Zero phrase budget survives configuration · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21443

Zero phrase budget survives configuration · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21444

Zero phrase budget survives configuration · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21445

Zero phrase budget survives configuration · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21446

Empty phrase creates a spoken empty packet · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21447

Empty phrase creates a spoken empty packet · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21448

Empty phrase creates a spoken empty packet · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21449

Empty phrase creates a spoken empty packet · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21450

Empty phrase creates a spoken empty packet · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21451

Hard speech boundary is discarded before packetization · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21452

Hard speech boundary is discarded before packetization · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21453

Hard speech boundary is discarded before packetization · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21454

Hard speech boundary is discarded before packetization · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21455

Hard speech boundary is discarded before packetization · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21456

Canceling one language removes hard boundaries and other phrases · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21457

Canceling one language removes hard boundaries and other phrases · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21458

Canceling one language removes hard boundaries and other phrases · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21459

Canceling one language removes hard boundaries and other phrases · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21460

Canceling one language removes hard boundaries and other phrases · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21461

Hard boundary emits packet without clearing current packet · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21462

Hard boundary emits packet without clearing current packet · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21463

Hard boundary emits packet without clearing current packet · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21464

Hard boundary emits packet without clearing current packet · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21465

Hard boundary emits packet without clearing current packet · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21466

Different-language phrases share one voice packet · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21467

Different-language phrases share one voice packet · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21468

Different-language phrases share one voice packet · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21469

Different-language phrases share one voice packet · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21470

Different-language phrases share one voice packet · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21471

Packing omits separator space from budget calculation · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21472

Packing omits separator space from budget calculation · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21473

Packing omits separator space from budget calculation · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21474

Packing omits separator space from budget calculation · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21475

Packing omits separator space from budget calculation · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21476

Packet text glues adjacent phrases together · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21477

Packet text glues adjacent phrases together · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21478

Packet text glues adjacent phrases together · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21479

Packet text glues adjacent phrases together · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21480

Packet text glues adjacent phrases together · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21481

Oversize phrase is truncated to packet budget · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21482

Oversize phrase is truncated to packet budget · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21483

Oversize phrase is truncated to packet budget · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21484

Oversize phrase is truncated to packet budget · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21485

Oversize phrase is truncated to packet budget · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21486

Last buffered speech packet is lost · case 01

The announcement trace violates the stated sentence-packing contract.

Assistive announcements● Open access↗
FA-21487

Last buffered speech packet is lost · case 02

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21488

Last buffered speech packet is lost · case 03

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21489

Last buffered speech packet is lost · case 04

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21490

Last buffered speech packet is lost · case 05

The announcement trace violates the stated sentence-packing contract.

Assistive announcements◈ Members↗
FA-21491

Adding device replaces all currently available outputs · case 01

The announcement trace violates the stated device-handoff contract.

Assistive announcements● Open access↗
FA-21492

Adding device replaces all currently available outputs · case 02

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21493

Adding device replaces all currently available outputs · case 03

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21494

Adding device replaces all currently available outputs · case 04

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21495

Adding device replaces all currently available outputs · case 05

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21496

Queued speech uses uncommitted handoff target · case 01

The announcement trace violates the stated device-handoff contract.

Assistive announcements● Open access↗
FA-21497

Queued speech uses uncommitted handoff target · case 02

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21498

Queued speech uses uncommitted handoff target · case 03

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21499

Queued speech uses uncommitted handoff target · case 04

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗
FA-21500

Queued speech uses uncommitted handoff target · case 05

The announcement trace violates the stated device-handoff contract.

Assistive announcements◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗