FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-24501

Nested client render failure boundaries: Render only catch · case 01

Render only catch.

Client state● Open access↗
FA-24502

Nested client render failure boundaries: Render only catch · case 02

Render only catch.

Client state◈ Members↗
FA-24503

Nested client render failure boundaries: Render only catch · case 03

Render only catch.

Client state◈ Members↗
FA-24504

Nested client render failure boundaries: Render only catch · case 04

Render only catch.

Client state◈ Members↗
FA-24505

Nested client render failure boundaries: Render only catch · case 05

Render only catch.

Client state◈ Members↗
FA-24506

Nested client render failure boundaries: Unhandled root escalation · case 01

Unhandled root escalation.

Client state● Open access↗
FA-24507

Nested client render failure boundaries: Unhandled root escalation · case 02

Unhandled root escalation.

Client state◈ Members↗
FA-24508

Nested client render failure boundaries: Unhandled root escalation · case 03

Unhandled root escalation.

Client state◈ Members↗
FA-24509

Nested client render failure boundaries: Unhandled root escalation · case 04

Unhandled root escalation.

Client state◈ Members↗
FA-24510

Nested client render failure boundaries: Unhandled root escalation · case 05

Unhandled root escalation.

Client state◈ Members↗
FA-24511

Nested client render failure boundaries: Capture path inside out · case 01

Capture path inside out.

Client state● Open access↗
FA-24512

Nested client render failure boundaries: Capture path inside out · case 02

Capture path inside out.

Client state◈ Members↗
FA-24513

Nested client render failure boundaries: Capture path inside out · case 03

Capture path inside out.

Client state◈ Members↗
FA-24514

Nested client render failure boundaries: Capture path inside out · case 04

Capture path inside out.

Client state◈ Members↗
FA-24515

Nested client render failure boundaries: Capture path inside out · case 05

Capture path inside out.

Client state◈ Members↗
FA-24516

Nested client render failure boundaries: Reported error dedup · case 01

Reported error dedup.

Client state● Open access↗
FA-24517

Nested client render failure boundaries: Reported error dedup · case 02

Reported error dedup.

Client state◈ Members↗
FA-24518

Nested client render failure boundaries: Reported error dedup · case 03

Reported error dedup.

Client state◈ Members↗
FA-24519

Nested client render failure boundaries: Reported error dedup · case 04

Reported error dedup.

Client state◈ Members↗
FA-24520

Nested client render failure boundaries: Reported error dedup · case 05

Reported error dedup.

Client state◈ Members↗
FA-24521

Nested client render failure boundaries: Boundary disabled fallback · case 01

Boundary disabled fallback.

Client state● Open access↗
FA-24522

Nested client render failure boundaries: Boundary disabled fallback · case 02

Boundary disabled fallback.

Client state◈ Members↗
FA-24523

Nested client render failure boundaries: Boundary disabled fallback · case 03

Boundary disabled fallback.

Client state◈ Members↗
FA-24524

Nested client render failure boundaries: Boundary disabled fallback · case 04

Boundary disabled fallback.

Client state◈ Members↗
FA-24525

Nested client render failure boundaries: Boundary disabled fallback · case 05

Boundary disabled fallback.

Client state◈ Members↗
FA-24526

Nested client render failure boundaries: Reset clears handled marker · case 01

Reset clears handled marker.

Client state● Open access↗
FA-24527

Nested client render failure boundaries: Reset clears handled marker · case 02

Reset clears handled marker.

Client state◈ Members↗
FA-24528

Nested client render failure boundaries: Reset clears handled marker · case 03

Reset clears handled marker.

Client state◈ Members↗
FA-24529

Nested client render failure boundaries: Reset clears handled marker · case 04

Reset clears handled marker.

Client state◈ Members↗
FA-24530

Nested client render failure boundaries: Reset clears handled marker · case 05

Reset clears handled marker.

Client state◈ Members↗
FA-24531

Nested client render failure boundaries: Event error propagation · case 01

Event error propagation.

Client state● Open access↗
FA-24532

Nested client render failure boundaries: Event error propagation · case 02

Event error propagation.

Client state◈ Members↗
FA-24533

Nested client render failure boundaries: Event error propagation · case 03

Event error propagation.

Client state◈ Members↗
FA-24534

Nested client render failure boundaries: Event error propagation · case 04

Event error propagation.

Client state◈ Members↗
FA-24535

Nested client render failure boundaries: Event error propagation · case 05

Event error propagation.

Client state◈ Members↗
FA-24536

Incremental client response projection: Append only unseen chunks · case 01

Append only unseen chunks.

Client state● Open access↗
FA-24537

Incremental client response projection: Append only unseen chunks · case 02

Append only unseen chunks.

Client state◈ Members↗
FA-24538

Incremental client response projection: Append only unseen chunks · case 03

Append only unseen chunks.

Client state◈ Members↗
FA-24539

Incremental client response projection: Append only unseen chunks · case 04

Append only unseen chunks.

Client state◈ Members↗
FA-24540

Incremental client response projection: Append only unseen chunks · case 05

Append only unseen chunks.

Client state◈ Members↗
FA-24541

Incremental client response projection: Render budget prefix · case 01

Render budget prefix.

Client state● Open access↗
FA-24542

Incremental client response projection: Render budget prefix · case 02

Render budget prefix.

Client state◈ Members↗
FA-24543

Incremental client response projection: Render budget prefix · case 03

Render budget prefix.

Client state◈ Members↗
FA-24544

Incremental client response projection: Render budget prefix · case 04

Render budget prefix.

Client state◈ Members↗
FA-24545

Incremental client response projection: Render budget prefix · case 05

Render budget prefix.

Client state◈ Members↗
FA-24546

Incremental client response projection: Cursor advances by consumed count · case 01

Cursor advances by consumed count.

Client state● Open access↗
FA-24547

Incremental client response projection: Cursor advances by consumed count · case 02

Cursor advances by consumed count.

Client state◈ Members↗
FA-24548

Incremental client response projection: Cursor advances by consumed count · case 03

Cursor advances by consumed count.

Client state◈ Members↗
FA-24549

Incremental client response projection: Cursor advances by consumed count · case 04

Cursor advances by consumed count.

Client state◈ Members↗
FA-24550

Incremental client response projection: Cursor advances by consumed count · case 05

Cursor advances by consumed count.

Client state◈ Members↗
FA-24551

Incremental client response projection: Cancel freezes visible text · case 01

Cancel freezes visible text.

Client state● Open access↗
FA-24552

Incremental client response projection: Cancel freezes visible text · case 02

Cancel freezes visible text.

Client state◈ Members↗
FA-24553

Incremental client response projection: Cancel freezes visible text · case 03

Cancel freezes visible text.

Client state◈ Members↗
FA-24554

Incremental client response projection: Cancel freezes visible text · case 04

Cancel freezes visible text.

Client state◈ Members↗
FA-24555

Incremental client response projection: Cancel freezes visible text · case 05

Cancel freezes visible text.

Client state◈ Members↗
FA-24556

Incremental client response projection: Finished but buffered state · case 01

Finished but buffered state.

Client state● Open access↗
FA-24557

Incremental client response projection: Finished but buffered state · case 02

Finished but buffered state.

Client state◈ Members↗
FA-24558

Incremental client response projection: Finished but buffered state · case 03

Finished but buffered state.

Client state◈ Members↗
FA-24559

Incremental client response projection: Finished but buffered state · case 04

Finished but buffered state.

Client state◈ Members↗
FA-24560

Incremental client response projection: Finished but buffered state · case 05

Finished but buffered state.

Client state◈ Members↗
FA-24561

Incremental client response projection: Empty chunk consumes position · case 01

Empty chunk consumes position.

Client state● Open access↗
FA-24562

Incremental client response projection: Empty chunk consumes position · case 02

Empty chunk consumes position.

Client state◈ Members↗
FA-24563

Incremental client response projection: Empty chunk consumes position · case 03

Empty chunk consumes position.

Client state◈ Members↗
FA-24564

Incremental client response projection: Empty chunk consumes position · case 04

Empty chunk consumes position.

Client state◈ Members↗
FA-24565

Incremental client response projection: Empty chunk consumes position · case 05

Empty chunk consumes position.

Client state◈ Members↗
FA-24566

Incremental client response projection: Unconsumed tail after frame · case 01

Unconsumed tail after frame.

Client state● Open access↗
FA-24567

Incremental client response projection: Unconsumed tail after frame · case 02

Unconsumed tail after frame.

Client state◈ Members↗
FA-24568

Incremental client response projection: Unconsumed tail after frame · case 03

Unconsumed tail after frame.

Client state◈ Members↗
FA-24569

Incremental client response projection: Unconsumed tail after frame · case 04

Unconsumed tail after frame.

Client state◈ Members↗
FA-24570

Incremental client response projection: Unconsumed tail after frame · case 05

Unconsumed tail after frame.

Client state◈ Members↗
FA-24571

Incremental client response projection: Completion event once drained · case 01

Completion event once drained.

Client state● Open access↗
FA-24572

Incremental client response projection: Completion event once drained · case 02

Completion event once drained.

Client state◈ Members↗
FA-24573

Incremental client response projection: Completion event once drained · case 03

Completion event once drained.

Client state◈ Members↗
FA-24574

Incremental client response projection: Completion event once drained · case 04

Completion event once drained.

Client state◈ Members↗
FA-24575

Incremental client response projection: Completion event once drained · case 05

Completion event once drained.

Client state◈ Members↗
FA-24576

Incremental client response projection: Render frame needed · case 01

Render frame needed.

Client state● Open access↗
FA-24577

Incremental client response projection: Render frame needed · case 02

Render frame needed.

Client state◈ Members↗
FA-24578

Incremental client response projection: Render frame needed · case 03

Render frame needed.

Client state◈ Members↗
FA-24579

Incremental client response projection: Render frame needed · case 04

Render frame needed.

Client state◈ Members↗
FA-24580

Incremental client response projection: Render frame needed · case 05

Render frame needed.

Client state◈ Members↗
FA-24581

Incremental client response projection: Abort discards buffered suffix · case 01

Abort discards buffered suffix.

Client state● Open access↗
FA-24582

Incremental client response projection: Abort discards buffered suffix · case 02

Abort discards buffered suffix.

Client state◈ Members↗
FA-24583

Incremental client response projection: Abort discards buffered suffix · case 03

Abort discards buffered suffix.

Client state◈ Members↗
FA-24584

Incremental client response projection: Abort discards buffered suffix · case 04

Abort discards buffered suffix.

Client state◈ Members↗
FA-24585

Incremental client response projection: Abort discards buffered suffix · case 05

Abort discards buffered suffix.

Client state◈ Members↗
FA-24586

Client worker task handoff: Result matches pending job · case 01

Result matches pending job.

Client state● Open access↗
FA-24587

Client worker task handoff: Result matches pending job · case 02

Result matches pending job.

Client state◈ Members↗
FA-24588

Client worker task handoff: Result matches pending job · case 03

Result matches pending job.

Client state◈ Members↗
FA-24589

Client worker task handoff: Result matches pending job · case 04

Result matches pending job.

Client state◈ Members↗
FA-24590

Client worker task handoff: Result matches pending job · case 05

Result matches pending job.

Client state◈ Members↗
FA-24591

Client worker task handoff: Worker instance result owner · case 01

Worker instance result owner.

Client state● Open access↗
FA-24592

Client worker task handoff: Worker instance result owner · case 02

Worker instance result owner.

Client state◈ Members↗
FA-24593

Client worker task handoff: Worker instance result owner · case 03

Worker instance result owner.

Client state◈ Members↗
FA-24594

Client worker task handoff: Worker instance result owner · case 04

Worker instance result owner.

Client state◈ Members↗
FA-24595

Client worker task handoff: Worker instance result owner · case 05

Worker instance result owner.

Client state◈ Members↗
FA-24596

Client worker task handoff: Result removes exact job · case 01

Result removes exact job.

Client state● Open access↗
FA-24597

Client worker task handoff: Result removes exact job · case 02

Result removes exact job.

Client state◈ Members↗
FA-24598

Client worker task handoff: Result removes exact job · case 03

Result removes exact job.

Client state◈ Members↗
FA-24599

Client worker task handoff: Result removes exact job · case 04

Result removes exact job.

Client state◈ Members↗
FA-24600

Client worker task handoff: Result removes exact job · case 05

Result removes exact job.

Client state◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗