FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-35601

Strip reveal: scroll limit · case 01

The tab workspace reports an incorrect scroll limit.

Tab interfaces● Open access↗
FA-35602

Strip reveal: scroll limit · case 02

The tab workspace reports an incorrect scroll limit.

Tab interfaces◈ Members↗
FA-35603

Strip reveal: scroll limit · case 03

The tab workspace reports an incorrect scroll limit.

Tab interfaces◈ Members↗
FA-35604

Strip reveal: scroll limit · case 04

The tab workspace reports an incorrect scroll limit.

Tab interfaces◈ Members↗
FA-35605

Strip reveal: scroll limit · case 05

The tab workspace reports an incorrect scroll limit.

Tab interfaces◈ Members↗
FA-35606

Strip reveal: reveal offset · case 01

The tab workspace reports an incorrect reveal offset.

Tab interfaces● Open access↗
FA-35607

Strip reveal: reveal offset · case 02

The tab workspace reports an incorrect reveal offset.

Tab interfaces◈ Members↗
FA-35608

Strip reveal: reveal offset · case 03

The tab workspace reports an incorrect reveal offset.

Tab interfaces◈ Members↗
FA-35609

Strip reveal: reveal offset · case 04

The tab workspace reports an incorrect reveal offset.

Tab interfaces◈ Members↗
FA-35610

Strip reveal: reveal offset · case 05

The tab workspace reports an incorrect reveal offset.

Tab interfaces◈ Members↗
FA-35611

Recently closed stack: restore entry · case 01

The tab workspace reports an incorrect restore entry.

Tab interfaces● Open access↗
FA-35612

Recently closed stack: restore entry · case 02

The tab workspace reports an incorrect restore entry.

Tab interfaces◈ Members↗
FA-35613

Recently closed stack: restore entry · case 03

The tab workspace reports an incorrect restore entry.

Tab interfaces◈ Members↗
FA-35614

Recently closed stack: restore entry · case 04

The tab workspace reports an incorrect restore entry.

Tab interfaces◈ Members↗
FA-35615

Recently closed stack: restore entry · case 05

The tab workspace reports an incorrect restore entry.

Tab interfaces◈ Members↗
FA-35616

Recently closed stack: restore group · case 01

The tab workspace reports an incorrect restore group.

Tab interfaces● Open access↗
FA-35617

Recently closed stack: restore group · case 02

The tab workspace reports an incorrect restore group.

Tab interfaces◈ Members↗
FA-35618

Recently closed stack: restore group · case 03

The tab workspace reports an incorrect restore group.

Tab interfaces◈ Members↗
FA-35619

Recently closed stack: restore group · case 04

The tab workspace reports an incorrect restore group.

Tab interfaces◈ Members↗
FA-35620

Recently closed stack: restore group · case 05

The tab workspace reports an incorrect restore group.

Tab interfaces◈ Members↗
FA-35621

Recently closed stack: restore position · case 01

The tab workspace reports an incorrect restore position.

Tab interfaces● Open access↗
FA-35622

Recently closed stack: restore position · case 02

The tab workspace reports an incorrect restore position.

Tab interfaces◈ Members↗
FA-35623

Recently closed stack: restore position · case 03

The tab workspace reports an incorrect restore position.

Tab interfaces◈ Members↗
FA-35624

Recently closed stack: restore position · case 04

The tab workspace reports an incorrect restore position.

Tab interfaces◈ Members↗
FA-35625

Recently closed stack: restore position · case 05

The tab workspace reports an incorrect restore position.

Tab interfaces◈ Members↗
FA-35626

Recently closed stack: restore viewport · case 01

The tab workspace reports an incorrect restore viewport.

Tab interfaces● Open access↗
FA-35627

Recently closed stack: restore viewport · case 02

The tab workspace reports an incorrect restore viewport.

Tab interfaces◈ Members↗
FA-35628

Recently closed stack: restore viewport · case 03

The tab workspace reports an incorrect restore viewport.

Tab interfaces◈ Members↗
FA-35629

Recently closed stack: restore viewport · case 04

The tab workspace reports an incorrect restore viewport.

Tab interfaces◈ Members↗
FA-35630

Recently closed stack: restore viewport · case 05

The tab workspace reports an incorrect restore viewport.

Tab interfaces◈ Members↗
FA-35631

Recently closed stack: tombstone filter · case 01

The tab workspace reports an incorrect tombstone filter.

Tab interfaces● Open access↗
FA-35632

Recently closed stack: tombstone filter · case 02

The tab workspace reports an incorrect tombstone filter.

Tab interfaces◈ Members↗
FA-35633

Recently closed stack: tombstone filter · case 03

The tab workspace reports an incorrect tombstone filter.

Tab interfaces◈ Members↗
FA-35634

Recently closed stack: tombstone filter · case 04

The tab workspace reports an incorrect tombstone filter.

Tab interfaces◈ Members↗
FA-35635

Recently closed stack: tombstone filter · case 05

The tab workspace reports an incorrect tombstone filter.

Tab interfaces◈ Members↗
FA-35636

Recently closed stack: remaining undo stack · case 01

The tab workspace reports an incorrect remaining undo stack.

Tab interfaces● Open access↗
FA-35637

Recently closed stack: remaining undo stack · case 02

The tab workspace reports an incorrect remaining undo stack.

Tab interfaces◈ Members↗
FA-35638

Recently closed stack: remaining undo stack · case 03

The tab workspace reports an incorrect remaining undo stack.

Tab interfaces◈ Members↗
FA-35639

Recently closed stack: remaining undo stack · case 04

The tab workspace reports an incorrect remaining undo stack.

Tab interfaces◈ Members↗
FA-35640

Recently closed stack: remaining undo stack · case 05

The tab workspace reports an incorrect remaining undo stack.

Tab interfaces◈ Members↗
FA-35641

Session persistence: durable only · case 01

The tab workspace reports an incorrect durable only.

Tab interfaces● Open access↗
FA-35642

Session persistence: durable only · case 02

The tab workspace reports an incorrect durable only.

Tab interfaces◈ Members↗
FA-35643

Session persistence: durable only · case 03

The tab workspace reports an incorrect durable only.

Tab interfaces◈ Members↗
FA-35644

Session persistence: durable only · case 04

The tab workspace reports an incorrect durable only.

Tab interfaces◈ Members↗
FA-35645

Session persistence: durable only · case 05

The tab workspace reports an incorrect durable only.

Tab interfaces◈ Members↗
FA-35646

Session persistence: private redaction · case 01

The tab workspace reports an incorrect private redaction.

Tab interfaces● Open access↗
FA-35647

Session persistence: private redaction · case 02

The tab workspace reports an incorrect private redaction.

Tab interfaces◈ Members↗
FA-35648

Session persistence: private redaction · case 03

The tab workspace reports an incorrect private redaction.

Tab interfaces◈ Members↗
FA-35649

Session persistence: private redaction · case 04

The tab workspace reports an incorrect private redaction.

Tab interfaces◈ Members↗
FA-35650

Session persistence: private redaction · case 05

The tab workspace reports an incorrect private redaction.

Tab interfaces◈ Members↗
FA-35651

Session persistence: serialized order · case 01

The tab workspace reports an incorrect serialized order.

Tab interfaces● Open access↗
FA-35652

Session persistence: serialized order · case 02

The tab workspace reports an incorrect serialized order.

Tab interfaces◈ Members↗
FA-35653

Session persistence: serialized order · case 03

The tab workspace reports an incorrect serialized order.

Tab interfaces◈ Members↗
FA-35654

Session persistence: serialized order · case 04

The tab workspace reports an incorrect serialized order.

Tab interfaces◈ Members↗
FA-35655

Session persistence: serialized order · case 05

The tab workspace reports an incorrect serialized order.

Tab interfaces◈ Members↗
FA-35656

Session persistence: pin references · case 01

The tab workspace reports an incorrect pin references.

Tab interfaces● Open access↗
FA-35657

Session persistence: pin references · case 02

The tab workspace reports an incorrect pin references.

Tab interfaces◈ Members↗
FA-35658

Session persistence: pin references · case 03

The tab workspace reports an incorrect pin references.

Tab interfaces◈ Members↗
FA-35659

Session persistence: pin references · case 04

The tab workspace reports an incorrect pin references.

Tab interfaces◈ Members↗
FA-35660

Session persistence: pin references · case 05

The tab workspace reports an incorrect pin references.

Tab interfaces◈ Members↗
FA-35661

Session persistence: persisted selection · case 01

The tab workspace reports an incorrect persisted selection.

Tab interfaces● Open access↗
FA-35662

Session persistence: persisted selection · case 02

The tab workspace reports an incorrect persisted selection.

Tab interfaces◈ Members↗
FA-35663

Session persistence: persisted selection · case 03

The tab workspace reports an incorrect persisted selection.

Tab interfaces◈ Members↗
FA-35664

Session persistence: persisted selection · case 04

The tab workspace reports an incorrect persisted selection.

Tab interfaces◈ Members↗
FA-35665

Session persistence: persisted selection · case 05

The tab workspace reports an incorrect persisted selection.

Tab interfaces◈ Members↗
FA-35666

Session persistence: viewport redaction · case 01

The tab workspace reports an incorrect viewport redaction.

Tab interfaces● Open access↗
FA-35667

Session persistence: viewport redaction · case 02

The tab workspace reports an incorrect viewport redaction.

Tab interfaces◈ Members↗
FA-35668

Session persistence: viewport redaction · case 03

The tab workspace reports an incorrect viewport redaction.

Tab interfaces◈ Members↗
FA-35669

Session persistence: viewport redaction · case 04

The tab workspace reports an incorrect viewport redaction.

Tab interfaces◈ Members↗
FA-35670

Session persistence: viewport redaction · case 05

The tab workspace reports an incorrect viewport redaction.

Tab interfaces◈ Members↗
FA-35671

Restore conflicts: restore new documents · case 01

The tab workspace reports an incorrect restore new documents.

Tab interfaces● Open access↗
FA-35672

Restore conflicts: restore new documents · case 02

The tab workspace reports an incorrect restore new documents.

Tab interfaces◈ Members↗
FA-35673

Restore conflicts: restore new documents · case 03

The tab workspace reports an incorrect restore new documents.

Tab interfaces◈ Members↗
FA-35674

Restore conflicts: restore new documents · case 04

The tab workspace reports an incorrect restore new documents.

Tab interfaces◈ Members↗
FA-35675

Restore conflicts: restore new documents · case 05

The tab workspace reports an incorrect restore new documents.

Tab interfaces◈ Members↗
FA-35676

Restore conflicts: current order preserved · case 01

The tab workspace reports an incorrect current order preserved.

Tab interfaces● Open access↗
FA-35677

Restore conflicts: current order preserved · case 02

The tab workspace reports an incorrect current order preserved.

Tab interfaces◈ Members↗
FA-35678

Restore conflicts: current order preserved · case 03

The tab workspace reports an incorrect current order preserved.

Tab interfaces◈ Members↗
FA-35679

Restore conflicts: current order preserved · case 04

The tab workspace reports an incorrect current order preserved.

Tab interfaces◈ Members↗
FA-35680

Restore conflicts: current order preserved · case 05

The tab workspace reports an incorrect current order preserved.

Tab interfaces◈ Members↗
FA-35681

Restore conflicts: missing documents skipped · case 01

The tab workspace reports an incorrect missing documents skipped.

Tab interfaces● Open access↗
FA-35682

Restore conflicts: missing documents skipped · case 02

The tab workspace reports an incorrect missing documents skipped.

Tab interfaces◈ Members↗
FA-35683

Restore conflicts: missing documents skipped · case 03

The tab workspace reports an incorrect missing documents skipped.

Tab interfaces◈ Members↗
FA-35684

Restore conflicts: missing documents skipped · case 04

The tab workspace reports an incorrect missing documents skipped.

Tab interfaces◈ Members↗
FA-35685

Restore conflicts: missing documents skipped · case 05

The tab workspace reports an incorrect missing documents skipped.

Tab interfaces◈ Members↗
FA-35686

Restore conflicts: active session wins · case 01

The tab workspace reports an incorrect active session wins.

Tab interfaces● Open access↗
FA-35687

Restore conflicts: active session wins · case 02

The tab workspace reports an incorrect active session wins.

Tab interfaces◈ Members↗
FA-35688

Restore conflicts: active session wins · case 03

The tab workspace reports an incorrect active session wins.

Tab interfaces◈ Members↗
FA-35689

Restore conflicts: active session wins · case 04

The tab workspace reports an incorrect active session wins.

Tab interfaces◈ Members↗
FA-35690

Restore conflicts: active session wins · case 05

The tab workspace reports an incorrect active session wins.

Tab interfaces◈ Members↗
FA-35691

Restore conflicts: edited document wins · case 01

The tab workspace reports an incorrect edited document wins.

Tab interfaces● Open access↗
FA-35692

Restore conflicts: edited document wins · case 02

The tab workspace reports an incorrect edited document wins.

Tab interfaces◈ Members↗
FA-35693

Restore conflicts: edited document wins · case 03

The tab workspace reports an incorrect edited document wins.

Tab interfaces◈ Members↗
FA-35694

Restore conflicts: edited document wins · case 04

The tab workspace reports an incorrect edited document wins.

Tab interfaces◈ Members↗
FA-35695

Restore conflicts: edited document wins · case 05

The tab workspace reports an incorrect edited document wins.

Tab interfaces◈ Members↗
FA-35696

Restore conflicts: merged order · case 01

The tab workspace reports an incorrect merged order.

Tab interfaces● Open access↗
FA-35697

Restore conflicts: merged order · case 02

The tab workspace reports an incorrect merged order.

Tab interfaces◈ Members↗
FA-35698

Restore conflicts: merged order · case 03

The tab workspace reports an incorrect merged order.

Tab interfaces◈ Members↗
FA-35699

Restore conflicts: merged order · case 04

The tab workspace reports an incorrect merged order.

Tab interfaces◈ Members↗
FA-35700

Restore conflicts: merged order · case 05

The tab workspace reports an incorrect merged order.

Tab interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗