FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-35701

Tab label disambiguation: duplicate suffix · case 01

The tab workspace reports an incorrect duplicate suffix.

Tab interfaces● Open access↗
FA-35702

Tab label disambiguation: duplicate suffix · case 02

The tab workspace reports an incorrect duplicate suffix.

Tab interfaces◈ Members↗
FA-35703

Tab label disambiguation: duplicate suffix · case 03

The tab workspace reports an incorrect duplicate suffix.

Tab interfaces◈ Members↗
FA-35704

Tab label disambiguation: duplicate suffix · case 04

The tab workspace reports an incorrect duplicate suffix.

Tab interfaces◈ Members↗
FA-35705

Tab label disambiguation: duplicate suffix · case 05

The tab workspace reports an incorrect duplicate suffix.

Tab interfaces◈ Members↗
FA-35706

Tab label disambiguation: dirty marker · case 01

The tab workspace reports an incorrect dirty marker.

Tab interfaces● Open access↗
FA-35707

Tab label disambiguation: dirty marker · case 02

The tab workspace reports an incorrect dirty marker.

Tab interfaces◈ Members↗
FA-35708

Tab label disambiguation: dirty marker · case 03

The tab workspace reports an incorrect dirty marker.

Tab interfaces◈ Members↗
FA-35709

Tab label disambiguation: dirty marker · case 04

The tab workspace reports an incorrect dirty marker.

Tab interfaces◈ Members↗
FA-35710

Tab label disambiguation: dirty marker · case 05

The tab workspace reports an incorrect dirty marker.

Tab interfaces◈ Members↗
FA-35711

Tab label disambiguation: pinned marker · case 01

The tab workspace reports an incorrect pinned marker.

Tab interfaces● Open access↗
FA-35712

Tab label disambiguation: pinned marker · case 02

The tab workspace reports an incorrect pinned marker.

Tab interfaces◈ Members↗
FA-35713

Tab label disambiguation: pinned marker · case 03

The tab workspace reports an incorrect pinned marker.

Tab interfaces◈ Members↗
FA-35714

Tab label disambiguation: pinned marker · case 04

The tab workspace reports an incorrect pinned marker.

Tab interfaces◈ Members↗
FA-35715

Tab label disambiguation: pinned marker · case 05

The tab workspace reports an incorrect pinned marker.

Tab interfaces◈ Members↗
FA-35716

Tab label disambiguation: full path tooltip · case 01

The tab workspace reports an incorrect full path tooltip.

Tab interfaces● Open access↗
FA-35717

Tab label disambiguation: full path tooltip · case 02

The tab workspace reports an incorrect full path tooltip.

Tab interfaces◈ Members↗
FA-35718

Tab label disambiguation: full path tooltip · case 03

The tab workspace reports an incorrect full path tooltip.

Tab interfaces◈ Members↗
FA-35719

Tab label disambiguation: full path tooltip · case 04

The tab workspace reports an incorrect full path tooltip.

Tab interfaces◈ Members↗
FA-35720

Tab label disambiguation: full path tooltip · case 05

The tab workspace reports an incorrect full path tooltip.

Tab interfaces◈ Members↗
FA-35721

Tab label disambiguation: ellipsis budget · case 01

The tab workspace reports an incorrect ellipsis budget.

Tab interfaces● Open access↗
FA-35722

Tab label disambiguation: ellipsis budget · case 02

The tab workspace reports an incorrect ellipsis budget.

Tab interfaces◈ Members↗
FA-35723

Tab label disambiguation: ellipsis budget · case 03

The tab workspace reports an incorrect ellipsis budget.

Tab interfaces◈ Members↗
FA-35724

Tab label disambiguation: ellipsis budget · case 04

The tab workspace reports an incorrect ellipsis budget.

Tab interfaces◈ Members↗
FA-35725

Tab label disambiguation: ellipsis budget · case 05

The tab workspace reports an incorrect ellipsis budget.

Tab interfaces◈ Members↗
FA-35726

Tab label disambiguation: searchable label · case 01

The tab workspace reports an incorrect searchable label.

Tab interfaces● Open access↗
FA-35727

Tab label disambiguation: searchable label · case 02

The tab workspace reports an incorrect searchable label.

Tab interfaces◈ Members↗
FA-35728

Tab label disambiguation: searchable label · case 03

The tab workspace reports an incorrect searchable label.

Tab interfaces◈ Members↗
FA-35729

Tab label disambiguation: searchable label · case 04

The tab workspace reports an incorrect searchable label.

Tab interfaces◈ Members↗
FA-35730

Tab label disambiguation: searchable label · case 05

The tab workspace reports an incorrect searchable label.

Tab interfaces◈ Members↗
FA-35731

Tab width budget: control reservation · case 01

The tab workspace reports an incorrect control reservation.

Tab interfaces● Open access↗
FA-35732

Tab width budget: control reservation · case 02

The tab workspace reports an incorrect control reservation.

Tab interfaces◈ Members↗
FA-35733

Tab width budget: control reservation · case 03

The tab workspace reports an incorrect control reservation.

Tab interfaces◈ Members↗
FA-35734

Tab width budget: control reservation · case 04

The tab workspace reports an incorrect control reservation.

Tab interfaces◈ Members↗
FA-35735

Tab width budget: control reservation · case 05

The tab workspace reports an incorrect control reservation.

Tab interfaces◈ Members↗
FA-35736

Tab width budget: pinned footprint · case 01

The tab workspace reports an incorrect pinned footprint.

Tab interfaces● Open access↗
FA-35737

Tab width budget: pinned footprint · case 02

The tab workspace reports an incorrect pinned footprint.

Tab interfaces◈ Members↗
FA-35738

Tab width budget: pinned footprint · case 03

The tab workspace reports an incorrect pinned footprint.

Tab interfaces◈ Members↗
FA-35739

Tab width budget: pinned footprint · case 04

The tab workspace reports an incorrect pinned footprint.

Tab interfaces◈ Members↗
FA-35740

Tab width budget: pinned footprint · case 05

The tab workspace reports an incorrect pinned footprint.

Tab interfaces◈ Members↗
FA-35741

Tab width budget: normal share · case 01

The tab workspace reports an incorrect normal share.

Tab interfaces● Open access↗
FA-35742

Tab width budget: normal share · case 02

The tab workspace reports an incorrect normal share.

Tab interfaces◈ Members↗
FA-35743

Tab width budget: normal share · case 03

The tab workspace reports an incorrect normal share.

Tab interfaces◈ Members↗
FA-35744

Tab width budget: normal share · case 04

The tab workspace reports an incorrect normal share.

Tab interfaces◈ Members↗
FA-35745

Tab width budget: normal share · case 05

The tab workspace reports an incorrect normal share.

Tab interfaces◈ Members↗
FA-35746

Tab width budget: clamped tab width · case 01

The tab workspace reports an incorrect clamped tab width.

Tab interfaces● Open access↗
FA-35747

Tab width budget: clamped tab width · case 02

The tab workspace reports an incorrect clamped tab width.

Tab interfaces◈ Members↗
FA-35748

Tab width budget: clamped tab width · case 03

The tab workspace reports an incorrect clamped tab width.

Tab interfaces◈ Members↗
FA-35749

Tab width budget: clamped tab width · case 04

The tab workspace reports an incorrect clamped tab width.

Tab interfaces◈ Members↗
FA-35750

Tab width budget: clamped tab width · case 05

The tab workspace reports an incorrect clamped tab width.

Tab interfaces◈ Members↗
FA-35751

Tab width budget: minimum overflow · case 01

The tab workspace reports an incorrect minimum overflow.

Tab interfaces● Open access↗
FA-35752

Tab width budget: minimum overflow · case 02

The tab workspace reports an incorrect minimum overflow.

Tab interfaces◈ Members↗
FA-35753

Tab width budget: minimum overflow · case 03

The tab workspace reports an incorrect minimum overflow.

Tab interfaces◈ Members↗
FA-35754

Tab width budget: minimum overflow · case 04

The tab workspace reports an incorrect minimum overflow.

Tab interfaces◈ Members↗
FA-35755

Tab width budget: minimum overflow · case 05

The tab workspace reports an incorrect minimum overflow.

Tab interfaces◈ Members↗
FA-35756

Tab width budget: unused spacer · case 01

The tab workspace reports an incorrect unused spacer.

Tab interfaces● Open access↗
FA-35757

Tab width budget: unused spacer · case 02

The tab workspace reports an incorrect unused spacer.

Tab interfaces◈ Members↗
FA-35758

Tab width budget: unused spacer · case 03

The tab workspace reports an incorrect unused spacer.

Tab interfaces◈ Members↗
FA-35759

Tab width budget: unused spacer · case 04

The tab workspace reports an incorrect unused spacer.

Tab interfaces◈ Members↗
FA-35760

Tab width budget: unused spacer · case 05

The tab workspace reports an incorrect unused spacer.

Tab interfaces◈ Members↗
FA-35761

Overflow menu map: hidden order · case 01

The tab workspace reports an incorrect hidden order.

Tab interfaces● Open access↗
FA-35762

Overflow menu map: hidden order · case 02

The tab workspace reports an incorrect hidden order.

Tab interfaces◈ Members↗
FA-35763

Overflow menu map: hidden order · case 03

The tab workspace reports an incorrect hidden order.

Tab interfaces◈ Members↗
FA-35764

Overflow menu map: hidden order · case 04

The tab workspace reports an incorrect hidden order.

Tab interfaces◈ Members↗
FA-35765

Overflow menu map: hidden order · case 05

The tab workspace reports an incorrect hidden order.

Tab interfaces◈ Members↗
FA-35766

Overflow menu map: menu row identity binding · case 01

The tab workspace reports an incorrect menu row identity binding.

Tab interfaces● Open access↗
FA-35767

Overflow menu map: menu row identity binding · case 02

The tab workspace reports an incorrect menu row identity binding.

Tab interfaces◈ Members↗
FA-35768

Overflow menu map: menu row identity binding · case 03

The tab workspace reports an incorrect menu row identity binding.

Tab interfaces◈ Members↗
FA-35769

Overflow menu map: menu row identity binding · case 04

The tab workspace reports an incorrect menu row identity binding.

Tab interfaces◈ Members↗
FA-35770

Overflow menu map: menu row identity binding · case 05

The tab workspace reports an incorrect menu row identity binding.

Tab interfaces◈ Members↗
FA-35771

Overflow menu map: active overflow badge · case 01

The tab workspace reports an incorrect active overflow badge.

Tab interfaces● Open access↗
FA-35772

Overflow menu map: active overflow badge · case 02

The tab workspace reports an incorrect active overflow badge.

Tab interfaces◈ Members↗
FA-35773

Overflow menu map: active overflow badge · case 03

The tab workspace reports an incorrect active overflow badge.

Tab interfaces◈ Members↗
FA-35774

Overflow menu map: active overflow badge · case 04

The tab workspace reports an incorrect active overflow badge.

Tab interfaces◈ Members↗
FA-35775

Overflow menu map: active overflow badge · case 05

The tab workspace reports an incorrect active overflow badge.

Tab interfaces◈ Members↗
FA-35776

Overflow menu map: dirty overflow badges · case 01

The tab workspace reports an incorrect dirty overflow badges.

Tab interfaces● Open access↗
FA-35777

Overflow menu map: dirty overflow badges · case 02

The tab workspace reports an incorrect dirty overflow badges.

Tab interfaces◈ Members↗
FA-35778

Overflow menu map: dirty overflow badges · case 03

The tab workspace reports an incorrect dirty overflow badges.

Tab interfaces◈ Members↗
FA-35779

Overflow menu map: dirty overflow badges · case 04

The tab workspace reports an incorrect dirty overflow badges.

Tab interfaces◈ Members↗
FA-35780

Overflow menu map: dirty overflow badges · case 05

The tab workspace reports an incorrect dirty overflow badges.

Tab interfaces◈ Members↗
FA-35781

Overflow menu map: original strip indices · case 01

The tab workspace reports an incorrect original strip indices.

Tab interfaces● Open access↗
FA-35782

Overflow menu map: original strip indices · case 02

The tab workspace reports an incorrect original strip indices.

Tab interfaces◈ Members↗
FA-35783

Overflow menu map: original strip indices · case 03

The tab workspace reports an incorrect original strip indices.

Tab interfaces◈ Members↗
FA-35784

Overflow menu map: original strip indices · case 04

The tab workspace reports an incorrect original strip indices.

Tab interfaces◈ Members↗
FA-35785

Overflow menu map: original strip indices · case 05

The tab workspace reports an incorrect original strip indices.

Tab interfaces◈ Members↗
FA-35786

Overflow menu map: duplicate label retention · case 01

The tab workspace reports an incorrect duplicate label retention.

Tab interfaces● Open access↗
FA-35787

Overflow menu map: duplicate label retention · case 02

The tab workspace reports an incorrect duplicate label retention.

Tab interfaces◈ Members↗
FA-35788

Overflow menu map: duplicate label retention · case 03

The tab workspace reports an incorrect duplicate label retention.

Tab interfaces◈ Members↗
FA-35789

Overflow menu map: duplicate label retention · case 04

The tab workspace reports an incorrect duplicate label retention.

Tab interfaces◈ Members↗
FA-35790

Overflow menu map: duplicate label retention · case 05

The tab workspace reports an incorrect duplicate label retention.

Tab interfaces◈ Members↗
FA-35791

Close others command: target protection · case 01

The tab workspace reports an incorrect target protection.

Tab interfaces● Open access↗
FA-35792

Close others command: target protection · case 02

The tab workspace reports an incorrect target protection.

Tab interfaces◈ Members↗
FA-35793

Close others command: target protection · case 03

The tab workspace reports an incorrect target protection.

Tab interfaces◈ Members↗
FA-35794

Close others command: target protection · case 04

The tab workspace reports an incorrect target protection.

Tab interfaces◈ Members↗
FA-35795

Close others command: target protection · case 05

The tab workspace reports an incorrect target protection.

Tab interfaces◈ Members↗
FA-35796

Close others command: pinned victim protection · case 01

The tab workspace reports an incorrect pinned victim protection.

Tab interfaces● Open access↗
FA-35797

Close others command: pinned victim protection · case 02

The tab workspace reports an incorrect pinned victim protection.

Tab interfaces◈ Members↗
FA-35798

Close others command: pinned victim protection · case 03

The tab workspace reports an incorrect pinned victim protection.

Tab interfaces◈ Members↗
FA-35799

Close others command: pinned victim protection · case 04

The tab workspace reports an incorrect pinned victim protection.

Tab interfaces◈ Members↗
FA-35800

Close others command: pinned victim protection · case 05

The tab workspace reports an incorrect pinned victim protection.

Tab interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗