FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-25801

Group drops reject both self targets and descendant targets · case 01

Group drops reject both self targets and descendant targets is violated by the widget projection.

Filter interfaces● Open access↗
FA-25802

Group drops reject both self targets and descendant targets · case 02

Group drops reject both self targets and descendant targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25803

Group drops reject both self targets and descendant targets · case 03

Group drops reject both self targets and descendant targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25804

Group drops reject both self targets and descendant targets · case 04

Group drops reject both self targets and descendant targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25805

Group drops reject both self targets and descendant targets · case 05

Group drops reject both self targets and descendant targets is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25806

A drag must originate from a group containing the criterion · case 01

A drag must originate from a group containing the criterion is violated by the widget projection.

Filter interfaces● Open access↗
FA-25807

A drag must originate from a group containing the criterion · case 02

A drag must originate from a group containing the criterion is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25808

A drag must originate from a group containing the criterion · case 03

A drag must originate from a group containing the criterion is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25809

A drag must originate from a group containing the criterion · case 04

A drag must originate from a group containing the criterion is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25810

A drag must originate from a group containing the criterion · case 05

A drag must originate from a group containing the criterion is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25811

Cross-group duplicate constraints are detected without rejecting self reorder · case 01

Cross-group duplicate constraints are detected without rejecting self reorder is violated by the widget projection.

Filter interfaces● Open access↗
FA-25812

Cross-group duplicate constraints are detected without rejecting self reorder · case 02

Cross-group duplicate constraints are detected without rejecting self reorder is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25813

Cross-group duplicate constraints are detected without rejecting self reorder · case 03

Cross-group duplicate constraints are detected without rejecting self reorder is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25814

Cross-group duplicate constraints are detected without rejecting self reorder · case 04

Cross-group duplicate constraints are detected without rejecting self reorder is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25815

Cross-group duplicate constraints are detected without rejecting self reorder · case 05

Cross-group duplicate constraints are detected without rejecting self reorder is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25816

Reparenting removes the specific dragged criterion from its source · case 01

Reparenting removes the specific dragged criterion from its source is violated by the widget projection.

Filter interfaces● Open access↗
FA-25817

Reparenting removes the specific dragged criterion from its source · case 02

Reparenting removes the specific dragged criterion from its source is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25818

Reparenting removes the specific dragged criterion from its source · case 03

Reparenting removes the specific dragged criterion from its source is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25819

Reparenting removes the specific dragged criterion from its source · case 04

Reparenting removes the specific dragged criterion from its source is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25820

Reparenting removes the specific dragged criterion from its source · case 05

Reparenting removes the specific dragged criterion from its source is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25821

The drop position determines the new group operand order · case 01

The drop position determines the new group operand order is violated by the widget projection.

Filter interfaces● Open access↗
FA-25822

The drop position determines the new group operand order · case 02

The drop position determines the new group operand order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25823

The drop position determines the new group operand order · case 03

The drop position determines the new group operand order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25824

The drop position determines the new group operand order · case 04

The drop position determines the new group operand order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25825

The drop position determines the new group operand order · case 05

The drop position determines the new group operand order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25826

Flattening group wrappers requires matching operators and no negation · case 01

Flattening group wrappers requires matching operators and no negation is violated by the widget projection.

Filter interfaces● Open access↗
FA-25827

Flattening group wrappers requires matching operators and no negation · case 02

Flattening group wrappers requires matching operators and no negation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25828

Flattening group wrappers requires matching operators and no negation · case 03

Flattening group wrappers requires matching operators and no negation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25829

Flattening group wrappers requires matching operators and no negation · case 04

Flattening group wrappers requires matching operators and no negation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25830

Flattening group wrappers requires matching operators and no negation · case 05

Flattening group wrappers requires matching operators and no negation is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25831

Scalar operands keep their envelope even when explicitly null · case 01

Scalar operands keep their envelope even when explicitly null is violated by the widget projection.

Filter interfaces● Open access↗
FA-25832

Scalar operands keep their envelope even when explicitly null · case 02

Scalar operands keep their envelope even when explicitly null is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25833

Scalar operands keep their envelope even when explicitly null · case 03

Scalar operands keep their envelope even when explicitly null is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25834

Scalar operands keep their envelope even when explicitly null · case 04

Scalar operands keep their envelope even when explicitly null is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25835

Scalar operands keep their envelope even when explicitly null · case 05

Scalar operands keep their envelope even when explicitly null is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25836

Set operands use an ordered values array · case 01

Set operands use an ordered values array is violated by the widget projection.

Filter interfaces● Open access↗
FA-25837

Set operands use an ordered values array · case 02

Set operands use an ordered values array is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25838

Set operands use an ordered values array · case 03

Set operands use an ordered values array is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25839

Set operands use an ordered values array · case 04

Set operands use an ordered values array is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25840

Set operands use an ordered values array · case 05

Set operands use an ordered values array is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25841

Range envelopes preserve endpoint roles and open sides · case 01

Range envelopes preserve endpoint roles and open sides is violated by the widget projection.

Filter interfaces● Open access↗
FA-25842

Range envelopes preserve endpoint roles and open sides · case 02

Range envelopes preserve endpoint roles and open sides is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25843

Range envelopes preserve endpoint roles and open sides · case 03

Range envelopes preserve endpoint roles and open sides is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25844

Range envelopes preserve endpoint roles and open sides · case 04

Range envelopes preserve endpoint roles and open sides is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25845

Range envelopes preserve endpoint roles and open sides · case 05

Range envelopes preserve endpoint roles and open sides is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25846

Unary constraints omit operand keys instead of leaking prior values · case 01

Unary constraints omit operand keys instead of leaking prior values is violated by the widget projection.

Filter interfaces● Open access↗
FA-25847

Unary constraints omit operand keys instead of leaking prior values · case 02

Unary constraints omit operand keys instead of leaking prior values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25848

Unary constraints omit operand keys instead of leaking prior values · case 03

Unary constraints omit operand keys instead of leaking prior values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25849

Unary constraints omit operand keys instead of leaking prior values · case 04

Unary constraints omit operand keys instead of leaking prior values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25850

Unary constraints omit operand keys instead of leaking prior values · case 05

Unary constraints omit operand keys instead of leaking prior values is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25851

Wire operators retain exact schema identifiers · case 01

Wire operators retain exact schema identifiers is violated by the widget projection.

Filter interfaces● Open access↗
FA-25852

Wire operators retain exact schema identifiers · case 02

Wire operators retain exact schema identifiers is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25853

Wire operators retain exact schema identifiers · case 03

Wire operators retain exact schema identifiers is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25854

Wire operators retain exact schema identifiers · case 04

Wire operators retain exact schema identifiers is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25855

Wire operators retain exact schema identifiers · case 05

Wire operators retain exact schema identifiers is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25856

Nested field paths serialize as segments without flattening literal dots · case 01

Nested field paths serialize as segments without flattening literal dots is violated by the widget projection.

Filter interfaces● Open access↗
FA-25857

Nested field paths serialize as segments without flattening literal dots · case 02

Nested field paths serialize as segments without flattening literal dots is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25858

Nested field paths serialize as segments without flattening literal dots · case 03

Nested field paths serialize as segments without flattening literal dots is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25859

Nested field paths serialize as segments without flattening literal dots · case 04

Nested field paths serialize as segments without flattening literal dots is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25860

Nested field paths serialize as segments without flattening literal dots · case 05

Nested field paths serialize as segments without flattening literal dots is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25861

Lower-bound crossing is clamped only under range lock · case 01

Lower-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces● Open access↗
FA-25862

Lower-bound crossing is clamped only under range lock · case 02

Lower-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25863

Lower-bound crossing is clamped only under range lock · case 03

Lower-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25864

Lower-bound crossing is clamped only under range lock · case 04

Lower-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25865

Lower-bound crossing is clamped only under range lock · case 05

Lower-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25866

Upper-bound crossing is clamped only under range lock · case 01

Upper-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces● Open access↗
FA-25867

Upper-bound crossing is clamped only under range lock · case 02

Upper-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25868

Upper-bound crossing is clamped only under range lock · case 03

Upper-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25869

Upper-bound crossing is clamped only under range lock · case 04

Upper-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25870

Upper-bound crossing is clamped only under range lock · case 05

Upper-bound crossing is clamped only under range lock is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25871

Moving a linked lower bound translates the upper bound by the same delta · case 01

Moving a linked lower bound translates the upper bound by the same delta is violated by the widget projection.

Filter interfaces● Open access↗
FA-25872

Moving a linked lower bound translates the upper bound by the same delta · case 02

Moving a linked lower bound translates the upper bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25873

Moving a linked lower bound translates the upper bound by the same delta · case 03

Moving a linked lower bound translates the upper bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25874

Moving a linked lower bound translates the upper bound by the same delta · case 04

Moving a linked lower bound translates the upper bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25875

Moving a linked lower bound translates the upper bound by the same delta · case 05

Moving a linked lower bound translates the upper bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25876

Moving a linked upper bound translates the lower bound by the same delta · case 01

Moving a linked upper bound translates the lower bound by the same delta is violated by the widget projection.

Filter interfaces● Open access↗
FA-25877

Moving a linked upper bound translates the lower bound by the same delta · case 02

Moving a linked upper bound translates the lower bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25878

Moving a linked upper bound translates the lower bound by the same delta · case 03

Moving a linked upper bound translates the lower bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25879

Moving a linked upper bound translates the lower bound by the same delta · case 04

Moving a linked upper bound translates the lower bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25880

Moving a linked upper bound translates the lower bound by the same delta · case 05

Moving a linked upper bound translates the lower bound by the same delta is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25881

Width linking requires two finite endpoints including zero · case 01

Width linking requires two finite endpoints including zero is violated by the widget projection.

Filter interfaces● Open access↗
FA-25882

Width linking requires two finite endpoints including zero · case 02

Width linking requires two finite endpoints including zero is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25883

Width linking requires two finite endpoints including zero · case 03

Width linking requires two finite endpoints including zero is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25884

Width linking requires two finite endpoints including zero · case 04

Width linking requires two finite endpoints including zero is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25885

Width linking requires two finite endpoints including zero · case 05

Width linking requires two finite endpoints including zero is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25886

Reversed draft ranges show an error while equal endpoints remain valid · case 01

Reversed draft ranges show an error while equal endpoints remain valid is violated by the widget projection.

Filter interfaces● Open access↗
FA-25887

Reversed draft ranges show an error while equal endpoints remain valid · case 02

Reversed draft ranges show an error while equal endpoints remain valid is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25888

Reversed draft ranges show an error while equal endpoints remain valid · case 03

Reversed draft ranges show an error while equal endpoints remain valid is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25889

Reversed draft ranges show an error while equal endpoints remain valid · case 04

Reversed draft ranges show an error while equal endpoints remain valid is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25890

Reversed draft ranges show an error while equal endpoints remain valid · case 05

Reversed draft ranges show an error while equal endpoints remain valid is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25891

Missing lower option identities do not silently become the first option · case 01

Missing lower option identities do not silently become the first option is violated by the widget projection.

Filter interfaces● Open access↗
FA-25892

Missing lower option identities do not silently become the first option · case 02

Missing lower option identities do not silently become the first option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25893

Missing lower option identities do not silently become the first option · case 03

Missing lower option identities do not silently become the first option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25894

Missing lower option identities do not silently become the first option · case 04

Missing lower option identities do not silently become the first option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25895

Missing lower option identities do not silently become the first option · case 05

Missing lower option identities do not silently become the first option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25896

Missing upper identities do not silently become the final option · case 01

Missing upper identities do not silently become the final option is violated by the widget projection.

Filter interfaces● Open access↗
FA-25897

Missing upper identities do not silently become the final option · case 02

Missing upper identities do not silently become the final option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25898

Missing upper identities do not silently become the final option · case 03

Missing upper identities do not silently become the final option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25899

Missing upper identities do not silently become the final option · case 04

Missing upper identities do not silently become the final option is violated by the widget projection.

Filter interfaces◈ Members↗
FA-25900

Missing upper identities do not silently become the final option · case 05

Missing upper identities do not silently become the final option is violated by the widget projection.

Filter interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗