FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-9501

Package source selection: Last source declaration overrides precedence · case 01

Last source declaration overrides precedence.

Dependency resolution● Open access↗
FA-9502

Package source selection: Last source declaration overrides precedence · case 02

Last source declaration overrides precedence.

Dependency resolution◈ Members↗
FA-9503

Package source selection: Last source declaration overrides precedence · case 03

Last source declaration overrides precedence.

Dependency resolution◈ Members↗
FA-9504

Package source selection: Last source declaration overrides precedence · case 04

Last source declaration overrides precedence.

Dependency resolution◈ Members↗
FA-9505

Package source selection: Last source declaration overrides precedence · case 05

Last source declaration overrides precedence.

Dependency resolution◈ Members↗
FA-9506

Feature activation closure: Explicit feature requests are discarded · case 01

Explicit feature requests are discarded.

Dependency resolution● Open access↗
FA-9507

Feature activation closure: Explicit feature requests are discarded · case 02

Explicit feature requests are discarded.

Dependency resolution◈ Members↗
FA-9508

Feature activation closure: Explicit feature requests are discarded · case 03

Explicit feature requests are discarded.

Dependency resolution◈ Members↗
FA-9509

Feature activation closure: Explicit feature requests are discarded · case 04

Explicit feature requests are discarded.

Dependency resolution◈ Members↗
FA-9510

Feature activation closure: Explicit feature requests are discarded · case 05

Explicit feature requests are discarded.

Dependency resolution◈ Members↗
FA-9511

Feature activation closure: Only one implication pass runs · case 01

Only one implication pass runs.

Dependency resolution● Open access↗
FA-9512

Feature activation closure: Only one implication pass runs · case 02

Only one implication pass runs.

Dependency resolution◈ Members↗
FA-9513

Feature activation closure: Only one implication pass runs · case 03

Only one implication pass runs.

Dependency resolution◈ Members↗
FA-9514

Feature activation closure: Only one implication pass runs · case 04

Only one implication pass runs.

Dependency resolution◈ Members↗
FA-9515

Feature activation closure: Only one implication pass runs · case 05

Only one implication pass runs.

Dependency resolution◈ Members↗
FA-9516

Feature activation closure: Inactive features activate their implications · case 01

Inactive features activate their implications.

Dependency resolution● Open access↗
FA-9517

Feature activation closure: Inactive features activate their implications · case 02

Inactive features activate their implications.

Dependency resolution◈ Members↗
FA-9518

Feature activation closure: Inactive features activate their implications · case 03

Inactive features activate their implications.

Dependency resolution◈ Members↗
FA-9519

Feature activation closure: Inactive features activate their implications · case 04

Inactive features activate their implications.

Dependency resolution◈ Members↗
FA-9520

Feature activation closure: Inactive features activate their implications · case 05

Inactive features activate their implications.

Dependency resolution◈ Members↗
FA-9521

Feature activation closure: Disabled feature implications activate dependencies · case 01

Disabled feature implications activate dependencies.

Dependency resolution● Open access↗
FA-9522

Feature activation closure: Disabled feature implications activate dependencies · case 02

Disabled feature implications activate dependencies.

Dependency resolution◈ Members↗
FA-9523

Feature activation closure: Disabled feature implications activate dependencies · case 03

Disabled feature implications activate dependencies.

Dependency resolution◈ Members↗
FA-9524

Feature activation closure: Disabled feature implications activate dependencies · case 04

Disabled feature implications activate dependencies.

Dependency resolution◈ Members↗
FA-9525

Feature activation closure: Disabled feature implications activate dependencies · case 05

Disabled feature implications activate dependencies.

Dependency resolution◈ Members↗
FA-9526

Feature activation closure: Requested leaves are omitted from results · case 01

Requested leaves are omitted from results.

Dependency resolution● Open access↗
FA-9527

Feature activation closure: Requested leaves are omitted from results · case 02

Requested leaves are omitted from results.

Dependency resolution◈ Members↗
FA-9528

Feature activation closure: Requested leaves are omitted from results · case 03

Requested leaves are omitted from results.

Dependency resolution◈ Members↗
FA-9529

Feature activation closure: Requested leaves are omitted from results · case 04

Requested leaves are omitted from results.

Dependency resolution◈ Members↗
FA-9530

Feature activation closure: Requested leaves are omitted from results · case 05

Requested leaves are omitted from results.

Dependency resolution◈ Members↗
FA-9531

Compatible release admission: Explicitly excluded versions remain eligible · case 01

Explicitly excluded versions remain eligible.

Version constraints● Open access↗
FA-9532

Compatible release admission: Explicitly excluded versions remain eligible · case 02

Explicitly excluded versions remain eligible.

Version constraints◈ Members↗
FA-9533

Compatible release admission: Explicitly excluded versions remain eligible · case 03

Explicitly excluded versions remain eligible.

Version constraints◈ Members↗
FA-9534

Compatible release admission: Explicitly excluded versions remain eligible · case 04

Explicitly excluded versions remain eligible.

Version constraints◈ Members↗
FA-9535

Compatible release admission: Explicitly excluded versions remain eligible · case 05

Explicitly excluded versions remain eligible.

Version constraints◈ Members↗
FA-9536

Compatible release admission: Compatible ranges accept versions below their floor · case 01

Compatible ranges accept versions below their floor.

Version constraints● Open access↗
FA-9537

Compatible release admission: Compatible ranges accept versions below their floor · case 02

Compatible ranges accept versions below their floor.

Version constraints◈ Members↗
FA-9538

Compatible release admission: Compatible ranges accept versions below their floor · case 03

Compatible ranges accept versions below their floor.

Version constraints◈ Members↗
FA-9539

Compatible release admission: Compatible ranges accept versions below their floor · case 04

Compatible ranges accept versions below their floor.

Version constraints◈ Members↗
FA-9540

Compatible release admission: Compatible ranges accept versions below their floor · case 05

Compatible ranges accept versions below their floor.

Version constraints◈ Members↗
FA-9541

Compatible release admission: Compatibility extends through the next incompatible release · case 01

Compatibility extends through the next incompatible release.

Version constraints● Open access↗
FA-9542

Compatible release admission: Compatibility extends through the next incompatible release · case 02

Compatibility extends through the next incompatible release.

Version constraints◈ Members↗
FA-9543

Compatible release admission: Compatibility extends through the next incompatible release · case 03

Compatibility extends through the next incompatible release.

Version constraints◈ Members↗
FA-9544

Compatible release admission: Compatibility extends through the next incompatible release · case 04

Compatibility extends through the next incompatible release.

Version constraints◈ Members↗
FA-9545

Compatible release admission: Compatibility extends through the next incompatible release · case 05

Compatibility extends through the next incompatible release.

Version constraints◈ Members↗
FA-9546

Compatible release admission: Prereleases bypass explicit opt-in · case 01

Prereleases bypass explicit opt-in.

Version constraints● Open access↗
FA-9547

Compatible release admission: Prereleases bypass explicit opt-in · case 02

Prereleases bypass explicit opt-in.

Version constraints◈ Members↗
FA-9548

Compatible release admission: Prereleases bypass explicit opt-in · case 03

Prereleases bypass explicit opt-in.

Version constraints◈ Members↗
FA-9549

Compatible release admission: Prereleases bypass explicit opt-in · case 04

Prereleases bypass explicit opt-in.

Version constraints◈ Members↗
FA-9550

Compatible release admission: Prereleases bypass explicit opt-in · case 05

Prereleases bypass explicit opt-in.

Version constraints◈ Members↗
FA-9551

Compatible release admission: An exact pin is treated as advisory · case 01

An exact pin is treated as advisory.

Version constraints● Open access↗
FA-9552

Compatible release admission: An exact pin is treated as advisory · case 02

An exact pin is treated as advisory.

Version constraints◈ Members↗
FA-9553

Compatible release admission: An exact pin is treated as advisory · case 03

An exact pin is treated as advisory.

Version constraints◈ Members↗
FA-9554

Compatible release admission: An exact pin is treated as advisory · case 04

An exact pin is treated as advisory.

Version constraints◈ Members↗
FA-9555

Compatible release admission: An exact pin is treated as advisory · case 05

An exact pin is treated as advisory.

Version constraints◈ Members↗
FA-9556

Installed package reconciliation: Undeclared packages remain installed · case 01

Undeclared packages remain installed.

Dependency resolution● Open access↗
FA-9557

Installed package reconciliation: Undeclared packages remain installed · case 02

Undeclared packages remain installed.

Dependency resolution◈ Members↗
FA-9558

Installed package reconciliation: Undeclared packages remain installed · case 03

Undeclared packages remain installed.

Dependency resolution◈ Members↗
FA-9559

Installed package reconciliation: Undeclared packages remain installed · case 04

Undeclared packages remain installed.

Dependency resolution◈ Members↗
FA-9560

Installed package reconciliation: Undeclared packages remain installed · case 05

Undeclared packages remain installed.

Dependency resolution◈ Members↗
FA-9561

Installed package reconciliation: Missing packages are classified as upgrades · case 01

Missing packages are classified as upgrades.

Dependency resolution● Open access↗
FA-9562

Installed package reconciliation: Missing packages are classified as upgrades · case 02

Missing packages are classified as upgrades.

Dependency resolution◈ Members↗
FA-9563

Installed package reconciliation: Missing packages are classified as upgrades · case 03

Missing packages are classified as upgrades.

Dependency resolution◈ Members↗
FA-9564

Installed package reconciliation: Missing packages are classified as upgrades · case 04

Missing packages are classified as upgrades.

Dependency resolution◈ Members↗
FA-9565

Installed package reconciliation: Missing packages are classified as upgrades · case 05

Missing packages are classified as upgrades.

Dependency resolution◈ Members↗
FA-9566

Installed package reconciliation: Newer requested versions are ignored · case 01

Newer requested versions are ignored.

Dependency resolution● Open access↗
FA-9567

Installed package reconciliation: Newer requested versions are ignored · case 02

Newer requested versions are ignored.

Dependency resolution◈ Members↗
FA-9568

Installed package reconciliation: Newer requested versions are ignored · case 03

Newer requested versions are ignored.

Dependency resolution◈ Members↗
FA-9569

Installed package reconciliation: Newer requested versions are ignored · case 04

Newer requested versions are ignored.

Dependency resolution◈ Members↗
FA-9570

Installed package reconciliation: Newer requested versions are ignored · case 05

Newer requested versions are ignored.

Dependency resolution◈ Members↗
FA-9571

Installed package reconciliation: Pinned older versions are silently retained · case 01

Pinned older versions are silently retained.

Dependency resolution● Open access↗
FA-9572

Installed package reconciliation: Pinned older versions are silently retained · case 02

Pinned older versions are silently retained.

Dependency resolution◈ Members↗
FA-9573

Installed package reconciliation: Pinned older versions are silently retained · case 03

Pinned older versions are silently retained.

Dependency resolution◈ Members↗
FA-9574

Installed package reconciliation: Pinned older versions are silently retained · case 04

Pinned older versions are silently retained.

Dependency resolution◈ Members↗
FA-9575

Installed package reconciliation: Pinned older versions are silently retained · case 05

Pinned older versions are silently retained.

Dependency resolution◈ Members↗
FA-9576

Installed package reconciliation: Content drift at an equal version is ignored · case 01

Content drift at an equal version is ignored.

Dependency resolution● Open access↗
FA-9577

Installed package reconciliation: Content drift at an equal version is ignored · case 02

Content drift at an equal version is ignored.

Dependency resolution◈ Members↗
FA-9578

Installed package reconciliation: Content drift at an equal version is ignored · case 03

Content drift at an equal version is ignored.

Dependency resolution◈ Members↗
FA-9579

Installed package reconciliation: Content drift at an equal version is ignored · case 04

Content drift at an equal version is ignored.

Dependency resolution◈ Members↗
FA-9580

Installed package reconciliation: Content drift at an equal version is ignored · case 05

Content drift at an equal version is ignored.

Dependency resolution◈ Members↗
FA-9581

Explicit configuration overlay: Earlier configuration layers override later ones · case 01

Earlier configuration layers override later ones.

Configuration● Open access↗
FA-9582

Explicit configuration overlay: Earlier configuration layers override later ones · case 02

Earlier configuration layers override later ones.

Configuration◈ Members↗
FA-9583

Explicit configuration overlay: Earlier configuration layers override later ones · case 03

Earlier configuration layers override later ones.

Configuration◈ Members↗
FA-9584

Explicit configuration overlay: Earlier configuration layers override later ones · case 04

Earlier configuration layers override later ones.

Configuration◈ Members↗
FA-9585

Explicit configuration overlay: Earlier configuration layers override later ones · case 05

Earlier configuration layers override later ones.

Configuration◈ Members↗
FA-9586

Explicit configuration overlay: Null values persist as ordinary configuration · case 01

Null values persist as ordinary configuration.

Configuration● Open access↗
FA-9587

Explicit configuration overlay: Null values persist as ordinary configuration · case 02

Null values persist as ordinary configuration.

Configuration◈ Members↗
FA-9588

Explicit configuration overlay: Null values persist as ordinary configuration · case 03

Null values persist as ordinary configuration.

Configuration◈ Members↗
FA-9589

Explicit configuration overlay: Null values persist as ordinary configuration · case 04

Null values persist as ordinary configuration.

Configuration◈ Members↗
FA-9590

Explicit configuration overlay: Null values persist as ordinary configuration · case 05

Null values persist as ordinary configuration.

Configuration◈ Members↗
FA-9591

Explicit configuration overlay: False and zero are confused with deletion · case 01

False and zero are confused with deletion.

Configuration● Open access↗
FA-9592

Explicit configuration overlay: False and zero are confused with deletion · case 02

False and zero are confused with deletion.

Configuration◈ Members↗
FA-9593

Explicit configuration overlay: False and zero are confused with deletion · case 03

False and zero are confused with deletion.

Configuration◈ Members↗
FA-9594

Explicit configuration overlay: False and zero are confused with deletion · case 04

False and zero are confused with deletion.

Configuration◈ Members↗
FA-9595

Explicit configuration overlay: False and zero are confused with deletion · case 05

False and zero are confused with deletion.

Configuration◈ Members↗
FA-9596

Explicit configuration overlay: List overlays accumulate obsolete values · case 01

List overlays accumulate obsolete values.

Configuration● Open access↗
FA-9597

Explicit configuration overlay: List overlays accumulate obsolete values · case 02

List overlays accumulate obsolete values.

Configuration◈ Members↗
FA-9598

Explicit configuration overlay: List overlays accumulate obsolete values · case 03

List overlays accumulate obsolete values.

Configuration◈ Members↗
FA-9599

Explicit configuration overlay: List overlays accumulate obsolete values · case 04

List overlays accumulate obsolete values.

Configuration◈ Members↗
FA-9600

Explicit configuration overlay: List overlays accumulate obsolete values · case 05

List overlays accumulate obsolete values.

Configuration◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗