Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Dependency group activation: Dependencies repeated across groups install repeatedly · case 01
Dependencies repeated across groups install repeatedly.
Dependency group activation: Dependencies repeated across groups install repeatedly · case 02
Dependencies repeated across groups install repeatedly.
Dependency group activation: Dependencies repeated across groups install repeatedly · case 03
Dependencies repeated across groups install repeatedly.
Dependency group activation: Dependencies repeated across groups install repeatedly · case 04
Dependencies repeated across groups install repeatedly.
Dependency group activation: Dependencies repeated across groups install repeatedly · case 05
Dependencies repeated across groups install repeatedly.
Layered dependency override resolution: Global overrides win over package-local overrides · case 01
Global overrides win over package-local overrides.
Layered dependency override resolution: Global overrides win over package-local overrides · case 02
Global overrides win over package-local overrides.
Layered dependency override resolution: Global overrides win over package-local overrides · case 03
Global overrides win over package-local overrides.
Layered dependency override resolution: Global overrides win over package-local overrides · case 04
Global overrides win over package-local overrides.
Layered dependency override resolution: Global overrides win over package-local overrides · case 05
Global overrides win over package-local overrides.
Layered dependency override resolution: An unrelated override changes the selected package · case 01
An unrelated override changes the selected package.
Layered dependency override resolution: An unrelated override changes the selected package · case 02
An unrelated override changes the selected package.
Layered dependency override resolution: An unrelated override changes the selected package · case 03
An unrelated override changes the selected package.
Layered dependency override resolution: An unrelated override changes the selected package · case 04
An unrelated override changes the selected package.
Layered dependency override resolution: An unrelated override changes the selected package · case 05
An unrelated override changes the selected package.
Layered dependency override resolution: Deletion replaces the requirement with null · case 01
Deletion replaces the requirement with null.
Layered dependency override resolution: Deletion replaces the requirement with null · case 02
Deletion replaces the requirement with null.
Layered dependency override resolution: Deletion replaces the requirement with null · case 03
Deletion replaces the requirement with null.
Layered dependency override resolution: Deletion replaces the requirement with null · case 04
Deletion replaces the requirement with null.
Layered dependency override resolution: Deletion replaces the requirement with null · case 05
Deletion replaces the requirement with null.
Layered dependency override resolution: Explicit empty overrides are silently ignored · case 01
Explicit empty overrides are silently ignored.
Layered dependency override resolution: Explicit empty overrides are silently ignored · case 02
Explicit empty overrides are silently ignored.
Layered dependency override resolution: Explicit empty overrides are silently ignored · case 03
Explicit empty overrides are silently ignored.
Layered dependency override resolution: Explicit empty overrides are silently ignored · case 04
Explicit empty overrides are silently ignored.
Layered dependency override resolution: Explicit empty overrides are silently ignored · case 05
Explicit empty overrides are silently ignored.
Layered dependency override resolution: Present override values never replace the base · case 01
Present override values never replace the base.
Layered dependency override resolution: Present override values never replace the base · case 02
Present override values never replace the base.
Layered dependency override resolution: Present override values never replace the base · case 03
Present override values never replace the base.
Layered dependency override resolution: Present override values never replace the base · case 04
Present override values never replace the base.
Layered dependency override resolution: Present override values never replace the base · case 05
Present override values never replace the base.
Lockfile consistency report: Unlocked requirements disappear from diagnostics · case 01
Unlocked requirements disappear from diagnostics.
Lockfile consistency report: Unlocked requirements disappear from diagnostics · case 02
Unlocked requirements disappear from diagnostics.
Lockfile consistency report: Unlocked requirements disappear from diagnostics · case 03
Unlocked requirements disappear from diagnostics.
Lockfile consistency report: Unlocked requirements disappear from diagnostics · case 04
Unlocked requirements disappear from diagnostics.
Lockfile consistency report: Unlocked requirements disappear from diagnostics · case 05
Unlocked requirements disappear from diagnostics.
Lockfile consistency report: Unrequested lock entries disappear from diagnostics · case 01
Unrequested lock entries disappear from diagnostics.
Lockfile consistency report: Unrequested lock entries disappear from diagnostics · case 02
Unrequested lock entries disappear from diagnostics.
Lockfile consistency report: Unrequested lock entries disappear from diagnostics · case 03
Unrequested lock entries disappear from diagnostics.
Lockfile consistency report: Unrequested lock entries disappear from diagnostics · case 04
Unrequested lock entries disappear from diagnostics.
Lockfile consistency report: Unrequested lock entries disappear from diagnostics · case 05
Unrequested lock entries disappear from diagnostics.
Lockfile consistency report: Locked version drift is ignored · case 01
Locked version drift is ignored.
Lockfile consistency report: Locked version drift is ignored · case 02
Locked version drift is ignored.
Lockfile consistency report: Locked version drift is ignored · case 03
Locked version drift is ignored.
Lockfile consistency report: Locked version drift is ignored · case 04
Locked version drift is ignored.
Lockfile consistency report: Locked version drift is ignored · case 05
Locked version drift is ignored.
Lockfile consistency report: Changed content at the same version is ignored · case 01
Changed content at the same version is ignored.
Lockfile consistency report: Changed content at the same version is ignored · case 02
Changed content at the same version is ignored.
Lockfile consistency report: Changed content at the same version is ignored · case 03
Changed content at the same version is ignored.
Lockfile consistency report: Changed content at the same version is ignored · case 04
Changed content at the same version is ignored.
Lockfile consistency report: Changed content at the same version is ignored · case 05
Changed content at the same version is ignored.
Lockfile consistency report: A package can silently change origin · case 01
A package can silently change origin.
Lockfile consistency report: A package can silently change origin · case 02
A package can silently change origin.
Lockfile consistency report: A package can silently change origin · case 03
A package can silently change origin.
Lockfile consistency report: A package can silently change origin · case 04
A package can silently change origin.
Lockfile consistency report: A package can silently change origin · case 05
A package can silently change origin.
Peer dependency diagnostics: Missing optional peers become errors · case 01
Missing optional peers become errors.
Peer dependency diagnostics: Missing optional peers become errors · case 02
Missing optional peers become errors.
Peer dependency diagnostics: Missing optional peers become errors · case 03
Missing optional peers become errors.
Peer dependency diagnostics: Missing optional peers become errors · case 04
Missing optional peers become errors.
Peer dependency diagnostics: Missing optional peers become errors · case 05
Missing optional peers become errors.
Peer dependency diagnostics: Missing peers are classified as version failures · case 01
Missing peers are classified as version failures.
Peer dependency diagnostics: Missing peers are classified as version failures · case 02
Missing peers are classified as version failures.
Peer dependency diagnostics: Missing peers are classified as version failures · case 03
Missing peers are classified as version failures.
Peer dependency diagnostics: Missing peers are classified as version failures · case 04
Missing peers are classified as version failures.
Peer dependency diagnostics: Missing peers are classified as version failures · case 05
Missing peers are classified as version failures.
Peer dependency diagnostics: The minimum supported peer version is rejected · case 01
The minimum supported peer version is rejected.
Peer dependency diagnostics: The minimum supported peer version is rejected · case 02
The minimum supported peer version is rejected.
Peer dependency diagnostics: The minimum supported peer version is rejected · case 03
The minimum supported peer version is rejected.
Peer dependency diagnostics: The minimum supported peer version is rejected · case 04
The minimum supported peer version is rejected.
Peer dependency diagnostics: The minimum supported peer version is rejected · case 05
The minimum supported peer version is rejected.
Peer dependency diagnostics: The excluded upper peer version is accepted · case 01
The excluded upper peer version is accepted.
Peer dependency diagnostics: The excluded upper peer version is accepted · case 02
The excluded upper peer version is accepted.
Peer dependency diagnostics: The excluded upper peer version is accepted · case 03
The excluded upper peer version is accepted.
Peer dependency diagnostics: The excluded upper peer version is accepted · case 04
The excluded upper peer version is accepted.
Peer dependency diagnostics: The excluded upper peer version is accepted · case 05
The excluded upper peer version is accepted.
Peer dependency diagnostics: Diagnostics lose the failing package identity · case 01
Diagnostics lose the failing package identity.
Peer dependency diagnostics: Diagnostics lose the failing package identity · case 02
Diagnostics lose the failing package identity.
Peer dependency diagnostics: Diagnostics lose the failing package identity · case 03
Diagnostics lose the failing package identity.
Peer dependency diagnostics: Diagnostics lose the failing package identity · case 04
Diagnostics lose the failing package identity.
Peer dependency diagnostics: Diagnostics lose the failing package identity · case 05
Diagnostics lose the failing package identity.
Package source selection: Disabled indexes can supply packages · case 01
Disabled indexes can supply packages.
Package source selection: Disabled indexes can supply packages · case 02
Disabled indexes can supply packages.
Package source selection: Disabled indexes can supply packages · case 03
Disabled indexes can supply packages.
Package source selection: Disabled indexes can supply packages · case 04
Disabled indexes can supply packages.
Package source selection: Disabled indexes can supply packages · case 05
Disabled indexes can supply packages.
Package source selection: Untrusted indexes can supply packages · case 01
Untrusted indexes can supply packages.
Package source selection: Untrusted indexes can supply packages · case 02
Untrusted indexes can supply packages.
Package source selection: Untrusted indexes can supply packages · case 03
Untrusted indexes can supply packages.
Package source selection: Untrusted indexes can supply packages · case 04
Untrusted indexes can supply packages.
Package source selection: Untrusted indexes can supply packages · case 05
Untrusted indexes can supply packages.
Package source selection: An index missing the package is selected · case 01
An index missing the package is selected.
Package source selection: An index missing the package is selected · case 02
An index missing the package is selected.
Package source selection: An index missing the package is selected · case 03
An index missing the package is selected.
Package source selection: An index missing the package is selected · case 04
An index missing the package is selected.
Package source selection: An index missing the package is selected · case 05
An index missing the package is selected.
Package source selection: A mirror outranks an available primary · case 01
A mirror outranks an available primary.
Package source selection: A mirror outranks an available primary · case 02
A mirror outranks an available primary.
Package source selection: A mirror outranks an available primary · case 03
A mirror outranks an available primary.
Package source selection: A mirror outranks an available primary · case 04
A mirror outranks an available primary.
Package source selection: A mirror outranks an available primary · case 05
A mirror outranks an available primary.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗