Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Installed distribution record validation: Unexpected executable files pass validation · case 01
Unexpected executable files pass validation.
Installed distribution record validation: Unexpected executable files pass validation · case 02
Unexpected executable files pass validation.
Installed distribution record validation: Unexpected executable files pass validation · case 03
Unexpected executable files pass validation.
Installed distribution record validation: Unexpected executable files pass validation · case 04
Unexpected executable files pass validation.
Installed distribution record validation: Unexpected executable files pass validation · case 05
Unexpected executable files pass validation.
Entry point registry assembly: Disabled entry points are published · case 01
Disabled entry points are published.
Entry point registry assembly: Disabled entry points are published · case 02
Disabled entry points are published.
Entry point registry assembly: Disabled entry points are published · case 03
Disabled entry points are published.
Entry point registry assembly: Disabled entry points are published · case 04
Disabled entry points are published.
Entry point registry assembly: Disabled entry points are published · case 05
Disabled entry points are published.
Entry point registry assembly: Entry point groups share one namespace · case 01
Entry point groups share one namespace.
Entry point registry assembly: Entry point groups share one namespace · case 02
Entry point groups share one namespace.
Entry point registry assembly: Entry point groups share one namespace · case 03
Entry point groups share one namespace.
Entry point registry assembly: Entry point groups share one namespace · case 04
Entry point groups share one namespace.
Entry point registry assembly: Entry point groups share one namespace · case 05
Entry point groups share one namespace.
Entry point registry assembly: Conflicting entry points silently replace earlier ones · case 01
Conflicting entry points silently replace earlier ones.
Entry point registry assembly: Conflicting entry points silently replace earlier ones · case 02
Conflicting entry points silently replace earlier ones.
Entry point registry assembly: Conflicting entry points silently replace earlier ones · case 03
Conflicting entry points silently replace earlier ones.
Entry point registry assembly: Conflicting entry points silently replace earlier ones · case 04
Conflicting entry points silently replace earlier ones.
Entry point registry assembly: Conflicting entry points silently replace earlier ones · case 05
Conflicting entry points silently replace earlier ones.
Entry point registry assembly: Identical duplicate entry points are rejected · case 01
Identical duplicate entry points are rejected.
Entry point registry assembly: Identical duplicate entry points are rejected · case 02
Identical duplicate entry points are rejected.
Entry point registry assembly: Identical duplicate entry points are rejected · case 03
Identical duplicate entry points are rejected.
Entry point registry assembly: Identical duplicate entry points are rejected · case 04
Identical duplicate entry points are rejected.
Entry point registry assembly: Identical duplicate entry points are rejected · case 05
Identical duplicate entry points are rejected.
Entry point registry assembly: Entry names replace import targets · case 01
Entry names replace import targets.
Entry point registry assembly: Entry names replace import targets · case 02
Entry names replace import targets.
Entry point registry assembly: Entry names replace import targets · case 03
Entry names replace import targets.
Entry point registry assembly: Entry names replace import targets · case 04
Entry names replace import targets.
Entry point registry assembly: Entry names replace import targets · case 05
Entry names replace import targets.
Distribution license policy: Undeclared licenses pass admission · case 01
Undeclared licenses pass admission.
Distribution license policy: Undeclared licenses pass admission · case 02
Undeclared licenses pass admission.
Distribution license policy: Undeclared licenses pass admission · case 03
Undeclared licenses pass admission.
Distribution license policy: Undeclared licenses pass admission · case 04
Undeclared licenses pass admission.
Distribution license policy: Undeclared licenses pass admission · case 05
Undeclared licenses pass admission.
Distribution license policy: One allowed license masks an unsupported requirement · case 01
One allowed license masks an unsupported requirement.
Distribution license policy: One allowed license masks an unsupported requirement · case 02
One allowed license masks an unsupported requirement.
Distribution license policy: One allowed license masks an unsupported requirement · case 03
One allowed license masks an unsupported requirement.
Distribution license policy: One allowed license masks an unsupported requirement · case 04
One allowed license masks an unsupported requirement.
Distribution license policy: One allowed license masks an unsupported requirement · case 05
One allowed license masks an unsupported requirement.
Distribution license policy: Explicit prohibitions are ignored · case 01
Explicit prohibitions are ignored.
Distribution license policy: Explicit prohibitions are ignored · case 02
Explicit prohibitions are ignored.
Distribution license policy: Explicit prohibitions are ignored · case 03
Explicit prohibitions are ignored.
Distribution license policy: Explicit prohibitions are ignored · case 04
Explicit prohibitions are ignored.
Distribution license policy: Explicit prohibitions are ignored · case 05
Explicit prohibitions are ignored.
Distribution license policy: Redistribution opt-out is ignored · case 01
Redistribution opt-out is ignored.
Distribution license policy: Redistribution opt-out is ignored · case 02
Redistribution opt-out is ignored.
Distribution license policy: Redistribution opt-out is ignored · case 03
Redistribution opt-out is ignored.
Distribution license policy: Redistribution opt-out is ignored · case 04
Redistribution opt-out is ignored.
Distribution license policy: Redistribution opt-out is ignored · case 05
Redistribution opt-out is ignored.
Distribution license policy: Required source offers are missing · case 01
Required source offers are missing.
Distribution license policy: Required source offers are missing · case 02
Required source offers are missing.
Distribution license policy: Required source offers are missing · case 03
Required source offers are missing.
Distribution license policy: Required source offers are missing · case 04
Required source offers are missing.
Distribution license policy: Required source offers are missing · case 05
Required source offers are missing.
Reproducible archive metadata: Archive owner IDs depend on the build host · case 01
Archive owner IDs depend on the build host.
Reproducible archive metadata: Archive owner IDs depend on the build host · case 02
Archive owner IDs depend on the build host.
Reproducible archive metadata: Archive owner IDs depend on the build host · case 03
Archive owner IDs depend on the build host.
Reproducible archive metadata: Archive owner IDs depend on the build host · case 04
Archive owner IDs depend on the build host.
Reproducible archive metadata: Archive owner IDs depend on the build host · case 05
Archive owner IDs depend on the build host.
Reproducible archive metadata: Archive group IDs depend on the build host · case 01
Archive group IDs depend on the build host.
Reproducible archive metadata: Archive group IDs depend on the build host · case 02
Archive group IDs depend on the build host.
Reproducible archive metadata: Archive group IDs depend on the build host · case 03
Archive group IDs depend on the build host.
Reproducible archive metadata: Archive group IDs depend on the build host · case 04
Archive group IDs depend on the build host.
Reproducible archive metadata: Archive group IDs depend on the build host · case 05
Archive group IDs depend on the build host.
Reproducible archive metadata: Archive timestamps depend on checkout time · case 01
Archive timestamps depend on checkout time.
Reproducible archive metadata: Archive timestamps depend on checkout time · case 02
Archive timestamps depend on checkout time.
Reproducible archive metadata: Archive timestamps depend on checkout time · case 03
Archive timestamps depend on checkout time.
Reproducible archive metadata: Archive timestamps depend on checkout time · case 04
Archive timestamps depend on checkout time.
Reproducible archive metadata: Archive timestamps depend on checkout time · case 05
Archive timestamps depend on checkout time.
Reproducible archive metadata: Executable files lose their mode bit · case 01
Executable files lose their mode bit.
Reproducible archive metadata: Executable files lose their mode bit · case 02
Executable files lose their mode bit.
Reproducible archive metadata: Executable files lose their mode bit · case 03
Executable files lose their mode bit.
Reproducible archive metadata: Executable files lose their mode bit · case 04
Executable files lose their mode bit.
Reproducible archive metadata: Executable files lose their mode bit · case 05
Executable files lose their mode bit.
Reproducible archive metadata: Archive entry order follows filesystem enumeration · case 01
Archive entry order follows filesystem enumeration.
Reproducible archive metadata: Archive entry order follows filesystem enumeration · case 02
Archive entry order follows filesystem enumeration.
Reproducible archive metadata: Archive entry order follows filesystem enumeration · case 03
Archive entry order follows filesystem enumeration.
Reproducible archive metadata: Archive entry order follows filesystem enumeration · case 04
Archive entry order follows filesystem enumeration.
Reproducible archive metadata: Archive entry order follows filesystem enumeration · case 05
Archive entry order follows filesystem enumeration.
Package publication plan: An unrelated published version blocks a new release · case 01
An unrelated published version blocks a new release.
Package publication plan: An unrelated published version blocks a new release · case 02
An unrelated published version blocks a new release.
Package publication plan: An unrelated published version blocks a new release · case 03
An unrelated published version blocks a new release.
Package publication plan: An unrelated published version blocks a new release · case 04
An unrelated published version blocks a new release.
Package publication plan: An unrelated published version blocks a new release · case 05
An unrelated published version blocks a new release.
Package publication plan: Different package bytes are treated as already published · case 01
Different package bytes are treated as already published.
Package publication plan: Different package bytes are treated as already published · case 02
Different package bytes are treated as already published.
Package publication plan: Different package bytes are treated as already published · case 03
Different package bytes are treated as already published.
Package publication plan: Different package bytes are treated as already published · case 04
Different package bytes are treated as already published.
Package publication plan: Different package bytes are treated as already published · case 05
Different package bytes are treated as already published.
Package publication plan: Immutable versions are overwritten · case 01
Immutable versions are overwritten.
Package publication plan: Immutable versions are overwritten · case 02
Immutable versions are overwritten.
Package publication plan: Immutable versions are overwritten · case 03
Immutable versions are overwritten.
Package publication plan: Immutable versions are overwritten · case 04
Immutable versions are overwritten.
Package publication plan: Immutable versions are overwritten · case 05
Immutable versions are overwritten.
Package publication plan: Unsigned provenance is ignored · case 01
Unsigned provenance is ignored.
Package publication plan: Unsigned provenance is ignored · case 02
Unsigned provenance is ignored.
Package publication plan: Unsigned provenance is ignored · case 03
Unsigned provenance is ignored.
Package publication plan: Unsigned provenance is ignored · case 04
Unsigned provenance is ignored.
Package publication plan: Unsigned provenance is ignored · case 05
Unsigned provenance is ignored.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗