Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Access policy decision combination: No-match decisions ignore the supplied default · case 01
No-match decisions ignore the supplied default.
Access policy decision combination: No-match decisions ignore the supplied default · case 02
No-match decisions ignore the supplied default.
Access policy decision combination: No-match decisions ignore the supplied default · case 03
No-match decisions ignore the supplied default.
Access policy decision combination: No-match decisions ignore the supplied default · case 04
No-match decisions ignore the supplied default.
Access policy decision combination: No-match decisions ignore the supplied default · case 05
No-match decisions ignore the supplied default.
Configuration schema upgrade: Upgrading discards extension settings · case 01
Upgrading discards extension settings.
Configuration schema upgrade: Upgrading discards extension settings · case 02
Upgrading discards extension settings.
Configuration schema upgrade: Upgrading discards extension settings · case 03
Upgrading discards extension settings.
Configuration schema upgrade: Upgrading discards extension settings · case 04
Upgrading discards extension settings.
Configuration schema upgrade: Upgrading discards extension settings · case 05
Upgrading discards extension settings.
Configuration schema upgrade: Legacy fields override canonical values · case 01
Legacy fields override canonical values.
Configuration schema upgrade: Legacy fields override canonical values · case 02
Legacy fields override canonical values.
Configuration schema upgrade: Legacy fields override canonical values · case 03
Legacy fields override canonical values.
Configuration schema upgrade: Legacy fields override canonical values · case 04
Legacy fields override canonical values.
Configuration schema upgrade: Legacy fields override canonical values · case 05
Legacy fields override canonical values.
Configuration schema upgrade: Millisecond values are assigned as seconds · case 01
Millisecond values are assigned as seconds.
Configuration schema upgrade: Millisecond values are assigned as seconds · case 02
Millisecond values are assigned as seconds.
Configuration schema upgrade: Millisecond values are assigned as seconds · case 03
Millisecond values are assigned as seconds.
Configuration schema upgrade: Millisecond values are assigned as seconds · case 04
Millisecond values are assigned as seconds.
Configuration schema upgrade: Millisecond values are assigned as seconds · case 05
Millisecond values are assigned as seconds.
Configuration schema upgrade: Deprecated configuration fields survive migration · case 01
Deprecated configuration fields survive migration.
Configuration schema upgrade: Deprecated configuration fields survive migration · case 02
Deprecated configuration fields survive migration.
Configuration schema upgrade: Deprecated configuration fields survive migration · case 03
Deprecated configuration fields survive migration.
Configuration schema upgrade: Deprecated configuration fields survive migration · case 04
Deprecated configuration fields survive migration.
Configuration schema upgrade: Deprecated configuration fields survive migration · case 05
Deprecated configuration fields survive migration.
Configuration schema upgrade: Migrated configuration retains an obsolete schema version · case 01
Migrated configuration retains an obsolete schema version.
Configuration schema upgrade: Migrated configuration retains an obsolete schema version · case 02
Migrated configuration retains an obsolete schema version.
Configuration schema upgrade: Migrated configuration retains an obsolete schema version · case 03
Migrated configuration retains an obsolete schema version.
Configuration schema upgrade: Migrated configuration retains an obsolete schema version · case 04
Migrated configuration retains an obsolete schema version.
Configuration schema upgrade: Migrated configuration retains an obsolete schema version · case 05
Migrated configuration retains an obsolete schema version.
Wheel compatibility admission: Yanked wheel files remain selectable · case 01
Yanked wheel files remain selectable.
Wheel compatibility admission: Yanked wheel files remain selectable · case 02
Yanked wheel files remain selectable.
Wheel compatibility admission: Yanked wheel files remain selectable · case 03
Yanked wheel files remain selectable.
Wheel compatibility admission: Yanked wheel files remain selectable · case 04
Yanked wheel files remain selectable.
Wheel compatibility admission: Yanked wheel files remain selectable · case 05
Yanked wheel files remain selectable.
Wheel compatibility admission: Interpreter compatibility is ignored · case 01
Interpreter compatibility is ignored.
Wheel compatibility admission: Interpreter compatibility is ignored · case 02
Interpreter compatibility is ignored.
Wheel compatibility admission: Interpreter compatibility is ignored · case 03
Interpreter compatibility is ignored.
Wheel compatibility admission: Interpreter compatibility is ignored · case 04
Interpreter compatibility is ignored.
Wheel compatibility admission: Interpreter compatibility is ignored · case 05
Interpreter compatibility is ignored.
Wheel compatibility admission: ABI compatibility is ignored · case 01
ABI compatibility is ignored.
Wheel compatibility admission: ABI compatibility is ignored · case 02
ABI compatibility is ignored.
Wheel compatibility admission: ABI compatibility is ignored · case 03
ABI compatibility is ignored.
Wheel compatibility admission: ABI compatibility is ignored · case 04
ABI compatibility is ignored.
Wheel compatibility admission: ABI compatibility is ignored · case 05
ABI compatibility is ignored.
Wheel compatibility admission: Foreign-platform wheels install locally · case 01
Foreign-platform wheels install locally.
Wheel compatibility admission: Foreign-platform wheels install locally · case 02
Foreign-platform wheels install locally.
Wheel compatibility admission: Foreign-platform wheels install locally · case 03
Foreign-platform wheels install locally.
Wheel compatibility admission: Foreign-platform wheels install locally · case 04
Foreign-platform wheels install locally.
Wheel compatibility admission: Foreign-platform wheels install locally · case 05
Foreign-platform wheels install locally.
Wheel compatibility admission: Interpreter minimum constraints are ignored · case 01
Interpreter minimum constraints are ignored.
Wheel compatibility admission: Interpreter minimum constraints are ignored · case 02
Interpreter minimum constraints are ignored.
Wheel compatibility admission: Interpreter minimum constraints are ignored · case 03
Interpreter minimum constraints are ignored.
Wheel compatibility admission: Interpreter minimum constraints are ignored · case 04
Interpreter minimum constraints are ignored.
Wheel compatibility admission: Interpreter minimum constraints are ignored · case 05
Interpreter minimum constraints are ignored.
Package file manifest selection: Excluded files enter distributions · case 01
Excluded files enter distributions.
Package file manifest selection: Excluded files enter distributions · case 02
Excluded files enter distributions.
Package file manifest selection: Excluded files enter distributions · case 03
Excluded files enter distributions.
Package file manifest selection: Excluded files enter distributions · case 04
Excluded files enter distributions.
Package file manifest selection: Excluded files enter distributions · case 05
Excluded files enter distributions.
Package file manifest selection: Force-included files remain excluded · case 01
Force-included files remain excluded.
Package file manifest selection: Force-included files remain excluded · case 02
Force-included files remain excluded.
Package file manifest selection: Force-included files remain excluded · case 03
Force-included files remain excluded.
Package file manifest selection: Force-included files remain excluded · case 04
Force-included files remain excluded.
Package file manifest selection: Force-included files remain excluded · case 05
Force-included files remain excluded.
Package file manifest selection: Missing declared files enter manifests · case 01
Missing declared files enter manifests.
Package file manifest selection: Missing declared files enter manifests · case 02
Missing declared files enter manifests.
Package file manifest selection: Missing declared files enter manifests · case 03
Missing declared files enter manifests.
Package file manifest selection: Missing declared files enter manifests · case 04
Missing declared files enter manifests.
Package file manifest selection: Missing declared files enter manifests · case 05
Missing declared files enter manifests.
Package file manifest selection: Forced files override hard prohibitions · case 01
Forced files override hard prohibitions.
Package file manifest selection: Forced files override hard prohibitions · case 02
Forced files override hard prohibitions.
Package file manifest selection: Forced files override hard prohibitions · case 03
Forced files override hard prohibitions.
Package file manifest selection: Forced files override hard prohibitions · case 04
Forced files override hard prohibitions.
Package file manifest selection: Forced files override hard prohibitions · case 05
Forced files override hard prohibitions.
Package file manifest selection: Manifest order is reverse lexical · case 01
Manifest order is reverse lexical.
Package file manifest selection: Manifest order is reverse lexical · case 02
Manifest order is reverse lexical.
Package file manifest selection: Manifest order is reverse lexical · case 03
Manifest order is reverse lexical.
Package file manifest selection: Manifest order is reverse lexical · case 04
Manifest order is reverse lexical.
Package file manifest selection: Manifest order is reverse lexical · case 05
Manifest order is reverse lexical.
Installed distribution record validation: Missing installed members pass validation · case 01
Missing installed members pass validation.
Installed distribution record validation: Missing installed members pass validation · case 02
Missing installed members pass validation.
Installed distribution record validation: Missing installed members pass validation · case 03
Missing installed members pass validation.
Installed distribution record validation: Missing installed members pass validation · case 04
Missing installed members pass validation.
Installed distribution record validation: Missing installed members pass validation · case 05
Missing installed members pass validation.
Installed distribution record validation: Unexpected installed files pass validation · case 01
Unexpected installed files pass validation.
Installed distribution record validation: Unexpected installed files pass validation · case 02
Unexpected installed files pass validation.
Installed distribution record validation: Unexpected installed files pass validation · case 03
Unexpected installed files pass validation.
Installed distribution record validation: Unexpected installed files pass validation · case 04
Unexpected installed files pass validation.
Installed distribution record validation: Unexpected installed files pass validation · case 05
Unexpected installed files pass validation.
Installed distribution record validation: Tampered file digests pass validation · case 01
Tampered file digests pass validation.
Installed distribution record validation: Tampered file digests pass validation · case 02
Tampered file digests pass validation.
Installed distribution record validation: Tampered file digests pass validation · case 03
Tampered file digests pass validation.
Installed distribution record validation: Tampered file digests pass validation · case 04
Tampered file digests pass validation.
Installed distribution record validation: Tampered file digests pass validation · case 05
Tampered file digests pass validation.
Installed distribution record validation: Wrong file sizes pass validation · case 01
Wrong file sizes pass validation.
Installed distribution record validation: Wrong file sizes pass validation · case 02
Wrong file sizes pass validation.
Installed distribution record validation: Wrong file sizes pass validation · case 03
Wrong file sizes pass validation.
Installed distribution record validation: Wrong file sizes pass validation · case 04
Wrong file sizes pass validation.
Installed distribution record validation: Wrong file sizes pass validation · case 05
Wrong file sizes pass validation.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗