Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Package publication plan: Private packages are published publicly · case 01
Private packages are published publicly.
Package publication plan: Private packages are published publicly · case 02
Private packages are published publicly.
Package publication plan: Private packages are published publicly · case 03
Private packages are published publicly.
Package publication plan: Private packages are published publicly · case 04
Private packages are published publicly.
Package publication plan: Private packages are published publicly · case 05
Private packages are published publicly.
Distribution budget enforcement: A bundle exactly at its count limit is rejected · case 01
A bundle exactly at its count limit is rejected.
Distribution budget enforcement: A bundle exactly at its count limit is rejected · case 02
A bundle exactly at its count limit is rejected.
Distribution budget enforcement: A bundle exactly at its count limit is rejected · case 03
A bundle exactly at its count limit is rejected.
Distribution budget enforcement: A bundle exactly at its count limit is rejected · case 04
A bundle exactly at its count limit is rejected.
Distribution budget enforcement: A bundle exactly at its count limit is rejected · case 05
A bundle exactly at its count limit is rejected.
Distribution budget enforcement: Total distribution bytes are not checked · case 01
Total distribution bytes are not checked.
Distribution budget enforcement: Total distribution bytes are not checked · case 02
Total distribution bytes are not checked.
Distribution budget enforcement: Total distribution bytes are not checked · case 03
Total distribution bytes are not checked.
Distribution budget enforcement: Total distribution bytes are not checked · case 04
Total distribution bytes are not checked.
Distribution budget enforcement: Total distribution bytes are not checked · case 05
Total distribution bytes are not checked.
Distribution budget enforcement: Oversized individual files pass an aggregate-only budget · case 01
Oversized individual files pass an aggregate-only budget.
Distribution budget enforcement: Oversized individual files pass an aggregate-only budget · case 02
Oversized individual files pass an aggregate-only budget.
Distribution budget enforcement: Oversized individual files pass an aggregate-only budget · case 03
Oversized individual files pass an aggregate-only budget.
Distribution budget enforcement: Oversized individual files pass an aggregate-only budget · case 04
Oversized individual files pass an aggregate-only budget.
Distribution budget enforcement: Oversized individual files pass an aggregate-only budget · case 05
Oversized individual files pass an aggregate-only budget.
Distribution budget enforcement: Forbidden file types enter the distribution · case 01
Forbidden file types enter the distribution.
Distribution budget enforcement: Forbidden file types enter the distribution · case 02
Forbidden file types enter the distribution.
Distribution budget enforcement: Forbidden file types enter the distribution · case 03
Forbidden file types enter the distribution.
Distribution budget enforcement: Forbidden file types enter the distribution · case 04
Forbidden file types enter the distribution.
Distribution budget enforcement: Forbidden file types enter the distribution · case 05
Forbidden file types enter the distribution.
Distribution budget enforcement: Mandatory package files may be absent · case 01
Mandatory package files may be absent.
Distribution budget enforcement: Mandatory package files may be absent · case 02
Mandatory package files may be absent.
Distribution budget enforcement: Mandatory package files may be absent · case 03
Mandatory package files may be absent.
Distribution budget enforcement: Mandatory package files may be absent · case 04
Mandatory package files may be absent.
Distribution budget enforcement: Mandatory package files may be absent · case 05
Mandatory package files may be absent.
Editable installation mapping: Disabled module mappings are installed · case 01
Disabled module mappings are installed.
Editable installation mapping: Disabled module mappings are installed · case 02
Disabled module mappings are installed.
Editable installation mapping: Disabled module mappings are installed · case 03
Disabled module mappings are installed.
Editable installation mapping: Disabled module mappings are installed · case 04
Disabled module mappings are installed.
Editable installation mapping: Disabled module mappings are installed · case 05
Disabled module mappings are installed.
Editable installation mapping: Editable mappings target nonexistent sources · case 01
Editable mappings target nonexistent sources.
Editable installation mapping: Editable mappings target nonexistent sources · case 02
Editable mappings target nonexistent sources.
Editable installation mapping: Editable mappings target nonexistent sources · case 03
Editable mappings target nonexistent sources.
Editable installation mapping: Editable mappings target nonexistent sources · case 04
Editable mappings target nonexistent sources.
Editable installation mapping: Editable mappings target nonexistent sources · case 05
Editable mappings target nonexistent sources.
Editable installation mapping: Conflicting editable modules silently override · case 01
Conflicting editable modules silently override.
Editable installation mapping: Conflicting editable modules silently override · case 02
Conflicting editable modules silently override.
Editable installation mapping: Conflicting editable modules silently override · case 03
Conflicting editable modules silently override.
Editable installation mapping: Conflicting editable modules silently override · case 04
Conflicting editable modules silently override.
Editable installation mapping: Conflicting editable modules silently override · case 05
Conflicting editable modules silently override.
Editable installation mapping: Module names replace source directory locations · case 01
Module names replace source directory locations.
Editable installation mapping: Module names replace source directory locations · case 02
Module names replace source directory locations.
Editable installation mapping: Module names replace source directory locations · case 03
Module names replace source directory locations.
Editable installation mapping: Module names replace source directory locations · case 04
Module names replace source directory locations.
Editable installation mapping: Module names replace source directory locations · case 05
Module names replace source directory locations.
Editable installation mapping: Editable mapping output depends on declaration order · case 01
Editable mapping output depends on declaration order.
Editable installation mapping: Editable mapping output depends on declaration order · case 02
Editable mapping output depends on declaration order.
Editable installation mapping: Editable mapping output depends on declaration order · case 03
Editable mapping output depends on declaration order.
Editable installation mapping: Editable mapping output depends on declaration order · case 04
Editable mapping output depends on declaration order.
Editable installation mapping: Editable mapping output depends on declaration order · case 05
Editable mapping output depends on declaration order.
Software bill of materials component assembly: Development-only components inflate production inventories · case 01
Development-only components inflate production inventories.
Software bill of materials component assembly: Development-only components inflate production inventories · case 02
Development-only components inflate production inventories.
Software bill of materials component assembly: Development-only components inflate production inventories · case 03
Development-only components inflate production inventories.
Software bill of materials component assembly: Development-only components inflate production inventories · case 04
Development-only components inflate production inventories.
Software bill of materials component assembly: Development-only components inflate production inventories · case 05
Development-only components inflate production inventories.
Software bill of materials component assembly: Different component versions collapse in the inventory · case 01
Different component versions collapse in the inventory.
Software bill of materials component assembly: Different component versions collapse in the inventory · case 02
Different component versions collapse in the inventory.
Software bill of materials component assembly: Different component versions collapse in the inventory · case 03
Different component versions collapse in the inventory.
Software bill of materials component assembly: Different component versions collapse in the inventory · case 04
Different component versions collapse in the inventory.
Software bill of materials component assembly: Different component versions collapse in the inventory · case 05
Different component versions collapse in the inventory.
Software bill of materials component assembly: Components from different origins collapse · case 01
Components from different origins collapse.
Software bill of materials component assembly: Components from different origins collapse · case 02
Components from different origins collapse.
Software bill of materials component assembly: Components from different origins collapse · case 03
Components from different origins collapse.
Software bill of materials component assembly: Components from different origins collapse · case 04
Components from different origins collapse.
Software bill of materials component assembly: Components from different origins collapse · case 05
Components from different origins collapse.
Software bill of materials component assembly: Only the final digest is retained · case 01
Only the final digest is retained.
Software bill of materials component assembly: Only the final digest is retained · case 02
Only the final digest is retained.
Software bill of materials component assembly: Only the final digest is retained · case 03
Only the final digest is retained.
Software bill of materials component assembly: Only the final digest is retained · case 04
Only the final digest is retained.
Software bill of materials component assembly: Only the final digest is retained · case 05
Only the final digest is retained.
Software bill of materials component assembly: Digest lists use reverse lexical order · case 01
Digest lists use reverse lexical order.
Software bill of materials component assembly: Digest lists use reverse lexical order · case 02
Digest lists use reverse lexical order.
Software bill of materials component assembly: Digest lists use reverse lexical order · case 03
Digest lists use reverse lexical order.
Software bill of materials component assembly: Digest lists use reverse lexical order · case 04
Digest lists use reverse lexical order.
Software bill of materials component assembly: Digest lists use reverse lexical order · case 05
Digest lists use reverse lexical order.
Deployment promotion gate: A revision is promoted using another revision’s checks · case 01
A revision is promoted using another revision’s checks.
Deployment promotion gate: A revision is promoted using another revision’s checks · case 02
A revision is promoted using another revision’s checks.
Deployment promotion gate: A revision is promoted using another revision’s checks · case 03
A revision is promoted using another revision’s checks.
Deployment promotion gate: A revision is promoted using another revision’s checks · case 04
A revision is promoted using another revision’s checks.
Deployment promotion gate: A revision is promoted using another revision’s checks · case 05
A revision is promoted using another revision’s checks.
Deployment promotion gate: One passing check masks failing required checks · case 01
One passing check masks failing required checks.
Deployment promotion gate: One passing check masks failing required checks · case 02
One passing check masks failing required checks.
Deployment promotion gate: One passing check masks failing required checks · case 03
One passing check masks failing required checks.
Deployment promotion gate: One passing check masks failing required checks · case 04
One passing check masks failing required checks.
Deployment promotion gate: One passing check masks failing required checks · case 05
One passing check masks failing required checks.
Deployment promotion gate: Promotion occurs below the healthy replica floor · case 01
Promotion occurs below the healthy replica floor.
Deployment promotion gate: Promotion occurs below the healthy replica floor · case 02
Promotion occurs below the healthy replica floor.
Deployment promotion gate: Promotion occurs below the healthy replica floor · case 03
Promotion occurs below the healthy replica floor.
Deployment promotion gate: Promotion occurs below the healthy replica floor · case 04
Promotion occurs below the healthy replica floor.
Deployment promotion gate: Promotion occurs below the healthy replica floor · case 05
Promotion occurs below the healthy replica floor.
Deployment promotion gate: Mandatory deployment approval is ignored · case 01
Mandatory deployment approval is ignored.
Deployment promotion gate: Mandatory deployment approval is ignored · case 02
Mandatory deployment approval is ignored.
Deployment promotion gate: Mandatory deployment approval is ignored · case 03
Mandatory deployment approval is ignored.
Deployment promotion gate: Mandatory deployment approval is ignored · case 04
Mandatory deployment approval is ignored.
Deployment promotion gate: Mandatory deployment approval is ignored · case 05
Mandatory deployment approval is ignored.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗