Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Release retention selection: A zero retention count keeps historical releases · case 01
A zero retention count keeps historical releases.
Release retention selection: A zero retention count keeps historical releases · case 02
A zero retention count keeps historical releases.
Release retention selection: A zero retention count keeps historical releases · case 03
A zero retention count keeps historical releases.
Release retention selection: A zero retention count keeps historical releases · case 04
A zero retention count keeps historical releases.
Release retention selection: A zero retention count keeps historical releases · case 05
A zero retention count keeps historical releases.
Environment promotion plan: Unknown environments are silently created · case 01
Unknown environments are silently created.
Environment promotion plan: Unknown environments are silently created · case 02
Unknown environments are silently created.
Environment promotion plan: Unknown environments are silently created · case 03
Unknown environments are silently created.
Environment promotion plan: Unknown environments are silently created · case 04
Unknown environments are silently created.
Environment promotion plan: Unknown environments are silently created · case 05
Unknown environments are silently created.
Environment promotion plan: Downgrades ignore the explicit policy · case 01
Downgrades ignore the explicit policy.
Environment promotion plan: Downgrades ignore the explicit policy · case 02
Downgrades ignore the explicit policy.
Environment promotion plan: Downgrades ignore the explicit policy · case 03
Downgrades ignore the explicit policy.
Environment promotion plan: Downgrades ignore the explicit policy · case 04
Downgrades ignore the explicit policy.
Environment promotion plan: Downgrades ignore the explicit policy · case 05
Downgrades ignore the explicit policy.
Environment promotion plan: Identical artifacts require redundant promotion · case 01
Identical artifacts require redundant promotion.
Environment promotion plan: Identical artifacts require redundant promotion · case 02
Identical artifacts require redundant promotion.
Environment promotion plan: Identical artifacts require redundant promotion · case 03
Identical artifacts require redundant promotion.
Environment promotion plan: Identical artifacts require redundant promotion · case 04
Identical artifacts require redundant promotion.
Environment promotion plan: Identical artifacts require redundant promotion · case 05
Identical artifacts require redundant promotion.
Environment promotion plan: Untested artifacts reach the target · case 01
Untested artifacts reach the target.
Environment promotion plan: Untested artifacts reach the target · case 02
Untested artifacts reach the target.
Environment promotion plan: Untested artifacts reach the target · case 03
Untested artifacts reach the target.
Environment promotion plan: Untested artifacts reach the target · case 04
Untested artifacts reach the target.
Environment promotion plan: Untested artifacts reach the target · case 05
Untested artifacts reach the target.
Environment promotion plan: Promotion erases unrelated environments · case 01
Promotion erases unrelated environments.
Environment promotion plan: Promotion erases unrelated environments · case 02
Promotion erases unrelated environments.
Environment promotion plan: Promotion erases unrelated environments · case 03
Promotion erases unrelated environments.
Environment promotion plan: Promotion erases unrelated environments · case 04
Promotion erases unrelated environments.
Environment promotion plan: Promotion erases unrelated environments · case 05
Promotion erases unrelated environments.
Deployment resource cleanup eligibility: Desired resources are selected for deletion · case 01
Desired resources are selected for deletion.
Deployment resource cleanup eligibility: Desired resources are selected for deletion · case 02
Desired resources are selected for deletion.
Deployment resource cleanup eligibility: Desired resources are selected for deletion · case 03
Desired resources are selected for deletion.
Deployment resource cleanup eligibility: Desired resources are selected for deletion · case 04
Desired resources are selected for deletion.
Deployment resource cleanup eligibility: Desired resources are selected for deletion · case 05
Desired resources are selected for deletion.
Deployment resource cleanup eligibility: Another deployment’s resources are deleted · case 01
Another deployment’s resources are deleted.
Deployment resource cleanup eligibility: Another deployment’s resources are deleted · case 02
Another deployment’s resources are deleted.
Deployment resource cleanup eligibility: Another deployment’s resources are deleted · case 03
Another deployment’s resources are deleted.
Deployment resource cleanup eligibility: Another deployment’s resources are deleted · case 04
Another deployment’s resources are deleted.
Deployment resource cleanup eligibility: Another deployment’s resources are deleted · case 05
Another deployment’s resources are deleted.
Deployment resource cleanup eligibility: Protected resources are deleted · case 01
Protected resources are deleted.
Deployment resource cleanup eligibility: Protected resources are deleted · case 02
Protected resources are deleted.
Deployment resource cleanup eligibility: Protected resources are deleted · case 03
Protected resources are deleted.
Deployment resource cleanup eligibility: Protected resources are deleted · case 04
Protected resources are deleted.
Deployment resource cleanup eligibility: Protected resources are deleted · case 05
Protected resources are deleted.
Deployment resource cleanup eligibility: Resources with active consumers are deleted · case 01
Resources with active consumers are deleted.
Deployment resource cleanup eligibility: Resources with active consumers are deleted · case 02
Resources with active consumers are deleted.
Deployment resource cleanup eligibility: Resources with active consumers are deleted · case 03
Resources with active consumers are deleted.
Deployment resource cleanup eligibility: Resources with active consumers are deleted · case 04
Resources with active consumers are deleted.
Deployment resource cleanup eligibility: Resources with active consumers are deleted · case 05
Resources with active consumers are deleted.
Deployment resource cleanup eligibility: Resources are deleted before their grace deadline · case 01
Resources are deleted before their grace deadline.
Deployment resource cleanup eligibility: Resources are deleted before their grace deadline · case 02
Resources are deleted before their grace deadline.
Deployment resource cleanup eligibility: Resources are deleted before their grace deadline · case 03
Resources are deleted before their grace deadline.
Deployment resource cleanup eligibility: Resources are deleted before their grace deadline · case 04
Resources are deleted before their grace deadline.
Deployment resource cleanup eligibility: Resources are deleted before their grace deadline · case 05
Resources are deleted before their grace deadline.
Metric series identity: Different instruments collide by omitting the metric name · case 01
Different instruments collide by omitting the metric name.
Metric series identity: Different instruments collide by omitting the metric name · case 02
Different instruments collide by omitting the metric name.
Metric series identity: Different instruments collide by omitting the metric name · case 03
Different instruments collide by omitting the metric name.
Metric series identity: Different instruments collide by omitting the metric name · case 04
Different instruments collide by omitting the metric name.
Metric series identity: Different instruments collide by omitting the metric name · case 05
Different instruments collide by omitting the metric name.
Metric series identity: Label insertion order fragments one series · case 01
Label insertion order fragments one series.
Metric series identity: Label insertion order fragments one series · case 02
Label insertion order fragments one series.
Metric series identity: Label insertion order fragments one series · case 03
Label insertion order fragments one series.
Metric series identity: Label insertion order fragments one series · case 04
Label insertion order fragments one series.
Metric series identity: Label insertion order fragments one series · case 05
Label insertion order fragments one series.
Metric series identity: Dropped high-cardinality labels remain in identity · case 01
Dropped high-cardinality labels remain in identity.
Metric series identity: Dropped high-cardinality labels remain in identity · case 02
Dropped high-cardinality labels remain in identity.
Metric series identity: Dropped high-cardinality labels remain in identity · case 03
Dropped high-cardinality labels remain in identity.
Metric series identity: Dropped high-cardinality labels remain in identity · case 04
Dropped high-cardinality labels remain in identity.
Metric series identity: Dropped high-cardinality labels remain in identity · case 05
Dropped high-cardinality labels remain in identity.
Metric series identity: Metrics using different units collide · case 01
Metrics using different units collide.
Metric series identity: Metrics using different units collide · case 02
Metrics using different units collide.
Metric series identity: Metrics using different units collide · case 03
Metrics using different units collide.
Metric series identity: Metrics using different units collide · case 04
Metrics using different units collide.
Metric series identity: Metrics using different units collide · case 05
Metrics using different units collide.
Metric series identity: Counter and gauge identities collide · case 01
Counter and gauge identities collide.
Metric series identity: Counter and gauge identities collide · case 02
Counter and gauge identities collide.
Metric series identity: Counter and gauge identities collide · case 03
Counter and gauge identities collide.
Metric series identity: Counter and gauge identities collide · case 04
Counter and gauge identities collide.
Metric series identity: Counter and gauge identities collide · case 05
Counter and gauge identities collide.
Structured log emission policy: Logs exactly at threshold disappear · case 01
Logs exactly at threshold disappear.
Structured log emission policy: Logs exactly at threshold disappear · case 02
Logs exactly at threshold disappear.
Structured log emission policy: Logs exactly at threshold disappear · case 03
Logs exactly at threshold disappear.
Structured log emission policy: Logs exactly at threshold disappear · case 04
Logs exactly at threshold disappear.
Structured log emission policy: Logs exactly at threshold disappear · case 05
Logs exactly at threshold disappear.
Structured log emission policy: Disabled loggers still emit events · case 01
Disabled loggers still emit events.
Structured log emission policy: Disabled loggers still emit events · case 02
Disabled loggers still emit events.
Structured log emission policy: Disabled loggers still emit events · case 03
Disabled loggers still emit events.
Structured log emission policy: Disabled loggers still emit events · case 04
Disabled loggers still emit events.
Structured log emission policy: Disabled loggers still emit events · case 05
Disabled loggers still emit events.
Structured log emission policy: Rejected samples still produce log records · case 01
Rejected samples still produce log records.
Structured log emission policy: Rejected samples still produce log records · case 02
Rejected samples still produce log records.
Structured log emission policy: Rejected samples still produce log records · case 03
Rejected samples still produce log records.
Structured log emission policy: Rejected samples still produce log records · case 04
Rejected samples still produce log records.
Structured log emission policy: Rejected samples still produce log records · case 05
Rejected samples still produce log records.
Structured log emission policy: Suppressed log records are exported · case 01
Suppressed log records are exported.
Structured log emission policy: Suppressed log records are exported · case 02
Suppressed log records are exported.
Structured log emission policy: Suppressed log records are exported · case 03
Suppressed log records are exported.
Structured log emission policy: Suppressed log records are exported · case 04
Suppressed log records are exported.
Structured log emission policy: Suppressed log records are exported · case 05
Suppressed log records are exported.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗