Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Structured log emission policy: Incomplete structured logs are exported · case 01
Incomplete structured logs are exported.
Structured log emission policy: Incomplete structured logs are exported · case 02
Incomplete structured logs are exported.
Structured log emission policy: Incomplete structured logs are exported · case 03
Incomplete structured logs are exported.
Structured log emission policy: Incomplete structured logs are exported · case 04
Incomplete structured logs are exported.
Structured log emission policy: Incomplete structured logs are exported · case 05
Incomplete structured logs are exported.
Alert evaluation state transition: Disabled alert rules keep evaluating · case 01
Disabled alert rules keep evaluating.
Alert evaluation state transition: Disabled alert rules keep evaluating · case 02
Disabled alert rules keep evaluating.
Alert evaluation state transition: Disabled alert rules keep evaluating · case 03
Disabled alert rules keep evaluating.
Alert evaluation state transition: Disabled alert rules keep evaluating · case 04
Disabled alert rules keep evaluating.
Alert evaluation state transition: Disabled alert rules keep evaluating · case 05
Disabled alert rules keep evaluating.
Alert evaluation state transition: Evaluation errors are mistaken for healthy results · case 01
Evaluation errors are mistaken for healthy results.
Alert evaluation state transition: Evaluation errors are mistaken for healthy results · case 02
Evaluation errors are mistaken for healthy results.
Alert evaluation state transition: Evaluation errors are mistaken for healthy results · case 03
Evaluation errors are mistaken for healthy results.
Alert evaluation state transition: Evaluation errors are mistaken for healthy results · case 04
Evaluation errors are mistaken for healthy results.
Alert evaluation state transition: Evaluation errors are mistaken for healthy results · case 05
Evaluation errors are mistaken for healthy results.
Alert evaluation state transition: Missing observations clear alert history · case 01
Missing observations clear alert history.
Alert evaluation state transition: Missing observations clear alert history · case 02
Missing observations clear alert history.
Alert evaluation state transition: Missing observations clear alert history · case 03
Missing observations clear alert history.
Alert evaluation state transition: Missing observations clear alert history · case 04
Missing observations clear alert history.
Alert evaluation state transition: Missing observations clear alert history · case 05
Missing observations clear alert history.
Alert evaluation state transition: Threshold equality starts an alert · case 01
Threshold equality starts an alert.
Alert evaluation state transition: Threshold equality starts an alert · case 02
Threshold equality starts an alert.
Alert evaluation state transition: Threshold equality starts an alert · case 03
Threshold equality starts an alert.
Alert evaluation state transition: Threshold equality starts an alert · case 04
Threshold equality starts an alert.
Alert evaluation state transition: Threshold equality starts an alert · case 05
Threshold equality starts an alert.
Alert evaluation state transition: Firing is delayed by an extra observation · case 01
Firing is delayed by an extra observation.
Alert evaluation state transition: Firing is delayed by an extra observation · case 02
Firing is delayed by an extra observation.
Alert evaluation state transition: Firing is delayed by an extra observation · case 03
Firing is delayed by an extra observation.
Alert evaluation state transition: Firing is delayed by an extra observation · case 04
Firing is delayed by an extra observation.
Alert evaluation state transition: Firing is delayed by an extra observation · case 05
Firing is delayed by an extra observation.
Structured telemetry field redaction: Forbidden telemetry fields leave their keys visible · case 01
Forbidden telemetry fields leave their keys visible.
Structured telemetry field redaction: Forbidden telemetry fields leave their keys visible · case 02
Forbidden telemetry fields leave their keys visible.
Structured telemetry field redaction: Forbidden telemetry fields leave their keys visible · case 03
Forbidden telemetry fields leave their keys visible.
Structured telemetry field redaction: Forbidden telemetry fields leave their keys visible · case 04
Forbidden telemetry fields leave their keys visible.
Structured telemetry field redaction: Forbidden telemetry fields leave their keys visible · case 05
Forbidden telemetry fields leave their keys visible.
Structured telemetry field redaction: Sensitive values escape telemetry redaction · case 01
Sensitive values escape telemetry redaction.
Structured telemetry field redaction: Sensitive values escape telemetry redaction · case 02
Sensitive values escape telemetry redaction.
Structured telemetry field redaction: Sensitive values escape telemetry redaction · case 03
Sensitive values escape telemetry redaction.
Structured telemetry field redaction: Sensitive values escape telemetry redaction · case 04
Sensitive values escape telemetry redaction.
Structured telemetry field redaction: Sensitive values escape telemetry redaction · case 05
Sensitive values escape telemetry redaction.
Structured telemetry field redaction: Public strings exceed the configured field limit · case 01
Public strings exceed the configured field limit.
Structured telemetry field redaction: Public strings exceed the configured field limit · case 02
Public strings exceed the configured field limit.
Structured telemetry field redaction: Public strings exceed the configured field limit · case 03
Public strings exceed the configured field limit.
Structured telemetry field redaction: Public strings exceed the configured field limit · case 04
Public strings exceed the configured field limit.
Structured telemetry field redaction: Public strings exceed the configured field limit · case 05
Public strings exceed the configured field limit.
Structured telemetry field redaction: Telemetry redaction stringifies numeric and boolean values · case 01
Telemetry redaction stringifies numeric and boolean values.
Structured telemetry field redaction: Telemetry redaction stringifies numeric and boolean values · case 02
Telemetry redaction stringifies numeric and boolean values.
Structured telemetry field redaction: Telemetry redaction stringifies numeric and boolean values · case 03
Telemetry redaction stringifies numeric and boolean values.
Structured telemetry field redaction: Telemetry redaction stringifies numeric and boolean values · case 04
Telemetry redaction stringifies numeric and boolean values.
Structured telemetry field redaction: Telemetry redaction stringifies numeric and boolean values · case 05
Telemetry redaction stringifies numeric and boolean values.
Structured telemetry field redaction: Redacted telemetry fields retain arbitrary insertion order · case 01
Redacted telemetry fields retain arbitrary insertion order.
Structured telemetry field redaction: Redacted telemetry fields retain arbitrary insertion order · case 02
Redacted telemetry fields retain arbitrary insertion order.
Structured telemetry field redaction: Redacted telemetry fields retain arbitrary insertion order · case 03
Redacted telemetry fields retain arbitrary insertion order.
Structured telemetry field redaction: Redacted telemetry fields retain arbitrary insertion order · case 04
Redacted telemetry fields retain arbitrary insertion order.
Structured telemetry field redaction: Redacted telemetry fields retain arbitrary insertion order · case 05
Redacted telemetry fields retain arbitrary insertion order.
Trace export admission: Unfinished spans enter completed-span exports · case 01
Unfinished spans enter completed-span exports.
Trace export admission: Unfinished spans enter completed-span exports · case 02
Unfinished spans enter completed-span exports.
Trace export admission: Unfinished spans enter completed-span exports · case 03
Unfinished spans enter completed-span exports.
Trace export admission: Unfinished spans enter completed-span exports · case 04
Unfinished spans enter completed-span exports.
Trace export admission: Unfinished spans enter completed-span exports · case 05
Unfinished spans enter completed-span exports.
Trace export admission: Unsampled spans are exported · case 01
Unsampled spans are exported.
Trace export admission: Unsampled spans are exported · case 02
Unsampled spans are exported.
Trace export admission: Unsampled spans are exported · case 03
Unsampled spans are exported.
Trace export admission: Unsampled spans are exported · case 04
Unsampled spans are exported.
Trace export admission: Unsampled spans are exported · case 05
Unsampled spans are exported.
Trace export admission: Locally suppressed instrumentation exports spans · case 01
Locally suppressed instrumentation exports spans.
Trace export admission: Locally suppressed instrumentation exports spans · case 02
Locally suppressed instrumentation exports spans.
Trace export admission: Locally suppressed instrumentation exports spans · case 03
Locally suppressed instrumentation exports spans.
Trace export admission: Locally suppressed instrumentation exports spans · case 04
Locally suppressed instrumentation exports spans.
Trace export admission: Locally suppressed instrumentation exports spans · case 05
Locally suppressed instrumentation exports spans.
Trace export admission: Nonroot spans export without required parent linkage · case 01
Nonroot spans export without required parent linkage.
Trace export admission: Nonroot spans export without required parent linkage · case 02
Nonroot spans export without required parent linkage.
Trace export admission: Nonroot spans export without required parent linkage · case 03
Nonroot spans export without required parent linkage.
Trace export admission: Nonroot spans export without required parent linkage · case 04
Nonroot spans export without required parent linkage.
Trace export admission: Nonroot spans export without required parent linkage · case 05
Nonroot spans export without required parent linkage.
Trace export admission: Spans export without a service identity · case 01
Spans export without a service identity.
Trace export admission: Spans export without a service identity · case 02
Spans export without a service identity.
Trace export admission: Spans export without a service identity · case 03
Spans export without a service identity.
Trace export admission: Spans export without a service identity · case 04
Spans export without a service identity.
Trace export admission: Spans export without a service identity · case 05
Spans export without a service identity.
A cache hit leaves the entry at the eviction end · case 01
A cache hit leaves the entry at the eviction end.
A cache hit leaves the entry at the eviction end · case 02
A cache hit leaves the entry at the eviction end.
A cache hit leaves the entry at the eviction end · case 03
A cache hit leaves the entry at the eviction end.
A cache hit leaves the entry at the eviction end · case 04
A cache hit leaves the entry at the eviction end.
A cache hit leaves the entry at the eviction end · case 05
A cache hit leaves the entry at the eviction end.
Replacing a cached value duplicates its recency entry · case 01
Replacing a cached value duplicates its recency entry.
Replacing a cached value duplicates its recency entry · case 02
Replacing a cached value duplicates its recency entry.
Replacing a cached value duplicates its recency entry · case 03
Replacing a cached value duplicates its recency entry.
Replacing a cached value duplicates its recency entry · case 04
Replacing a cached value duplicates its recency entry.
Replacing a cached value duplicates its recency entry · case 05
Replacing a cached value duplicates its recency entry.
Shrinking cache capacity evicts only one excess entry · case 01
Shrinking cache capacity evicts only one excess entry.
Shrinking cache capacity evicts only one excess entry · case 02
Shrinking cache capacity evicts only one excess entry.
Shrinking cache capacity evicts only one excess entry · case 03
Shrinking cache capacity evicts only one excess entry.
Shrinking cache capacity evicts only one excess entry · case 04
Shrinking cache capacity evicts only one excess entry.
Shrinking cache capacity evicts only one excess entry · case 05
Shrinking cache capacity evicts only one excess entry.
Weighted eviction frees fewer bytes than the new budget requires · case 01
Weighted eviction frees fewer bytes than the new budget requires.
Weighted eviction frees fewer bytes than the new budget requires · case 02
Weighted eviction frees fewer bytes than the new budget requires.
Weighted eviction frees fewer bytes than the new budget requires · case 03
Weighted eviction frees fewer bytes than the new budget requires.
Weighted eviction frees fewer bytes than the new budget requires · case 04
Weighted eviction frees fewer bytes than the new budget requires.
Weighted eviction frees fewer bytes than the new budget requires · case 05
Weighted eviction frees fewer bytes than the new budget requires.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗