Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Lateral correlation treats absent keys as equal keys · case 01
Lateral correlation treats absent keys as equal keys.
Lateral correlation treats absent keys as equal keys · case 02
Lateral correlation treats absent keys as equal keys.
Lateral correlation treats absent keys as equal keys · case 03
Lateral correlation treats absent keys as equal keys.
Lateral correlation treats absent keys as equal keys · case 04
Lateral correlation treats absent keys as equal keys.
Lateral correlation treats absent keys as equal keys · case 05
Lateral correlation treats absent keys as equal keys.
Lateral execution drops outer rows with empty subqueries · case 01
Lateral execution drops outer rows with empty subqueries.
Lateral execution drops outer rows with empty subqueries · case 02
Lateral execution drops outer rows with empty subqueries.
Lateral execution drops outer rows with empty subqueries · case 03
Lateral execution drops outer rows with empty subqueries.
Lateral execution drops outer rows with empty subqueries · case 04
Lateral execution drops outer rows with empty subqueries.
Lateral execution drops outer rows with empty subqueries · case 05
Lateral execution drops outer rows with empty subqueries.
Lateral execution deduplicates repeated inner matches · case 01
Lateral execution deduplicates repeated inner matches.
Lateral execution deduplicates repeated inner matches · case 02
Lateral execution deduplicates repeated inner matches.
Lateral execution deduplicates repeated inner matches · case 03
Lateral execution deduplicates repeated inner matches.
Lateral execution deduplicates repeated inner matches · case 04
Lateral execution deduplicates repeated inner matches.
Lateral execution deduplicates repeated inner matches · case 05
Lateral execution deduplicates repeated inner matches.
Lateral result rows use correlation key as parent identity · case 01
Lateral result rows use correlation key as parent identity.
Lateral result rows use correlation key as parent identity · case 02
Lateral result rows use correlation key as parent identity.
Lateral result rows use correlation key as parent identity · case 03
Lateral result rows use correlation key as parent identity.
Lateral result rows use correlation key as parent identity · case 04
Lateral result rows use correlation key as parent identity.
Lateral result rows use correlation key as parent identity · case 05
Lateral result rows use correlation key as parent identity.
Scalar subquery cardinality counts distinct values · case 01
Scalar subquery cardinality counts distinct values.
Scalar subquery cardinality counts distinct values · case 02
Scalar subquery cardinality counts distinct values.
Scalar subquery cardinality counts distinct values · case 03
Scalar subquery cardinality counts distinct values.
Scalar subquery cardinality counts distinct values · case 04
Scalar subquery cardinality counts distinct values.
Scalar subquery cardinality counts distinct values · case 05
Scalar subquery cardinality counts distinct values.
Scalar subquery cardinality ignores null-valued rows · case 01
Scalar subquery cardinality ignores null-valued rows.
Scalar subquery cardinality ignores null-valued rows · case 02
Scalar subquery cardinality ignores null-valued rows.
Scalar subquery cardinality ignores null-valued rows · case 03
Scalar subquery cardinality ignores null-valued rows.
Scalar subquery cardinality ignores null-valued rows · case 04
Scalar subquery cardinality ignores null-valued rows.
Scalar subquery cardinality ignores null-valued rows · case 05
Scalar subquery cardinality ignores null-valued rows.
Scalar lookup counts rows from unrelated correlation keys · case 01
Scalar lookup counts rows from unrelated correlation keys.
Scalar lookup counts rows from unrelated correlation keys · case 02
Scalar lookup counts rows from unrelated correlation keys.
Scalar lookup counts rows from unrelated correlation keys · case 03
Scalar lookup counts rows from unrelated correlation keys.
Scalar lookup counts rows from unrelated correlation keys · case 04
Scalar lookup counts rows from unrelated correlation keys.
Scalar lookup counts rows from unrelated correlation keys · case 05
Scalar lookup counts rows from unrelated correlation keys.
Scalar lookup joins absent keys to absent keys · case 01
Scalar lookup joins absent keys to absent keys.
Scalar lookup joins absent keys to absent keys · case 02
Scalar lookup joins absent keys to absent keys.
Scalar lookup joins absent keys to absent keys · case 03
Scalar lookup joins absent keys to absent keys.
Scalar lookup joins absent keys to absent keys · case 04
Scalar lookup joins absent keys to absent keys.
Scalar lookup joins absent keys to absent keys · case 05
Scalar lookup joins absent keys to absent keys.
An empty scalar subquery yields a fabricated zero · case 01
An empty scalar subquery yields a fabricated zero.
An empty scalar subquery yields a fabricated zero · case 02
An empty scalar subquery yields a fabricated zero.
An empty scalar subquery yields a fabricated zero · case 03
An empty scalar subquery yields a fabricated zero.
An empty scalar subquery yields a fabricated zero · case 04
An empty scalar subquery yields a fabricated zero.
An empty scalar subquery yields a fabricated zero · case 05
An empty scalar subquery yields a fabricated zero.
A multirow scalar subquery silently picks its first result · case 01
A multirow scalar subquery silently picks its first result.
A multirow scalar subquery silently picks its first result · case 02
A multirow scalar subquery silently picks its first result.
A multirow scalar subquery silently picks its first result · case 03
A multirow scalar subquery silently picks its first result.
A multirow scalar subquery silently picks its first result · case 04
A multirow scalar subquery silently picks its first result.
A multirow scalar subquery silently picks its first result · case 05
A multirow scalar subquery silently picks its first result.
Grouping metadata mistakes real null keys for omitted dimensions · case 01
Grouping metadata mistakes real null keys for omitted dimensions.
Grouping metadata mistakes real null keys for omitted dimensions · case 02
Grouping metadata mistakes real null keys for omitted dimensions.
Grouping metadata mistakes real null keys for omitted dimensions · case 03
Grouping metadata mistakes real null keys for omitted dimensions.
Grouping metadata mistakes real null keys for omitted dimensions · case 04
Grouping metadata mistakes real null keys for omitted dimensions.
Grouping metadata mistakes real null keys for omitted dimensions · case 05
Grouping metadata mistakes real null keys for omitted dimensions.
Grouping metadata reverses the declared dimension bit order · case 01
Grouping metadata reverses the declared dimension bit order.
Grouping metadata reverses the declared dimension bit order · case 02
Grouping metadata reverses the declared dimension bit order.
Grouping metadata reverses the declared dimension bit order · case 03
Grouping metadata reverses the declared dimension bit order.
Grouping metadata reverses the declared dimension bit order · case 04
Grouping metadata reverses the declared dimension bit order.
Grouping metadata reverses the declared dimension bit order · case 05
Grouping metadata reverses the declared dimension bit order.
Grouping expansion deduplicates repeated grouping sets · case 01
Grouping expansion deduplicates repeated grouping sets.
Grouping expansion deduplicates repeated grouping sets · case 02
Grouping expansion deduplicates repeated grouping sets.
Grouping expansion deduplicates repeated grouping sets · case 03
Grouping expansion deduplicates repeated grouping sets.
Grouping expansion deduplicates repeated grouping sets · case 04
Grouping expansion deduplicates repeated grouping sets.
Grouping expansion deduplicates repeated grouping sets · case 05
Grouping expansion deduplicates repeated grouping sets.
Grouping expansion leaks source keys into rolled-up slots · case 01
Grouping expansion leaks source keys into rolled-up slots.
Grouping expansion leaks source keys into rolled-up slots · case 02
Grouping expansion leaks source keys into rolled-up slots.
Grouping expansion leaks source keys into rolled-up slots · case 03
Grouping expansion leaks source keys into rolled-up slots.
Grouping expansion leaks source keys into rolled-up slots · case 04
Grouping expansion leaks source keys into rolled-up slots.
Grouping expansion leaks source keys into rolled-up slots · case 05
Grouping expansion leaks source keys into rolled-up slots.
Grouping expansion carries a key instead of the fact payload · case 01
Grouping expansion carries a key instead of the fact payload.
Grouping expansion carries a key instead of the fact payload · case 02
Grouping expansion carries a key instead of the fact payload.
Grouping expansion carries a key instead of the fact payload · case 03
Grouping expansion carries a key instead of the fact payload.
Grouping expansion carries a key instead of the fact payload · case 04
Grouping expansion carries a key instead of the fact payload.
Grouping expansion carries a key instead of the fact payload · case 05
Grouping expansion carries a key instead of the fact payload.
Grouping expansion deduplicates equal facts before expansion · case 01
Grouping expansion deduplicates equal facts before expansion.
Grouping expansion deduplicates equal facts before expansion · case 02
Grouping expansion deduplicates equal facts before expansion.
Grouping expansion deduplicates equal facts before expansion · case 03
Grouping expansion deduplicates equal facts before expansion.
Grouping expansion deduplicates equal facts before expansion · case 04
Grouping expansion deduplicates equal facts before expansion.
Grouping expansion deduplicates equal facts before expansion · case 05
Grouping expansion deduplicates equal facts before expansion.
Pivot sorts categories instead of honoring declared columns · case 01
Pivot sorts categories instead of honoring declared columns.
Pivot sorts categories instead of honoring declared columns · case 02
Pivot sorts categories instead of honoring declared columns.
Pivot sorts categories instead of honoring declared columns · case 03
Pivot sorts categories instead of honoring declared columns.
Pivot sorts categories instead of honoring declared columns · case 04
Pivot sorts categories instead of honoring declared columns.
Pivot sorts categories instead of honoring declared columns · case 05
Pivot sorts categories instead of honoring declared columns.
Pivot drops identities seen only in unrequested categories · case 01
Pivot drops identities seen only in unrequested categories.
Pivot drops identities seen only in unrequested categories · case 02
Pivot drops identities seen only in unrequested categories.
Pivot drops identities seen only in unrequested categories · case 03
Pivot drops identities seen only in unrequested categories.
Pivot drops identities seen only in unrequested categories · case 04
Pivot drops identities seen only in unrequested categories.
Pivot drops identities seen only in unrequested categories · case 05
Pivot drops identities seen only in unrequested categories.
Pivot mixes values from different row identities · case 01
Pivot mixes values from different row identities.
Pivot mixes values from different row identities · case 02
Pivot mixes values from different row identities.
Pivot mixes values from different row identities · case 03
Pivot mixes values from different row identities.
Pivot mixes values from different row identities · case 04
Pivot mixes values from different row identities.
Pivot mixes values from different row identities · case 05
Pivot mixes values from different row identities.
Pivot drops null fact values inside a cell · case 01
Pivot drops null fact values inside a cell.
Pivot drops null fact values inside a cell · case 02
Pivot drops null fact values inside a cell.
Pivot drops null fact values inside a cell · case 03
Pivot drops null fact values inside a cell.
Pivot drops null fact values inside a cell · case 04
Pivot drops null fact values inside a cell.
Pivot drops null fact values inside a cell · case 05
Pivot drops null fact values inside a cell.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗