Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Group average: Averages unique values instead of observations · case 01
The query violates its result contract: averages unique values instead of observations.
Group average: Averages unique values instead of observations · case 02
The query violates its result contract: averages unique values instead of observations.
Group average: Averages unique values instead of observations · case 03
The query violates its result contract: averages unique values instead of observations.
Group average: Averages unique values instead of observations · case 04
The query violates its result contract: averages unique values instead of observations.
Group average: Averages unique values instead of observations · case 05
The query violates its result contract: averages unique values instead of observations.
Group average: Imputes missing measurements as zero · case 01
The query violates its result contract: imputes missing measurements as zero.
Group average: Imputes missing measurements as zero · case 02
The query violates its result contract: imputes missing measurements as zero.
Group average: Imputes missing measurements as zero · case 03
The query violates its result contract: imputes missing measurements as zero.
Group average: Imputes missing measurements as zero · case 04
The query violates its result contract: imputes missing measurements as zero.
Group average: Imputes missing measurements as zero · case 05
The query violates its result contract: imputes missing measurements as zero.
Group average: Uses integer division for average · case 01
The query violates its result contract: uses integer division for average.
Group average: Uses integer division for average · case 02
The query violates its result contract: uses integer division for average.
Group average: Uses integer division for average · case 03
The query violates its result contract: uses integer division for average.
Group average: Uses integer division for average · case 04
The query violates its result contract: uses integer division for average.
Group average: Uses integer division for average · case 05
The query violates its result contract: uses integer division for average.
Group average: Replaces an unknown-only average with zero · case 01
The query violates its result contract: replaces an unknown-only average with zero.
Group average: Replaces an unknown-only average with zero · case 02
The query violates its result contract: replaces an unknown-only average with zero.
Group average: Replaces an unknown-only average with zero · case 03
The query violates its result contract: replaces an unknown-only average with zero.
Group average: Replaces an unknown-only average with zero · case 04
The query violates its result contract: replaces an unknown-only average with zero.
Group average: Replaces an unknown-only average with zero · case 05
The query violates its result contract: replaces an unknown-only average with zero.
Conditional count: COUNT counts both zero and one branches of CASE · case 01
The query violates its result contract: count counts both zero and one branches of case.
Conditional count: COUNT counts both zero and one branches of CASE · case 02
The query violates its result contract: count counts both zero and one branches of case.
Conditional count: COUNT counts both zero and one branches of CASE · case 03
The query violates its result contract: count counts both zero and one branches of case.
Conditional count: COUNT counts both zero and one branches of CASE · case 04
The query violates its result contract: count counts both zero and one branches of case.
Conditional count: COUNT counts both zero and one branches of CASE · case 05
The query violates its result contract: count counts both zero and one branches of case.
Conditional count: Adds raw flag magnitudes instead of occurrences · case 01
The query violates its result contract: adds raw flag magnitudes instead of occurrences.
Conditional count: Adds raw flag magnitudes instead of occurrences · case 02
The query violates its result contract: adds raw flag magnitudes instead of occurrences.
Conditional count: Adds raw flag magnitudes instead of occurrences · case 03
The query violates its result contract: adds raw flag magnitudes instead of occurrences.
Conditional count: Adds raw flag magnitudes instead of occurrences · case 04
The query violates its result contract: adds raw flag magnitudes instead of occurrences.
Conditional count: Adds raw flag magnitudes instead of occurrences · case 05
The query violates its result contract: adds raw flag magnitudes instead of occurrences.
Conditional count: Removes zero-eligible groups with WHERE · case 01
The query violates its result contract: removes zero-eligible groups with where.
Conditional count: Removes zero-eligible groups with WHERE · case 02
The query violates its result contract: removes zero-eligible groups with where.
Conditional count: Removes zero-eligible groups with WHERE · case 03
The query violates its result contract: removes zero-eligible groups with where.
Conditional count: Removes zero-eligible groups with WHERE · case 04
The query violates its result contract: removes zero-eligible groups with where.
Conditional count: Removes zero-eligible groups with WHERE · case 05
The query violates its result contract: removes zero-eligible groups with where.
Conditional count: Counts known false flags as true · case 01
The query violates its result contract: counts known false flags as true.
Conditional count: Counts known false flags as true · case 02
The query violates its result contract: counts known false flags as true.
Conditional count: Counts known false flags as true · case 03
The query violates its result contract: counts known false flags as true.
Conditional count: Counts known false flags as true · case 04
The query violates its result contract: counts known false flags as true.
Conditional count: Counts known false flags as true · case 05
The query violates its result contract: counts known false flags as true.
Conditional count: Rejects non-one true flags · case 01
The query violates its result contract: rejects non-one true flags.
Conditional count: Rejects non-one true flags · case 02
The query violates its result contract: rejects non-one true flags.
Conditional count: Rejects non-one true flags · case 03
The query violates its result contract: rejects non-one true flags.
Conditional count: Rejects non-one true flags · case 04
The query violates its result contract: rejects non-one true flags.
Conditional count: Rejects non-one true flags · case 05
The query violates its result contract: rejects non-one true flags.
Conditional sum: Introduces zero via the excluded CASE branch · case 01
The query violates its result contract: introduces zero via the excluded case branch.
Conditional sum: Introduces zero via the excluded CASE branch · case 02
The query violates its result contract: introduces zero via the excluded case branch.
Conditional sum: Introduces zero via the excluded CASE branch · case 03
The query violates its result contract: introduces zero via the excluded case branch.
Conditional sum: Introduces zero via the excluded CASE branch · case 04
The query violates its result contract: introduces zero via the excluded case branch.
Conditional sum: Introduces zero via the excluded CASE branch · case 05
The query violates its result contract: introduces zero via the excluded case branch.
Conditional sum: Computes total sum before considering group eligibility · case 01
The query violates its result contract: computes total sum before considering group eligibility.
Conditional sum: Computes total sum before considering group eligibility · case 02
The query violates its result contract: computes total sum before considering group eligibility.
Conditional sum: Computes total sum before considering group eligibility · case 03
The query violates its result contract: computes total sum before considering group eligibility.
Conditional sum: Computes total sum before considering group eligibility · case 04
The query violates its result contract: computes total sum before considering group eligibility.
Conditional sum: Computes total sum before considering group eligibility · case 05
The query violates its result contract: computes total sum before considering group eligibility.
Conditional sum: Drops groups without an eligible row · case 01
The query violates its result contract: drops groups without an eligible row.
Conditional sum: Drops groups without an eligible row · case 02
The query violates its result contract: drops groups without an eligible row.
Conditional sum: Drops groups without an eligible row · case 03
The query violates its result contract: drops groups without an eligible row.
Conditional sum: Drops groups without an eligible row · case 04
The query violates its result contract: drops groups without an eligible row.
Conditional sum: Drops groups without an eligible row · case 05
The query violates its result contract: drops groups without an eligible row.
Conditional sum: Multiplies by flag magnitude instead of testing truth · case 01
The query violates its result contract: multiplies by flag magnitude instead of testing truth.
Conditional sum: Multiplies by flag magnitude instead of testing truth · case 02
The query violates its result contract: multiplies by flag magnitude instead of testing truth.
Conditional sum: Multiplies by flag magnitude instead of testing truth · case 03
The query violates its result contract: multiplies by flag magnitude instead of testing truth.
Conditional sum: Multiplies by flag magnitude instead of testing truth · case 04
The query violates its result contract: multiplies by flag magnitude instead of testing truth.
Conditional sum: Multiplies by flag magnitude instead of testing truth · case 05
The query violates its result contract: multiplies by flag magnitude instead of testing truth.
Conditional sum: Includes false rows because their flag is known · case 01
The query violates its result contract: includes false rows because their flag is known.
Conditional sum: Includes false rows because their flag is known · case 02
The query violates its result contract: includes false rows because their flag is known.
Conditional sum: Includes false rows because their flag is known · case 03
The query violates its result contract: includes false rows because their flag is known.
Conditional sum: Includes false rows because their flag is known · case 04
The query violates its result contract: includes false rows because their flag is known.
Conditional sum: Includes false rows because their flag is known · case 05
The query violates its result contract: includes false rows because their flag is known.
Group cardinality filter: Rejects groups exactly at minimum cardinality · case 01
The query violates its result contract: rejects groups exactly at minimum cardinality.
Group cardinality filter: Rejects groups exactly at minimum cardinality · case 02
The query violates its result contract: rejects groups exactly at minimum cardinality.
Group cardinality filter: Rejects groups exactly at minimum cardinality · case 03
The query violates its result contract: rejects groups exactly at minimum cardinality.
Group cardinality filter: Rejects groups exactly at minimum cardinality · case 04
The query violates its result contract: rejects groups exactly at minimum cardinality.
Group cardinality filter: Rejects groups exactly at minimum cardinality · case 05
The query violates its result contract: rejects groups exactly at minimum cardinality.
Group cardinality filter: Uses known-value count for eligibility · case 01
The query violates its result contract: uses known-value count for eligibility.
Group cardinality filter: Uses known-value count for eligibility · case 02
The query violates its result contract: uses known-value count for eligibility.
Group cardinality filter: Uses known-value count for eligibility · case 03
The query violates its result contract: uses known-value count for eligibility.
Group cardinality filter: Uses known-value count for eligibility · case 04
The query violates its result contract: uses known-value count for eligibility.
Group cardinality filter: Uses known-value count for eligibility · case 05
The query violates its result contract: uses known-value count for eligibility.
Group cardinality filter: Uses distinct-value count for eligibility · case 01
The query violates its result contract: uses distinct-value count for eligibility.
Group cardinality filter: Uses distinct-value count for eligibility · case 02
The query violates its result contract: uses distinct-value count for eligibility.
Group cardinality filter: Uses distinct-value count for eligibility · case 03
The query violates its result contract: uses distinct-value count for eligibility.
Group cardinality filter: Uses distinct-value count for eligibility · case 04
The query violates its result contract: uses distinct-value count for eligibility.
Group cardinality filter: Uses distinct-value count for eligibility · case 05
The query violates its result contract: uses distinct-value count for eligibility.
Group cardinality filter: Filters individual values instead of group counts · case 01
The query violates its result contract: filters individual values instead of group counts.
Group cardinality filter: Filters individual values instead of group counts · case 02
The query violates its result contract: filters individual values instead of group counts.
Group cardinality filter: Filters individual values instead of group counts · case 03
The query violates its result contract: filters individual values instead of group counts.
Group cardinality filter: Filters individual values instead of group counts · case 04
The query violates its result contract: filters individual values instead of group counts.
Group cardinality filter: Filters individual values instead of group counts · case 05
The query violates its result contract: filters individual values instead of group counts.
Group cardinality filter: Keeps small rather than large groups · case 01
The query violates its result contract: keeps small rather than large groups.
Group cardinality filter: Keeps small rather than large groups · case 02
The query violates its result contract: keeps small rather than large groups.
Group cardinality filter: Keeps small rather than large groups · case 03
The query violates its result contract: keeps small rather than large groups.
Group cardinality filter: Keeps small rather than large groups · case 04
The query violates its result contract: keeps small rather than large groups.
Group cardinality filter: Keeps small rather than large groups · case 05
The query violates its result contract: keeps small rather than large groups.
Group total filter: Includes groups whose contributions cancel · case 01
The query violates its result contract: includes groups whose contributions cancel.
Group total filter: Includes groups whose contributions cancel · case 02
The query violates its result contract: includes groups whose contributions cancel.
Group total filter: Includes groups whose contributions cancel · case 03
The query violates its result contract: includes groups whose contributions cancel.
Group total filter: Includes groups whose contributions cancel · case 04
The query violates its result contract: includes groups whose contributions cancel.
Group total filter: Includes groups whose contributions cancel · case 05
The query violates its result contract: includes groups whose contributions cancel.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗