Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Group total filter: Tests for one positive member instead of positive total · case 01
The query violates its result contract: tests for one positive member instead of positive total.
Group total filter: Tests for one positive member instead of positive total · case 02
The query violates its result contract: tests for one positive member instead of positive total.
Group total filter: Tests for one positive member instead of positive total · case 03
The query violates its result contract: tests for one positive member instead of positive total.
Group total filter: Tests for one positive member instead of positive total · case 04
The query violates its result contract: tests for one positive member instead of positive total.
Group total filter: Tests for one positive member instead of positive total · case 05
The query violates its result contract: tests for one positive member instead of positive total.
Group total filter: Requires every known measurement to be positive · case 01
The query violates its result contract: requires every known measurement to be positive.
Group total filter: Requires every known measurement to be positive · case 02
The query violates its result contract: requires every known measurement to be positive.
Group total filter: Requires every known measurement to be positive · case 03
The query violates its result contract: requires every known measurement to be positive.
Group total filter: Requires every known measurement to be positive · case 04
The query violates its result contract: requires every known measurement to be positive.
Group total filter: Requires every known measurement to be positive · case 05
The query violates its result contract: requires every known measurement to be positive.
Group total filter: Filters using the sum of unique amounts · case 01
The query violates its result contract: filters using the sum of unique amounts.
Group total filter: Filters using the sum of unique amounts · case 02
The query violates its result contract: filters using the sum of unique amounts.
Group total filter: Filters using the sum of unique amounts · case 03
The query violates its result contract: filters using the sum of unique amounts.
Group total filter: Filters using the sum of unique amounts · case 04
The query violates its result contract: filters using the sum of unique amounts.
Group total filter: Filters using the sum of unique amounts · case 05
The query violates its result contract: filters using the sum of unique amounts.
Distinct known count: Counts occurrences instead of distinct observations · case 01
The query violates its result contract: counts occurrences instead of distinct observations.
Distinct known count: Counts occurrences instead of distinct observations · case 02
The query violates its result contract: counts occurrences instead of distinct observations.
Distinct known count: Counts occurrences instead of distinct observations · case 03
The query violates its result contract: counts occurrences instead of distinct observations.
Distinct known count: Counts occurrences instead of distinct observations · case 04
The query violates its result contract: counts occurrences instead of distinct observations.
Distinct known count: Counts occurrences instead of distinct observations · case 05
The query violates its result contract: counts occurrences instead of distinct observations.
Distinct known count: Includes NULL as one distinct measured value · case 01
The query violates its result contract: includes null as one distinct measured value.
Distinct known count: Includes NULL as one distinct measured value · case 02
The query violates its result contract: includes null as one distinct measured value.
Distinct known count: Includes NULL as one distinct measured value · case 03
The query violates its result contract: includes null as one distinct measured value.
Distinct known count: Includes NULL as one distinct measured value · case 04
The query violates its result contract: includes null as one distinct measured value.
Distinct known count: Includes NULL as one distinct measured value · case 05
The query violates its result contract: includes null as one distinct measured value.
Distinct known count: Counts distinct keys instead of measurements · case 01
The query violates its result contract: counts distinct keys instead of measurements.
Distinct known count: Counts distinct keys instead of measurements · case 02
The query violates its result contract: counts distinct keys instead of measurements.
Distinct known count: Counts distinct keys instead of measurements · case 03
The query violates its result contract: counts distinct keys instead of measurements.
Distinct known count: Counts distinct keys instead of measurements · case 04
The query violates its result contract: counts distinct keys instead of measurements.
Distinct known count: Counts distinct keys instead of measurements · case 05
The query violates its result contract: counts distinct keys instead of measurements.
Distinct known count: Introduces zero when only NULL is present · case 01
The query violates its result contract: introduces zero when only null is present.
Distinct known count: Introduces zero when only NULL is present · case 02
The query violates its result contract: introduces zero when only null is present.
Distinct known count: Introduces zero when only NULL is present · case 03
The query violates its result contract: introduces zero when only null is present.
Distinct known count: Introduces zero when only NULL is present · case 04
The query violates its result contract: introduces zero when only null is present.
Distinct known count: Introduces zero when only NULL is present · case 05
The query violates its result contract: introduces zero when only null is present.
Distinct known count: Drops nonpositive known values · case 01
The query violates its result contract: drops nonpositive known values.
Distinct known count: Drops nonpositive known values · case 02
The query violates its result contract: drops nonpositive known values.
Distinct known count: Drops nonpositive known values · case 03
The query violates its result contract: drops nonpositive known values.
Distinct known count: Drops nonpositive known values · case 04
The query violates its result contract: drops nonpositive known values.
Distinct known count: Drops nonpositive known values · case 05
The query violates its result contract: drops nonpositive known values.
Left join count: Counts the NULL-padded outer row as a match · case 01
The query violates its result contract: counts the null-padded outer row as a match.
Left join count: Counts the NULL-padded outer row as a match · case 02
The query violates its result contract: counts the null-padded outer row as a match.
Left join count: Counts the NULL-padded outer row as a match · case 03
The query violates its result contract: counts the null-padded outer row as a match.
Left join count: Counts the NULL-padded outer row as a match · case 04
The query violates its result contract: counts the null-padded outer row as a match.
Left join count: Counts the NULL-padded outer row as a match · case 05
The query violates its result contract: counts the null-padded outer row as a match.
Left join count: Does not count matches with NULL payloads · case 01
The query violates its result contract: does not count matches with null payloads.
Left join count: Does not count matches with NULL payloads · case 02
The query violates its result contract: does not count matches with null payloads.
Left join count: Does not count matches with NULL payloads · case 03
The query violates its result contract: does not count matches with null payloads.
Left join count: Does not count matches with NULL payloads · case 04
The query violates its result contract: does not count matches with null payloads.
Left join count: Does not count matches with NULL payloads · case 05
The query violates its result contract: does not count matches with null payloads.
Left join count: Collapses separate matches with equal values · case 01
The query violates its result contract: collapses separate matches with equal values.
Left join count: Collapses separate matches with equal values · case 02
The query violates its result contract: collapses separate matches with equal values.
Left join count: Collapses separate matches with equal values · case 03
The query violates its result contract: collapses separate matches with equal values.
Left join count: Collapses separate matches with equal values · case 04
The query violates its result contract: collapses separate matches with equal values.
Left join count: Collapses separate matches with equal values · case 05
The query violates its result contract: collapses separate matches with equal values.
Left join count: Drops left rows with zero matches · case 01
The query violates its result contract: drops left rows with zero matches.
Left join count: Drops left rows with zero matches · case 02
The query violates its result contract: drops left rows with zero matches.
Left join count: Drops left rows with zero matches · case 03
The query violates its result contract: drops left rows with zero matches.
Left join count: Drops left rows with zero matches · case 04
The query violates its result contract: drops left rows with zero matches.
Left join count: Drops left rows with zero matches · case 05
The query violates its result contract: drops left rows with zero matches.
Left join count: Combines separate left identities sharing a key · case 01
The query violates its result contract: combines separate left identities sharing a key.
Left join count: Combines separate left identities sharing a key · case 02
The query violates its result contract: combines separate left identities sharing a key.
Left join count: Combines separate left identities sharing a key · case 03
The query violates its result contract: combines separate left identities sharing a key.
Left join count: Combines separate left identities sharing a key · case 04
The query violates its result contract: combines separate left identities sharing a key.
Left join count: Combines separate left identities sharing a key · case 05
The query violates its result contract: combines separate left identities sharing a key.
Correlated maximum: Omits the correlation predicate · case 01
The query violates its result contract: omits the correlation predicate.
Correlated maximum: Omits the correlation predicate · case 02
The query violates its result contract: omits the correlation predicate.
Correlated maximum: Omits the correlation predicate · case 03
The query violates its result contract: omits the correlation predicate.
Correlated maximum: Omits the correlation predicate · case 04
The query violates its result contract: omits the correlation predicate.
Correlated maximum: Omits the correlation predicate · case 05
The query violates its result contract: omits the correlation predicate.
Correlated maximum: Searches the source table instead of the reference table · case 01
The query violates its result contract: searches the source table instead of the reference table.
Correlated maximum: Searches the source table instead of the reference table · case 02
The query violates its result contract: searches the source table instead of the reference table.
Correlated maximum: Searches the source table instead of the reference table · case 03
The query violates its result contract: searches the source table instead of the reference table.
Correlated maximum: Searches the source table instead of the reference table · case 04
The query violates its result contract: searches the source table instead of the reference table.
Correlated maximum: Searches the source table instead of the reference table · case 05
The query violates its result contract: searches the source table instead of the reference table.
Correlated maximum: Selects the minimum reference value · case 01
The query violates its result contract: selects the minimum reference value.
Correlated maximum: Selects the minimum reference value · case 02
The query violates its result contract: selects the minimum reference value.
Correlated maximum: Selects the minimum reference value · case 03
The query violates its result contract: selects the minimum reference value.
Correlated maximum: Selects the minimum reference value · case 04
The query violates its result contract: selects the minimum reference value.
Correlated maximum: Selects the minimum reference value · case 05
The query violates its result contract: selects the minimum reference value.
Correlated maximum: Matches any reference value rather than the maximum · case 01
The query violates its result contract: matches any reference value rather than the maximum.
Correlated maximum: Matches any reference value rather than the maximum · case 02
The query violates its result contract: matches any reference value rather than the maximum.
Correlated maximum: Matches any reference value rather than the maximum · case 03
The query violates its result contract: matches any reference value rather than the maximum.
Correlated maximum: Matches any reference value rather than the maximum · case 04
The query violates its result contract: matches any reference value rather than the maximum.
Correlated maximum: Matches any reference value rather than the maximum · case 05
The query violates its result contract: matches any reference value rather than the maximum.
Correlated maximum: Treats missing maximum and missing measurement as equal · case 01
The query violates its result contract: treats missing maximum and missing measurement as equal.
Correlated maximum: Treats missing maximum and missing measurement as equal · case 02
The query violates its result contract: treats missing maximum and missing measurement as equal.
Correlated maximum: Treats missing maximum and missing measurement as equal · case 03
The query violates its result contract: treats missing maximum and missing measurement as equal.
Correlated maximum: Treats missing maximum and missing measurement as equal · case 04
The query violates its result contract: treats missing maximum and missing measurement as equal.
Correlated maximum: Treats missing maximum and missing measurement as equal · case 05
The query violates its result contract: treats missing maximum and missing measurement as equal.
All reference values: Accepts one smaller reference despite a larger blocker · case 01
The query violates its result contract: accepts one smaller reference despite a larger blocker.
All reference values: Accepts one smaller reference despite a larger blocker · case 02
The query violates its result contract: accepts one smaller reference despite a larger blocker.
All reference values: Accepts one smaller reference despite a larger blocker · case 03
The query violates its result contract: accepts one smaller reference despite a larger blocker.
All reference values: Accepts one smaller reference despite a larger blocker · case 04
The query violates its result contract: accepts one smaller reference despite a larger blocker.
All reference values: Accepts one smaller reference despite a larger blocker · case 05
The query violates its result contract: accepts one smaller reference despite a larger blocker.
All reference values: A scalar MAX comparison loses vacuous truth on empty reference sets · case 01
The query violates its result contract: a scalar max comparison loses vacuous truth on empty reference sets.
All reference values: A scalar MAX comparison loses vacuous truth on empty reference sets · case 02
The query violates its result contract: a scalar max comparison loses vacuous truth on empty reference sets.
All reference values: A scalar MAX comparison loses vacuous truth on empty reference sets · case 03
The query violates its result contract: a scalar max comparison loses vacuous truth on empty reference sets.
All reference values: A scalar MAX comparison loses vacuous truth on empty reference sets · case 04
The query violates its result contract: a scalar max comparison loses vacuous truth on empty reference sets.
All reference values: A scalar MAX comparison loses vacuous truth on empty reference sets · case 05
The query violates its result contract: a scalar max comparison loses vacuous truth on empty reference sets.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗