Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
A vector UDF validates against unfiltered input length · case 01
A vector UDF validates against unfiltered input length.
A vector UDF validates against unfiltered input length · case 02
A vector UDF validates against unfiltered input length.
A vector UDF validates against unfiltered input length · case 03
A vector UDF validates against unfiltered input length.
A vector UDF validates against unfiltered input length · case 04
A vector UDF validates against unfiltered input length.
A vector UDF validates against unfiltered input length · case 05
A vector UDF validates against unfiltered input length.
A vector UDF omits output validity cardinality validation · case 01
A vector UDF omits output validity cardinality validation.
A vector UDF omits output validity cardinality validation · case 02
A vector UDF omits output validity cardinality validation.
A vector UDF omits output validity cardinality validation · case 03
A vector UDF omits output validity cardinality validation.
A vector UDF omits output validity cardinality validation · case 04
A vector UDF omits output validity cardinality validation.
A vector UDF omits output validity cardinality validation · case 05
A vector UDF omits output validity cardinality validation.
A vector UDF pairs output with prefix identities rather than selected identities · case 01
A vector UDF pairs output with prefix identities rather than selected identities.
A vector UDF pairs output with prefix identities rather than selected identities · case 02
A vector UDF pairs output with prefix identities rather than selected identities.
A vector UDF pairs output with prefix identities rather than selected identities · case 03
A vector UDF pairs output with prefix identities rather than selected identities.
A vector UDF pairs output with prefix identities rather than selected identities · case 04
A vector UDF pairs output with prefix identities rather than selected identities.
A vector UDF pairs output with prefix identities rather than selected identities · case 05
A vector UDF pairs output with prefix identities rather than selected identities.
A malformed UDF batch returns an empty success instead of an error · case 01
A malformed UDF batch returns an empty success instead of an error.
A malformed UDF batch returns an empty success instead of an error · case 02
A malformed UDF batch returns an empty success instead of an error.
A malformed UDF batch returns an empty success instead of an error · case 03
A malformed UDF batch returns an empty success instead of an error.
A malformed UDF batch returns an empty success instead of an error · case 04
A malformed UDF batch returns an empty success instead of an error.
A malformed UDF batch returns an empty success instead of an error · case 05
A malformed UDF batch returns an empty success instead of an error.
A vector UDF ignores result null validity · case 01
A vector UDF ignores result null validity.
A vector UDF ignores result null validity · case 02
A vector UDF ignores result null validity.
A vector UDF ignores result null validity · case 03
A vector UDF ignores result null validity.
A vector UDF ignores result null validity · case 04
A vector UDF ignores result null validity.
A vector UDF ignores result null validity · case 05
A vector UDF ignores result null validity.
A vector UDF drops empty successful batches · case 01
A vector UDF drops empty successful batches.
A vector UDF drops empty successful batches · case 02
A vector UDF drops empty successful batches.
A vector UDF drops empty successful batches · case 03
A vector UDF drops empty successful batches.
A vector UDF drops empty successful batches · case 04
A vector UDF drops empty successful batches.
A vector UDF drops empty successful batches · case 05
A vector UDF drops empty successful batches.
Vector CASE evaluates THEN errors on ELSE-selected lanes · case 01
Vector CASE evaluates THEN errors on ELSE-selected lanes.
Vector CASE evaluates THEN errors on ELSE-selected lanes · case 02
Vector CASE evaluates THEN errors on ELSE-selected lanes.
Vector CASE evaluates THEN errors on ELSE-selected lanes · case 03
Vector CASE evaluates THEN errors on ELSE-selected lanes.
Vector CASE evaluates THEN errors on ELSE-selected lanes · case 04
Vector CASE evaluates THEN errors on ELSE-selected lanes.
Vector CASE evaluates THEN errors on ELSE-selected lanes · case 05
Vector CASE evaluates THEN errors on ELSE-selected lanes.
Vector CASE evaluates ELSE errors on THEN-selected lanes · case 01
Vector CASE evaluates ELSE errors on THEN-selected lanes.
Vector CASE evaluates ELSE errors on THEN-selected lanes · case 02
Vector CASE evaluates ELSE errors on THEN-selected lanes.
Vector CASE evaluates ELSE errors on THEN-selected lanes · case 03
Vector CASE evaluates ELSE errors on THEN-selected lanes.
Vector CASE evaluates ELSE errors on THEN-selected lanes · case 04
Vector CASE evaluates ELSE errors on THEN-selected lanes.
Vector CASE evaluates ELSE errors on THEN-selected lanes · case 05
Vector CASE evaluates ELSE errors on THEN-selected lanes.
Vector CASE treats an unknown condition as selected THEN · case 01
Vector CASE treats an unknown condition as selected THEN.
Vector CASE treats an unknown condition as selected THEN · case 02
Vector CASE treats an unknown condition as selected THEN.
Vector CASE treats an unknown condition as selected THEN · case 03
Vector CASE treats an unknown condition as selected THEN.
Vector CASE treats an unknown condition as selected THEN · case 04
Vector CASE treats an unknown condition as selected THEN.
Vector CASE treats an unknown condition as selected THEN · case 05
Vector CASE treats an unknown condition as selected THEN.
Vector CASE writes ELSE values into THEN-selected lanes · case 01
Vector CASE writes ELSE values into THEN-selected lanes.
Vector CASE writes ELSE values into THEN-selected lanes · case 02
Vector CASE writes ELSE values into THEN-selected lanes.
Vector CASE writes ELSE values into THEN-selected lanes · case 03
Vector CASE writes ELSE values into THEN-selected lanes.
Vector CASE writes ELSE values into THEN-selected lanes · case 04
Vector CASE writes ELSE values into THEN-selected lanes.
Vector CASE writes ELSE values into THEN-selected lanes · case 05
Vector CASE writes ELSE values into THEN-selected lanes.
Vector CASE writes THEN values into ELSE-selected lanes · case 01
Vector CASE writes THEN values into ELSE-selected lanes.
Vector CASE writes THEN values into ELSE-selected lanes · case 02
Vector CASE writes THEN values into ELSE-selected lanes.
Vector CASE writes THEN values into ELSE-selected lanes · case 03
Vector CASE writes THEN values into ELSE-selected lanes.
Vector CASE writes THEN values into ELSE-selected lanes · case 04
Vector CASE writes THEN values into ELSE-selected lanes.
Vector CASE writes THEN values into ELSE-selected lanes · case 05
Vector CASE writes THEN values into ELSE-selected lanes.
Vector CASE converts selected errors into successful null values · case 01
Vector CASE converts selected errors into successful null values.
Vector CASE converts selected errors into successful null values · case 02
Vector CASE converts selected errors into successful null values.
Vector CASE converts selected errors into successful null values · case 03
Vector CASE converts selected errors into successful null values.
Vector CASE converts selected errors into successful null values · case 04
Vector CASE converts selected errors into successful null values.
Vector CASE converts selected errors into successful null values · case 05
Vector CASE converts selected errors into successful null values.
Volatile projection calls are cached by expression key · case 01
Volatile projection calls are cached by expression key.
Volatile projection calls are cached by expression key · case 02
Volatile projection calls are cached by expression key.
Volatile projection calls are cached by expression key · case 03
Volatile projection calls are cached by expression key.
Volatile projection calls are cached by expression key · case 04
Volatile projection calls are cached by expression key.
Volatile projection calls are cached by expression key · case 05
Volatile projection calls are cached by expression key.
Stable query results are discarded at each new input row · case 01
Stable query results are discarded at each new input row.
Stable query results are discarded at each new input row · case 02
Stable query results are discarded at each new input row.
Stable query results are discarded at each new input row · case 03
Stable query results are discarded at each new input row.
Stable query results are discarded at each new input row · case 04
Stable query results are discarded at each new input row.
Stable query results are discarded at each new input row · case 05
Stable query results are discarded at each new input row.
Different stable functions share one cached result · case 01
Different stable functions share one cached result.
Different stable functions share one cached result · case 02
Different stable functions share one cached result.
Different stable functions share one cached result · case 03
Different stable functions share one cached result.
Different stable functions share one cached result · case 04
Different stable functions share one cached result.
Different stable functions share one cached result · case 05
Different stable functions share one cached result.
Row-dependent projection is evaluated only against the first row · case 01
Row-dependent projection is evaluated only against the first row.
Row-dependent projection is evaluated only against the first row · case 02
Row-dependent projection is evaluated only against the first row.
Row-dependent projection is evaluated only against the first row · case 03
Row-dependent projection is evaluated only against the first row.
Row-dependent projection is evaluated only against the first row · case 04
Row-dependent projection is evaluated only against the first row.
Row-dependent projection is evaluated only against the first row · case 05
Row-dependent projection is evaluated only against the first row.
Projection evaluates expressions in key order · case 01
Projection evaluates expressions in key order.
Projection evaluates expressions in key order · case 02
Projection evaluates expressions in key order.
Projection evaluates expressions in key order · case 03
Projection evaluates expressions in key order.
Projection evaluates expressions in key order · case 04
Projection evaluates expressions in key order.
Projection evaluates expressions in key order · case 05
Projection evaluates expressions in key order.
Projection evaluates input rows in sorted order · case 01
Projection evaluates input rows in sorted order.
Projection evaluates input rows in sorted order · case 02
Projection evaluates input rows in sorted order.
Projection evaluates input rows in sorted order · case 03
Projection evaluates input rows in sorted order.
Projection evaluates input rows in sorted order · case 04
Projection evaluates input rows in sorted order.
Projection evaluates input rows in sorted order · case 05
Projection evaluates input rows in sorted order.
MERGE preflight detects duplicate whole source rows instead of duplicate keys · case 01
MERGE preflight detects duplicate whole source rows instead of duplicate keys.
MERGE preflight detects duplicate whole source rows instead of duplicate keys · case 02
MERGE preflight detects duplicate whole source rows instead of duplicate keys.
MERGE preflight detects duplicate whole source rows instead of duplicate keys · case 03
MERGE preflight detects duplicate whole source rows instead of duplicate keys.
MERGE preflight detects duplicate whole source rows instead of duplicate keys · case 04
MERGE preflight detects duplicate whole source rows instead of duplicate keys.
MERGE preflight detects duplicate whole source rows instead of duplicate keys · case 05
MERGE preflight detects duplicate whole source rows instead of duplicate keys.
MERGE preflight rejects duplicates only for keys already in target · case 01
MERGE preflight rejects duplicates only for keys already in target.
MERGE preflight rejects duplicates only for keys already in target · case 02
MERGE preflight rejects duplicates only for keys already in target.
MERGE preflight rejects duplicates only for keys already in target · case 03
MERGE preflight rejects duplicates only for keys already in target.
MERGE preflight rejects duplicates only for keys already in target · case 04
MERGE preflight rejects duplicates only for keys already in target.
MERGE preflight rejects duplicates only for keys already in target · case 05
MERGE preflight rejects duplicates only for keys already in target.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗