Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Pivot substitutes a null element for an absent cell · case 01
Pivot substitutes a null element for an absent cell.
Pivot substitutes a null element for an absent cell · case 02
Pivot substitutes a null element for an absent cell.
Pivot substitutes a null element for an absent cell · case 03
Pivot substitutes a null element for an absent cell.
Pivot substitutes a null element for an absent cell · case 04
Pivot substitutes a null element for an absent cell.
Pivot substitutes a null element for an absent cell · case 05
Pivot substitutes a null element for an absent cell.
Pivot treats equal fact values as one fact · case 01
Pivot treats equal fact values as one fact.
Pivot treats equal fact values as one fact · case 02
Pivot treats equal fact values as one fact.
Pivot treats equal fact values as one fact · case 03
Pivot treats equal fact values as one fact.
Pivot treats equal fact values as one fact · case 04
Pivot treats equal fact values as one fact.
Pivot treats equal fact values as one fact · case 05
Pivot treats equal fact values as one fact.
Unpivot materializes absent columns as explicit null values · case 01
Unpivot materializes absent columns as explicit null values.
Unpivot materializes absent columns as explicit null values · case 02
Unpivot materializes absent columns as explicit null values.
Unpivot materializes absent columns as explicit null values · case 03
Unpivot materializes absent columns as explicit null values.
Unpivot materializes absent columns as explicit null values · case 04
Unpivot materializes absent columns as explicit null values.
Unpivot materializes absent columns as explicit null values · case 05
Unpivot materializes absent columns as explicit null values.
Unpivot removes explicitly stored null field values · case 01
Unpivot removes explicitly stored null field values.
Unpivot removes explicitly stored null field values · case 02
Unpivot removes explicitly stored null field values.
Unpivot removes explicitly stored null field values · case 03
Unpivot removes explicitly stored null field values.
Unpivot removes explicitly stored null field values · case 04
Unpivot removes explicitly stored null field values.
Unpivot removes explicitly stored null field values · case 05
Unpivot removes explicitly stored null field values.
Unpivot iterates selected columns in sorted name order · case 01
Unpivot iterates selected columns in sorted name order.
Unpivot iterates selected columns in sorted name order · case 02
Unpivot iterates selected columns in sorted name order.
Unpivot iterates selected columns in sorted name order · case 03
Unpivot iterates selected columns in sorted name order.
Unpivot iterates selected columns in sorted name order · case 04
Unpivot iterates selected columns in sorted name order.
Unpivot iterates selected columns in sorted name order · case 05
Unpivot iterates selected columns in sorted name order.
Unpivot deduplicates repeated selected columns · case 01
Unpivot deduplicates repeated selected columns.
Unpivot deduplicates repeated selected columns · case 02
Unpivot deduplicates repeated selected columns.
Unpivot deduplicates repeated selected columns · case 03
Unpivot deduplicates repeated selected columns.
Unpivot deduplicates repeated selected columns · case 04
Unpivot deduplicates repeated selected columns.
Unpivot deduplicates repeated selected columns · case 05
Unpivot deduplicates repeated selected columns.
Unpivot uses row position instead of the identity column · case 01
Unpivot uses row position instead of the identity column.
Unpivot uses row position instead of the identity column · case 02
Unpivot uses row position instead of the identity column.
Unpivot uses row position instead of the identity column · case 03
Unpivot uses row position instead of the identity column.
Unpivot uses row position instead of the identity column · case 04
Unpivot uses row position instead of the identity column.
Unpivot uses row position instead of the identity column · case 05
Unpivot uses row position instead of the identity column.
Unpivot sorts parents by identity before expansion · case 01
Unpivot sorts parents by identity before expansion.
Unpivot sorts parents by identity before expansion · case 02
Unpivot sorts parents by identity before expansion.
Unpivot sorts parents by identity before expansion · case 03
Unpivot sorts parents by identity before expansion.
Unpivot sorts parents by identity before expansion · case 04
Unpivot sorts parents by identity before expansion.
Unpivot sorts parents by identity before expansion · case 05
Unpivot sorts parents by identity before expansion.
Hash-join probe treats bucket equality as key equality · case 01
Hash-join probe treats bucket equality as key equality.
Hash-join probe treats bucket equality as key equality · case 02
Hash-join probe treats bucket equality as key equality.
Hash-join probe treats bucket equality as key equality · case 03
Hash-join probe treats bucket equality as key equality.
Hash-join probe treats bucket equality as key equality · case 04
Hash-join probe treats bucket equality as key equality.
Hash-join probe treats bucket equality as key equality · case 05
Hash-join probe treats bucket equality as key equality.
Hash-join probe omits its non-equality residual · case 01
Hash-join probe omits its non-equality residual.
Hash-join probe omits its non-equality residual · case 02
Hash-join probe omits its non-equality residual.
Hash-join probe omits its non-equality residual · case 03
Hash-join probe omits its non-equality residual.
Hash-join probe omits its non-equality residual · case 04
Hash-join probe omits its non-equality residual.
Hash-join probe omits its non-equality residual · case 05
Hash-join probe omits its non-equality residual.
Hash-join build buckets retain only the final row · case 01
Hash-join build buckets retain only the final row.
Hash-join build buckets retain only the final row · case 02
Hash-join build buckets retain only the final row.
Hash-join build buckets retain only the final row · case 03
Hash-join build buckets retain only the final row.
Hash-join build buckets retain only the final row · case 04
Hash-join build buckets retain only the final row.
Hash-join build buckets retain only the final row · case 05
Hash-join build buckets retain only the final row.
Hash-join probe computes bucket from row identity · case 01
Hash-join probe computes bucket from row identity.
Hash-join probe computes bucket from row identity · case 02
Hash-join probe computes bucket from row identity.
Hash-join probe computes bucket from row identity · case 03
Hash-join probe computes bucket from row identity.
Hash-join probe computes bucket from row identity · case 04
Hash-join probe computes bucket from row identity.
Hash-join probe computes bucket from row identity · case 05
Hash-join probe computes bucket from row identity.
Hash-join build indexes buckets by payload score · case 01
Hash-join build indexes buckets by payload score.
Hash-join build indexes buckets by payload score · case 02
Hash-join build indexes buckets by payload score.
Hash-join build indexes buckets by payload score · case 03
Hash-join build indexes buckets by payload score.
Hash-join build indexes buckets by payload score · case 04
Hash-join build indexes buckets by payload score.
Hash-join build indexes buckets by payload score · case 05
Hash-join build indexes buckets by payload score.
Hash join emits matched keys instead of build row IDs · case 01
Hash join emits matched keys instead of build row IDs.
Hash join emits matched keys instead of build row IDs · case 02
Hash join emits matched keys instead of build row IDs.
Hash join emits matched keys instead of build row IDs · case 03
Hash join emits matched keys instead of build row IDs.
Hash join emits matched keys instead of build row IDs · case 04
Hash join emits matched keys instead of build row IDs.
Hash join emits matched keys instead of build row IDs · case 05
Hash join emits matched keys instead of build row IDs.
Merge join matches only the first row of a repeated left key · case 01
Merge join matches only the first row of a repeated left key.
Merge join matches only the first row of a repeated left key · case 02
Merge join matches only the first row of a repeated left key.
Merge join matches only the first row of a repeated left key · case 03
Merge join matches only the first row of a repeated left key.
Merge join matches only the first row of a repeated left key · case 04
Merge join matches only the first row of a repeated left key.
Merge join matches only the first row of a repeated left key · case 05
Merge join matches only the first row of a repeated left key.
Merge join matches only the first row of a repeated right key · case 01
Merge join matches only the first row of a repeated right key.
Merge join matches only the first row of a repeated right key · case 02
Merge join matches only the first row of a repeated right key.
Merge join matches only the first row of a repeated right key · case 03
Merge join matches only the first row of a repeated right key.
Merge join matches only the first row of a repeated right key · case 04
Merge join matches only the first row of a repeated right key.
Merge join matches only the first row of a repeated right key · case 05
Merge join matches only the first row of a repeated right key.
Merge join advances the right cursor when the left key is smaller · case 01
Merge join advances the right cursor when the left key is smaller.
Merge join advances the right cursor when the left key is smaller · case 02
Merge join advances the right cursor when the left key is smaller.
Merge join advances the right cursor when the left key is smaller · case 03
Merge join advances the right cursor when the left key is smaller.
Merge join advances the right cursor when the left key is smaller · case 04
Merge join advances the right cursor when the left key is smaller.
Merge join advances the right cursor when the left key is smaller · case 05
Merge join advances the right cursor when the left key is smaller.
Merge join advances the left cursor when the right key is smaller · case 01
Merge join advances the left cursor when the right key is smaller.
Merge join advances the left cursor when the right key is smaller · case 02
Merge join advances the left cursor when the right key is smaller.
Merge join advances the left cursor when the right key is smaller · case 03
Merge join advances the left cursor when the right key is smaller.
Merge join advances the left cursor when the right key is smaller · case 04
Merge join advances the left cursor when the right key is smaller.
Merge join advances the left cursor when the right key is smaller · case 05
Merge join advances the left cursor when the right key is smaller.
Merge join reuses only one build row per equal-key run · case 01
Merge join reuses only one build row per equal-key run.
Merge join reuses only one build row per equal-key run · case 02
Merge join reuses only one build row per equal-key run.
Merge join reuses only one build row per equal-key run · case 03
Merge join reuses only one build row per equal-key run.
Merge join reuses only one build row per equal-key run · case 04
Merge join reuses only one build row per equal-key run.
Merge join reuses only one build row per equal-key run · case 05
Merge join reuses only one build row per equal-key run.
Merge join reverses left-run order while emitting pairs · case 01
Merge join reverses left-run order while emitting pairs.
Merge join reverses left-run order while emitting pairs · case 02
Merge join reverses left-run order while emitting pairs.
Merge join reverses left-run order while emitting pairs · case 03
Merge join reverses left-run order while emitting pairs.
Merge join reverses left-run order while emitting pairs · case 04
Merge join reverses left-run order while emitting pairs.
Merge join reverses left-run order while emitting pairs · case 05
Merge join reverses left-run order while emitting pairs.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗