Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Zip unnest swaps left and right child columns · case 01
Zip unnest swaps left and right child columns.
Zip unnest swaps left and right child columns · case 02
Zip unnest swaps left and right child columns.
Zip unnest swaps left and right child columns · case 03
Zip unnest swaps left and right child columns.
Zip unnest swaps left and right child columns · case 04
Zip unnest swaps left and right child columns.
Zip unnest swaps left and right child columns · case 05
Zip unnest swaps left and right child columns.
Zip unnest exposes flattened output offsets as list ordinals · case 01
Zip unnest exposes flattened output offsets as list ordinals.
Zip unnest exposes flattened output offsets as list ordinals · case 02
Zip unnest exposes flattened output offsets as list ordinals.
Zip unnest exposes flattened output offsets as list ordinals · case 03
Zip unnest exposes flattened output offsets as list ordinals.
Zip unnest exposes flattened output offsets as list ordinals · case 04
Zip unnest exposes flattened output offsets as list ordinals.
Zip unnest exposes flattened output offsets as list ordinals · case 05
Zip unnest exposes flattened output offsets as list ordinals.
A simultaneous join update omits the delta-delta product · case 01
A simultaneous join update omits the delta-delta product.
A simultaneous join update omits the delta-delta product · case 02
A simultaneous join update omits the delta-delta product.
A simultaneous join update omits the delta-delta product · case 03
A simultaneous join update omits the delta-delta product.
A simultaneous join update omits the delta-delta product · case 04
A simultaneous join update omits the delta-delta product.
A simultaneous join update omits the delta-delta product · case 05
A simultaneous join update omits the delta-delta product.
A simultaneous join update counts the delta-delta product twice · case 01
A simultaneous join update counts the delta-delta product twice.
A simultaneous join update counts the delta-delta product twice · case 02
A simultaneous join update counts the delta-delta product twice.
A simultaneous join update counts the delta-delta product twice · case 03
A simultaneous join update counts the delta-delta product twice.
A simultaneous join update counts the delta-delta product twice · case 04
A simultaneous join update counts the delta-delta product twice.
A simultaneous join update counts the delta-delta product twice · case 05
A simultaneous join update counts the delta-delta product twice.
Join delta weights lose retraction signs · case 01
Join delta weights lose retraction signs.
Join delta weights lose retraction signs · case 02
Join delta weights lose retraction signs.
Join delta weights lose retraction signs · case 03
Join delta weights lose retraction signs.
Join delta weights lose retraction signs · case 04
Join delta weights lose retraction signs.
Join delta weights lose retraction signs · case 05
Join delta weights lose retraction signs.
Incremental join matches null join keys · case 01
Incremental join matches null join keys.
Incremental join matches null join keys · case 02
Incremental join matches null join keys.
Incremental join matches null join keys · case 03
Incremental join matches null join keys.
Incremental join matches null join keys · case 04
Incremental join matches null join keys.
Incremental join matches null join keys · case 05
Incremental join matches null join keys.
Join delta consolidation groups only by left payload · case 01
Join delta consolidation groups only by left payload.
Join delta consolidation groups only by left payload · case 02
Join delta consolidation groups only by left payload.
Join delta consolidation groups only by left payload · case 03
Join delta consolidation groups only by left payload.
Join delta consolidation groups only by left payload · case 04
Join delta consolidation groups only by left payload.
Join delta consolidation groups only by left payload · case 05
Join delta consolidation groups only by left payload.
Consolidated zero-weight join rows remain in the changelog · case 01
Consolidated zero-weight join rows remain in the changelog.
Consolidated zero-weight join rows remain in the changelog · case 02
Consolidated zero-weight join rows remain in the changelog.
Consolidated zero-weight join rows remain in the changelog · case 03
Consolidated zero-weight join rows remain in the changelog.
Consolidated zero-weight join rows remain in the changelog · case 04
Consolidated zero-weight join rows remain in the changelog.
Consolidated zero-weight join rows remain in the changelog · case 05
Consolidated zero-weight join rows remain in the changelog.
Incremental distinct replaces counts with delta weights · case 01
Incremental distinct replaces counts with delta weights.
Incremental distinct replaces counts with delta weights · case 02
Incremental distinct replaces counts with delta weights.
Incremental distinct replaces counts with delta weights · case 03
Incremental distinct replaces counts with delta weights.
Incremental distinct replaces counts with delta weights · case 04
Incremental distinct replaces counts with delta weights.
Incremental distinct replaces counts with delta weights · case 05
Incremental distinct replaces counts with delta weights.
Distinct mutates its before-image while applying changes · case 01
Distinct mutates its before-image while applying changes.
Distinct mutates its before-image while applying changes · case 02
Distinct mutates its before-image while applying changes.
Distinct mutates its before-image while applying changes · case 03
Distinct mutates its before-image while applying changes.
Distinct mutates its before-image while applying changes · case 04
Distinct mutates its before-image while applying changes.
Distinct mutates its before-image while applying changes · case 05
Distinct mutates its before-image while applying changes.
Distinct requires two live copies before a value becomes present · case 01
Distinct requires two live copies before a value becomes present.
Distinct requires two live copies before a value becomes present · case 02
Distinct requires two live copies before a value becomes present.
Distinct requires two live copies before a value becomes present · case 03
Distinct requires two live copies before a value becomes present.
Distinct requires two live copies before a value becomes present · case 04
Distinct requires two live copies before a value becomes present.
Distinct requires two live copies before a value becomes present · case 05
Distinct requires two live copies before a value becomes present.
Distinct scans only values present before the batch · case 01
Distinct scans only values present before the batch.
Distinct scans only values present before the batch · case 02
Distinct scans only values present before the batch.
Distinct scans only values present before the batch · case 03
Distinct scans only values present before the batch.
Distinct scans only values present before the batch · case 04
Distinct scans only values present before the batch.
Distinct scans only values present before the batch · case 05
Distinct scans only values present before the batch.
Distinct forwards count changes that do not cross membership · case 01
Distinct forwards count changes that do not cross membership.
Distinct forwards count changes that do not cross membership · case 02
Distinct forwards count changes that do not cross membership.
Distinct forwards count changes that do not cross membership · case 03
Distinct forwards count changes that do not cross membership.
Distinct forwards count changes that do not cross membership · case 04
Distinct forwards count changes that do not cross membership.
Distinct forwards count changes that do not cross membership · case 05
Distinct forwards count changes that do not cross membership.
Distinct removal events use insertion polarity · case 01
Distinct removal events use insertion polarity.
Distinct removal events use insertion polarity · case 02
Distinct removal events use insertion polarity.
Distinct removal events use insertion polarity · case 03
Distinct removal events use insertion polarity.
Distinct removal events use insertion polarity · case 04
Distinct removal events use insertion polarity.
Distinct removal events use insertion polarity · case 05
Distinct removal events use insertion polarity.
Update filtering uses the after predicate for its before image · case 01
Update filtering uses the after predicate for its before image.
Update filtering uses the after predicate for its before image · case 02
Update filtering uses the after predicate for its before image.
Update filtering uses the after predicate for its before image · case 03
Update filtering uses the after predicate for its before image.
Update filtering uses the after predicate for its before image · case 04
Update filtering uses the after predicate for its before image.
Update filtering uses the after predicate for its before image · case 05
Update filtering uses the after predicate for its before image.
Update filtering uses the before predicate for its after image · case 01
Update filtering uses the before predicate for its after image.
Update filtering uses the before predicate for its after image · case 02
Update filtering uses the before predicate for its after image.
Update filtering uses the before predicate for its after image · case 03
Update filtering uses the before predicate for its after image.
Update filtering uses the before predicate for its after image · case 04
Update filtering uses the before predicate for its after image.
Update filtering uses the before predicate for its after image · case 05
Update filtering uses the before predicate for its after image.
Filtered updates emit unchanged rows as spurious changes · case 01
Filtered updates emit unchanged rows as spurious changes.
Filtered updates emit unchanged rows as spurious changes · case 02
Filtered updates emit unchanged rows as spurious changes.
Filtered updates emit unchanged rows as spurious changes · case 03
Filtered updates emit unchanged rows as spurious changes.
Filtered updates emit unchanged rows as spurious changes · case 04
Filtered updates emit unchanged rows as spurious changes.
Filtered updates emit unchanged rows as spurious changes · case 05
Filtered updates emit unchanged rows as spurious changes.
Retractions carry the new value instead of the old value · case 01
Retractions carry the new value instead of the old value.
Retractions carry the new value instead of the old value · case 02
Retractions carry the new value instead of the old value.
Retractions carry the new value instead of the old value · case 03
Retractions carry the new value instead of the old value.
Retractions carry the new value instead of the old value · case 04
Retractions carry the new value instead of the old value.
Retractions carry the new value instead of the old value · case 05
Retractions carry the new value instead of the old value.
Insertions carry the old value instead of the new value · case 01
Insertions carry the old value instead of the new value.
Insertions carry the old value instead of the new value · case 02
Insertions carry the old value instead of the new value.
Insertions carry the old value instead of the new value · case 03
Insertions carry the old value instead of the new value.
Insertions carry the old value instead of the new value · case 04
Insertions carry the old value instead of the new value.
Insertions carry the old value instead of the new value · case 05
Insertions carry the old value instead of the new value.
A filtered update publishes insertion before retraction · case 01
A filtered update publishes insertion before retraction.
A filtered update publishes insertion before retraction · case 02
A filtered update publishes insertion before retraction.
A filtered update publishes insertion before retraction · case 03
A filtered update publishes insertion before retraction.
A filtered update publishes insertion before retraction · case 04
A filtered update publishes insertion before retraction.
A filtered update publishes insertion before retraction · case 05
A filtered update publishes insertion before retraction.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗