Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Top-k retractions carry updated scores instead of old scores · case 01
Top-k retractions carry updated scores instead of old scores.
Top-k retractions carry updated scores instead of old scores · case 02
Top-k retractions carry updated scores instead of old scores.
Top-k retractions carry updated scores instead of old scores · case 03
Top-k retractions carry updated scores instead of old scores.
Top-k retractions carry updated scores instead of old scores · case 04
Top-k retractions carry updated scores instead of old scores.
Top-k retractions carry updated scores instead of old scores · case 05
Top-k retractions carry updated scores instead of old scores.
Top-k suppresses retractions for score changes of surviving IDs · case 01
Top-k suppresses retractions for score changes of surviving IDs.
Top-k suppresses retractions for score changes of surviving IDs · case 02
Top-k suppresses retractions for score changes of surviving IDs.
Top-k suppresses retractions for score changes of surviving IDs · case 03
Top-k suppresses retractions for score changes of surviving IDs.
Top-k suppresses retractions for score changes of surviving IDs · case 04
Top-k suppresses retractions for score changes of surviving IDs.
Top-k suppresses retractions for score changes of surviving IDs · case 05
Top-k suppresses retractions for score changes of surviving IDs.
Top-k suppresses insertions for score changes of surviving IDs · case 01
Top-k suppresses insertions for score changes of surviving IDs.
Top-k suppresses insertions for score changes of surviving IDs · case 02
Top-k suppresses insertions for score changes of surviving IDs.
Top-k suppresses insertions for score changes of surviving IDs · case 03
Top-k suppresses insertions for score changes of surviving IDs.
Top-k suppresses insertions for score changes of surviving IDs · case 04
Top-k suppresses insertions for score changes of surviving IDs.
Top-k suppresses insertions for score changes of surviving IDs · case 05
Top-k suppresses insertions for score changes of surviving IDs.
Top-k publishes new membership before retracting old tuples · case 01
Top-k publishes new membership before retracting old tuples.
Top-k publishes new membership before retracting old tuples · case 02
Top-k publishes new membership before retracting old tuples.
Top-k publishes new membership before retracting old tuples · case 03
Top-k publishes new membership before retracting old tuples.
Top-k publishes new membership before retracting old tuples · case 04
Top-k publishes new membership before retracting old tuples.
Top-k publishes new membership before retracting old tuples · case 05
Top-k publishes new membership before retracting old tuples.
Temporal enrichment selects dimension versions after fact time · case 01
Temporal enrichment selects dimension versions after fact time.
Temporal enrichment selects dimension versions after fact time · case 02
Temporal enrichment selects dimension versions after fact time.
Temporal enrichment selects dimension versions after fact time · case 03
Temporal enrichment selects dimension versions after fact time.
Temporal enrichment selects dimension versions after fact time · case 04
Temporal enrichment selects dimension versions after fact time.
Temporal enrichment selects dimension versions after fact time · case 05
Temporal enrichment selects dimension versions after fact time.
Temporal enrichment excludes a version effective exactly at fact time · case 01
Temporal enrichment excludes a version effective exactly at fact time.
Temporal enrichment excludes a version effective exactly at fact time · case 02
Temporal enrichment excludes a version effective exactly at fact time.
Temporal enrichment excludes a version effective exactly at fact time · case 03
Temporal enrichment excludes a version effective exactly at fact time.
Temporal enrichment excludes a version effective exactly at fact time · case 04
Temporal enrichment excludes a version effective exactly at fact time.
Temporal enrichment excludes a version effective exactly at fact time · case 05
Temporal enrichment excludes a version effective exactly at fact time.
Temporal enrichment ignores revisions at equal effective time · case 01
Temporal enrichment ignores revisions at equal effective time.
Temporal enrichment ignores revisions at equal effective time · case 02
Temporal enrichment ignores revisions at equal effective time.
Temporal enrichment ignores revisions at equal effective time · case 03
Temporal enrichment ignores revisions at equal effective time.
Temporal enrichment ignores revisions at equal effective time · case 04
Temporal enrichment ignores revisions at equal effective time.
Temporal enrichment ignores revisions at equal effective time · case 05
Temporal enrichment ignores revisions at equal effective time.
Temporal enrichment skips tombstones and revives older dimension values · case 01
Temporal enrichment skips tombstones and revives older dimension values.
Temporal enrichment skips tombstones and revives older dimension values · case 02
Temporal enrichment skips tombstones and revives older dimension values.
Temporal enrichment skips tombstones and revives older dimension values · case 03
Temporal enrichment skips tombstones and revives older dimension values.
Temporal enrichment skips tombstones and revives older dimension values · case 04
Temporal enrichment skips tombstones and revives older dimension values.
Temporal enrichment skips tombstones and revives older dimension values · case 05
Temporal enrichment skips tombstones and revives older dimension values.
Temporal enrichment chooses the newest version across all keys · case 01
Temporal enrichment chooses the newest version across all keys.
Temporal enrichment chooses the newest version across all keys · case 02
Temporal enrichment chooses the newest version across all keys.
Temporal enrichment chooses the newest version across all keys · case 03
Temporal enrichment chooses the newest version across all keys.
Temporal enrichment chooses the newest version across all keys · case 04
Temporal enrichment chooses the newest version across all keys.
Temporal enrichment chooses the newest version across all keys · case 05
Temporal enrichment chooses the newest version across all keys.
Temporal enrichment exposes the hidden payload of a deleted dimension row · case 01
Temporal enrichment exposes the hidden payload of a deleted dimension row.
Temporal enrichment exposes the hidden payload of a deleted dimension row · case 02
Temporal enrichment exposes the hidden payload of a deleted dimension row.
Temporal enrichment exposes the hidden payload of a deleted dimension row · case 03
Temporal enrichment exposes the hidden payload of a deleted dimension row.
Temporal enrichment exposes the hidden payload of a deleted dimension row · case 04
Temporal enrichment exposes the hidden payload of a deleted dimension row.
Temporal enrichment exposes the hidden payload of a deleted dimension row · case 05
Temporal enrichment exposes the hidden payload of a deleted dimension row.
Exchange receivers share the same mutable row buffer · case 01
Exchange receivers share the same mutable row buffer.
Exchange receivers share the same mutable row buffer · case 02
Exchange receivers share the same mutable row buffer.
Exchange receivers share the same mutable row buffer · case 03
Exchange receivers share the same mutable row buffer.
Exchange receivers share the same mutable row buffer · case 04
Exchange receivers share the same mutable row buffer.
Exchange receivers share the same mutable row buffer · case 05
Exchange receivers share the same mutable row buffer.
Exchange routes null keys to receiver zero instead of the configured receiver · case 01
Exchange routes null keys to receiver zero instead of the configured receiver.
Exchange routes null keys to receiver zero instead of the configured receiver · case 02
Exchange routes null keys to receiver zero instead of the configured receiver.
Exchange routes null keys to receiver zero instead of the configured receiver · case 03
Exchange routes null keys to receiver zero instead of the configured receiver.
Exchange routes null keys to receiver zero instead of the configured receiver · case 04
Exchange routes null keys to receiver zero instead of the configured receiver.
Exchange routes null keys to receiver zero instead of the configured receiver · case 05
Exchange routes null keys to receiver zero instead of the configured receiver.
Exchange looks up row identity instead of the routing key · case 01
Exchange looks up row identity instead of the routing key.
Exchange looks up row identity instead of the routing key · case 02
Exchange looks up row identity instead of the routing key.
Exchange looks up row identity instead of the routing key · case 03
Exchange looks up row identity instead of the routing key.
Exchange looks up row identity instead of the routing key · case 04
Exchange looks up row identity instead of the routing key.
Exchange looks up row identity instead of the routing key · case 05
Exchange looks up row identity instead of the routing key.
Exchange silently routes unmapped keys to receiver zero · case 01
Exchange silently routes unmapped keys to receiver zero.
Exchange silently routes unmapped keys to receiver zero · case 02
Exchange silently routes unmapped keys to receiver zero.
Exchange silently routes unmapped keys to receiver zero · case 03
Exchange silently routes unmapped keys to receiver zero.
Exchange silently routes unmapped keys to receiver zero · case 04
Exchange silently routes unmapped keys to receiver zero.
Exchange silently routes unmapped keys to receiver zero · case 05
Exchange silently routes unmapped keys to receiver zero.
Exchange drops row identity while transferring payload · case 01
Exchange drops row identity while transferring payload.
Exchange drops row identity while transferring payload · case 02
Exchange drops row identity while transferring payload.
Exchange drops row identity while transferring payload · case 03
Exchange drops row identity while transferring payload.
Exchange drops row identity while transferring payload · case 04
Exchange drops row identity while transferring payload.
Exchange drops row identity while transferring payload · case 05
Exchange drops row identity while transferring payload.
Exchange removes empty receivers from its output · case 01
Exchange removes empty receivers from its output.
Exchange removes empty receivers from its output · case 02
Exchange removes empty receivers from its output.
Exchange removes empty receivers from its output · case 03
Exchange removes empty receivers from its output.
Exchange removes empty receivers from its output · case 04
Exchange removes empty receivers from its output.
Exchange removes empty receivers from its output · case 05
Exchange removes empty receivers from its output.
Recursive query re-expands all previously emitted rows · case 01
Recursive query re-expands all previously emitted rows.
Recursive query re-expands all previously emitted rows · case 02
Recursive query re-expands all previously emitted rows.
Recursive query re-expands all previously emitted rows · case 03
Recursive query re-expands all previously emitted rows.
Recursive query re-expands all previously emitted rows · case 04
Recursive query re-expands all previously emitted rows.
Recursive query re-expands all previously emitted rows · case 05
Recursive query re-expands all previously emitted rows.
Recursive UNION ALL deduplicates its anchor relation · case 01
Recursive UNION ALL deduplicates its anchor relation.
Recursive UNION ALL deduplicates its anchor relation · case 02
Recursive UNION ALL deduplicates its anchor relation.
Recursive UNION ALL deduplicates its anchor relation · case 03
Recursive UNION ALL deduplicates its anchor relation.
Recursive UNION ALL deduplicates its anchor relation · case 04
Recursive UNION ALL deduplicates its anchor relation.
Recursive UNION ALL deduplicates its anchor relation · case 05
Recursive UNION ALL deduplicates its anchor relation.
Recursive UNION ALL deduplicates repeated recursive join rules · case 01
Recursive UNION ALL deduplicates repeated recursive join rules.
Recursive UNION ALL deduplicates repeated recursive join rules · case 02
Recursive UNION ALL deduplicates repeated recursive join rules.
Recursive UNION ALL deduplicates repeated recursive join rules · case 03
Recursive UNION ALL deduplicates repeated recursive join rules.
Recursive UNION ALL deduplicates repeated recursive join rules · case 04
Recursive UNION ALL deduplicates repeated recursive join rules.
Recursive UNION ALL deduplicates repeated recursive join rules · case 05
Recursive UNION ALL deduplicates repeated recursive join rules.
Recursive query omits the requested final expansion depth · case 01
Recursive query omits the requested final expansion depth.
Recursive query omits the requested final expansion depth · case 02
Recursive query omits the requested final expansion depth.
Recursive query omits the requested final expansion depth · case 03
Recursive query omits the requested final expansion depth.
Recursive query omits the requested final expansion depth · case 04
Recursive query omits the requested final expansion depth.
Recursive query omits the requested final expansion depth · case 05
Recursive query omits the requested final expansion depth.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗