Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Anti join: Tests a nullable payload to identify unmatched join rows · case 01
The query violates its result contract: tests a nullable payload to identify unmatched join rows.
Anti join: Tests a nullable payload to identify unmatched join rows · case 02
The query violates its result contract: tests a nullable payload to identify unmatched join rows.
Anti join: Tests a nullable payload to identify unmatched join rows · case 03
The query violates its result contract: tests a nullable payload to identify unmatched join rows.
Anti join: Tests a nullable payload to identify unmatched join rows · case 04
The query violates its result contract: tests a nullable payload to identify unmatched join rows.
Anti join: Tests a nullable payload to identify unmatched join rows · case 05
The query violates its result contract: tests a nullable payload to identify unmatched join rows.
Anti join: Suppresses all left rows whenever any right row exists · case 01
The query violates its result contract: suppresses all left rows whenever any right row exists.
Anti join: Suppresses all left rows whenever any right row exists · case 02
The query violates its result contract: suppresses all left rows whenever any right row exists.
Anti join: Suppresses all left rows whenever any right row exists · case 03
The query violates its result contract: suppresses all left rows whenever any right row exists.
Anti join: Suppresses all left rows whenever any right row exists · case 04
The query violates its result contract: suppresses all left rows whenever any right row exists.
Anti join: Suppresses all left rows whenever any right row exists · case 05
The query violates its result contract: suppresses all left rows whenever any right row exists.
Anti join: Excludes NULL keys when right NULL keys exist · case 01
The query violates its result contract: excludes null keys when right null keys exist.
Anti join: Excludes NULL keys when right NULL keys exist · case 02
The query violates its result contract: excludes null keys when right null keys exist.
Anti join: Excludes NULL keys when right NULL keys exist · case 03
The query violates its result contract: excludes null keys when right null keys exist.
Anti join: Excludes NULL keys when right NULL keys exist · case 04
The query violates its result contract: excludes null keys when right null keys exist.
Anti join: Excludes NULL keys when right NULL keys exist · case 05
The query violates its result contract: excludes null keys when right null keys exist.
Anti join: Excludes by measurement rather than key · case 01
The query violates its result contract: excludes by measurement rather than key.
Anti join: Excludes by measurement rather than key · case 02
The query violates its result contract: excludes by measurement rather than key.
Anti join: Excludes by measurement rather than key · case 03
The query violates its result contract: excludes by measurement rather than key.
Anti join: Excludes by measurement rather than key · case 04
The query violates its result contract: excludes by measurement rather than key.
Anti join: Excludes by measurement rather than key · case 05
The query violates its result contract: excludes by measurement rather than key.
Filtered left join: Moves right eligibility from ON into WHERE · case 01
The query violates its result contract: moves right eligibility from on into where.
Filtered left join: Moves right eligibility from ON into WHERE · case 02
The query violates its result contract: moves right eligibility from on into where.
Filtered left join: Moves right eligibility from ON into WHERE · case 03
The query violates its result contract: moves right eligibility from on into where.
Filtered left join: Moves right eligibility from ON into WHERE · case 04
The query violates its result contract: moves right eligibility from on into where.
Filtered left join: Moves right eligibility from ON into WHERE · case 05
The query violates its result contract: moves right eligibility from on into where.
Filtered left join: Joins ineligible right rows · case 01
The query violates its result contract: joins ineligible right rows.
Filtered left join: Joins ineligible right rows · case 02
The query violates its result contract: joins ineligible right rows.
Filtered left join: Joins ineligible right rows · case 03
The query violates its result contract: joins ineligible right rows.
Filtered left join: Joins ineligible right rows · case 04
The query violates its result contract: joins ineligible right rows.
Filtered left join: Joins ineligible right rows · case 05
The query violates its result contract: joins ineligible right rows.
Filtered left join: Filters on the left flag instead of right eligibility · case 01
The query violates its result contract: filters on the left flag instead of right eligibility.
Filtered left join: Filters on the left flag instead of right eligibility · case 02
The query violates its result contract: filters on the left flag instead of right eligibility.
Filtered left join: Filters on the left flag instead of right eligibility · case 03
The query violates its result contract: filters on the left flag instead of right eligibility.
Filtered left join: Filters on the left flag instead of right eligibility · case 04
The query violates its result contract: filters on the left flag instead of right eligibility.
Filtered left join: Filters on the left flag instead of right eligibility · case 05
The query violates its result contract: filters on the left flag instead of right eligibility.
Filtered left join: Coalesces unknown right eligibility to true · case 01
The query violates its result contract: coalesces unknown right eligibility to true.
Filtered left join: Coalesces unknown right eligibility to true · case 02
The query violates its result contract: coalesces unknown right eligibility to true.
Filtered left join: Coalesces unknown right eligibility to true · case 03
The query violates its result contract: coalesces unknown right eligibility to true.
Filtered left join: Coalesces unknown right eligibility to true · case 04
The query violates its result contract: coalesces unknown right eligibility to true.
Filtered left join: Coalesces unknown right eligibility to true · case 05
The query violates its result contract: coalesces unknown right eligibility to true.
Filtered left join: Removes left rows without eligible matches · case 01
The query violates its result contract: removes left rows without eligible matches.
Filtered left join: Removes left rows without eligible matches · case 02
The query violates its result contract: removes left rows without eligible matches.
Filtered left join: Removes left rows without eligible matches · case 03
The query violates its result contract: removes left rows without eligible matches.
Filtered left join: Removes left rows without eligible matches · case 04
The query violates its result contract: removes left rows without eligible matches.
Filtered left join: Removes left rows without eligible matches · case 05
The query violates its result contract: removes left rows without eligible matches.
Composite join: Omits the value component of a composite join key · case 01
The query violates its result contract: omits the value component of a composite join key.
Composite join: Omits the value component of a composite join key · case 02
The query violates its result contract: omits the value component of a composite join key.
Composite join: Omits the value component of a composite join key · case 03
The query violates its result contract: omits the value component of a composite join key.
Composite join: Omits the value component of a composite join key · case 04
The query violates its result contract: omits the value component of a composite join key.
Composite join: Omits the value component of a composite join key · case 05
The query violates its result contract: omits the value component of a composite join key.
Composite join: Omits the descriptive component of the composite key · case 01
The query violates its result contract: omits the descriptive component of the composite key.
Composite join: Omits the descriptive component of the composite key · case 02
The query violates its result contract: omits the descriptive component of the composite key.
Composite join: Omits the descriptive component of the composite key · case 03
The query violates its result contract: omits the descriptive component of the composite key.
Composite join: Omits the descriptive component of the composite key · case 04
The query violates its result contract: omits the descriptive component of the composite key.
Composite join: Omits the descriptive component of the composite key · case 05
The query violates its result contract: omits the descriptive component of the composite key.
Composite join: Accepts either component rather than both · case 01
The query violates its result contract: accepts either component rather than both.
Composite join: Accepts either component rather than both · case 02
The query violates its result contract: accepts either component rather than both.
Composite join: Accepts either component rather than both · case 03
The query violates its result contract: accepts either component rather than both.
Composite join: Accepts either component rather than both · case 04
The query violates its result contract: accepts either component rather than both.
Composite join: Accepts either component rather than both · case 05
The query violates its result contract: accepts either component rather than both.
Composite join: Compares the left value to the right weight · case 01
The query violates its result contract: compares the left value to the right weight.
Composite join: Compares the left value to the right weight · case 02
The query violates its result contract: compares the left value to the right weight.
Composite join: Compares the left value to the right weight · case 03
The query violates its result contract: compares the left value to the right weight.
Composite join: Compares the left value to the right weight · case 04
The query violates its result contract: compares the left value to the right weight.
Composite join: Compares the left value to the right weight · case 05
The query violates its result contract: compares the left value to the right weight.
Composite join: Matches composite keys containing NULL · case 01
The query violates its result contract: matches composite keys containing null.
Composite join: Matches composite keys containing NULL · case 02
The query violates its result contract: matches composite keys containing null.
Composite join: Matches composite keys containing NULL · case 03
The query violates its result contract: matches composite keys containing null.
Composite join: Matches composite keys containing NULL · case 04
The query violates its result contract: matches composite keys containing null.
Composite join: Matches composite keys containing NULL · case 05
The query violates its result contract: matches composite keys containing null.
Union bag: Uses UNION and erases duplicate facts · case 01
The query violates its result contract: uses union and erases duplicate facts.
Union bag: Uses UNION and erases duplicate facts · case 02
The query violates its result contract: uses union and erases duplicate facts.
Union bag: Uses UNION and erases duplicate facts · case 03
The query violates its result contract: uses union and erases duplicate facts.
Union bag: Uses UNION and erases duplicate facts · case 04
The query violates its result contract: uses union and erases duplicate facts.
Union bag: Uses UNION and erases duplicate facts · case 05
The query violates its result contract: uses union and erases duplicate facts.
Union bag: Deduplicates the left branch before bag union · case 01
The query violates its result contract: deduplicates the left branch before bag union.
Union bag: Deduplicates the left branch before bag union · case 02
The query violates its result contract: deduplicates the left branch before bag union.
Union bag: Deduplicates the left branch before bag union · case 03
The query violates its result contract: deduplicates the left branch before bag union.
Union bag: Deduplicates the left branch before bag union · case 04
The query violates its result contract: deduplicates the left branch before bag union.
Union bag: Deduplicates the left branch before bag union · case 05
The query violates its result contract: deduplicates the left branch before bag union.
Union bag: Deduplicates the right branch before bag union · case 01
The query violates its result contract: deduplicates the right branch before bag union.
Union bag: Deduplicates the right branch before bag union · case 02
The query violates its result contract: deduplicates the right branch before bag union.
Union bag: Deduplicates the right branch before bag union · case 03
The query violates its result contract: deduplicates the right branch before bag union.
Union bag: Deduplicates the right branch before bag union · case 04
The query violates its result contract: deduplicates the right branch before bag union.
Union bag: Deduplicates the right branch before bag union · case 05
The query violates its result contract: deduplicates the right branch before bag union.
Union bag: Returns only common keys · case 01
The query violates its result contract: returns only common keys.
Union bag: Returns only common keys · case 02
The query violates its result contract: returns only common keys.
Union bag: Returns only common keys · case 03
The query violates its result contract: returns only common keys.
Union bag: Returns only common keys · case 04
The query violates its result contract: returns only common keys.
Union bag: Returns only common keys · case 05
The query violates its result contract: returns only common keys.
Union bag: Filters unknown keys out of both branches · case 01
The query violates its result contract: filters unknown keys out of both branches.
Union bag: Filters unknown keys out of both branches · case 02
The query violates its result contract: filters unknown keys out of both branches.
Union bag: Filters unknown keys out of both branches · case 03
The query violates its result contract: filters unknown keys out of both branches.
Union bag: Filters unknown keys out of both branches · case 04
The query violates its result contract: filters unknown keys out of both branches.
Union bag: Filters unknown keys out of both branches · case 05
The query violates its result contract: filters unknown keys out of both branches.
Intersect set: Implements set intersection as a bag join · case 01
The query violates its result contract: implements set intersection as a bag join.
Intersect set: Implements set intersection as a bag join · case 02
The query violates its result contract: implements set intersection as a bag join.
Intersect set: Implements set intersection as a bag join · case 03
The query violates its result contract: implements set intersection as a bag join.
Intersect set: Implements set intersection as a bag join · case 04
The query violates its result contract: implements set intersection as a bag join.
Intersect set: Implements set intersection as a bag join · case 05
The query violates its result contract: implements set intersection as a bag join.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗