Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Outside range: Requires both mutually exclusive outside conditions · case 01
The query violates its result contract: requires both mutually exclusive outside conditions.
Outside range: Requires both mutually exclusive outside conditions · case 02
The query violates its result contract: requires both mutually exclusive outside conditions.
Outside range: Requires both mutually exclusive outside conditions · case 03
The query violates its result contract: requires both mutually exclusive outside conditions.
Outside range: Requires both mutually exclusive outside conditions · case 04
The query violates its result contract: requires both mutually exclusive outside conditions.
Outside range: Requires both mutually exclusive outside conditions · case 05
The query violates its result contract: requires both mutually exclusive outside conditions.
Outside range: Includes the closed lower boundary in the exterior · case 01
The query violates its result contract: includes the closed lower boundary in the exterior.
Outside range: Includes the closed lower boundary in the exterior · case 02
The query violates its result contract: includes the closed lower boundary in the exterior.
Outside range: Includes the closed lower boundary in the exterior · case 03
The query violates its result contract: includes the closed lower boundary in the exterior.
Outside range: Includes the closed lower boundary in the exterior · case 04
The query violates its result contract: includes the closed lower boundary in the exterior.
Outside range: Includes the closed lower boundary in the exterior · case 05
The query violates its result contract: includes the closed lower boundary in the exterior.
Outside range: Includes the closed upper boundary in the exterior · case 01
The query violates its result contract: includes the closed upper boundary in the exterior.
Outside range: Includes the closed upper boundary in the exterior · case 02
The query violates its result contract: includes the closed upper boundary in the exterior.
Outside range: Includes the closed upper boundary in the exterior · case 03
The query violates its result contract: includes the closed upper boundary in the exterior.
Outside range: Includes the closed upper boundary in the exterior · case 04
The query violates its result contract: includes the closed upper boundary in the exterior.
Outside range: Includes the closed upper boundary in the exterior · case 05
The query violates its result contract: includes the closed upper boundary in the exterior.
Outside range: Treats unknown values as proven outside · case 01
The query violates its result contract: treats unknown values as proven outside.
Outside range: Treats unknown values as proven outside · case 02
The query violates its result contract: treats unknown values as proven outside.
Outside range: Treats unknown values as proven outside · case 03
The query violates its result contract: treats unknown values as proven outside.
Outside range: Treats unknown values as proven outside · case 04
The query violates its result contract: treats unknown values as proven outside.
Outside range: Treats unknown values as proven outside · case 05
The query violates its result contract: treats unknown values as proven outside.
Outside range: Negates only the lower-bound comparison · case 01
The query violates its result contract: negates only the lower-bound comparison.
Outside range: Negates only the lower-bound comparison · case 02
The query violates its result contract: negates only the lower-bound comparison.
Outside range: Negates only the lower-bound comparison · case 03
The query violates its result contract: negates only the lower-bound comparison.
Outside range: Negates only the lower-bound comparison · case 04
The query violates its result contract: negates only the lower-bound comparison.
Outside range: Negates only the lower-bound comparison · case 05
The query violates its result contract: negates only the lower-bound comparison.
Nullable equality: Changes SQL equality to NULL-safe equality · case 01
The query violates its result contract: changes sql equality to null-safe equality.
Nullable equality: Changes SQL equality to NULL-safe equality · case 02
The query violates its result contract: changes sql equality to null-safe equality.
Nullable equality: Changes SQL equality to NULL-safe equality · case 03
The query violates its result contract: changes sql equality to null-safe equality.
Nullable equality: Changes SQL equality to NULL-safe equality · case 04
The query violates its result contract: changes sql equality to null-safe equality.
Nullable equality: Changes SQL equality to NULL-safe equality · case 05
The query violates its result contract: changes sql equality to null-safe equality.
Nullable equality: Coalesces NULL and zero to one join key · case 01
The query violates its result contract: coalesces null and zero to one join key.
Nullable equality: Coalesces NULL and zero to one join key · case 02
The query violates its result contract: coalesces null and zero to one join key.
Nullable equality: Coalesces NULL and zero to one join key · case 03
The query violates its result contract: coalesces null and zero to one join key.
Nullable equality: Coalesces NULL and zero to one join key · case 04
The query violates its result contract: coalesces null and zero to one join key.
Nullable equality: Coalesces NULL and zero to one join key · case 05
The query violates its result contract: coalesces null and zero to one join key.
Nullable equality: Joins descriptive keys instead of values · case 01
The query violates its result contract: joins descriptive keys instead of values.
Nullable equality: Joins descriptive keys instead of values · case 02
The query violates its result contract: joins descriptive keys instead of values.
Nullable equality: Joins descriptive keys instead of values · case 03
The query violates its result contract: joins descriptive keys instead of values.
Nullable equality: Joins descriptive keys instead of values · case 04
The query violates its result contract: joins descriptive keys instead of values.
Nullable equality: Joins descriptive keys instead of values · case 05
The query violates its result contract: joins descriptive keys instead of values.
Nullable equality: Reverses the equality relationship · case 01
The query violates its result contract: reverses the equality relationship.
Nullable equality: Reverses the equality relationship · case 02
The query violates its result contract: reverses the equality relationship.
Nullable equality: Reverses the equality relationship · case 03
The query violates its result contract: reverses the equality relationship.
Nullable equality: Reverses the equality relationship · case 04
The query violates its result contract: reverses the equality relationship.
Nullable equality: Reverses the equality relationship · case 05
The query violates its result contract: reverses the equality relationship.
Nullable equality: Preserves unmatched rows in an inner join · case 01
The query violates its result contract: preserves unmatched rows in an inner join.
Nullable equality: Preserves unmatched rows in an inner join · case 02
The query violates its result contract: preserves unmatched rows in an inner join.
Nullable equality: Preserves unmatched rows in an inner join · case 03
The query violates its result contract: preserves unmatched rows in an inner join.
Nullable equality: Preserves unmatched rows in an inner join · case 04
The query violates its result contract: preserves unmatched rows in an inner join.
Nullable equality: Preserves unmatched rows in an inner join · case 05
The query violates its result contract: preserves unmatched rows in an inner join.
Null safe join: Drops NULL-to-NULL identity matches · case 01
The query violates its result contract: drops null-to-null identity matches.
Null safe join: Drops NULL-to-NULL identity matches · case 02
The query violates its result contract: drops null-to-null identity matches.
Null safe join: Drops NULL-to-NULL identity matches · case 03
The query violates its result contract: drops null-to-null identity matches.
Null safe join: Drops NULL-to-NULL identity matches · case 04
The query violates its result contract: drops null-to-null identity matches.
Null safe join: Drops NULL-to-NULL identity matches · case 05
The query violates its result contract: drops null-to-null identity matches.
Null safe join: Makes unknown values equal to measured zeros · case 01
The query violates its result contract: makes unknown values equal to measured zeros.
Null safe join: Makes unknown values equal to measured zeros · case 02
The query violates its result contract: makes unknown values equal to measured zeros.
Null safe join: Makes unknown values equal to measured zeros · case 03
The query violates its result contract: makes unknown values equal to measured zeros.
Null safe join: Makes unknown values equal to measured zeros · case 04
The query violates its result contract: makes unknown values equal to measured zeros.
Null safe join: Makes unknown values equal to measured zeros · case 05
The query violates its result contract: makes unknown values equal to measured zeros.
Null safe join: Lets a left NULL match every right value · case 01
The query violates its result contract: lets a left null match every right value.
Null safe join: Lets a left NULL match every right value · case 02
The query violates its result contract: lets a left null match every right value.
Null safe join: Lets a left NULL match every right value · case 03
The query violates its result contract: lets a left null match every right value.
Null safe join: Lets a left NULL match every right value · case 04
The query violates its result contract: lets a left null match every right value.
Null safe join: Lets a left NULL match every right value · case 05
The query violates its result contract: lets a left null match every right value.
Null safe join: Matches every pair of known values · case 01
The query violates its result contract: matches every pair of known values.
Null safe join: Matches every pair of known values · case 02
The query violates its result contract: matches every pair of known values.
Null safe join: Matches every pair of known values · case 03
The query violates its result contract: matches every pair of known values.
Null safe join: Matches every pair of known values · case 04
The query violates its result contract: matches every pair of known values.
Null safe join: Matches every pair of known values · case 05
The query violates its result contract: matches every pair of known values.
Null safe join: Uses distinctness in place of identity · case 01
The query violates its result contract: uses distinctness in place of identity.
Null safe join: Uses distinctness in place of identity · case 02
The query violates its result contract: uses distinctness in place of identity.
Null safe join: Uses distinctness in place of identity · case 03
The query violates its result contract: uses distinctness in place of identity.
Null safe join: Uses distinctness in place of identity · case 04
The query violates its result contract: uses distinctness in place of identity.
Null safe join: Uses distinctness in place of identity · case 05
The query violates its result contract: uses distinctness in place of identity.
Semi join: Emits one left ID per matching right occurrence · case 01
The query violates its result contract: emits one left id per matching right occurrence.
Semi join: Emits one left ID per matching right occurrence · case 02
The query violates its result contract: emits one left id per matching right occurrence.
Semi join: Emits one left ID per matching right occurrence · case 03
The query violates its result contract: emits one left id per matching right occurrence.
Semi join: Emits one left ID per matching right occurrence · case 04
The query violates its result contract: emits one left id per matching right occurrence.
Semi join: Emits one left ID per matching right occurrence · case 05
The query violates its result contract: emits one left id per matching right occurrence.
Semi join: Checks whether b is nonempty without correlating the key · case 01
The query violates its result contract: checks whether b is nonempty without correlating the key.
Semi join: Checks whether b is nonempty without correlating the key · case 02
The query violates its result contract: checks whether b is nonempty without correlating the key.
Semi join: Checks whether b is nonempty without correlating the key · case 03
The query violates its result contract: checks whether b is nonempty without correlating the key.
Semi join: Checks whether b is nonempty without correlating the key · case 04
The query violates its result contract: checks whether b is nonempty without correlating the key.
Semi join: Checks whether b is nonempty without correlating the key · case 05
The query violates its result contract: checks whether b is nonempty without correlating the key.
Semi join: Uses absence instead of existence · case 01
The query violates its result contract: uses absence instead of existence.
Semi join: Uses absence instead of existence · case 02
The query violates its result contract: uses absence instead of existence.
Semi join: Uses absence instead of existence · case 03
The query violates its result contract: uses absence instead of existence.
Semi join: Uses absence instead of existence · case 04
The query violates its result contract: uses absence instead of existence.
Semi join: Uses absence instead of existence · case 05
The query violates its result contract: uses absence instead of existence.
Semi join: Correlates value instead of key · case 01
The query violates its result contract: correlates value instead of key.
Semi join: Correlates value instead of key · case 02
The query violates its result contract: correlates value instead of key.
Semi join: Correlates value instead of key · case 03
The query violates its result contract: correlates value instead of key.
Semi join: Correlates value instead of key · case 04
The query violates its result contract: correlates value instead of key.
Semi join: Correlates value instead of key · case 05
The query violates its result contract: correlates value instead of key.
Semi join: Uses NULL-safe equality for membership · case 01
The query violates its result contract: uses null-safe equality for membership.
Semi join: Uses NULL-safe equality for membership · case 02
The query violates its result contract: uses null-safe equality for membership.
Semi join: Uses NULL-safe equality for membership · case 03
The query violates its result contract: uses null-safe equality for membership.
Semi join: Uses NULL-safe equality for membership · case 04
The query violates its result contract: uses null-safe equality for membership.
Semi join: Uses NULL-safe equality for membership · case 05
The query violates its result contract: uses null-safe equality for membership.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗