Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
All reference values: Allows equality to the reference maximum · case 01
The query violates its result contract: allows equality to the reference maximum.
All reference values: Allows equality to the reference maximum · case 02
The query violates its result contract: allows equality to the reference maximum.
All reference values: Allows equality to the reference maximum · case 03
The query violates its result contract: allows equality to the reference maximum.
All reference values: Allows equality to the reference maximum · case 04
The query violates its result contract: allows equality to the reference maximum.
All reference values: Allows equality to the reference maximum · case 05
The query violates its result contract: allows equality to the reference maximum.
All reference values: Lets unknown candidates pass absence-of-blocker logic · case 01
The query violates its result contract: lets unknown candidates pass absence-of-blocker logic.
All reference values: Lets unknown candidates pass absence-of-blocker logic · case 02
The query violates its result contract: lets unknown candidates pass absence-of-blocker logic.
All reference values: Lets unknown candidates pass absence-of-blocker logic · case 03
The query violates its result contract: lets unknown candidates pass absence-of-blocker logic.
All reference values: Lets unknown candidates pass absence-of-blocker logic · case 04
The query violates its result contract: lets unknown candidates pass absence-of-blocker logic.
All reference values: Lets unknown candidates pass absence-of-blocker logic · case 05
The query violates its result contract: lets unknown candidates pass absence-of-blocker logic.
All reference values: Allows an unrelated key to block a candidate · case 01
The query violates its result contract: allows an unrelated key to block a candidate.
All reference values: Allows an unrelated key to block a candidate · case 02
The query violates its result contract: allows an unrelated key to block a candidate.
All reference values: Allows an unrelated key to block a candidate · case 03
The query violates its result contract: allows an unrelated key to block a candidate.
All reference values: Allows an unrelated key to block a candidate · case 04
The query violates its result contract: allows an unrelated key to block a candidate.
All reference values: Allows an unrelated key to block a candidate · case 05
The query violates its result contract: allows an unrelated key to block a candidate.
Division coverage: Accepts partial overlap rather than complete coverage · case 01
The query violates its result contract: accepts partial overlap rather than complete coverage.
Division coverage: Accepts partial overlap rather than complete coverage · case 02
The query violates its result contract: accepts partial overlap rather than complete coverage.
Division coverage: Accepts partial overlap rather than complete coverage · case 03
The query violates its result contract: accepts partial overlap rather than complete coverage.
Division coverage: Accepts partial overlap rather than complete coverage · case 04
The query violates its result contract: accepts partial overlap rather than complete coverage.
Division coverage: Accepts partial overlap rather than complete coverage · case 05
The query violates its result contract: accepts partial overlap rather than complete coverage.
Division coverage: Uses row count rather than distinct requirement coverage · case 01
The query violates its result contract: uses row count rather than distinct requirement coverage.
Division coverage: Uses row count rather than distinct requirement coverage · case 02
The query violates its result contract: uses row count rather than distinct requirement coverage.
Division coverage: Uses row count rather than distinct requirement coverage · case 03
The query violates its result contract: uses row count rather than distinct requirement coverage.
Division coverage: Uses row count rather than distinct requirement coverage · case 04
The query violates its result contract: uses row count rather than distinct requirement coverage.
Division coverage: Uses row count rather than distinct requirement coverage · case 05
The query violates its result contract: uses row count rather than distinct requirement coverage.
Division coverage: Uses all source keys collectively to cover requirements · case 01
The query violates its result contract: uses all source keys collectively to cover requirements.
Division coverage: Uses all source keys collectively to cover requirements · case 02
The query violates its result contract: uses all source keys collectively to cover requirements.
Division coverage: Uses all source keys collectively to cover requirements · case 03
The query violates its result contract: uses all source keys collectively to cover requirements.
Division coverage: Uses all source keys collectively to cover requirements · case 04
The query violates its result contract: uses all source keys collectively to cover requirements.
Division coverage: Uses all source keys collectively to cover requirements · case 05
The query violates its result contract: uses all source keys collectively to cover requirements.
Division coverage: Requires SQL equality to an unknown requirement · case 01
The query violates its result contract: requires sql equality to an unknown requirement.
Division coverage: Requires SQL equality to an unknown requirement · case 02
The query violates its result contract: requires sql equality to an unknown requirement.
Division coverage: Requires SQL equality to an unknown requirement · case 03
The query violates its result contract: requires sql equality to an unknown requirement.
Division coverage: Requires SQL equality to an unknown requirement · case 04
The query violates its result contract: requires sql equality to an unknown requirement.
Division coverage: Requires SQL equality to an unknown requirement · case 05
The query violates its result contract: requires sql equality to an unknown requirement.
Division coverage: Requires exact set equality rather than coverage · case 01
The query violates its result contract: requires exact set equality rather than coverage.
Division coverage: Requires exact set equality rather than coverage · case 02
The query violates its result contract: requires exact set equality rather than coverage.
Division coverage: Requires exact set equality rather than coverage · case 03
The query violates its result contract: requires exact set equality rather than coverage.
Division coverage: Requires exact set equality rather than coverage · case 04
The query violates its result contract: requires exact set equality rather than coverage.
Division coverage: Requires exact set equality rather than coverage · case 05
The query violates its result contract: requires exact set equality rather than coverage.
Row number: Numbers the entire table rather than each key · case 01
The query violates its result contract: numbers the entire table rather than each key.
Row number: Numbers the entire table rather than each key · case 02
The query violates its result contract: numbers the entire table rather than each key.
Row number: Numbers the entire table rather than each key · case 03
The query violates its result contract: numbers the entire table rather than each key.
Row number: Numbers the entire table rather than each key · case 04
The query violates its result contract: numbers the entire table rather than each key.
Row number: Numbers the entire table rather than each key · case 05
The query violates its result contract: numbers the entire table rather than each key.
Row number: Numbers measurements in descending order · case 01
The query violates its result contract: numbers measurements in descending order.
Row number: Numbers measurements in descending order · case 02
The query violates its result contract: numbers measurements in descending order.
Row number: Numbers measurements in descending order · case 03
The query violates its result contract: numbers measurements in descending order.
Row number: Numbers measurements in descending order · case 04
The query violates its result contract: numbers measurements in descending order.
Row number: Numbers measurements in descending order · case 05
The query violates its result contract: numbers measurements in descending order.
Row number: Gives tied measurements the same position · case 01
The query violates its result contract: gives tied measurements the same position.
Row number: Gives tied measurements the same position · case 02
The query violates its result contract: gives tied measurements the same position.
Row number: Gives tied measurements the same position · case 03
The query violates its result contract: gives tied measurements the same position.
Row number: Gives tied measurements the same position · case 04
The query violates its result contract: gives tied measurements the same position.
Row number: Gives tied measurements the same position · case 05
The query violates its result contract: gives tied measurements the same position.
Row number: Uses physical identity instead of measurement order · case 01
The query violates its result contract: uses physical identity instead of measurement order.
Row number: Uses physical identity instead of measurement order · case 02
The query violates its result contract: uses physical identity instead of measurement order.
Row number: Uses physical identity instead of measurement order · case 03
The query violates its result contract: uses physical identity instead of measurement order.
Row number: Uses physical identity instead of measurement order · case 04
The query violates its result contract: uses physical identity instead of measurement order.
Row number: Uses physical identity instead of measurement order · case 05
The query violates its result contract: uses physical identity instead of measurement order.
Row number: Exposes zero-based positions instead of one-based positions · case 01
The query violates its result contract: exposes zero-based positions instead of one-based positions.
Row number: Exposes zero-based positions instead of one-based positions · case 02
The query violates its result contract: exposes zero-based positions instead of one-based positions.
Row number: Exposes zero-based positions instead of one-based positions · case 03
The query violates its result contract: exposes zero-based positions instead of one-based positions.
Row number: Exposes zero-based positions instead of one-based positions · case 04
The query violates its result contract: exposes zero-based positions instead of one-based positions.
Row number: Exposes zero-based positions instead of one-based positions · case 05
The query violates its result contract: exposes zero-based positions instead of one-based positions.
Competition rank: Removes the rank gaps after ties · case 01
The query violates its result contract: removes the rank gaps after ties.
Competition rank: Removes the rank gaps after ties · case 02
The query violates its result contract: removes the rank gaps after ties.
Competition rank: Removes the rank gaps after ties · case 03
The query violates its result contract: removes the rank gaps after ties.
Competition rank: Removes the rank gaps after ties · case 04
The query violates its result contract: removes the rank gaps after ties.
Competition rank: Removes the rank gaps after ties · case 05
The query violates its result contract: removes the rank gaps after ties.
Competition rank: Uses row numbering and breaks tied values · case 01
The query violates its result contract: uses row numbering and breaks tied values.
Competition rank: Uses row numbering and breaks tied values · case 02
The query violates its result contract: uses row numbering and breaks tied values.
Competition rank: Uses row numbering and breaks tied values · case 03
The query violates its result contract: uses row numbering and breaks tied values.
Competition rank: Uses row numbering and breaks tied values · case 04
The query violates its result contract: uses row numbering and breaks tied values.
Competition rank: Uses row numbering and breaks tied values · case 05
The query violates its result contract: uses row numbering and breaks tied values.
Competition rank: Adds identity to peer equivalence · case 01
The query violates its result contract: adds identity to peer equivalence.
Competition rank: Adds identity to peer equivalence · case 02
The query violates its result contract: adds identity to peer equivalence.
Competition rank: Adds identity to peer equivalence · case 03
The query violates its result contract: adds identity to peer equivalence.
Competition rank: Adds identity to peer equivalence · case 04
The query violates its result contract: adds identity to peer equivalence.
Competition rank: Adds identity to peer equivalence · case 05
The query violates its result contract: adds identity to peer equivalence.
Competition rank: Lets unrelated keys change local ranks · case 01
The query violates its result contract: lets unrelated keys change local ranks.
Competition rank: Lets unrelated keys change local ranks · case 02
The query violates its result contract: lets unrelated keys change local ranks.
Competition rank: Lets unrelated keys change local ranks · case 03
The query violates its result contract: lets unrelated keys change local ranks.
Competition rank: Lets unrelated keys change local ranks · case 04
The query violates its result contract: lets unrelated keys change local ranks.
Competition rank: Lets unrelated keys change local ranks · case 05
The query violates its result contract: lets unrelated keys change local ranks.
Competition rank: Ranks largest measurements first · case 01
The query violates its result contract: ranks largest measurements first.
Competition rank: Ranks largest measurements first · case 02
The query violates its result contract: ranks largest measurements first.
Competition rank: Ranks largest measurements first · case 03
The query violates its result contract: ranks largest measurements first.
Competition rank: Ranks largest measurements first · case 04
The query violates its result contract: ranks largest measurements first.
Competition rank: Ranks largest measurements first · case 05
The query violates its result contract: ranks largest measurements first.
Dense rank: Uses competition rank and skips after ties · case 01
The query violates its result contract: uses competition rank and skips after ties.
Dense rank: Uses competition rank and skips after ties · case 02
The query violates its result contract: uses competition rank and skips after ties.
Dense rank: Uses competition rank and skips after ties · case 03
The query violates its result contract: uses competition rank and skips after ties.
Dense rank: Uses competition rank and skips after ties · case 04
The query violates its result contract: uses competition rank and skips after ties.
Dense rank: Uses competition rank and skips after ties · case 05
The query violates its result contract: uses competition rank and skips after ties.
Dense rank: Treats unique IDs as part of the peer key · case 01
The query violates its result contract: treats unique ids as part of the peer key.
Dense rank: Treats unique IDs as part of the peer key · case 02
The query violates its result contract: treats unique ids as part of the peer key.
Dense rank: Treats unique IDs as part of the peer key · case 03
The query violates its result contract: treats unique ids as part of the peer key.
Dense rank: Treats unique IDs as part of the peer key · case 04
The query violates its result contract: treats unique ids as part of the peer key.
Dense rank: Treats unique IDs as part of the peer key · case 05
The query violates its result contract: treats unique ids as part of the peer key.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗