Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Next value: Skips the immediate successor · case 01
The query violates its result contract: skips the immediate successor.
Next value: Skips the immediate successor · case 02
The query violates its result contract: skips the immediate successor.
Next value: Skips the immediate successor · case 03
The query violates its result contract: skips the immediate successor.
Next value: Skips the immediate successor · case 04
The query violates its result contract: skips the immediate successor.
Next value: Skips the immediate successor · case 05
The query violates its result contract: skips the immediate successor.
Next value: Invents zero beyond the end of a partition · case 01
The query violates its result contract: invents zero beyond the end of a partition.
Next value: Invents zero beyond the end of a partition · case 02
The query violates its result contract: invents zero beyond the end of a partition.
Next value: Invents zero beyond the end of a partition · case 03
The query violates its result contract: invents zero beyond the end of a partition.
Next value: Invents zero beyond the end of a partition · case 04
The query violates its result contract: invents zero beyond the end of a partition.
Next value: Invents zero beyond the end of a partition · case 05
The query violates its result contract: invents zero beyond the end of a partition.
Next value: Selects successor in value order instead of identity order · case 01
The query violates its result contract: selects successor in value order instead of identity order.
Next value: Selects successor in value order instead of identity order · case 02
The query violates its result contract: selects successor in value order instead of identity order.
Next value: Selects successor in value order instead of identity order · case 03
The query violates its result contract: selects successor in value order instead of identity order.
Next value: Selects successor in value order instead of identity order · case 04
The query violates its result contract: selects successor in value order instead of identity order.
Next value: Selects successor in value order instead of identity order · case 05
The query violates its result contract: selects successor in value order instead of identity order.
Partition last value: Uses default frame ending at current row · case 01
The query violates its result contract: uses default frame ending at current row.
Partition last value: Uses default frame ending at current row · case 02
The query violates its result contract: uses default frame ending at current row.
Partition last value: Uses default frame ending at current row · case 03
The query violates its result contract: uses default frame ending at current row.
Partition last value: Uses default frame ending at current row · case 04
The query violates its result contract: uses default frame ending at current row.
Partition last value: Uses default frame ending at current row · case 05
The query violates its result contract: uses default frame ending at current row.
Partition last value: Selects the first partition value · case 01
The query violates its result contract: selects the first partition value.
Partition last value: Selects the first partition value · case 02
The query violates its result contract: selects the first partition value.
Partition last value: Selects the first partition value · case 03
The query violates its result contract: selects the first partition value.
Partition last value: Selects the first partition value · case 04
The query violates its result contract: selects the first partition value.
Partition last value: Selects the first partition value · case 05
The query violates its result contract: selects the first partition value.
Partition last value: Confuses last identity with largest measurement · case 01
The query violates its result contract: confuses last identity with largest measurement.
Partition last value: Confuses last identity with largest measurement · case 02
The query violates its result contract: confuses last identity with largest measurement.
Partition last value: Confuses last identity with largest measurement · case 03
The query violates its result contract: confuses last identity with largest measurement.
Partition last value: Confuses last identity with largest measurement · case 04
The query violates its result contract: confuses last identity with largest measurement.
Partition last value: Confuses last identity with largest measurement · case 05
The query violates its result contract: confuses last identity with largest measurement.
Partition last value: Uses the last record in the entire relation · case 01
The query violates its result contract: uses the last record in the entire relation.
Partition last value: Uses the last record in the entire relation · case 02
The query violates its result contract: uses the last record in the entire relation.
Partition last value: Uses the last record in the entire relation · case 03
The query violates its result contract: uses the last record in the entire relation.
Partition last value: Uses the last record in the entire relation · case 04
The query violates its result contract: uses the last record in the entire relation.
Partition last value: Uses the last record in the entire relation · case 05
The query violates its result contract: uses the last record in the entire relation.
Partition last value: Removes NULL values and output records before selecting last · case 01
The query violates its result contract: removes null values and output records before selecting last.
Partition last value: Removes NULL values and output records before selecting last · case 02
The query violates its result contract: removes null values and output records before selecting last.
Partition last value: Removes NULL values and output records before selecting last · case 03
The query violates its result contract: removes null values and output records before selecting last.
Partition last value: Removes NULL values and output records before selecting last · case 04
The query violates its result contract: removes null values and output records before selecting last.
Partition last value: Removes NULL values and output records before selecting last · case 05
The query violates its result contract: removes null values and output records before selecting last.
Top two per key: Uses rank and returns more than two rows when tied · case 01
The query violates its result contract: uses rank and returns more than two rows when tied.
Top two per key: Uses rank and returns more than two rows when tied · case 02
The query violates its result contract: uses rank and returns more than two rows when tied.
Top two per key: Uses rank and returns more than two rows when tied · case 03
The query violates its result contract: uses rank and returns more than two rows when tied.
Top two per key: Uses rank and returns more than two rows when tied · case 04
The query violates its result contract: uses rank and returns more than two rows when tied.
Top two per key: Uses rank and returns more than two rows when tied · case 05
The query violates its result contract: uses rank and returns more than two rows when tied.
Top two per key: Applies one shared quota to all keys · case 01
The query violates its result contract: applies one shared quota to all keys.
Top two per key: Applies one shared quota to all keys · case 02
The query violates its result contract: applies one shared quota to all keys.
Top two per key: Applies one shared quota to all keys · case 03
The query violates its result contract: applies one shared quota to all keys.
Top two per key: Applies one shared quota to all keys · case 04
The query violates its result contract: applies one shared quota to all keys.
Top two per key: Applies one shared quota to all keys · case 05
The query violates its result contract: applies one shared quota to all keys.
Top two per key: Selects smallest measurements instead of greatest · case 01
The query violates its result contract: selects smallest measurements instead of greatest.
Top two per key: Selects smallest measurements instead of greatest · case 02
The query violates its result contract: selects smallest measurements instead of greatest.
Top two per key: Selects smallest measurements instead of greatest · case 03
The query violates its result contract: selects smallest measurements instead of greatest.
Top two per key: Selects smallest measurements instead of greatest · case 04
The query violates its result contract: selects smallest measurements instead of greatest.
Top two per key: Selects smallest measurements instead of greatest · case 05
The query violates its result contract: selects smallest measurements instead of greatest.
Top two per key: Returns only one row due to a strict comparison · case 01
The query violates its result contract: returns only one row due to a strict comparison.
Top two per key: Returns only one row due to a strict comparison · case 02
The query violates its result contract: returns only one row due to a strict comparison.
Top two per key: Returns only one row due to a strict comparison · case 03
The query violates its result contract: returns only one row due to a strict comparison.
Top two per key: Returns only one row due to a strict comparison · case 04
The query violates its result contract: returns only one row due to a strict comparison.
Top two per key: Returns only one row due to a strict comparison · case 05
The query violates its result contract: returns only one row due to a strict comparison.
Top two per key: Uses greatest ID when the quota cuts through a tie · case 01
The query violates its result contract: uses greatest id when the quota cuts through a tie.
Top two per key: Uses greatest ID when the quota cuts through a tie · case 02
The query violates its result contract: uses greatest id when the quota cuts through a tie.
Top two per key: Uses greatest ID when the quota cuts through a tie · case 03
The query violates its result contract: uses greatest id when the quota cuts through a tie.
Top two per key: Uses greatest ID when the quota cuts through a tie · case 04
The query violates its result contract: uses greatest id when the quota cuts through a tie.
Top two per key: Uses greatest ID when the quota cuts through a tie · case 05
The query violates its result contract: uses greatest id when the quota cuts through a tie.
Rolling three: Retains only one predecessor · case 01
The query violates its result contract: retains only one predecessor.
Rolling three: Retains only one predecessor · case 02
The query violates its result contract: retains only one predecessor.
Rolling three: Retains only one predecessor · case 03
The query violates its result contract: retains only one predecessor.
Rolling three: Retains only one predecessor · case 04
The query violates its result contract: retains only one predecessor.
Rolling three: Retains only one predecessor · case 05
The query violates its result contract: retains only one predecessor.
Rolling three: Includes one extra predecessor · case 01
The query violates its result contract: includes one extra predecessor.
Rolling three: Includes one extra predecessor · case 02
The query violates its result contract: includes one extra predecessor.
Rolling three: Includes one extra predecessor · case 03
The query violates its result contract: includes one extra predecessor.
Rolling three: Includes one extra predecessor · case 04
The query violates its result contract: includes one extra predecessor.
Rolling three: Includes one extra predecessor · case 05
The query violates its result contract: includes one extra predecessor.
Rolling three: Uses one future row instead of two past rows · case 01
The query violates its result contract: uses one future row instead of two past rows.
Rolling three: Uses one future row instead of two past rows · case 02
The query violates its result contract: uses one future row instead of two past rows.
Rolling three: Uses one future row instead of two past rows · case 03
The query violates its result contract: uses one future row instead of two past rows.
Rolling three: Uses one future row instead of two past rows · case 04
The query violates its result contract: uses one future row instead of two past rows.
Rolling three: Uses one future row instead of two past rows · case 05
The query violates its result contract: uses one future row instead of two past rows.
Rolling three: Uses identity distance rather than physical row count · case 01
The query violates its result contract: uses identity distance rather than physical row count.
Rolling three: Uses identity distance rather than physical row count · case 02
The query violates its result contract: uses identity distance rather than physical row count.
Rolling three: Uses identity distance rather than physical row count · case 03
The query violates its result contract: uses identity distance rather than physical row count.
Rolling three: Uses identity distance rather than physical row count · case 04
The query violates its result contract: uses identity distance rather than physical row count.
Rolling three: Uses identity distance rather than physical row count · case 05
The query violates its result contract: uses identity distance rather than physical row count.
Rolling three: Mixes key partitions in a rolling aggregate · case 01
The query violates its result contract: mixes key partitions in a rolling aggregate.
Rolling three: Mixes key partitions in a rolling aggregate · case 02
The query violates its result contract: mixes key partitions in a rolling aggregate.
Rolling three: Mixes key partitions in a rolling aggregate · case 03
The query violates its result contract: mixes key partitions in a rolling aggregate.
Rolling three: Mixes key partitions in a rolling aggregate · case 04
The query violates its result contract: mixes key partitions in a rolling aggregate.
Rolling three: Mixes key partitions in a rolling aggregate · case 05
The query violates its result contract: mixes key partitions in a rolling aggregate.
Unique index conflicts: Reports repeated NULLs as unique-index violations · case 01
The query violates its result contract: reports repeated nulls as unique-index violations.
Unique index conflicts: Reports repeated NULLs as unique-index violations · case 02
The query violates its result contract: reports repeated nulls as unique-index violations.
Unique index conflicts: Reports repeated NULLs as unique-index violations · case 03
The query violates its result contract: reports repeated nulls as unique-index violations.
Unique index conflicts: Reports repeated NULLs as unique-index violations · case 04
The query violates its result contract: reports repeated nulls as unique-index violations.
Unique index conflicts: Reports repeated NULLs as unique-index violations · case 05
The query violates its result contract: reports repeated nulls as unique-index violations.
Unique index conflicts: Counts only rows with known payload while checking key uniqueness · case 01
The query violates its result contract: counts only rows with known payload while checking key uniqueness.
Unique index conflicts: Counts only rows with known payload while checking key uniqueness · case 02
The query violates its result contract: counts only rows with known payload while checking key uniqueness.
Unique index conflicts: Counts only rows with known payload while checking key uniqueness · case 03
The query violates its result contract: counts only rows with known payload while checking key uniqueness.
Unique index conflicts: Counts only rows with known payload while checking key uniqueness · case 04
The query violates its result contract: counts only rows with known payload while checking key uniqueness.
Unique index conflicts: Counts only rows with known payload while checking key uniqueness · case 05
The query violates its result contract: counts only rows with known payload while checking key uniqueness.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗