Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Dense rank: Includes distinct values from other keys · case 01
The query violates its result contract: includes distinct values from other keys.
Dense rank: Includes distinct values from other keys · case 02
The query violates its result contract: includes distinct values from other keys.
Dense rank: Includes distinct values from other keys · case 03
The query violates its result contract: includes distinct values from other keys.
Dense rank: Includes distinct values from other keys · case 04
The query violates its result contract: includes distinct values from other keys.
Dense rank: Includes distinct values from other keys · case 05
The query violates its result contract: includes distinct values from other keys.
Dense rank: Moves unknown measurements behind known values · case 01
The query violates its result contract: moves unknown measurements behind known values.
Dense rank: Moves unknown measurements behind known values · case 02
The query violates its result contract: moves unknown measurements behind known values.
Dense rank: Moves unknown measurements behind known values · case 03
The query violates its result contract: moves unknown measurements behind known values.
Dense rank: Moves unknown measurements behind known values · case 04
The query violates its result contract: moves unknown measurements behind known values.
Dense rank: Moves unknown measurements behind known values · case 05
The query violates its result contract: moves unknown measurements behind known values.
Dense rank: Ranks weights instead of measurements · case 01
The query violates its result contract: ranks weights instead of measurements.
Dense rank: Ranks weights instead of measurements · case 02
The query violates its result contract: ranks weights instead of measurements.
Dense rank: Ranks weights instead of measurements · case 03
The query violates its result contract: ranks weights instead of measurements.
Dense rank: Ranks weights instead of measurements · case 04
The query violates its result contract: ranks weights instead of measurements.
Dense rank: Ranks weights instead of measurements · case 05
The query violates its result contract: ranks weights instead of measurements.
Running row sum: Returns the final group total for every row · case 01
The query violates its result contract: returns the final group total for every row.
Running row sum: Returns the final group total for every row · case 02
The query violates its result contract: returns the final group total for every row.
Running row sum: Returns the final group total for every row · case 03
The query violates its result contract: returns the final group total for every row.
Running row sum: Returns the final group total for every row · case 04
The query violates its result contract: returns the final group total for every row.
Running row sum: Returns the final group total for every row · case 05
The query violates its result contract: returns the final group total for every row.
Running row sum: Omits the current contribution from its prefix · case 01
The query violates its result contract: omits the current contribution from its prefix.
Running row sum: Omits the current contribution from its prefix · case 02
The query violates its result contract: omits the current contribution from its prefix.
Running row sum: Omits the current contribution from its prefix · case 03
The query violates its result contract: omits the current contribution from its prefix.
Running row sum: Omits the current contribution from its prefix · case 04
The query violates its result contract: omits the current contribution from its prefix.
Running row sum: Omits the current contribution from its prefix · case 05
The query violates its result contract: omits the current contribution from its prefix.
Running row sum: Keeps only current and preceding row · case 01
The query violates its result contract: keeps only current and preceding row.
Running row sum: Keeps only current and preceding row · case 02
The query violates its result contract: keeps only current and preceding row.
Running row sum: Keeps only current and preceding row · case 03
The query violates its result contract: keeps only current and preceding row.
Running row sum: Keeps only current and preceding row · case 04
The query violates its result contract: keeps only current and preceding row.
Running row sum: Keeps only current and preceding row · case 05
The query violates its result contract: keeps only current and preceding row.
Running row sum: Accumulates other key groups into the prefix · case 01
The query violates its result contract: accumulates other key groups into the prefix.
Running row sum: Accumulates other key groups into the prefix · case 02
The query violates its result contract: accumulates other key groups into the prefix.
Running row sum: Accumulates other key groups into the prefix · case 03
The query violates its result contract: accumulates other key groups into the prefix.
Running row sum: Accumulates other key groups into the prefix · case 04
The query violates its result contract: accumulates other key groups into the prefix.
Running row sum: Accumulates other key groups into the prefix · case 05
The query violates its result contract: accumulates other key groups into the prefix.
Running row sum: Accumulates in measurement order instead of identity order · case 01
The query violates its result contract: accumulates in measurement order instead of identity order.
Running row sum: Accumulates in measurement order instead of identity order · case 02
The query violates its result contract: accumulates in measurement order instead of identity order.
Running row sum: Accumulates in measurement order instead of identity order · case 03
The query violates its result contract: accumulates in measurement order instead of identity order.
Running row sum: Accumulates in measurement order instead of identity order · case 04
The query violates its result contract: accumulates in measurement order instead of identity order.
Running row sum: Accumulates in measurement order instead of identity order · case 05
The query violates its result contract: accumulates in measurement order instead of identity order.
Peer range sum: Accumulates peers individually rather than as a range · case 01
The query violates its result contract: accumulates peers individually rather than as a range.
Peer range sum: Accumulates peers individually rather than as a range · case 02
The query violates its result contract: accumulates peers individually rather than as a range.
Peer range sum: Accumulates peers individually rather than as a range · case 03
The query violates its result contract: accumulates peers individually rather than as a range.
Peer range sum: Accumulates peers individually rather than as a range · case 04
The query violates its result contract: accumulates peers individually rather than as a range.
Peer range sum: Accumulates peers individually rather than as a range · case 05
The query violates its result contract: accumulates peers individually rather than as a range.
Peer range sum: Adds unique identity and destroys range peers · case 01
The query violates its result contract: adds unique identity and destroys range peers.
Peer range sum: Adds unique identity and destroys range peers · case 02
The query violates its result contract: adds unique identity and destroys range peers.
Peer range sum: Adds unique identity and destroys range peers · case 03
The query violates its result contract: adds unique identity and destroys range peers.
Peer range sum: Adds unique identity and destroys range peers · case 04
The query violates its result contract: adds unique identity and destroys range peers.
Peer range sum: Adds unique identity and destroys range peers · case 05
The query violates its result contract: adds unique identity and destroys range peers.
Peer range sum: Ignores the current peer cutoff · case 01
The query violates its result contract: ignores the current peer cutoff.
Peer range sum: Ignores the current peer cutoff · case 02
The query violates its result contract: ignores the current peer cutoff.
Peer range sum: Ignores the current peer cutoff · case 03
The query violates its result contract: ignores the current peer cutoff.
Peer range sum: Ignores the current peer cutoff · case 04
The query violates its result contract: ignores the current peer cutoff.
Peer range sum: Ignores the current peer cutoff · case 05
The query violates its result contract: ignores the current peer cutoff.
Peer range sum: Accumulates values greater than the current value · case 01
The query violates its result contract: accumulates values greater than the current value.
Peer range sum: Accumulates values greater than the current value · case 02
The query violates its result contract: accumulates values greater than the current value.
Peer range sum: Accumulates values greater than the current value · case 03
The query violates its result contract: accumulates values greater than the current value.
Peer range sum: Accumulates values greater than the current value · case 04
The query violates its result contract: accumulates values greater than the current value.
Peer range sum: Accumulates values greater than the current value · case 05
The query violates its result contract: accumulates values greater than the current value.
Peer range sum: Excludes the current peer group from its prefix · case 01
The query violates its result contract: excludes the current peer group from its prefix.
Peer range sum: Excludes the current peer group from its prefix · case 02
The query violates its result contract: excludes the current peer group from its prefix.
Peer range sum: Excludes the current peer group from its prefix · case 03
The query violates its result contract: excludes the current peer group from its prefix.
Peer range sum: Excludes the current peer group from its prefix · case 04
The query violates its result contract: excludes the current peer group from its prefix.
Peer range sum: Excludes the current peer group from its prefix · case 05
The query violates its result contract: excludes the current peer group from its prefix.
Previous value: Reads the successor rather than predecessor · case 01
The query violates its result contract: reads the successor rather than predecessor.
Previous value: Reads the successor rather than predecessor · case 02
The query violates its result contract: reads the successor rather than predecessor.
Previous value: Reads the successor rather than predecessor · case 03
The query violates its result contract: reads the successor rather than predecessor.
Previous value: Reads the successor rather than predecessor · case 04
The query violates its result contract: reads the successor rather than predecessor.
Previous value: Reads the successor rather than predecessor · case 05
The query violates its result contract: reads the successor rather than predecessor.
Previous value: Reads a predecessor from another key partition · case 01
The query violates its result contract: reads a predecessor from another key partition.
Previous value: Reads a predecessor from another key partition · case 02
The query violates its result contract: reads a predecessor from another key partition.
Previous value: Reads a predecessor from another key partition · case 03
The query violates its result contract: reads a predecessor from another key partition.
Previous value: Reads a predecessor from another key partition · case 04
The query violates its result contract: reads a predecessor from another key partition.
Previous value: Reads a predecessor from another key partition · case 05
The query violates its result contract: reads a predecessor from another key partition.
Previous value: Skips the immediate predecessor · case 01
The query violates its result contract: skips the immediate predecessor.
Previous value: Skips the immediate predecessor · case 02
The query violates its result contract: skips the immediate predecessor.
Previous value: Skips the immediate predecessor · case 03
The query violates its result contract: skips the immediate predecessor.
Previous value: Skips the immediate predecessor · case 04
The query violates its result contract: skips the immediate predecessor.
Previous value: Skips the immediate predecessor · case 05
The query violates its result contract: skips the immediate predecessor.
Previous value: Invents zero for absent predecessors · case 01
The query violates its result contract: invents zero for absent predecessors.
Previous value: Invents zero for absent predecessors · case 02
The query violates its result contract: invents zero for absent predecessors.
Previous value: Invents zero for absent predecessors · case 03
The query violates its result contract: invents zero for absent predecessors.
Previous value: Invents zero for absent predecessors · case 04
The query violates its result contract: invents zero for absent predecessors.
Previous value: Invents zero for absent predecessors · case 05
The query violates its result contract: invents zero for absent predecessors.
Previous value: Removes unknown values and their output rows before lagging · case 01
The query violates its result contract: removes unknown values and their output rows before lagging.
Previous value: Removes unknown values and their output rows before lagging · case 02
The query violates its result contract: removes unknown values and their output rows before lagging.
Previous value: Removes unknown values and their output rows before lagging · case 03
The query violates its result contract: removes unknown values and their output rows before lagging.
Previous value: Removes unknown values and their output rows before lagging · case 04
The query violates its result contract: removes unknown values and their output rows before lagging.
Previous value: Removes unknown values and their output rows before lagging · case 05
The query violates its result contract: removes unknown values and their output rows before lagging.
Next value: Reads the predecessor instead of successor · case 01
The query violates its result contract: reads the predecessor instead of successor.
Next value: Reads the predecessor instead of successor · case 02
The query violates its result contract: reads the predecessor instead of successor.
Next value: Reads the predecessor instead of successor · case 03
The query violates its result contract: reads the predecessor instead of successor.
Next value: Reads the predecessor instead of successor · case 04
The query violates its result contract: reads the predecessor instead of successor.
Next value: Reads the predecessor instead of successor · case 05
The query violates its result contract: reads the predecessor instead of successor.
Next value: Crosses partition boundaries when reading the successor · case 01
The query violates its result contract: crosses partition boundaries when reading the successor.
Next value: Crosses partition boundaries when reading the successor · case 02
The query violates its result contract: crosses partition boundaries when reading the successor.
Next value: Crosses partition boundaries when reading the successor · case 03
The query violates its result contract: crosses partition boundaries when reading the successor.
Next value: Crosses partition boundaries when reading the successor · case 04
The query violates its result contract: crosses partition boundaries when reading the successor.
Next value: Crosses partition boundaries when reading the successor · case 05
The query violates its result contract: crosses partition boundaries when reading the successor.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗