Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Group known count: Collapses equal observations · case 01
The query violates its result contract: collapses equal observations.
Group known count: Collapses equal observations · case 02
The query violates its result contract: collapses equal observations.
Group known count: Collapses equal observations · case 03
The query violates its result contract: collapses equal observations.
Group known count: Collapses equal observations · case 04
The query violates its result contract: collapses equal observations.
Group known count: Collapses equal observations · case 05
The query violates its result contract: collapses equal observations.
Group known count: Erases all-NULL groups before aggregating · case 01
The query violates its result contract: erases all-null groups before aggregating.
Group known count: Erases all-NULL groups before aggregating · case 02
The query violates its result contract: erases all-null groups before aggregating.
Group known count: Erases all-NULL groups before aggregating · case 03
The query violates its result contract: erases all-null groups before aggregating.
Group known count: Erases all-NULL groups before aggregating · case 04
The query violates its result contract: erases all-null groups before aggregating.
Group known count: Erases all-NULL groups before aggregating · case 05
The query violates its result contract: erases all-null groups before aggregating.
Group known count: Counts only nonzero measurements · case 01
The query violates its result contract: counts only nonzero measurements.
Group known count: Counts only nonzero measurements · case 02
The query violates its result contract: counts only nonzero measurements.
Group known count: Counts only nonzero measurements · case 03
The query violates its result contract: counts only nonzero measurements.
Group known count: Counts only nonzero measurements · case 04
The query violates its result contract: counts only nonzero measurements.
Group known count: Counts only nonzero measurements · case 05
The query violates its result contract: counts only nonzero measurements.
Group known count: Counts key presence instead of value presence · case 01
The query violates its result contract: counts key presence instead of value presence.
Group known count: Counts key presence instead of value presence · case 02
The query violates its result contract: counts key presence instead of value presence.
Group known count: Counts key presence instead of value presence · case 03
The query violates its result contract: counts key presence instead of value presence.
Group known count: Counts key presence instead of value presence · case 04
The query violates its result contract: counts key presence instead of value presence.
Group known count: Counts key presence instead of value presence · case 05
The query violates its result contract: counts key presence instead of value presence.
Group sum: Deduplicates equal measured contributions · case 01
The query violates its result contract: deduplicates equal measured contributions.
Group sum: Deduplicates equal measured contributions · case 02
The query violates its result contract: deduplicates equal measured contributions.
Group sum: Deduplicates equal measured contributions · case 03
The query violates its result contract: deduplicates equal measured contributions.
Group sum: Deduplicates equal measured contributions · case 04
The query violates its result contract: deduplicates equal measured contributions.
Group sum: Deduplicates equal measured contributions · case 05
The query violates its result contract: deduplicates equal measured contributions.
Group sum: Replaces unknown-only totals with zero · case 01
The query violates its result contract: replaces unknown-only totals with zero.
Group sum: Replaces unknown-only totals with zero · case 02
The query violates its result contract: replaces unknown-only totals with zero.
Group sum: Replaces unknown-only totals with zero · case 03
The query violates its result contract: replaces unknown-only totals with zero.
Group sum: Replaces unknown-only totals with zero · case 04
The query violates its result contract: replaces unknown-only totals with zero.
Group sum: Replaces unknown-only totals with zero · case 05
The query violates its result contract: replaces unknown-only totals with zero.
Group sum: Discards zero and negative contributions · case 01
The query violates its result contract: discards zero and negative contributions.
Group sum: Discards zero and negative contributions · case 02
The query violates its result contract: discards zero and negative contributions.
Group sum: Discards zero and negative contributions · case 03
The query violates its result contract: discards zero and negative contributions.
Group sum: Discards zero and negative contributions · case 04
The query violates its result contract: discards zero and negative contributions.
Group sum: Discards zero and negative contributions · case 05
The query violates its result contract: discards zero and negative contributions.
Group sum: Sums weights instead of measurements · case 01
The query violates its result contract: sums weights instead of measurements.
Group sum: Sums weights instead of measurements · case 02
The query violates its result contract: sums weights instead of measurements.
Group sum: Sums weights instead of measurements · case 03
The query violates its result contract: sums weights instead of measurements.
Group sum: Sums weights instead of measurements · case 04
The query violates its result contract: sums weights instead of measurements.
Group sum: Sums weights instead of measurements · case 05
The query violates its result contract: sums weights instead of measurements.
Group sum: Applies an unrequested flag filter before summing · case 01
The query violates its result contract: applies an unrequested flag filter before summing.
Group sum: Applies an unrequested flag filter before summing · case 02
The query violates its result contract: applies an unrequested flag filter before summing.
Group sum: Applies an unrequested flag filter before summing · case 03
The query violates its result contract: applies an unrequested flag filter before summing.
Group sum: Applies an unrequested flag filter before summing · case 04
The query violates its result contract: applies an unrequested flag filter before summing.
Group sum: Applies an unrequested flag filter before summing · case 05
The query violates its result contract: applies an unrequested flag filter before summing.
Group minimum: Selects maximum instead of minimum · case 01
The query violates its result contract: selects maximum instead of minimum.
Group minimum: Selects maximum instead of minimum · case 02
The query violates its result contract: selects maximum instead of minimum.
Group minimum: Selects maximum instead of minimum · case 03
The query violates its result contract: selects maximum instead of minimum.
Group minimum: Selects maximum instead of minimum · case 04
The query violates its result contract: selects maximum instead of minimum.
Group minimum: Selects maximum instead of minimum · case 05
The query violates its result contract: selects maximum instead of minimum.
Group minimum: Injects zero for NULL before taking minimum · case 01
The query violates its result contract: injects zero for null before taking minimum.
Group minimum: Injects zero for NULL before taking minimum · case 02
The query violates its result contract: injects zero for null before taking minimum.
Group minimum: Injects zero for NULL before taking minimum · case 03
The query violates its result contract: injects zero for null before taking minimum.
Group minimum: Injects zero for NULL before taking minimum · case 04
The query violates its result contract: injects zero for null before taking minimum.
Group minimum: Injects zero for NULL before taking minimum · case 05
The query violates its result contract: injects zero for null before taking minimum.
Group minimum: Defaults unknown-only minima to zero · case 01
The query violates its result contract: defaults unknown-only minima to zero.
Group minimum: Defaults unknown-only minima to zero · case 02
The query violates its result contract: defaults unknown-only minima to zero.
Group minimum: Defaults unknown-only minima to zero · case 03
The query violates its result contract: defaults unknown-only minima to zero.
Group minimum: Defaults unknown-only minima to zero · case 04
The query violates its result contract: defaults unknown-only minima to zero.
Group minimum: Defaults unknown-only minima to zero · case 05
The query violates its result contract: defaults unknown-only minima to zero.
Group minimum: Finds the minimum only among eligible rows · case 01
The query violates its result contract: finds the minimum only among eligible rows.
Group minimum: Finds the minimum only among eligible rows · case 02
The query violates its result contract: finds the minimum only among eligible rows.
Group minimum: Finds the minimum only among eligible rows · case 03
The query violates its result contract: finds the minimum only among eligible rows.
Group minimum: Finds the minimum only among eligible rows · case 04
The query violates its result contract: finds the minimum only among eligible rows.
Group minimum: Finds the minimum only among eligible rows · case 05
The query violates its result contract: finds the minimum only among eligible rows.
Group minimum: Minimizes magnitude rather than signed value · case 01
The query violates its result contract: minimizes magnitude rather than signed value.
Group minimum: Minimizes magnitude rather than signed value · case 02
The query violates its result contract: minimizes magnitude rather than signed value.
Group minimum: Minimizes magnitude rather than signed value · case 03
The query violates its result contract: minimizes magnitude rather than signed value.
Group minimum: Minimizes magnitude rather than signed value · case 04
The query violates its result contract: minimizes magnitude rather than signed value.
Group minimum: Minimizes magnitude rather than signed value · case 05
The query violates its result contract: minimizes magnitude rather than signed value.
Group maximum: Selects minimum instead of maximum · case 01
The query violates its result contract: selects minimum instead of maximum.
Group maximum: Selects minimum instead of maximum · case 02
The query violates its result contract: selects minimum instead of maximum.
Group maximum: Selects minimum instead of maximum · case 03
The query violates its result contract: selects minimum instead of maximum.
Group maximum: Selects minimum instead of maximum · case 04
The query violates its result contract: selects minimum instead of maximum.
Group maximum: Selects minimum instead of maximum · case 05
The query violates its result contract: selects minimum instead of maximum.
Group maximum: Injects zero for NULL before taking maximum · case 01
The query violates its result contract: injects zero for null before taking maximum.
Group maximum: Injects zero for NULL before taking maximum · case 02
The query violates its result contract: injects zero for null before taking maximum.
Group maximum: Injects zero for NULL before taking maximum · case 03
The query violates its result contract: injects zero for null before taking maximum.
Group maximum: Injects zero for NULL before taking maximum · case 04
The query violates its result contract: injects zero for null before taking maximum.
Group maximum: Injects zero for NULL before taking maximum · case 05
The query violates its result contract: injects zero for null before taking maximum.
Group maximum: Defaults unknown-only maxima to zero · case 01
The query violates its result contract: defaults unknown-only maxima to zero.
Group maximum: Defaults unknown-only maxima to zero · case 02
The query violates its result contract: defaults unknown-only maxima to zero.
Group maximum: Defaults unknown-only maxima to zero · case 03
The query violates its result contract: defaults unknown-only maxima to zero.
Group maximum: Defaults unknown-only maxima to zero · case 04
The query violates its result contract: defaults unknown-only maxima to zero.
Group maximum: Defaults unknown-only maxima to zero · case 05
The query violates its result contract: defaults unknown-only maxima to zero.
Group maximum: Finds maximum only among eligible rows · case 01
The query violates its result contract: finds maximum only among eligible rows.
Group maximum: Finds maximum only among eligible rows · case 02
The query violates its result contract: finds maximum only among eligible rows.
Group maximum: Finds maximum only among eligible rows · case 03
The query violates its result contract: finds maximum only among eligible rows.
Group maximum: Finds maximum only among eligible rows · case 04
The query violates its result contract: finds maximum only among eligible rows.
Group maximum: Finds maximum only among eligible rows · case 05
The query violates its result contract: finds maximum only among eligible rows.
Group maximum: Maximizes magnitude rather than signed value · case 01
The query violates its result contract: maximizes magnitude rather than signed value.
Group maximum: Maximizes magnitude rather than signed value · case 02
The query violates its result contract: maximizes magnitude rather than signed value.
Group maximum: Maximizes magnitude rather than signed value · case 03
The query violates its result contract: maximizes magnitude rather than signed value.
Group maximum: Maximizes magnitude rather than signed value · case 04
The query violates its result contract: maximizes magnitude rather than signed value.
Group maximum: Maximizes magnitude rather than signed value · case 05
The query violates its result contract: maximizes magnitude rather than signed value.
Group average: Divides by row count including NULL observations · case 01
The query violates its result contract: divides by row count including null observations.
Group average: Divides by row count including NULL observations · case 02
The query violates its result contract: divides by row count including null observations.
Group average: Divides by row count including NULL observations · case 03
The query violates its result contract: divides by row count including null observations.
Group average: Divides by row count including NULL observations · case 04
The query violates its result contract: divides by row count including null observations.
Group average: Divides by row count including NULL observations · case 05
The query violates its result contract: divides by row count including null observations.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗