Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Cosine restarts are misaligned with the end of warmup · case 01
Cosine restarts are misaligned with the end of warmup.
Cosine restarts are misaligned with the end of warmup · case 02
Cosine restarts are misaligned with the end of warmup.
Cosine restarts are misaligned with the end of warmup · case 03
Cosine restarts are misaligned with the end of warmup.
Cosine restarts are misaligned with the end of warmup · case 04
Cosine restarts are misaligned with the end of warmup.
Cosine restarts are misaligned with the end of warmup · case 05
Cosine restarts are misaligned with the end of warmup.
Hold time consumes part of the decay ramp · case 01
Hold time consumes part of the decay ramp.
Hold time consumes part of the decay ramp · case 02
Hold time consumes part of the decay ramp.
Hold time consumes part of the decay ramp · case 03
Hold time consumes part of the decay ramp.
Hold time consumes part of the decay ramp · case 04
Hold time consumes part of the decay ramp.
Hold time consumes part of the decay ramp · case 05
Hold time consumes part of the decay ramp.
Piecewise interpolation is anchored at the upper knot · case 01
Piecewise interpolation is anchored at the upper knot.
Piecewise interpolation is anchored at the upper knot · case 02
Piecewise interpolation is anchored at the upper knot.
Piecewise interpolation is anchored at the upper knot · case 03
Piecewise interpolation is anchored at the upper knot.
Piecewise interpolation is anchored at the upper knot · case 04
Piecewise interpolation is anchored at the upper knot.
Piecewise interpolation is anchored at the upper knot · case 05
Piecewise interpolation is anchored at the upper knot.
Linear decay ignores the configured minimum rate · case 01
Linear decay ignores the configured minimum rate.
Linear decay ignores the configured minimum rate · case 02
Linear decay ignores the configured minimum rate.
Linear decay ignores the configured minimum rate · case 03
Linear decay ignores the configured minimum rate.
Linear decay ignores the configured minimum rate · case 04
Linear decay ignores the configured minimum rate.
Linear decay ignores the configured minimum rate · case 05
Linear decay ignores the configured minimum rate.
Linear schedule exceeds its configured rate ceiling · case 01
Linear schedule exceeds its configured rate ceiling.
Linear schedule exceeds its configured rate ceiling · case 02
Linear schedule exceeds its configured rate ceiling.
Linear schedule exceeds its configured rate ceiling · case 03
Linear schedule exceeds its configured rate ceiling.
Linear schedule exceeds its configured rate ceiling · case 04
Linear schedule exceeds its configured rate ceiling.
Linear schedule exceeds its configured rate ceiling · case 05
Linear schedule exceeds its configured rate ceiling.
Warmup decay drops below the terminal floor · case 01
Warmup decay drops below the terminal floor.
Warmup decay drops below the terminal floor · case 02
Warmup decay drops below the terminal floor.
Warmup decay drops below the terminal floor · case 03
Warmup decay drops below the terminal floor.
Warmup decay drops below the terminal floor · case 04
Warmup decay drops below the terminal floor.
Warmup decay drops below the terminal floor · case 05
Warmup decay drops below the terminal floor.
One-cycle schedule extrapolates beyond its endpoints · case 01
One-cycle schedule extrapolates beyond its endpoints.
One-cycle schedule extrapolates beyond its endpoints · case 02
One-cycle schedule extrapolates beyond its endpoints.
One-cycle schedule extrapolates beyond its endpoints · case 03
One-cycle schedule extrapolates beyond its endpoints.
One-cycle schedule extrapolates beyond its endpoints · case 04
One-cycle schedule extrapolates beyond its endpoints.
One-cycle schedule extrapolates beyond its endpoints · case 05
One-cycle schedule extrapolates beyond its endpoints.
Cosine decay ends at half the configured floor · case 01
Cosine decay ends at half the configured floor.
Cosine decay ends at half the configured floor · case 02
Cosine decay ends at half the configured floor.
Cosine decay ends at half the configured floor · case 03
Cosine decay ends at half the configured floor.
Cosine decay ends at half the configured floor · case 04
Cosine decay ends at half the configured floor.
Cosine decay ends at half the configured floor · case 05
Cosine decay ends at half the configured floor.
Checkpoint mapping: module prefix is stripped from interior names · case 01
module prefix is stripped from interior names.
Checkpoint mapping: module prefix is stripped from interior names · case 02
module prefix is stripped from interior names.
Checkpoint mapping: module prefix is stripped from interior names · case 03
module prefix is stripped from interior names.
Checkpoint mapping: module prefix is stripped from interior names · case 04
module prefix is stripped from interior names.
Checkpoint mapping: module prefix is stripped from interior names · case 05
module prefix is stripped from interior names.
Checkpoint mapping: permuted dimensions pass exact shape matching · case 01
permuted dimensions pass exact shape matching.
Checkpoint mapping: permuted dimensions pass exact shape matching · case 02
permuted dimensions pass exact shape matching.
Checkpoint mapping: permuted dimensions pass exact shape matching · case 03
permuted dimensions pass exact shape matching.
Checkpoint mapping: permuted dimensions pass exact shape matching · case 04
permuted dimensions pass exact shape matching.
Checkpoint mapping: permuted dimensions pass exact shape matching · case 05
permuted dimensions pass exact shape matching.
Checkpoint mapping: a wildcard axis masks mismatches in fixed axes · case 01
a wildcard axis masks mismatches in fixed axes.
Checkpoint mapping: a wildcard axis masks mismatches in fixed axes · case 02
a wildcard axis masks mismatches in fixed axes.
Checkpoint mapping: a wildcard axis masks mismatches in fixed axes · case 03
a wildcard axis masks mismatches in fixed axes.
Checkpoint mapping: a wildcard axis masks mismatches in fixed axes · case 04
a wildcard axis masks mismatches in fixed axes.
Checkpoint mapping: a wildcard axis masks mismatches in fixed axes · case 05
a wildcard axis masks mismatches in fixed axes.
Checkpoint mapping: arrival order changes reconstructed shard order · case 01
arrival order changes reconstructed shard order.
Checkpoint mapping: arrival order changes reconstructed shard order · case 02
arrival order changes reconstructed shard order.
Checkpoint mapping: arrival order changes reconstructed shard order · case 03
arrival order changes reconstructed shard order.
Checkpoint mapping: arrival order changes reconstructed shard order · case 04
arrival order changes reconstructed shard order.
Checkpoint mapping: arrival order changes reconstructed shard order · case 05
arrival order changes reconstructed shard order.
Checkpoint mapping: missing shard indices are not detected · case 01
missing shard indices are not detected.
Checkpoint mapping: missing shard indices are not detected · case 02
missing shard indices are not detected.
Checkpoint mapping: missing shard indices are not detected · case 03
missing shard indices are not detected.
Checkpoint mapping: missing shard indices are not detected · case 04
missing shard indices are not detected.
Checkpoint mapping: missing shard indices are not detected · case 05
missing shard indices are not detected.
Checkpoint mapping: renaming collisions are not rejected · case 01
renaming collisions are not rejected.
Checkpoint mapping: renaming collisions are not rejected · case 02
renaming collisions are not rejected.
Checkpoint mapping: renaming collisions are not rejected · case 03
renaming collisions are not rejected.
Checkpoint mapping: renaming collisions are not rejected · case 04
renaming collisions are not rejected.
Checkpoint mapping: renaming collisions are not rejected · case 05
renaming collisions are not rejected.
Checkpoint mapping: unexpected checkpoint tensors are accepted · case 01
unexpected checkpoint tensors are accepted.
Checkpoint mapping: unexpected checkpoint tensors are accepted · case 02
unexpected checkpoint tensors are accepted.
Checkpoint mapping: unexpected checkpoint tensors are accepted · case 03
unexpected checkpoint tensors are accepted.
Checkpoint mapping: unexpected checkpoint tensors are accepted · case 04
unexpected checkpoint tensors are accepted.
Checkpoint mapping: unexpected checkpoint tensors are accepted · case 05
unexpected checkpoint tensors are accepted.
Checkpoint mapping: optional buffers are treated as required parameters · case 01
optional buffers are treated as required parameters.
Checkpoint mapping: optional buffers are treated as required parameters · case 02
optional buffers are treated as required parameters.
Checkpoint mapping: optional buffers are treated as required parameters · case 03
optional buffers are treated as required parameters.
Checkpoint mapping: optional buffers are treated as required parameters · case 04
optional buffers are treated as required parameters.
Checkpoint mapping: optional buffers are treated as required parameters · case 05
optional buffers are treated as required parameters.
Checkpoint mapping: different fixed dimensions pass shard compatibility · case 01
different fixed dimensions pass shard compatibility.
Checkpoint mapping: different fixed dimensions pass shard compatibility · case 02
different fixed dimensions pass shard compatibility.
Checkpoint mapping: different fixed dimensions pass shard compatibility · case 03
different fixed dimensions pass shard compatibility.
Checkpoint mapping: different fixed dimensions pass shard compatibility · case 04
different fixed dimensions pass shard compatibility.
Checkpoint mapping: different fixed dimensions pass shard compatibility · case 05
different fixed dimensions pass shard compatibility.
Checkpoint mapping: shard sizes are added along the wrong axis · case 01
shard sizes are added along the wrong axis.
Checkpoint mapping: shard sizes are added along the wrong axis · case 02
shard sizes are added along the wrong axis.
Checkpoint mapping: shard sizes are added along the wrong axis · case 03
shard sizes are added along the wrong axis.
Checkpoint mapping: shard sizes are added along the wrong axis · case 04
shard sizes are added along the wrong axis.
Checkpoint mapping: shard sizes are added along the wrong axis · case 05
shard sizes are added along the wrong axis.
Checkpoint mapping: row shard offset ignores preceding shard lengths · case 01
row shard offset ignores preceding shard lengths.
Checkpoint mapping: row shard offset ignores preceding shard lengths · case 02
row shard offset ignores preceding shard lengths.
Checkpoint mapping: row shard offset ignores preceding shard lengths · case 03
row shard offset ignores preceding shard lengths.
Checkpoint mapping: row shard offset ignores preceding shard lengths · case 04
row shard offset ignores preceding shard lengths.
Checkpoint mapping: row shard offset ignores preceding shard lengths · case 05
row shard offset ignores preceding shard lengths.
Checkpoint mapping: two dimensional shard indices use the tile width as row stride · case 01
two dimensional shard indices use the tile width as row stride.
Checkpoint mapping: two dimensional shard indices use the tile width as row stride · case 02
two dimensional shard indices use the tile width as row stride.
Checkpoint mapping: two dimensional shard indices use the tile width as row stride · case 03
two dimensional shard indices use the tile width as row stride.
Checkpoint mapping: two dimensional shard indices use the tile width as row stride · case 04
two dimensional shard indices use the tile width as row stride.
Checkpoint mapping: two dimensional shard indices use the tile width as row stride · case 05
two dimensional shard indices use the tile width as row stride.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗