Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Annulus area divided by pi · case 01
Squaring the thickness ignores the annulus mean radius.
Annulus area divided by pi · case 02
Squaring the thickness ignores the annulus mean radius.
Annulus area divided by pi · case 03
Squaring the thickness ignores the annulus mean radius.
Annulus area divided by pi · case 04
Squaring the thickness ignores the annulus mean radius.
Annulus area divided by pi · case 05
Squaring the thickness ignores the annulus mean radius.
Ellipse area divided by pi · case 01
Only one semiaxis determines the area.
Ellipse area divided by pi · case 02
Only one semiaxis determines the area.
Ellipse area divided by pi · case 03
Only one semiaxis determines the area.
Ellipse area divided by pi · case 04
Only one semiaxis determines the area.
Ellipse area divided by pi · case 05
Only one semiaxis determines the area.
Trapezoid area · case 01
The sum of parallel bases is not averaged.
Trapezoid area · case 02
The sum of parallel bases is not averaged.
Trapezoid area · case 03
The sum of parallel bases is not averaged.
Trapezoid area · case 04
The sum of parallel bases is not averaged.
Trapezoid area · case 05
The sum of parallel bases is not averaged.
Rhombus area from diagonals · case 01
Diagonal product is not halved.
Rhombus area from diagonals · case 02
Diagonal product is not halved.
Rhombus area from diagonals · case 03
Diagonal product is not halved.
Rhombus area from diagonals · case 04
Diagonal product is not halved.
Rhombus area from diagonals · case 05
Diagonal product is not halved.
Rectangle perimeter · case 01
Area is returned instead of perimeter.
Rectangle perimeter · case 02
Area is returned instead of perimeter.
Rectangle perimeter · case 03
Area is returned instead of perimeter.
Rectangle perimeter · case 04
Area is returned instead of perimeter.
Rectangle perimeter · case 05
Area is returned instead of perimeter.
Regular polygon interior angle sum · case 01
The triangulation has n minus two triangles, not n.
Regular polygon interior angle sum · case 02
The triangulation has n minus two triangles, not n.
Regular polygon interior angle sum · case 03
The triangulation has n minus two triangles, not n.
Regular polygon interior angle sum · case 04
The triangulation has n minus two triangles, not n.
Regular polygon interior angle sum · case 05
The triangulation has n minus two triangles, not n.
Regular polygon exterior angle · case 01
The interior angle is returned instead of its exterior turn.
Regular polygon exterior angle · case 02
The interior angle is returned instead of its exterior turn.
Regular polygon exterior angle · case 03
The interior angle is returned instead of its exterior turn.
Regular polygon exterior angle · case 04
The interior angle is returned instead of its exterior turn.
Regular polygon exterior angle · case 05
The interior angle is returned instead of its exterior turn.
Degree normalization signed · case 01
Unsigned normalization violates the signed half-open interval.
Degree normalization signed · case 02
Unsigned normalization violates the signed half-open interval.
Degree normalization signed · case 03
Unsigned normalization violates the signed half-open interval.
Degree normalization signed · case 04
Unsigned normalization violates the signed half-open interval.
Degree normalization signed · case 05
Unsigned normalization violates the signed half-open interval.
Degree shortest signed turn · case 01
Raw subtraction takes long turns across the wrap point.
Degree shortest signed turn · case 02
Raw subtraction takes long turns across the wrap point.
Degree shortest signed turn · case 03
Raw subtraction takes long turns across the wrap point.
Degree shortest signed turn · case 04
Raw subtraction takes long turns across the wrap point.
Degree shortest signed turn · case 05
Raw subtraction takes long turns across the wrap point.
Clockwise quarter turn · case 01
The rotation sign implements a counterclockwise turn.
Clockwise quarter turn · case 02
The rotation sign implements a counterclockwise turn.
Clockwise quarter turn · case 03
The rotation sign implements a counterclockwise turn.
Clockwise quarter turn · case 04
The rotation sign implements a counterclockwise turn.
Clockwise quarter turn · case 05
The rotation sign implements a counterclockwise turn.
Counterclockwise quarter turn · case 01
The rotation direction is reversed.
Counterclockwise quarter turn · case 02
The rotation direction is reversed.
Counterclockwise quarter turn · case 03
The rotation direction is reversed.
Counterclockwise quarter turn · case 04
The rotation direction is reversed.
Counterclockwise quarter turn · case 05
The rotation direction is reversed.
Reflection across horizontal line · case 01
Reflection is performed about the origin rather than the specified line.
Reflection across horizontal line · case 02
Reflection is performed about the origin rather than the specified line.
Reflection across horizontal line · case 03
Reflection is performed about the origin rather than the specified line.
Reflection across horizontal line · case 04
Reflection is performed about the origin rather than the specified line.
Reflection across horizontal line · case 05
Reflection is performed about the origin rather than the specified line.
Reflection across vertical line · case 01
The reflection axis is forced to x equals zero.
Reflection across vertical line · case 02
The reflection axis is forced to x equals zero.
Reflection across vertical line · case 03
The reflection axis is forced to x equals zero.
Reflection across vertical line · case 04
The reflection axis is forced to x equals zero.
Reflection across vertical line · case 05
The reflection axis is forced to x equals zero.
Point projection onto vector · case 01
Projection divides by vector magnitude in the wrong norm.
Point projection onto vector · case 02
Projection divides by vector magnitude in the wrong norm.
Point projection onto vector · case 03
Projection divides by vector magnitude in the wrong norm.
Point projection onto vector · case 04
Projection divides by vector magnitude in the wrong norm.
Point projection onto vector · case 05
Projection divides by vector magnitude in the wrong norm.
Point line squared distance · case 01
Distance to an endpoint replaces perpendicular distance to the infinite line.
Point line squared distance · case 02
Distance to an endpoint replaces perpendicular distance to the infinite line.
Point line squared distance · case 03
Distance to an endpoint replaces perpendicular distance to the infinite line.
Point line squared distance · case 04
Distance to an endpoint replaces perpendicular distance to the infinite line.
Point line squared distance · case 05
Distance to an endpoint replaces perpendicular distance to the infinite line.
Axis aligned point containment closed · case 01
Strict comparisons exclude the closed boundary.
Axis aligned point containment closed · case 02
Strict comparisons exclude the closed boundary.
Axis aligned point containment closed · case 03
Strict comparisons exclude the closed boundary.
Axis aligned point containment closed · case 04
Strict comparisons exclude the closed boundary.
Axis aligned point containment closed · case 05
Strict comparisons exclude the closed boundary.
Triangle side feasibility · case 01
Only one inequality is checked and degeneracy is accepted.
Triangle side feasibility · case 02
Only one inequality is checked and degeneracy is accepted.
Triangle side feasibility · case 03
Only one inequality is checked and degeneracy is accepted.
Triangle side feasibility · case 04
Only one inequality is checked and degeneracy is accepted.
Triangle side feasibility · case 05
Only one inequality is checked and degeneracy is accepted.
Squared heron area times sixteen · case 01
Two Heron factors are duplicated instead of respecting all three sides.
Squared heron area times sixteen · case 02
Two Heron factors are duplicated instead of respecting all three sides.
Squared heron area times sixteen · case 03
Two Heron factors are duplicated instead of respecting all three sides.
Squared heron area times sixteen · case 04
Two Heron factors are duplicated instead of respecting all three sides.
Squared heron area times sixteen · case 05
Two Heron factors are duplicated instead of respecting all three sides.
Polygon signed double area · case 01
The closing polygon edge is missing from the shoelace sum.
Polygon signed double area · case 02
The closing polygon edge is missing from the shoelace sum.
Polygon signed double area · case 03
The closing polygon edge is missing from the shoelace sum.
Polygon signed double area · case 04
The closing polygon edge is missing from the shoelace sum.
Polygon signed double area · case 05
The closing polygon edge is missing from the shoelace sum.
Polygon boundary lattice points · case 01
Only vertices are counted, excluding lattice points along edges.
Polygon boundary lattice points · case 02
Only vertices are counted, excluding lattice points along edges.
Polygon boundary lattice points · case 03
Only vertices are counted, excluding lattice points along edges.
Polygon boundary lattice points · case 04
Only vertices are counted, excluding lattice points along edges.
Polygon boundary lattice points · case 05
Only vertices are counted, excluding lattice points along edges.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗