Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
World file to corner geotransform and pixel centre: pixel centre origin · case 01
Pixel-centre eastings are half a pixel west of where the world file puts them.
World file to corner geotransform and pixel centre: pixel centre origin · case 02
Pixel-centre eastings are half a pixel west of where the world file puts them.
World file to corner geotransform and pixel centre: pixel centre origin · case 03
Pixel-centre eastings are half a pixel west of where the world file puts them.
World file to corner geotransform and pixel centre: pixel centre origin · case 04
Pixel-centre eastings are half a pixel west of where the world file puts them.
World file to corner geotransform and pixel centre: pixel centre origin · case 05
Pixel-centre eastings are half a pixel west of where the world file puts them.
World file to corner geotransform and pixel centre: centre row term · case 01
Pixel-centre northings follow the column index.
World file to corner geotransform and pixel centre: centre row term · case 02
Pixel-centre northings follow the column index.
World file to corner geotransform and pixel centre: centre row term · case 03
Pixel-centre northings follow the column index.
World file to corner geotransform and pixel centre: centre row term · case 04
Pixel-centre northings follow the column index.
World file to corner geotransform and pixel centre: centre row term · case 05
Pixel-centre northings follow the column index.
Seven-parameter Helmert datum shift: arc-second conversion · case 01
Tiny rotations shift coordinates by thousands of kilometres.
Seven-parameter Helmert datum shift: arc-second conversion · case 02
Tiny rotations shift coordinates by thousands of kilometres.
Seven-parameter Helmert datum shift: arc-second conversion · case 03
Tiny rotations shift coordinates by thousands of kilometres.
Seven-parameter Helmert datum shift: arc-second conversion · case 04
Tiny rotations shift coordinates by thousands of kilometres.
Seven-parameter Helmert datum shift: arc-second conversion · case 05
Tiny rotations shift coordinates by thousands of kilometres.
Seven-parameter Helmert datum shift: convention selector · case 01
Published parameters apply the rotation in the opposite sense, leaving metre-level residuals.
Seven-parameter Helmert datum shift: convention selector · case 02
Published parameters apply the rotation in the opposite sense, leaving metre-level residuals.
Seven-parameter Helmert datum shift: convention selector · case 03
Published parameters apply the rotation in the opposite sense, leaving metre-level residuals.
Seven-parameter Helmert datum shift: convention selector · case 04
Published parameters apply the rotation in the opposite sense, leaving metre-level residuals.
Seven-parameter Helmert datum shift: convention selector · case 05
Published parameters apply the rotation in the opposite sense, leaving metre-level residuals.
Seven-parameter Helmert datum shift: frame rotation transpose · case 01
Coordinate-frame shifts are right only when two of the rotations are zero.
Seven-parameter Helmert datum shift: frame rotation transpose · case 02
Coordinate-frame shifts are right only when two of the rotations are zero.
Seven-parameter Helmert datum shift: frame rotation transpose · case 03
Coordinate-frame shifts are right only when two of the rotations are zero.
Seven-parameter Helmert datum shift: frame rotation transpose · case 04
Coordinate-frame shifts are right only when two of the rotations are zero.
Seven-parameter Helmert datum shift: frame rotation transpose · case 05
Coordinate-frame shifts are right only when two of the rotations are zero.
Seven-parameter Helmert datum shift: ppm scale · case 01
Coordinates are scaled by several times their magnitude.
Seven-parameter Helmert datum shift: ppm scale · case 02
Coordinates are scaled by several times their magnitude.
Seven-parameter Helmert datum shift: ppm scale · case 03
Coordinates are scaled by several times their magnitude.
Seven-parameter Helmert datum shift: ppm scale · case 04
Coordinates are scaled by several times their magnitude.
Seven-parameter Helmert datum shift: ppm scale · case 05
Coordinates are scaled by several times their magnitude.
Seven-parameter Helmert datum shift: y row rotation signs · case 01
Y coordinates drift by metres when the x rotation is non-zero.
Seven-parameter Helmert datum shift: y row rotation signs · case 02
Y coordinates drift by metres when the x rotation is non-zero.
Seven-parameter Helmert datum shift: y row rotation signs · case 03
Y coordinates drift by metres when the x rotation is non-zero.
Seven-parameter Helmert datum shift: y row rotation signs · case 04
Y coordinates drift by metres when the x rotation is non-zero.
Seven-parameter Helmert datum shift: y row rotation signs · case 05
Y coordinates drift by metres when the x rotation is non-zero.
Seven-parameter Helmert datum shift: translation scaling · case 01
Z coordinates are off by the scale times the translation.
Seven-parameter Helmert datum shift: translation scaling · case 02
Z coordinates are off by the scale times the translation.
Seven-parameter Helmert datum shift: translation scaling · case 03
Z coordinates are off by the scale times the translation.
Seven-parameter Helmert datum shift: translation scaling · case 04
Z coordinates are off by the scale times the translation.
Seven-parameter Helmert datum shift: translation scaling · case 05
Z coordinates are off by the scale times the translation.
Right-hand rule ring orientation enforcement: hole orientation target · case 01
Holes are emitted with the same winding as the exterior, so renderers fill them.
Right-hand rule ring orientation enforcement: hole orientation target · case 02
Holes are emitted with the same winding as the exterior, so renderers fill them.
Right-hand rule ring orientation enforcement: hole orientation target · case 03
Holes are emitted with the same winding as the exterior, so renderers fill them.
Right-hand rule ring orientation enforcement: hole orientation target · case 04
Holes are emitted with the same winding as the exterior, so renderers fill them.
Right-hand rule ring orientation enforcement: hole orientation target · case 05
Holes are emitted with the same winding as the exterior, so renderers fill them.
Right-hand rule ring orientation enforcement: zero-area ring handling · case 01
Degenerate collapsed rings are reversed although they have no orientation.
Right-hand rule ring orientation enforcement: zero-area ring handling · case 02
Degenerate collapsed rings are reversed although they have no orientation.
Right-hand rule ring orientation enforcement: zero-area ring handling · case 03
Degenerate collapsed rings are reversed although they have no orientation.
Right-hand rule ring orientation enforcement: zero-area ring handling · case 04
Degenerate collapsed rings are reversed although they have no orientation.
Right-hand rule ring orientation enforcement: zero-area ring handling · case 05
Degenerate collapsed rings are reversed although they have no orientation.
Right-hand rule ring orientation enforcement: start-preserving reversal · case 01
Reoriented rings come out unclosed.
Right-hand rule ring orientation enforcement: start-preserving reversal · case 02
Reoriented rings come out unclosed.
Right-hand rule ring orientation enforcement: start-preserving reversal · case 03
Reoriented rings come out unclosed.
Right-hand rule ring orientation enforcement: start-preserving reversal · case 04
Reoriented rings come out unclosed.
Right-hand rule ring orientation enforcement: start-preserving reversal · case 05
Reoriented rings come out unclosed.
Right-hand rule ring orientation enforcement: closure requirement · case 01
Unclosed rings are silently accepted and reoriented.
Right-hand rule ring orientation enforcement: closure requirement · case 02
Unclosed rings are silently accepted and reoriented.
Right-hand rule ring orientation enforcement: closure requirement · case 03
Unclosed rings are silently accepted and reoriented.
Right-hand rule ring orientation enforcement: closure requirement · case 04
Unclosed rings are silently accepted and reoriented.
Right-hand rule ring orientation enforcement: closure requirement · case 05
Unclosed rings are silently accepted and reoriented.
Right-hand rule ring orientation enforcement: minimum ring size · case 01
Two-vertex closed "rings" pass validation.
Right-hand rule ring orientation enforcement: minimum ring size · case 02
Two-vertex closed "rings" pass validation.
Right-hand rule ring orientation enforcement: minimum ring size · case 03
Two-vertex closed "rings" pass validation.
Right-hand rule ring orientation enforcement: minimum ring size · case 04
Two-vertex closed "rings" pass validation.
Right-hand rule ring orientation enforcement: minimum ring size · case 05
Two-vertex closed "rings" pass validation.
Ring vertex cleaning with snapping tolerance: tolerance inclusivity · case 01
Vertices exactly one tolerance away from the previous vertex survive cleaning.
Ring vertex cleaning with snapping tolerance: tolerance inclusivity · case 02
Vertices exactly one tolerance away from the previous vertex survive cleaning.
Ring vertex cleaning with snapping tolerance: tolerance inclusivity · case 03
Vertices exactly one tolerance away from the previous vertex survive cleaning.
Ring vertex cleaning with snapping tolerance: tolerance inclusivity · case 04
Vertices exactly one tolerance away from the previous vertex survive cleaning.
Ring vertex cleaning with snapping tolerance: tolerance inclusivity · case 05
Vertices exactly one tolerance away from the previous vertex survive cleaning.
Ring vertex cleaning with snapping tolerance: distance metric · case 01
Diagonal jitter survives cleaning while axis-aligned jitter is removed.
Ring vertex cleaning with snapping tolerance: distance metric · case 02
Diagonal jitter survives cleaning while axis-aligned jitter is removed.
Ring vertex cleaning with snapping tolerance: distance metric · case 03
Diagonal jitter survives cleaning while axis-aligned jitter is removed.
Ring vertex cleaning with snapping tolerance: distance metric · case 04
Diagonal jitter survives cleaning while axis-aligned jitter is removed.
Ring vertex cleaning with snapping tolerance: distance metric · case 05
Diagonal jitter survives cleaning while axis-aligned jitter is removed.
Ring vertex cleaning with snapping tolerance: drift anchor · case 01
A run of small steps is collapsed entirely, cutting off a corner reached gradually.
Ring vertex cleaning with snapping tolerance: drift anchor · case 02
A run of small steps is collapsed entirely, cutting off a corner reached gradually.
Ring vertex cleaning with snapping tolerance: drift anchor · case 03
A run of small steps is collapsed entirely, cutting off a corner reached gradually.
Ring vertex cleaning with snapping tolerance: drift anchor · case 04
A run of small steps is collapsed entirely, cutting off a corner reached gradually.
Ring vertex cleaning with snapping tolerance: drift anchor · case 05
A run of small steps is collapsed entirely, cutting off a corner reached gradually.
Ring vertex cleaning with snapping tolerance: closing tolerance · case 01
Rings end with a near-duplicate of their start vertex.
Ring vertex cleaning with snapping tolerance: closing tolerance · case 02
Rings end with a near-duplicate of their start vertex.
Ring vertex cleaning with snapping tolerance: closing tolerance · case 03
Rings end with a near-duplicate of their start vertex.
Ring vertex cleaning with snapping tolerance: closing tolerance · case 04
Rings end with a near-duplicate of their start vertex.
Ring vertex cleaning with snapping tolerance: closing tolerance · case 05
Rings end with a near-duplicate of their start vertex.
Ring vertex cleaning with snapping tolerance: minimum distinct vertices · case 01
Valid cleaned triangles are rejected.
Ring vertex cleaning with snapping tolerance: minimum distinct vertices · case 02
Valid cleaned triangles are rejected.
Ring vertex cleaning with snapping tolerance: minimum distinct vertices · case 03
Valid cleaned triangles are rejected.
Ring vertex cleaning with snapping tolerance: minimum distinct vertices · case 04
Valid cleaned triangles are rejected.
Ring vertex cleaning with snapping tolerance: minimum distinct vertices · case 05
Valid cleaned triangles are rejected.
Point classification against a polygon with holes: every hole consulted · case 01
Points inside the second or later hole are reported as interior.
Point classification against a polygon with holes: every hole consulted · case 02
Points inside the second or later hole are reported as interior.
Point classification against a polygon with holes: every hole consulted · case 03
Points inside the second or later hole are reported as interior.
Point classification against a polygon with holes: every hole consulted · case 04
Points inside the second or later hole are reported as interior.
Point classification against a polygon with holes: every hole consulted · case 05
Points inside the second or later hole are reported as interior.
Point classification against a polygon with holes: hole boundaries · case 01
Points on a hole edge are classified as interior or exterior depending on the ray.
Point classification against a polygon with holes: hole boundaries · case 02
Points on a hole edge are classified as interior or exterior depending on the ray.
Point classification against a polygon with holes: hole boundaries · case 03
Points on a hole edge are classified as interior or exterior depending on the ray.
Point classification against a polygon with holes: hole boundaries · case 04
Points on a hole edge are classified as interior or exterior depending on the ray.
Point classification against a polygon with holes: hole boundaries · case 05
Points on a hole edge are classified as interior or exterior depending on the ray.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗