Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Sidereal hour angle adapter: East-positive site longitude is treated as west-positive · case 01
The adapter reports an incorrect local mean while other fields remain valid.
Sidereal hour angle adapter: East-positive site longitude is treated as west-positive · case 02
The adapter reports an incorrect local mean while other fields remain valid.
Sidereal hour angle adapter: East-positive site longitude is treated as west-positive · case 03
The adapter reports an incorrect local mean while other fields remain valid.
Sidereal hour angle adapter: East-positive site longitude is treated as west-positive · case 04
The adapter reports an incorrect local mean while other fields remain valid.
Sidereal hour angle adapter: East-positive site longitude is treated as west-positive · case 05
The adapter reports an incorrect local mean while other fields remain valid.
Sidereal hour angle adapter: Equation of equinoxes is removed instead of added to sidereal angle · case 01
The adapter reports an incorrect local apparent while other fields remain valid.
Sidereal hour angle adapter: Equation of equinoxes is removed instead of added to sidereal angle · case 02
The adapter reports an incorrect local apparent while other fields remain valid.
Sidereal hour angle adapter: Equation of equinoxes is removed instead of added to sidereal angle · case 03
The adapter reports an incorrect local apparent while other fields remain valid.
Sidereal hour angle adapter: Equation of equinoxes is removed instead of added to sidereal angle · case 04
The adapter reports an incorrect local apparent while other fields remain valid.
Sidereal hour angle adapter: Equation of equinoxes is removed instead of added to sidereal angle · case 05
The adapter reports an incorrect local apparent while other fields remain valid.
Sidereal hour angle adapter: Apparent right ascension omits the supplied apparent-place correction · case 01
The adapter reports an incorrect apparent ra while other fields remain valid.
Sidereal hour angle adapter: Apparent right ascension omits the supplied apparent-place correction · case 02
The adapter reports an incorrect apparent ra while other fields remain valid.
Sidereal hour angle adapter: Apparent right ascension omits the supplied apparent-place correction · case 03
The adapter reports an incorrect apparent ra while other fields remain valid.
Sidereal hour angle adapter: Apparent right ascension omits the supplied apparent-place correction · case 04
The adapter reports an incorrect apparent ra while other fields remain valid.
Sidereal hour angle adapter: Apparent right ascension omits the supplied apparent-place correction · case 05
The adapter reports an incorrect apparent ra while other fields remain valid.
Sidereal hour angle adapter: Hour-angle orientation or full-turn range is replaced by an unsigned half-circle · case 01
The adapter reports an incorrect mean hour angle while other fields remain valid.
Sidereal hour angle adapter: Hour-angle orientation or full-turn range is replaced by an unsigned half-circle · case 02
The adapter reports an incorrect mean hour angle while other fields remain valid.
Sidereal hour angle adapter: Hour-angle orientation or full-turn range is replaced by an unsigned half-circle · case 03
The adapter reports an incorrect mean hour angle while other fields remain valid.
Sidereal hour angle adapter: Hour-angle orientation or full-turn range is replaced by an unsigned half-circle · case 04
The adapter reports an incorrect mean hour angle while other fields remain valid.
Sidereal hour angle adapter: Hour-angle orientation or full-turn range is replaced by an unsigned half-circle · case 05
The adapter reports an incorrect mean hour angle while other fields remain valid.
Sidereal hour angle adapter: Apparent hour angle combines mean and apparent celestial quantities · case 01
The adapter reports an incorrect apparent hour angle while other fields remain valid.
Sidereal hour angle adapter: Apparent hour angle combines mean and apparent celestial quantities · case 02
The adapter reports an incorrect apparent hour angle while other fields remain valid.
Sidereal hour angle adapter: Apparent hour angle combines mean and apparent celestial quantities · case 03
The adapter reports an incorrect apparent hour angle while other fields remain valid.
Sidereal hour angle adapter: Apparent hour angle combines mean and apparent celestial quantities · case 04
The adapter reports an incorrect apparent hour angle while other fields remain valid.
Sidereal hour angle adapter: Apparent hour angle combines mean and apparent celestial quantities · case 05
The adapter reports an incorrect apparent hour angle while other fields remain valid.
Sidereal hour angle adapter: Meridian target conversion back to catalog RA applies the apparent correction twice · case 01
The adapter reports an incorrect meridian ra while other fields remain valid.
Sidereal hour angle adapter: Meridian target conversion back to catalog RA applies the apparent correction twice · case 02
The adapter reports an incorrect meridian ra while other fields remain valid.
Sidereal hour angle adapter: Meridian target conversion back to catalog RA applies the apparent correction twice · case 03
The adapter reports an incorrect meridian ra while other fields remain valid.
Sidereal hour angle adapter: Meridian target conversion back to catalog RA applies the apparent correction twice · case 04
The adapter reports an incorrect meridian ra while other fields remain valid.
Sidereal hour angle adapter: Meridian target conversion back to catalog RA applies the apparent correction twice · case 05
The adapter reports an incorrect meridian ra while other fields remain valid.
Catalog error ellipse: Astrometric variance scales as a standard deviation · case 01
The adapter reports an incorrect scaled variance x while other fields remain valid.
Catalog error ellipse: Astrometric variance scales as a standard deviation · case 02
The adapter reports an incorrect scaled variance x while other fields remain valid.
Catalog error ellipse: Astrometric variance scales as a standard deviation · case 03
The adapter reports an incorrect scaled variance x while other fields remain valid.
Catalog error ellipse: Astrometric variance scales as a standard deviation · case 04
The adapter reports an incorrect scaled variance x while other fields remain valid.
Catalog error ellipse: Astrometric variance scales as a standard deviation · case 05
The adapter reports an incorrect scaled variance x while other fields remain valid.
Catalog error ellipse: Signed astrometric covariance loses a reflected-axis orientation · case 01
The adapter reports an incorrect scaled covariance while other fields remain valid.
Catalog error ellipse: Signed astrometric covariance loses a reflected-axis orientation · case 02
The adapter reports an incorrect scaled covariance while other fields remain valid.
Catalog error ellipse: Signed astrometric covariance loses a reflected-axis orientation · case 03
The adapter reports an incorrect scaled covariance while other fields remain valid.
Catalog error ellipse: Signed astrometric covariance loses a reflected-axis orientation · case 04
The adapter reports an incorrect scaled covariance while other fields remain valid.
Catalog error ellipse: Signed astrometric covariance loses a reflected-axis orientation · case 05
The adapter reports an incorrect scaled covariance while other fields remain valid.
Catalog error ellipse: Quarter-turn astrometric covariance omits the cross-term sign change · case 01
The adapter reports an incorrect rotated covariance while other fields remain valid.
Catalog error ellipse: Quarter-turn astrometric covariance omits the cross-term sign change · case 02
The adapter reports an incorrect rotated covariance while other fields remain valid.
Catalog error ellipse: Quarter-turn astrometric covariance omits the cross-term sign change · case 03
The adapter reports an incorrect rotated covariance while other fields remain valid.
Catalog error ellipse: Quarter-turn astrometric covariance omits the cross-term sign change · case 04
The adapter reports an incorrect rotated covariance while other fields remain valid.
Catalog error ellipse: Quarter-turn astrometric covariance omits the cross-term sign change · case 05
The adapter reports an incorrect rotated covariance while other fields remain valid.
Catalog error ellipse: Projected RA variance uses a linear rather than squared Jacobian · case 01
The adapter reports an incorrect projected variance while other fields remain valid.
Catalog error ellipse: Projected RA variance uses a linear rather than squared Jacobian · case 02
The adapter reports an incorrect projected variance while other fields remain valid.
Catalog error ellipse: Projected RA variance uses a linear rather than squared Jacobian · case 03
The adapter reports an incorrect projected variance while other fields remain valid.
Catalog error ellipse: Projected RA variance uses a linear rather than squared Jacobian · case 04
The adapter reports an incorrect projected variance while other fields remain valid.
Catalog error ellipse: Projected RA variance uses a linear rather than squared Jacobian · case 05
The adapter reports an incorrect projected variance while other fields remain valid.
Catalog error ellipse: RA-declination covariance applies the RA factor to both axes · case 01
The adapter reports an incorrect projected cross term while other fields remain valid.
Catalog error ellipse: RA-declination covariance applies the RA factor to both axes · case 02
The adapter reports an incorrect projected cross term while other fields remain valid.
Catalog error ellipse: RA-declination covariance applies the RA factor to both axes · case 03
The adapter reports an incorrect projected cross term while other fields remain valid.
Catalog error ellipse: RA-declination covariance applies the RA factor to both axes · case 04
The adapter reports an incorrect projected cross term while other fields remain valid.
Catalog error ellipse: RA-declination covariance applies the RA factor to both axes · case 05
The adapter reports an incorrect projected cross term while other fields remain valid.
Catalog error ellipse: Astrometric error-ellipse area discards correlated uncertainty · case 01
The adapter reports an incorrect determinant while other fields remain valid.
Catalog error ellipse: Astrometric error-ellipse area discards correlated uncertainty · case 02
The adapter reports an incorrect determinant while other fields remain valid.
Catalog error ellipse: Astrometric error-ellipse area discards correlated uncertainty · case 03
The adapter reports an incorrect determinant while other fields remain valid.
Catalog error ellipse: Astrometric error-ellipse area discards correlated uncertainty · case 04
The adapter reports an incorrect determinant while other fields remain valid.
Catalog error ellipse: Astrometric error-ellipse area discards correlated uncertainty · case 05
The adapter reports an incorrect determinant while other fields remain valid.
Catalog propagated covariance: Catalog propagation omits the two symmetric position-motion covariance terms · case 01
The adapter reports an incorrect position variance while other fields remain valid.
Catalog propagated covariance: Catalog propagation omits the two symmetric position-motion covariance terms · case 02
The adapter reports an incorrect position variance while other fields remain valid.
Catalog propagated covariance: Catalog propagation omits the two symmetric position-motion covariance terms · case 03
The adapter reports an incorrect position variance while other fields remain valid.
Catalog propagated covariance: Catalog propagation omits the two symmetric position-motion covariance terms · case 04
The adapter reports an incorrect position variance while other fields remain valid.
Catalog propagated covariance: Catalog propagation omits the two symmetric position-motion covariance terms · case 05
The adapter reports an incorrect position variance while other fields remain valid.
Catalog propagated covariance: Propagated position-motion cross-covariance uses a variance time power · case 01
The adapter reports an incorrect position motion covariance while other fields remain valid.
Catalog propagated covariance: Propagated position-motion cross-covariance uses a variance time power · case 02
The adapter reports an incorrect position motion covariance while other fields remain valid.
Catalog propagated covariance: Propagated position-motion cross-covariance uses a variance time power · case 03
The adapter reports an incorrect position motion covariance while other fields remain valid.
Catalog propagated covariance: Propagated position-motion cross-covariance uses a variance time power · case 04
The adapter reports an incorrect position motion covariance while other fields remain valid.
Catalog propagated covariance: Propagated position-motion cross-covariance uses a variance time power · case 05
The adapter reports an incorrect position motion covariance while other fields remain valid.
Catalog propagated covariance: Acceleration variance is propagated with the position acceleration coefficient unsquared · case 01
The adapter reports an incorrect acceleration position variance while other fields remain valid.
Catalog propagated covariance: Acceleration variance is propagated with the position acceleration coefficient unsquared · case 02
The adapter reports an incorrect acceleration position variance while other fields remain valid.
Catalog propagated covariance: Acceleration variance is propagated with the position acceleration coefficient unsquared · case 03
The adapter reports an incorrect acceleration position variance while other fields remain valid.
Catalog propagated covariance: Acceleration variance is propagated with the position acceleration coefficient unsquared · case 04
The adapter reports an incorrect acceleration position variance while other fields remain valid.
Catalog propagated covariance: Acceleration variance is propagated with the position acceleration coefficient unsquared · case 05
The adapter reports an incorrect acceleration position variance while other fields remain valid.
Catalog propagated covariance: Catalog acceleration uncertainty is omitted from propagated motion · case 01
The adapter reports an incorrect motion variance while other fields remain valid.
Catalog propagated covariance: Catalog acceleration uncertainty is omitted from propagated motion · case 02
The adapter reports an incorrect motion variance while other fields remain valid.
Catalog propagated covariance: Catalog acceleration uncertainty is omitted from propagated motion · case 03
The adapter reports an incorrect motion variance while other fields remain valid.
Catalog propagated covariance: Catalog acceleration uncertainty is omitted from propagated motion · case 04
The adapter reports an incorrect motion variance while other fields remain valid.
Catalog propagated covariance: Catalog acceleration uncertainty is omitted from propagated motion · case 05
The adapter reports an incorrect motion variance while other fields remain valid.
Catalog propagated covariance: Unit conversion rescales only one member of position-motion covariance · case 01
The adapter reports an incorrect scaled motion covariance while other fields remain valid.
Catalog propagated covariance: Unit conversion rescales only one member of position-motion covariance · case 02
The adapter reports an incorrect scaled motion covariance while other fields remain valid.
Catalog propagated covariance: Unit conversion rescales only one member of position-motion covariance · case 03
The adapter reports an incorrect scaled motion covariance while other fields remain valid.
Catalog propagated covariance: Unit conversion rescales only one member of position-motion covariance · case 04
The adapter reports an incorrect scaled motion covariance while other fields remain valid.
Catalog propagated covariance: Unit conversion rescales only one member of position-motion covariance · case 05
The adapter reports an incorrect scaled motion covariance while other fields remain valid.
Catalog propagated covariance: Backward epoch propagation negates the catalog covariance itself · case 01
The adapter reports an incorrect backward cross covariance while other fields remain valid.
Catalog propagated covariance: Backward epoch propagation negates the catalog covariance itself · case 02
The adapter reports an incorrect backward cross covariance while other fields remain valid.
Catalog propagated covariance: Backward epoch propagation negates the catalog covariance itself · case 03
The adapter reports an incorrect backward cross covariance while other fields remain valid.
Catalog propagated covariance: Backward epoch propagation negates the catalog covariance itself · case 04
The adapter reports an incorrect backward cross covariance while other fields remain valid.
Catalog propagated covariance: Backward epoch propagation negates the catalog covariance itself · case 05
The adapter reports an incorrect backward cross covariance while other fields remain valid.
Astrometric parallax calibration: Color-dependent parallax calibration is omitted or negative measurements are clipped · case 01
The adapter reports an incorrect corrected parallax while other fields remain valid.
Astrometric parallax calibration: Color-dependent parallax calibration is omitted or negative measurements are clipped · case 02
The adapter reports an incorrect corrected parallax while other fields remain valid.
Astrometric parallax calibration: Color-dependent parallax calibration is omitted or negative measurements are clipped · case 03
The adapter reports an incorrect corrected parallax while other fields remain valid.
Astrometric parallax calibration: Color-dependent parallax calibration is omitted or negative measurements are clipped · case 04
The adapter reports an incorrect corrected parallax while other fields remain valid.
Astrometric parallax calibration: Color-dependent parallax calibration is omitted or negative measurements are clipped · case 05
The adapter reports an incorrect corrected parallax while other fields remain valid.
Astrometric parallax calibration: Parallax zero-point color term uses absolute rather than reference color · case 01
The adapter reports an incorrect zero point while other fields remain valid.
Astrometric parallax calibration: Parallax zero-point color term uses absolute rather than reference color · case 02
The adapter reports an incorrect zero point while other fields remain valid.
Astrometric parallax calibration: Parallax zero-point color term uses absolute rather than reference color · case 03
The adapter reports an incorrect zero point while other fields remain valid.
Astrometric parallax calibration: Parallax zero-point color term uses absolute rather than reference color · case 04
The adapter reports an incorrect zero point while other fields remain valid.
Astrometric parallax calibration: Parallax zero-point color term uses absolute rather than reference color · case 05
The adapter reports an incorrect zero point while other fields remain valid.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗