Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Radio fft channel labels: Complex FFT frequency labeling assigns positive Nyquist to the radio band · case 01
The adapter reports an incorrect signed bin while other fields remain valid.
Radio fft channel labels: Complex FFT frequency labeling assigns positive Nyquist to the radio band · case 02
The adapter reports an incorrect signed bin while other fields remain valid.
Radio fft channel labels: Complex FFT frequency labeling assigns positive Nyquist to the radio band · case 03
The adapter reports an incorrect signed bin while other fields remain valid.
Radio fft channel labels: Complex FFT frequency labeling assigns positive Nyquist to the radio band · case 04
The adapter reports an incorrect signed bin while other fields remain valid.
Radio fft channel labels: Complex FFT frequency labeling assigns positive Nyquist to the radio band · case 05
The adapter reports an incorrect signed bin while other fields remain valid.
Radio fft channel labels: FFT channel spacing uses endpoint-inclusive rather than periodic bins · case 01
The adapter reports an incorrect baseband frequency while other fields remain valid.
Radio fft channel labels: FFT channel spacing uses endpoint-inclusive rather than periodic bins · case 02
The adapter reports an incorrect baseband frequency while other fields remain valid.
Radio fft channel labels: FFT channel spacing uses endpoint-inclusive rather than periodic bins · case 03
The adapter reports an incorrect baseband frequency while other fields remain valid.
Radio fft channel labels: FFT channel spacing uses endpoint-inclusive rather than periodic bins · case 04
The adapter reports an incorrect baseband frequency while other fields remain valid.
Radio fft channel labels: FFT channel spacing uses endpoint-inclusive rather than periodic bins · case 05
The adapter reports an incorrect baseband frequency while other fields remain valid.
Radio fft channel labels: Shifted FFT channel coordinates put zero between central bins · case 01
The adapter reports an incorrect shifted frequency while other fields remain valid.
Radio fft channel labels: Shifted FFT channel coordinates put zero between central bins · case 02
The adapter reports an incorrect shifted frequency while other fields remain valid.
Radio fft channel labels: Shifted FFT channel coordinates put zero between central bins · case 03
The adapter reports an incorrect shifted frequency while other fields remain valid.
Radio fft channel labels: Shifted FFT channel coordinates put zero between central bins · case 04
The adapter reports an incorrect shifted frequency while other fields remain valid.
Radio fft channel labels: Shifted FFT channel coordinates put zero between central bins · case 05
The adapter reports an incorrect shifted frequency while other fields remain valid.
Radio fft channel labels: Radio FFT sky-frequency metadata omits local oscillator or signed-bin interpretation · case 01
The adapter reports an incorrect sky frequency while other fields remain valid.
Radio fft channel labels: Radio FFT sky-frequency metadata omits local oscillator or signed-bin interpretation · case 02
The adapter reports an incorrect sky frequency while other fields remain valid.
Radio fft channel labels: Radio FFT sky-frequency metadata omits local oscillator or signed-bin interpretation · case 03
The adapter reports an incorrect sky frequency while other fields remain valid.
Radio fft channel labels: Radio FFT sky-frequency metadata omits local oscillator or signed-bin interpretation · case 04
The adapter reports an incorrect sky frequency while other fields remain valid.
Radio fft channel labels: Radio FFT sky-frequency metadata omits local oscillator or signed-bin interpretation · case 05
The adapter reports an incorrect sky frequency while other fields remain valid.
Radio fft channel labels: FFT-shifted radio channel index uses a half-bin or nonwrapped permutation · case 01
The adapter reports an incorrect shifted index while other fields remain valid.
Radio fft channel labels: FFT-shifted radio channel index uses a half-bin or nonwrapped permutation · case 02
The adapter reports an incorrect shifted index while other fields remain valid.
Radio fft channel labels: FFT-shifted radio channel index uses a half-bin or nonwrapped permutation · case 03
The adapter reports an incorrect shifted index while other fields remain valid.
Radio fft channel labels: FFT-shifted radio channel index uses a half-bin or nonwrapped permutation · case 04
The adapter reports an incorrect shifted index while other fields remain valid.
Radio fft channel labels: FFT-shifted radio channel index uses a half-bin or nonwrapped permutation · case 05
The adapter reports an incorrect shifted index while other fields remain valid.
Radio fft channel labels: Radio FFT channel width uses inverse bandwidth or endpoint-inclusive resolution · case 01
The adapter reports an incorrect channel width while other fields remain valid.
Radio fft channel labels: Radio FFT channel width uses inverse bandwidth or endpoint-inclusive resolution · case 02
The adapter reports an incorrect channel width while other fields remain valid.
Radio fft channel labels: Radio FFT channel width uses inverse bandwidth or endpoint-inclusive resolution · case 03
The adapter reports an incorrect channel width while other fields remain valid.
Radio fft channel labels: Radio FFT channel width uses inverse bandwidth or endpoint-inclusive resolution · case 04
The adapter reports an incorrect channel width while other fields remain valid.
Radio fft channel labels: Radio FFT channel width uses inverse bandwidth or endpoint-inclusive resolution · case 05
The adapter reports an incorrect channel width while other fields remain valid.
Fabry perot spectral order: Fabry-Perot channel wavelength omits incidence angle or inverts interference order · case 01
The adapter reports an incorrect wavelength while other fields remain valid.
Fabry perot spectral order: Fabry-Perot channel wavelength omits incidence angle or inverts interference order · case 02
The adapter reports an incorrect wavelength while other fields remain valid.
Fabry perot spectral order: Fabry-Perot channel wavelength omits incidence angle or inverts interference order · case 03
The adapter reports an incorrect wavelength while other fields remain valid.
Fabry perot spectral order: Fabry-Perot channel wavelength omits incidence angle or inverts interference order · case 04
The adapter reports an incorrect wavelength while other fields remain valid.
Fabry perot spectral order: Fabry-Perot channel wavelength omits incidence angle or inverts interference order · case 05
The adapter reports an incorrect wavelength while other fields remain valid.
Fabry perot spectral order: Fabry-Perot dispersion changes interference order with scan channel · case 01
The adapter reports an incorrect channel dispersion while other fields remain valid.
Fabry perot spectral order: Fabry-Perot dispersion changes interference order with scan channel · case 02
The adapter reports an incorrect channel dispersion while other fields remain valid.
Fabry perot spectral order: Fabry-Perot dispersion changes interference order with scan channel · case 03
The adapter reports an incorrect channel dispersion while other fields remain valid.
Fabry perot spectral order: Fabry-Perot dispersion changes interference order with scan channel · case 04
The adapter reports an incorrect channel dispersion while other fields remain valid.
Fabry perot spectral order: Fabry-Perot dispersion changes interference order with scan channel · case 05
The adapter reports an incorrect channel dispersion while other fields remain valid.
Fabry perot spectral order: Adjacent Fabry-Perot order is treated as an additive wavelength step · case 01
The adapter reports an incorrect adjacent order wavelength while other fields remain valid.
Fabry perot spectral order: Adjacent Fabry-Perot order is treated as an additive wavelength step · case 02
The adapter reports an incorrect adjacent order wavelength while other fields remain valid.
Fabry perot spectral order: Adjacent Fabry-Perot order is treated as an additive wavelength step · case 03
The adapter reports an incorrect adjacent order wavelength while other fields remain valid.
Fabry perot spectral order: Adjacent Fabry-Perot order is treated as an additive wavelength step · case 04
The adapter reports an incorrect adjacent order wavelength while other fields remain valid.
Fabry perot spectral order: Adjacent Fabry-Perot order is treated as an additive wavelength step · case 05
The adapter reports an incorrect adjacent order wavelength while other fields remain valid.
Fabry perot spectral order: Finite neighboring-order separation is replaced by a local order derivative · case 01
The adapter reports an incorrect free spectral interval while other fields remain valid.
Fabry perot spectral order: Finite neighboring-order separation is replaced by a local order derivative · case 02
The adapter reports an incorrect free spectral interval while other fields remain valid.
Fabry perot spectral order: Finite neighboring-order separation is replaced by a local order derivative · case 03
The adapter reports an incorrect free spectral interval while other fields remain valid.
Fabry perot spectral order: Finite neighboring-order separation is replaced by a local order derivative · case 04
The adapter reports an incorrect free spectral interval while other fields remain valid.
Fabry perot spectral order: Finite neighboring-order separation is replaced by a local order derivative · case 05
The adapter reports an incorrect free spectral interval while other fields remain valid.
Fabry perot spectral order: Normal-incidence reference wavelength retains field-angle correction · case 01
The adapter reports an incorrect normal incidence while other fields remain valid.
Fabry perot spectral order: Normal-incidence reference wavelength retains field-angle correction · case 02
The adapter reports an incorrect normal incidence while other fields remain valid.
Fabry perot spectral order: Normal-incidence reference wavelength retains field-angle correction · case 03
The adapter reports an incorrect normal incidence while other fields remain valid.
Fabry perot spectral order: Normal-incidence reference wavelength retains field-angle correction · case 04
The adapter reports an incorrect normal incidence while other fields remain valid.
Fabry perot spectral order: Normal-incidence reference wavelength retains field-angle correction · case 05
The adapter reports an incorrect normal incidence while other fields remain valid.
Fabry perot spectral order: Inverse Fabry-Perot line calibration omits the incidence-angle divisor · case 01
The adapter reports an incorrect thickness from line while other fields remain valid.
Fabry perot spectral order: Inverse Fabry-Perot line calibration omits the incidence-angle divisor · case 02
The adapter reports an incorrect thickness from line while other fields remain valid.
Fabry perot spectral order: Inverse Fabry-Perot line calibration omits the incidence-angle divisor · case 03
The adapter reports an incorrect thickness from line while other fields remain valid.
Fabry perot spectral order: Inverse Fabry-Perot line calibration omits the incidence-angle divisor · case 04
The adapter reports an incorrect thickness from line while other fields remain valid.
Fabry perot spectral order: Inverse Fabry-Perot line calibration omits the incidence-angle divisor · case 05
The adapter reports an incorrect thickness from line while other fields remain valid.
Astro frequency comb coordinate: Frequency-comb coordinate drops or scales the carrier-envelope offset · case 01
The adapter reports an incorrect mode frequency while other fields remain valid.
Astro frequency comb coordinate: Frequency-comb coordinate drops or scales the carrier-envelope offset · case 02
The adapter reports an incorrect mode frequency while other fields remain valid.
Astro frequency comb coordinate: Frequency-comb coordinate drops or scales the carrier-envelope offset · case 03
The adapter reports an incorrect mode frequency while other fields remain valid.
Astro frequency comb coordinate: Frequency-comb coordinate drops or scales the carrier-envelope offset · case 04
The adapter reports an incorrect mode frequency while other fields remain valid.
Astro frequency comb coordinate: Frequency-comb coordinate drops or scales the carrier-envelope offset · case 05
The adapter reports an incorrect mode frequency while other fields remain valid.
Astro frequency comb coordinate: Filtered comb channel is mistaken for an unfiltered mode number · case 01
The adapter reports an incorrect retained mode while other fields remain valid.
Astro frequency comb coordinate: Filtered comb channel is mistaken for an unfiltered mode number · case 02
The adapter reports an incorrect retained mode while other fields remain valid.
Astro frequency comb coordinate: Filtered comb channel is mistaken for an unfiltered mode number · case 03
The adapter reports an incorrect retained mode while other fields remain valid.
Astro frequency comb coordinate: Filtered comb channel is mistaken for an unfiltered mode number · case 04
The adapter reports an incorrect retained mode while other fields remain valid.
Astro frequency comb coordinate: Filtered comb channel is mistaken for an unfiltered mode number · case 05
The adapter reports an incorrect retained mode while other fields remain valid.
Astro frequency comb coordinate: Filtered comb sky-frequency labels apply filter stride after mixing units · case 01
The adapter reports an incorrect retained frequency while other fields remain valid.
Astro frequency comb coordinate: Filtered comb sky-frequency labels apply filter stride after mixing units · case 02
The adapter reports an incorrect retained frequency while other fields remain valid.
Astro frequency comb coordinate: Filtered comb sky-frequency labels apply filter stride after mixing units · case 03
The adapter reports an incorrect retained frequency while other fields remain valid.
Astro frequency comb coordinate: Filtered comb sky-frequency labels apply filter stride after mixing units · case 04
The adapter reports an incorrect retained frequency while other fields remain valid.
Astro frequency comb coordinate: Filtered comb sky-frequency labels apply filter stride after mixing units · case 05
The adapter reports an incorrect retained frequency while other fields remain valid.
Astro frequency comb coordinate: Filtered calibration comb retains the original repetition spacing · case 01
The adapter reports an incorrect line spacing while other fields remain valid.
Astro frequency comb coordinate: Filtered calibration comb retains the original repetition spacing · case 02
The adapter reports an incorrect line spacing while other fields remain valid.
Astro frequency comb coordinate: Filtered calibration comb retains the original repetition spacing · case 03
The adapter reports an incorrect line spacing while other fields remain valid.
Astro frequency comb coordinate: Filtered calibration comb retains the original repetition spacing · case 04
The adapter reports an incorrect line spacing while other fields remain valid.
Astro frequency comb coordinate: Filtered calibration comb retains the original repetition spacing · case 05
The adapter reports an incorrect line spacing while other fields remain valid.
Astro frequency comb coordinate: Comb wavelength calibration evaluates the reciprocal before adding mode frequency · case 01
The adapter reports an incorrect mode wavelength while other fields remain valid.
Astro frequency comb coordinate: Comb wavelength calibration evaluates the reciprocal before adding mode frequency · case 02
The adapter reports an incorrect mode wavelength while other fields remain valid.
Astro frequency comb coordinate: Comb wavelength calibration evaluates the reciprocal before adding mode frequency · case 03
The adapter reports an incorrect mode wavelength while other fields remain valid.
Astro frequency comb coordinate: Comb wavelength calibration evaluates the reciprocal before adding mode frequency · case 04
The adapter reports an incorrect mode wavelength while other fields remain valid.
Astro frequency comb coordinate: Comb wavelength calibration evaluates the reciprocal before adding mode frequency · case 05
The adapter reports an incorrect mode wavelength while other fields remain valid.
Astro frequency comb coordinate: First retained comb mode is incorrectly multiplied by the filter stride · case 01
The adapter reports an incorrect first retained frequency while other fields remain valid.
Astro frequency comb coordinate: First retained comb mode is incorrectly multiplied by the filter stride · case 02
The adapter reports an incorrect first retained frequency while other fields remain valid.
Astro frequency comb coordinate: First retained comb mode is incorrectly multiplied by the filter stride · case 03
The adapter reports an incorrect first retained frequency while other fields remain valid.
Astro frequency comb coordinate: First retained comb mode is incorrectly multiplied by the filter stride · case 04
The adapter reports an incorrect first retained frequency while other fields remain valid.
Astro frequency comb coordinate: First retained comb mode is incorrectly multiplied by the filter stride · case 05
The adapter reports an incorrect first retained frequency while other fields remain valid.
Spectrograph grating coordinate: Grating coordinate uses a different incidence-angle sign convention · case 01
The adapter reports an incorrect wavelength while other fields remain valid.
Spectrograph grating coordinate: Grating coordinate uses a different incidence-angle sign convention · case 02
The adapter reports an incorrect wavelength while other fields remain valid.
Spectrograph grating coordinate: Grating coordinate uses a different incidence-angle sign convention · case 03
The adapter reports an incorrect wavelength while other fields remain valid.
Spectrograph grating coordinate: Grating coordinate uses a different incidence-angle sign convention · case 04
The adapter reports an incorrect wavelength while other fields remain valid.
Spectrograph grating coordinate: Grating coordinate uses a different incidence-angle sign convention · case 05
The adapter reports an incorrect wavelength while other fields remain valid.
Spectrograph grating coordinate: Littrow reference is evaluated at the observed diffraction direction · case 01
The adapter reports an incorrect littrow wavelength while other fields remain valid.
Spectrograph grating coordinate: Littrow reference is evaluated at the observed diffraction direction · case 02
The adapter reports an incorrect littrow wavelength while other fields remain valid.
Spectrograph grating coordinate: Littrow reference is evaluated at the observed diffraction direction · case 03
The adapter reports an incorrect littrow wavelength while other fields remain valid.
Spectrograph grating coordinate: Littrow reference is evaluated at the observed diffraction direction · case 04
The adapter reports an incorrect littrow wavelength while other fields remain valid.
Spectrograph grating coordinate: Littrow reference is evaluated at the observed diffraction direction · case 05
The adapter reports an incorrect littrow wavelength while other fields remain valid.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗