Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Diluted censored reports retain an aliquot detection limit · case 01
Diluted censored reports retain an aliquot detection limit.
Diluted censored reports retain an aliquot detection limit · case 02
Diluted censored reports retain an aliquot detection limit.
Diluted censored reports retain an aliquot detection limit · case 03
Diluted censored reports retain an aliquot detection limit.
Diluted censored reports retain an aliquot detection limit · case 04
Diluted censored reports retain an aliquot detection limit.
Diluted censored reports retain an aliquot detection limit · case 05
Diluted censored reports retain an aliquot detection limit.
Calibration lookup borrows coefficients from another matrix · case 01
Calibration lookup borrows coefficients from another matrix.
Calibration lookup borrows coefficients from another matrix · case 02
Calibration lookup borrows coefficients from another matrix.
Calibration lookup borrows coefficients from another matrix · case 03
Calibration lookup borrows coefficients from another matrix.
Calibration lookup borrows coefficients from another matrix · case 04
Calibration lookup borrows coefficients from another matrix.
Calibration lookup borrows coefficients from another matrix · case 05
Calibration lookup borrows coefficients from another matrix.
Piecewise inverse calibration chooses segments by concentration · case 01
Piecewise inverse calibration chooses segments by concentration.
Piecewise inverse calibration chooses segments by concentration · case 02
Piecewise inverse calibration chooses segments by concentration.
Piecewise inverse calibration chooses segments by concentration · case 03
Piecewise inverse calibration chooses segments by concentration.
Piecewise inverse calibration chooses segments by concentration · case 04
Piecewise inverse calibration chooses segments by concentration.
Piecewise inverse calibration chooses segments by concentration · case 05
Piecewise inverse calibration chooses segments by concentration.
Rejected replicate values enter a report average · case 01
Rejected replicate values enter a report average.
Rejected replicate values enter a report average · case 02
Rejected replicate values enter a report average.
Rejected replicate values enter a report average · case 03
Rejected replicate values enter a report average.
Rejected replicate values enter a report average · case 04
Rejected replicate values enter a report average.
Rejected replicate values enter a report average · case 05
Rejected replicate values enter a report average.
Spike recovery subtracts an undiluted baseline from a diluted sample · case 01
Spike recovery subtracts an undiluted baseline from a diluted sample.
Spike recovery subtracts an undiluted baseline from a diluted sample · case 02
Spike recovery subtracts an undiluted baseline from a diluted sample.
Spike recovery subtracts an undiluted baseline from a diluted sample · case 03
Spike recovery subtracts an undiluted baseline from a diluted sample.
Spike recovery subtracts an undiluted baseline from a diluted sample · case 04
Spike recovery subtracts an undiluted baseline from a diluted sample.
Spike recovery subtracts an undiluted baseline from a diluted sample · case 05
Spike recovery subtracts an undiluted baseline from a diluted sample.
Carryover correction skips an intervening wash injection · case 01
Carryover correction skips an intervening wash injection.
Carryover correction skips an intervening wash injection · case 02
Carryover correction skips an intervening wash injection.
Carryover correction skips an intervening wash injection · case 03
Carryover correction skips an intervening wash injection.
Carryover correction skips an intervening wash injection · case 04
Carryover correction skips an intervening wash injection.
Carryover correction skips an intervening wash injection · case 05
Carryover correction skips an intervening wash injection.
Rounding moves an unquantifiable result above the reporting threshold · case 01
Rounding moves an unquantifiable result above the reporting threshold.
Rounding moves an unquantifiable result above the reporting threshold · case 02
Rounding moves an unquantifiable result above the reporting threshold.
Rounding moves an unquantifiable result above the reporting threshold · case 03
Rounding moves an unquantifiable result above the reporting threshold.
Rounding moves an unquantifiable result above the reporting threshold · case 04
Rounding moves an unquantifiable result above the reporting threshold.
Rounding moves an unquantifiable result above the reporting threshold · case 05
Rounding moves an unquantifiable result above the reporting threshold.
Saturated instrument output is published as a precise value · case 01
Saturated instrument output is published as a precise value.
Saturated instrument output is published as a precise value · case 02
Saturated instrument output is published as a precise value.
Saturated instrument output is published as a precise value · case 03
Saturated instrument output is published as a precise value.
Saturated instrument output is published as a precise value · case 04
Saturated instrument output is published as a precise value.
Saturated instrument output is published as a precise value · case 05
Saturated instrument output is published as a precise value.
Explicit isotope labels disappear from atom keys · case 01
Explicit isotope labels disappear from atom keys.
Explicit isotope labels disappear from atom keys · case 02
Explicit isotope labels disappear from atom keys.
Explicit isotope labels disappear from atom keys · case 03
Explicit isotope labels disappear from atom keys.
Explicit isotope labels disappear from atom keys · case 04
Explicit isotope labels disappear from atom keys.
Explicit isotope labels disappear from atom keys · case 05
Explicit isotope labels disappear from atom keys.
Neighbor count replaces encoded bond order · case 01
Neighbor count replaces encoded bond order.
Neighbor count replaces encoded bond order · case 02
Neighbor count replaces encoded bond order.
Neighbor count replaces encoded bond order · case 03
Neighbor count replaces encoded bond order.
Neighbor count replaces encoded bond order · case 04
Neighbor count replaces encoded bond order.
Neighbor count replaces encoded bond order · case 05
Neighbor count replaces encoded bond order.
Dative donor and acceptor swap during canonicalization · case 01
Dative donor and acceptor swap during canonicalization.
Dative donor and acceptor swap during canonicalization · case 02
Dative donor and acceptor swap during canonicalization.
Dative donor and acceptor swap during canonicalization · case 03
Dative donor and acceptor swap during canonicalization.
Dative donor and acceptor swap during canonicalization · case 04
Dative donor and acceptor swap during canonicalization.
Dative donor and acceptor swap during canonicalization · case 05
Dative donor and acceptor swap during canonicalization.
Ligand reordering silently flips stored orientation · case 01
Ligand reordering silently flips stored orientation.
Ligand reordering silently flips stored orientation · case 02
Ligand reordering silently flips stored orientation.
Ligand reordering silently flips stored orientation · case 03
Ligand reordering silently flips stored orientation.
Ligand reordering silently flips stored orientation · case 04
Ligand reordering silently flips stored orientation.
Ligand reordering silently flips stored orientation · case 05
Ligand reordering silently flips stored orientation.
Aromatic bond tags are inferred from atom flags · case 01
Aromatic bond tags are inferred from atom flags.
Aromatic bond tags are inferred from atom flags · case 02
Aromatic bond tags are inferred from atom flags.
Aromatic bond tags are inferred from atom flags · case 03
Aromatic bond tags are inferred from atom flags.
Aromatic bond tags are inferred from atom flags · case 04
Aromatic bond tags are inferred from atom flags.
Aromatic bond tags are inferred from atom flags · case 05
Aromatic bond tags are inferred from atom flags.
Materialized hydrogens are counted twice · case 01
Materialized hydrogens are counted twice.
Materialized hydrogens are counted twice · case 02
Materialized hydrogens are counted twice.
Materialized hydrogens are counted twice · case 03
Materialized hydrogens are counted twice.
Materialized hydrogens are counted twice · case 04
Materialized hydrogens are counted twice.
Materialized hydrogens are counted twice · case 05
Materialized hydrogens are counted twice.
Reaction atom map labels contaminate structural keys · case 01
Reaction atom map labels contaminate structural keys.
Reaction atom map labels contaminate structural keys · case 02
Reaction atom map labels contaminate structural keys.
Reaction atom map labels contaminate structural keys · case 03
Reaction atom map labels contaminate structural keys.
Reaction atom map labels contaminate structural keys · case 04
Reaction atom map labels contaminate structural keys.
Reaction atom map labels contaminate structural keys · case 05
Reaction atom map labels contaminate structural keys.
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms · case 01
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms.
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms · case 02
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms.
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms · case 03
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms.
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms · case 04
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms.
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms · case 05
Bond reversal leaves endpoint-specific stereo ligands attached to wrong atoms.
Disconnected fragment charges are collapsed into a neutral flag · case 01
Disconnected fragment charges are collapsed into a neutral flag.
Disconnected fragment charges are collapsed into a neutral flag · case 02
Disconnected fragment charges are collapsed into a neutral flag.
Disconnected fragment charges are collapsed into a neutral flag · case 03
Disconnected fragment charges are collapsed into a neutral flag.
Disconnected fragment charges are collapsed into a neutral flag · case 04
Disconnected fragment charges are collapsed into a neutral flag.
Disconnected fragment charges are collapsed into a neutral flag · case 05
Disconnected fragment charges are collapsed into a neutral flag.
An unspecified query charge becomes a neutral-only constraint · case 01
An unspecified query charge becomes a neutral-only constraint.
An unspecified query charge becomes a neutral-only constraint · case 02
An unspecified query charge becomes a neutral-only constraint.
An unspecified query charge becomes a neutral-only constraint · case 03
An unspecified query charge becomes a neutral-only constraint.
An unspecified query charge becomes a neutral-only constraint · case 04
An unspecified query charge becomes a neutral-only constraint.
An unspecified query charge becomes a neutral-only constraint · case 05
An unspecified query charge becomes a neutral-only constraint.
Case normalization destroys soft-mask positions · case 01
Case normalization destroys soft-mask positions.
Case normalization destroys soft-mask positions · case 02
Case normalization destroys soft-mask positions.
Case normalization destroys soft-mask positions · case 03
Case normalization destroys soft-mask positions.
Case normalization destroys soft-mask positions · case 04
Case normalization destroys soft-mask positions.
Case normalization destroys soft-mask positions · case 05
Case normalization destroys soft-mask positions.
Ambiguous sequence symbols are compared as literal letters · case 01
Ambiguous sequence symbols are compared as literal letters.
Ambiguous sequence symbols are compared as literal letters · case 02
Ambiguous sequence symbols are compared as literal letters.
Ambiguous sequence symbols are compared as literal letters · case 03
Ambiguous sequence symbols are compared as literal letters.
Ambiguous sequence symbols are compared as literal letters · case 04
Ambiguous sequence symbols are compared as literal letters.
Ambiguous sequence symbols are compared as literal letters · case 05
Ambiguous sequence symbols are compared as literal letters.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗