Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Reverse complement leaves ambiguity symbols untranslated · case 01
Reverse complement leaves ambiguity symbols untranslated.
Reverse complement leaves ambiguity symbols untranslated · case 02
Reverse complement leaves ambiguity symbols untranslated.
Reverse complement leaves ambiguity symbols untranslated · case 03
Reverse complement leaves ambiguity symbols untranslated.
Reverse complement leaves ambiguity symbols untranslated · case 04
Reverse complement leaves ambiguity symbols untranslated.
Reverse complement leaves ambiguity symbols untranslated · case 05
Reverse complement leaves ambiguity symbols untranslated.
K-mer windows span independent sequence records · case 01
K-mer windows span independent sequence records.
K-mer windows span independent sequence records · case 02
K-mer windows span independent sequence records.
K-mer windows span independent sequence records · case 03
K-mer windows span independent sequence records.
K-mer windows span independent sequence records · case 04
K-mer windows span independent sequence records.
K-mer windows span independent sequence records · case 05
K-mer windows span independent sequence records.
Strand canonicalization compares a word with its reversal · case 01
Strand canonicalization compares a word with its reversal.
Strand canonicalization compares a word with its reversal · case 02
Strand canonicalization compares a word with its reversal.
Strand canonicalization compares a word with its reversal · case 03
Strand canonicalization compares a word with its reversal.
Strand canonicalization compares a word with its reversal · case 04
Strand canonicalization compares a word with its reversal.
Strand canonicalization compares a word with its reversal · case 05
Strand canonicalization compares a word with its reversal.
Removing alignment gaps independently pairs different columns · case 01
Removing alignment gaps independently pairs different columns.
Removing alignment gaps independently pairs different columns · case 02
Removing alignment gaps independently pairs different columns.
Removing alignment gaps independently pairs different columns · case 03
Removing alignment gaps independently pairs different columns.
Removing alignment gaps independently pairs different columns · case 04
Removing alignment gaps independently pairs different columns.
Removing alignment gaps independently pairs different columns · case 05
Removing alignment gaps independently pairs different columns.
Quality filtering separates scores from surviving bases · case 01
Quality filtering separates scores from surviving bases.
Quality filtering separates scores from surviving bases · case 02
Quality filtering separates scores from surviving bases.
Quality filtering separates scores from surviving bases · case 03
Quality filtering separates scores from surviving bases.
Quality filtering separates scores from surviving bases · case 04
Quality filtering separates scores from surviving bases.
Quality filtering separates scores from surviving bases · case 05
Quality filtering separates scores from surviving bases.
Circular sequence windows miss the origin-spanning start · case 01
Circular sequence windows miss the origin-spanning start.
Circular sequence windows miss the origin-spanning start · case 02
Circular sequence windows miss the origin-spanning start.
Circular sequence windows miss the origin-spanning start · case 03
Circular sequence windows miss the origin-spanning start.
Circular sequence windows miss the origin-spanning start · case 04
Circular sequence windows miss the origin-spanning start.
Circular sequence windows miss the origin-spanning start · case 05
Circular sequence windows miss the origin-spanning start.
DNA and RNA normalization silently changes molecule type · case 01
DNA and RNA normalization silently changes molecule type.
DNA and RNA normalization silently changes molecule type · case 02
DNA and RNA normalization silently changes molecule type.
DNA and RNA normalization silently changes molecule type · case 03
DNA and RNA normalization silently changes molecule type.
DNA and RNA normalization silently changes molecule type · case 04
DNA and RNA normalization silently changes molecule type.
DNA and RNA normalization silently changes molecule type · case 05
DNA and RNA normalization silently changes molecule type.
Unknown bases are deleted before k-mer extraction · case 01
Unknown bases are deleted before k-mer extraction.
Unknown bases are deleted before k-mer extraction · case 02
Unknown bases are deleted before k-mer extraction.
Unknown bases are deleted before k-mer extraction · case 03
Unknown bases are deleted before k-mer extraction.
Unknown bases are deleted before k-mer extraction · case 04
Unknown bases are deleted before k-mer extraction.
Unknown bases are deleted before k-mer extraction · case 05
Unknown bases are deleted before k-mer extraction.
Negative-strand transcript offsets visit exons in reference order · case 01
Negative-strand transcript offsets visit exons in reference order.
Negative-strand transcript offsets visit exons in reference order · case 02
Negative-strand transcript offsets visit exons in reference order.
Negative-strand transcript offsets visit exons in reference order · case 03
Negative-strand transcript offsets visit exons in reference order.
Negative-strand transcript offsets visit exons in reference order · case 04
Negative-strand transcript offsets visit exons in reference order.
Negative-strand transcript offsets visit exons in reference order · case 05
Negative-strand transcript offsets visit exons in reference order.
Reverse alignments apply soft clipping at the wrong query end · case 01
Original read positions map to the wrong reference base after reverse orientation and asymmetric soft clipping.
Reverse alignments apply soft clipping at the wrong query end · case 02
Original read positions map to the wrong reference base after reverse orientation and asymmetric soft clipping.
Reverse alignments apply soft clipping at the wrong query end · case 03
Original read positions map to the wrong reference base after reverse orientation and asymmetric soft clipping.
Reverse alignments apply soft clipping at the wrong query end · case 04
Original read positions map to the wrong reference base after reverse orientation and asymmetric soft clipping.
Reverse alignments apply soft clipping at the wrong query end · case 05
Original read positions map to the wrong reference base after reverse orientation and asymmetric soft clipping.
Contig aliases choose an arbitrary reference target · case 01
Contig aliases choose an arbitrary reference target.
Contig aliases choose an arbitrary reference target · case 02
Contig aliases choose an arbitrary reference target.
Contig aliases choose an arbitrary reference target · case 03
Contig aliases choose an arbitrary reference target.
Contig aliases choose an arbitrary reference target · case 04
Contig aliases choose an arbitrary reference target.
Contig aliases choose an arbitrary reference target · case 05
Contig aliases choose an arbitrary reference target.
Transcript coordinate lookup ignores version pinning · case 01
Transcript coordinate lookup ignores version pinning.
Transcript coordinate lookup ignores version pinning · case 02
Transcript coordinate lookup ignores version pinning.
Transcript coordinate lookup ignores version pinning · case 03
Transcript coordinate lookup ignores version pinning.
Transcript coordinate lookup ignores version pinning · case 04
Transcript coordinate lookup ignores version pinning.
Transcript coordinate lookup ignores version pinning · case 05
Transcript coordinate lookup ignores version pinning.
Intronic coordinate ties choose the wrong transcript anchor · case 01
Intronic coordinate ties choose the wrong transcript anchor.
Intronic coordinate ties choose the wrong transcript anchor · case 02
Intronic coordinate ties choose the wrong transcript anchor.
Intronic coordinate ties choose the wrong transcript anchor · case 03
Intronic coordinate ties choose the wrong transcript anchor.
Intronic coordinate ties choose the wrong transcript anchor · case 04
Intronic coordinate ties choose the wrong transcript anchor.
Intronic coordinate ties choose the wrong transcript anchor · case 05
Intronic coordinate ties choose the wrong transcript anchor.
Reference deletions fail to advance alignment position · case 01
Reference deletions fail to advance alignment position.
Reference deletions fail to advance alignment position · case 02
Reference deletions fail to advance alignment position.
Reference deletions fail to advance alignment position · case 03
Reference deletions fail to advance alignment position.
Reference deletions fail to advance alignment position · case 04
Reference deletions fail to advance alignment position.
Reference deletions fail to advance alignment position · case 05
Reference deletions fail to advance alignment position.
Inserted query bases acquire fabricated reference coordinates · case 01
Inserted query bases acquire fabricated reference coordinates.
Inserted query bases acquire fabricated reference coordinates · case 02
Inserted query bases acquire fabricated reference coordinates.
Inserted query bases acquire fabricated reference coordinates · case 03
Inserted query bases acquire fabricated reference coordinates.
Inserted query bases acquire fabricated reference coordinates · case 04
Inserted query bases acquire fabricated reference coordinates.
Inserted query bases acquire fabricated reference coordinates · case 05
Inserted query bases acquire fabricated reference coordinates.
Lifted coordinates discard ambiguous chain mappings · case 01
Lifted coordinates discard ambiguous chain mappings.
Lifted coordinates discard ambiguous chain mappings · case 02
Lifted coordinates discard ambiguous chain mappings.
Lifted coordinates discard ambiguous chain mappings · case 03
Lifted coordinates discard ambiguous chain mappings.
Lifted coordinates discard ambiguous chain mappings · case 04
Lifted coordinates discard ambiguous chain mappings.
Lifted coordinates discard ambiguous chain mappings · case 05
Lifted coordinates discard ambiguous chain mappings.
Coding coordinates include untranslated transcript prefix · case 01
Coding coordinates include untranslated transcript prefix.
Coding coordinates include untranslated transcript prefix · case 02
Coding coordinates include untranslated transcript prefix.
Coding coordinates include untranslated transcript prefix · case 03
Coding coordinates include untranslated transcript prefix.
Coding coordinates include untranslated transcript prefix · case 04
Coding coordinates include untranslated transcript prefix.
Coding coordinates include untranslated transcript prefix · case 05
Coding coordinates include untranslated transcript prefix.
CDS exon phase mistakes remaining bases for consumed bases · case 01
CDS exon phase mistakes remaining bases for consumed bases.
CDS exon phase mistakes remaining bases for consumed bases · case 02
CDS exon phase mistakes remaining bases for consumed bases.
CDS exon phase mistakes remaining bases for consumed bases · case 03
CDS exon phase mistakes remaining bases for consumed bases.
CDS exon phase mistakes remaining bases for consumed bases · case 04
CDS exon phase mistakes remaining bases for consumed bases.
CDS exon phase mistakes remaining bases for consumed bases · case 05
CDS exon phase mistakes remaining bases for consumed bases.
Normalizing inclusion weights changes a population total · case 01
Normalizing inclusion weights changes a population total.
Normalizing inclusion weights changes a population total · case 02
Normalizing inclusion weights changes a population total.
Normalizing inclusion weights changes a population total · case 03
Normalizing inclusion weights changes a population total.
Normalizing inclusion weights changes a population total · case 04
Normalizing inclusion weights changes a population total.
Normalizing inclusion weights changes a population total · case 05
Normalizing inclusion weights changes a population total.
Marginal weights omit the first sampling stage · case 01
Marginal weights omit the first sampling stage.
Marginal weights omit the first sampling stage · case 02
Marginal weights omit the first sampling stage.
Marginal weights omit the first sampling stage · case 03
Marginal weights omit the first sampling stage.
Marginal weights omit the first sampling stage · case 04
Marginal weights omit the first sampling stage.
Marginal weights omit the first sampling stage · case 05
Marginal weights omit the first sampling stage.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗