Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Nested list numbering survives a parent item advance · case 01
Nested list numbering survives a parent item advance in the controlled document model.
Nested list numbering survives a parent item advance · case 02
Nested list numbering survives a parent item advance in the controlled document model.
Nested list numbering survives a parent item advance · case 03
Nested list numbering survives a parent item advance in the controlled document model.
Nested list numbering survives a parent item advance · case 04
Nested list numbering survives a parent item advance in the controlled document model.
Nested list numbering survives a parent item advance · case 05
Nested list numbering survives a parent item advance in the controlled document model.
A heading attaches to a previous sibling instead of a shallower heading · case 01
A heading attaches to a previous sibling instead of a shallower heading in the controlled document model.
A heading attaches to a previous sibling instead of a shallower heading · case 02
A heading attaches to a previous sibling instead of a shallower heading in the controlled document model.
A heading attaches to a previous sibling instead of a shallower heading · case 03
A heading attaches to a previous sibling instead of a shallower heading in the controlled document model.
A heading attaches to a previous sibling instead of a shallower heading · case 04
A heading attaches to a previous sibling instead of a shallower heading in the controlled document model.
A heading attaches to a previous sibling instead of a shallower heading · case 05
A heading attaches to a previous sibling instead of a shallower heading in the controlled document model.
Run formatting cannot explicitly disable inherited emphasis · case 01
Run formatting cannot explicitly disable inherited emphasis in the controlled document model.
Run formatting cannot explicitly disable inherited emphasis · case 02
Run formatting cannot explicitly disable inherited emphasis in the controlled document model.
Run formatting cannot explicitly disable inherited emphasis · case 03
Run formatting cannot explicitly disable inherited emphasis in the controlled document model.
Run formatting cannot explicitly disable inherited emphasis · case 04
Run formatting cannot explicitly disable inherited emphasis in the controlled document model.
Run formatting cannot explicitly disable inherited emphasis · case 05
Run formatting cannot explicitly disable inherited emphasis in the controlled document model.
Updating an early field moves the offsets of later fields · case 01
Updating an early field moves the offsets of later fields in the controlled document model.
Updating an early field moves the offsets of later fields · case 02
Updating an early field moves the offsets of later fields in the controlled document model.
Updating an early field moves the offsets of later fields · case 03
Updating an early field moves the offsets of later fields in the controlled document model.
Updating an early field moves the offsets of later fields · case 04
Updating an early field moves the offsets of later fields in the controlled document model.
Updating an early field moves the offsets of later fields · case 05
Updating an early field moves the offsets of later fields in the controlled document model.
Deleted runs leak into the accepted revision view · case 01
Deleted runs leak into the accepted revision view in the controlled document model.
Deleted runs leak into the accepted revision view · case 02
Deleted runs leak into the accepted revision view in the controlled document model.
Deleted runs leak into the accepted revision view · case 03
Deleted runs leak into the accepted revision view in the controlled document model.
Deleted runs leak into the accepted revision view · case 04
Deleted runs leak into the accepted revision view in the controlled document model.
Deleted runs leak into the accepted revision view · case 05
Deleted runs leak into the accepted revision view in the controlled document model.
Deleting text leaves a bookmark endpoint inside removed content · case 01
Deleting text leaves a bookmark endpoint inside removed content in the controlled document model.
Deleting text leaves a bookmark endpoint inside removed content · case 02
Deleting text leaves a bookmark endpoint inside removed content in the controlled document model.
Deleting text leaves a bookmark endpoint inside removed content · case 03
Deleting text leaves a bookmark endpoint inside removed content in the controlled document model.
Deleting text leaves a bookmark endpoint inside removed content · case 04
Deleting text leaves a bookmark endpoint inside removed content in the controlled document model.
Deleting text leaves a bookmark endpoint inside removed content · case 05
Deleting text leaves a bookmark endpoint inside removed content in the controlled document model.
Comment replies create spurious independent document anchors · case 01
Comment replies create spurious independent document anchors in the controlled document model.
Comment replies create spurious independent document anchors · case 02
Comment replies create spurious independent document anchors in the controlled document model.
Comment replies create spurious independent document anchors · case 03
Comment replies create spurious independent document anchors in the controlled document model.
Comment replies create spurious independent document anchors · case 04
Comment replies create spurious independent document anchors in the controlled document model.
Comment replies create spurious independent document anchors · case 05
Comment replies create spurious independent document anchors in the controlled document model.
A cell is placed into a column occupied by a previous row span · case 01
A cell is placed into a column occupied by a previous row span in the controlled document model.
A cell is placed into a column occupied by a previous row span · case 02
A cell is placed into a column occupied by a previous row span in the controlled document model.
A cell is placed into a column occupied by a previous row span · case 03
A cell is placed into a column occupied by a previous row span in the controlled document model.
A cell is placed into a column occupied by a previous row span · case 04
A cell is placed into a column occupied by a previous row span in the controlled document model.
A cell is placed into a column occupied by a previous row span · case 05
A cell is placed into a column occupied by a previous row span in the controlled document model.
Stopword position holes disappear from phrase matching · case 01
Stopword position holes disappear from phrase matching.
Stopword position holes disappear from phrase matching · case 02
Stopword position holes disappear from phrase matching.
Stopword position holes disappear from phrase matching · case 03
Stopword position holes disappear from phrase matching.
Stopword position holes disappear from phrase matching · case 04
Stopword position holes disappear from phrase matching.
Stopword position holes disappear from phrase matching · case 05
Stopword position holes disappear from phrase matching.
Synonym expansion changes a conjunction into a broad disjunction · case 01
Synonym expansion changes a conjunction into a broad disjunction.
Synonym expansion changes a conjunction into a broad disjunction · case 02
Synonym expansion changes a conjunction into a broad disjunction.
Synonym expansion changes a conjunction into a broad disjunction · case 03
Synonym expansion changes a conjunction into a broad disjunction.
Synonym expansion changes a conjunction into a broad disjunction · case 04
Synonym expansion changes a conjunction into a broad disjunction.
Synonym expansion changes a conjunction into a broad disjunction · case 05
Synonym expansion changes a conjunction into a broad disjunction.
Repeated token occurrences satisfy too many optional query clauses · case 01
Repeated token occurrences satisfy too many optional query clauses.
Repeated token occurrences satisfy too many optional query clauses · case 02
Repeated token occurrences satisfy too many optional query clauses.
Repeated token occurrences satisfy too many optional query clauses · case 03
Repeated token occurrences satisfy too many optional query clauses.
Repeated token occurrences satisfy too many optional query clauses · case 04
Repeated token occurrences satisfy too many optional query clauses.
Repeated token occurrences satisfy too many optional query clauses · case 05
Repeated token occurrences satisfy too many optional query clauses.
Required terms in different fields produce a same-field hit · case 01
Required terms in different fields produce a same-field hit.
Required terms in different fields produce a same-field hit · case 02
Required terms in different fields produce a same-field hit.
Required terms in different fields produce a same-field hit · case 03
Required terms in different fields produce a same-field hit.
Required terms in different fields produce a same-field hit · case 04
Required terms in different fields produce a same-field hit.
Required terms in different fields produce a same-field hit · case 05
Required terms in different fields produce a same-field hit.
Posting frequency is mistaken for document frequency · case 01
Posting frequency is mistaken for document frequency.
Posting frequency is mistaken for document frequency · case 02
Posting frequency is mistaken for document frequency.
Posting frequency is mistaken for document frequency · case 03
Posting frequency is mistaken for document frequency.
Posting frequency is mistaken for document frequency · case 04
Posting frequency is mistaken for document frequency.
Posting frequency is mistaken for document frequency · case 05
Posting frequency is mistaken for document frequency.
Rank fusion uses incomparable raw scores · case 01
Rank fusion uses incomparable raw scores.
Rank fusion uses incomparable raw scores · case 02
Rank fusion uses incomparable raw scores.
Rank fusion uses incomparable raw scores · case 03
Rank fusion uses incomparable raw scores.
Rank fusion uses incomparable raw scores · case 04
Rank fusion uses incomparable raw scores.
Rank fusion uses incomparable raw scores · case 05
Rank fusion uses incomparable raw scores.
Filtered search returns an underfilled result page · case 01
Filtered search returns an underfilled result page.
Filtered search returns an underfilled result page · case 02
Filtered search returns an underfilled result page.
Filtered search returns an underfilled result page · case 03
Filtered search returns an underfilled result page.
Filtered search returns an underfilled result page · case 04
Filtered search returns an underfilled result page.
Filtered search returns an underfilled result page · case 05
Filtered search returns an underfilled result page.
Old document versions remain searchable after replacement · case 01
Old document versions remain searchable after replacement.
Old document versions remain searchable after replacement · case 02
Old document versions remain searchable after replacement.
Old document versions remain searchable after replacement · case 03
Old document versions remain searchable after replacement.
Old document versions remain searchable after replacement · case 04
Old document versions remain searchable after replacement.
Old document versions remain searchable after replacement · case 05
Old document versions remain searchable after replacement.
Active facet selection hides alternative facet counts · case 01
Active facet selection hides alternative facet counts.
Active facet selection hides alternative facet counts · case 02
Active facet selection hides alternative facet counts.
Active facet selection hides alternative facet counts · case 03
Active facet selection hides alternative facet counts.
Active facet selection hides alternative facet counts · case 04
Active facet selection hides alternative facet counts.
Active facet selection hides alternative facet counts · case 05
Active facet selection hides alternative facet counts.
Prefix expansion applies its budget before finding matching terms · case 01
Prefix expansion applies its budget before finding matching terms.
Prefix expansion applies its budget before finding matching terms · case 02
Prefix expansion applies its budget before finding matching terms.
Prefix expansion applies its budget before finding matching terms · case 03
Prefix expansion applies its budget before finding matching terms.
Prefix expansion applies its budget before finding matching terms · case 04
Prefix expansion applies its budget before finding matching terms.
Prefix expansion applies its budget before finding matching terms · case 05
Prefix expansion applies its budget before finding matching terms.
Sorting measurements separately reassigns sample values · case 01
Sorting measurements separately reassigns sample values.
Sorting measurements separately reassigns sample values · case 02
Sorting measurements separately reassigns sample values.
Sorting measurements separately reassigns sample values · case 03
Sorting measurements separately reassigns sample values.
Sorting measurements separately reassigns sample values · case 04
Sorting measurements separately reassigns sample values.
Sorting measurements separately reassigns sample values · case 05
Sorting measurements separately reassigns sample values.
Equal read counts hide mismatched mate identities · case 01
Equal read counts hide mismatched mate identities.
Equal read counts hide mismatched mate identities · case 02
Equal read counts hide mismatched mate identities.
Equal read counts hide mismatched mate identities · case 03
Equal read counts hide mismatched mate identities.
Equal read counts hide mismatched mate identities · case 04
Equal read counts hide mismatched mate identities.
Equal read counts hide mismatched mate identities · case 05
Equal read counts hide mismatched mate identities.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗