Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Unsupported nested list syntax is retained as ordinary item text · case 01
A structured table violates the declared record or column contract.
Unsupported nested list syntax is retained as ordinary item text · case 02
A structured table violates the declared record or column contract.
Unsupported nested list syntax is retained as ordinary item text · case 03
A structured table violates the declared record or column contract.
Unsupported nested list syntax is retained as ordinary item text · case 04
A structured table violates the declared record or column contract.
Unsupported nested list syntax is retained as ordinary item text · case 05
A structured table violates the declared record or column contract.
A bare scalar containing pipes is coerced into a list · case 01
A structured table violates the declared record or column contract.
A bare scalar containing pipes is coerced into a list · case 02
A structured table violates the declared record or column contract.
A bare scalar containing pipes is coerced into a list · case 03
A structured table violates the declared record or column contract.
A bare scalar containing pipes is coerced into a list · case 04
A structured table violates the declared record or column contract.
A bare scalar containing pipes is coerced into a list · case 05
A structured table violates the declared record or column contract.
A list-cell parser drops the last item character with its bracket · case 01
A structured table violates the declared record or column contract.
A list-cell parser drops the last item character with its bracket · case 02
A structured table violates the declared record or column contract.
A list-cell parser drops the last item character with its bracket · case 03
A structured table violates the declared record or column contract.
A list-cell parser drops the last item character with its bracket · case 04
A structured table violates the declared record or column contract.
A list-cell parser drops the last item character with its bracket · case 05
A structured table violates the declared record or column contract.
A wildcard reselects columns already named explicitly · case 01
A structured table violates the declared record or column contract.
A wildcard reselects columns already named explicitly · case 02
A structured table violates the declared record or column contract.
A wildcard reselects columns already named explicitly · case 03
A structured table violates the declared record or column contract.
A wildcard reselects columns already named explicitly · case 04
A structured table violates the declared record or column contract.
A wildcard reselects columns already named explicitly · case 05
A structured table violates the declared record or column contract.
A column range omits its inclusive last endpoint · case 01
A structured table violates the declared record or column contract.
A column range omits its inclusive last endpoint · case 02
A structured table violates the declared record or column contract.
A column range omits its inclusive last endpoint · case 03
A structured table violates the declared record or column contract.
A column range omits its inclusive last endpoint · case 04
A structured table violates the declared record or column contract.
A column range omits its inclusive last endpoint · case 05
A structured table violates the declared record or column contract.
Column-selector ranges retain one-based array offsets · case 01
A structured table violates the declared record or column contract.
Column-selector ranges retain one-based array offsets · case 02
A structured table violates the declared record or column contract.
Column-selector ranges retain one-based array offsets · case 03
A structured table violates the declared record or column contract.
Column-selector ranges retain one-based array offsets · case 04
A structured table violates the declared record or column contract.
Column-selector ranges retain one-based array offsets · case 05
A structured table violates the declared record or column contract.
Explicit repeated column selectors are deduplicated · case 01
A structured table violates the declared record or column contract.
Explicit repeated column selectors are deduplicated · case 02
A structured table violates the declared record or column contract.
Explicit repeated column selectors are deduplicated · case 03
A structured table violates the declared record or column contract.
Explicit repeated column selectors are deduplicated · case 04
A structured table violates the declared record or column contract.
Explicit repeated column selectors are deduplicated · case 05
A structured table violates the declared record or column contract.
A reversed column range is normalized instead of rejected · case 01
A structured table violates the declared record or column contract.
A reversed column range is normalized instead of rejected · case 02
A structured table violates the declared record or column contract.
A reversed column range is normalized instead of rejected · case 03
A structured table violates the declared record or column contract.
A reversed column range is normalized instead of rejected · case 04
A structured table violates the declared record or column contract.
A reversed column range is normalized instead of rejected · case 05
A structured table violates the declared record or column contract.
A duplicate header steals a later explicit column name · case 01
A structured table violates the declared record or column contract.
A duplicate header steals a later explicit column name · case 02
A structured table violates the declared record or column contract.
A duplicate header steals a later explicit column name · case 03
A structured table violates the declared record or column contract.
A duplicate header steals a later explicit column name · case 04
A structured table violates the declared record or column contract.
A duplicate header steals a later explicit column name · case 05
A structured table violates the declared record or column contract.
Duplicate-header suffix numbering starts at one · case 01
A structured table violates the declared record or column contract.
Duplicate-header suffix numbering starts at one · case 02
A structured table violates the declared record or column contract.
Duplicate-header suffix numbering starts at one · case 03
A structured table violates the declared record or column contract.
Duplicate-header suffix numbering starts at one · case 04
A structured table violates the declared record or column contract.
Duplicate-header suffix numbering starts at one · case 05
A structured table violates the declared record or column contract.
Unnamed columns receive zero-based fallback names · case 01
A structured table violates the declared record or column contract.
Unnamed columns receive zero-based fallback names · case 02
A structured table violates the declared record or column contract.
Unnamed columns receive zero-based fallback names · case 03
A structured table violates the declared record or column contract.
Unnamed columns receive zero-based fallback names · case 04
A structured table violates the declared record or column contract.
Unnamed columns receive zero-based fallback names · case 05
A structured table violates the declared record or column contract.
Header naming does not remember assigned suffixes · case 01
A structured table violates the declared record or column contract.
Header naming does not remember assigned suffixes · case 02
A structured table violates the declared record or column contract.
Header naming does not remember assigned suffixes · case 03
A structured table violates the declared record or column contract.
Header naming does not remember assigned suffixes · case 04
A structured table violates the declared record or column contract.
Header naming does not remember assigned suffixes · case 05
A structured table violates the declared record or column contract.
Header disambiguation computes a suffix but emits the raw name · case 01
A structured table violates the declared record or column contract.
Header disambiguation computes a suffix but emits the raw name · case 02
A structured table violates the declared record or column contract.
Header disambiguation computes a suffix but emits the raw name · case 03
A structured table violates the declared record or column contract.
Header disambiguation computes a suffix but emits the raw name · case 04
A structured table violates the declared record or column contract.
Header disambiguation computes a suffix but emits the raw name · case 05
A structured table violates the declared record or column contract.
Quarantine errors use zero-based source record numbers · case 01
A structured table violates the declared record or column contract.
Quarantine errors use zero-based source record numbers · case 02
A structured table violates the declared record or column contract.
Quarantine errors use zero-based source record numbers · case 03
A structured table violates the declared record or column contract.
Quarantine errors use zero-based source record numbers · case 04
A structured table violates the declared record or column contract.
Quarantine errors use zero-based source record numbers · case 05
A structured table violates the declared record or column contract.
Quarantine stops at the first malformed record · case 01
A structured table violates the declared record or column contract.
Quarantine stops at the first malformed record · case 02
A structured table violates the declared record or column contract.
Quarantine stops at the first malformed record · case 03
A structured table violates the declared record or column contract.
Quarantine stops at the first malformed record · case 04
A structured table violates the declared record or column contract.
Quarantine stops at the first malformed record · case 05
A structured table violates the declared record or column contract.
Strict ingestion returns partial success at a width error · case 01
A structured table violates the declared record or column contract.
Strict ingestion returns partial success at a width error · case 02
A structured table violates the declared record or column contract.
Strict ingestion returns partial success at a width error · case 03
A structured table violates the declared record or column contract.
Strict ingestion returns partial success at a width error · case 04
A structured table violates the declared record or column contract.
Strict ingestion returns partial success at a width error · case 05
A structured table violates the declared record or column contract.
Error records lose surplus cells before reporting · case 01
A structured table violates the declared record or column contract.
Error records lose surplus cells before reporting · case 02
A structured table violates the declared record or column contract.
Error records lose surplus cells before reporting · case 03
A structured table violates the declared record or column contract.
Error records lose surplus cells before reporting · case 04
A structured table violates the declared record or column contract.
Error records lose surplus cells before reporting · case 05
A structured table violates the declared record or column contract.
Skip mode unexpectedly retains quarantined error payloads · case 01
A structured table violates the declared record or column contract.
Skip mode unexpectedly retains quarantined error payloads · case 02
A structured table violates the declared record or column contract.
Skip mode unexpectedly retains quarantined error payloads · case 03
A structured table violates the declared record or column contract.
Skip mode unexpectedly retains quarantined error payloads · case 04
A structured table violates the declared record or column contract.
Skip mode unexpectedly retains quarantined error payloads · case 05
A structured table violates the declared record or column contract.
A row is bound using the newest schema instead of its declared revision · case 01
A structured table violates the declared record or column contract.
A row is bound using the newest schema instead of its declared revision · case 02
A structured table violates the declared record or column contract.
A row is bound using the newest schema instead of its declared revision · case 03
A structured table violates the declared record or column contract.
A row is bound using the newest schema instead of its declared revision · case 04
A structured table violates the declared record or column contract.
A row is bound using the newest schema instead of its declared revision · case 05
A structured table violates the declared record or column contract.
Imported rows are labeled with the wrong schema revision · case 01
A structured table violates the declared record or column contract.
Imported rows are labeled with the wrong schema revision · case 02
A structured table violates the declared record or column contract.
Imported rows are labeled with the wrong schema revision · case 03
A structured table violates the declared record or column contract.
Imported rows are labeled with the wrong schema revision · case 04
A structured table violates the declared record or column contract.
Imported rows are labeled with the wrong schema revision · case 05
A structured table violates the declared record or column contract.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗