Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
File basenames become fallback accessible labels · case 01
File basenames become fallback accessible labels.
File basenames become fallback accessible labels · case 02
File basenames become fallback accessible labels.
File basenames become fallback accessible labels · case 03
File basenames become fallback accessible labels.
File basenames become fallback accessible labels · case 04
File basenames become fallback accessible labels.
File basenames become fallback accessible labels · case 05
File basenames become fallback accessible labels.
Undocumented action kinds are exposed to clients · case 01
Undocumented action kinds are exposed to clients.
Undocumented action kinds are exposed to clients · case 02
Undocumented action kinds are exposed to clients.
Undocumented action kinds are exposed to clients · case 03
Undocumented action kinds are exposed to clients.
Undocumented action kinds are exposed to clients · case 04
Undocumented action kinds are exposed to clients.
Undocumented action kinds are exposed to clients · case 05
Undocumented action kinds are exposed to clients.
Disabled operations remain advertised as invokable · case 01
Disabled operations remain advertised as invokable.
Disabled operations remain advertised as invokable · case 02
Disabled operations remain advertised as invokable.
Disabled operations remain advertised as invokable · case 03
Disabled operations remain advertised as invokable.
Disabled operations remain advertised as invokable · case 04
Disabled operations remain advertised as invokable.
Disabled operations remain advertised as invokable · case 05
Disabled operations remain advertised as invokable.
Unexposed controls leak their action descriptors · case 01
Unexposed controls leak their action descriptors.
Unexposed controls leak their action descriptors · case 02
Unexposed controls leak their action descriptors.
Unexposed controls leak their action descriptors · case 03
Unexposed controls leak their action descriptors.
Unexposed controls leak their action descriptors · case 04
Unexposed controls leak their action descriptors.
Unexposed controls leak their action descriptors · case 05
Unexposed controls leak their action descriptors.
Confirmation actions ignore permission constraints · case 01
Confirmation actions ignore permission constraints.
Confirmation actions ignore permission constraints · case 02
Confirmation actions ignore permission constraints.
Confirmation actions ignore permission constraints · case 03
Confirmation actions ignore permission constraints.
Confirmation actions ignore permission constraints · case 04
Confirmation actions ignore permission constraints.
Confirmation actions ignore permission constraints · case 05
Confirmation actions ignore permission constraints.
Duplicate action IDs create ambiguous invocation descriptors · case 01
Duplicate action IDs create ambiguous invocation descriptors.
Duplicate action IDs create ambiguous invocation descriptors · case 02
Duplicate action IDs create ambiguous invocation descriptors.
Duplicate action IDs create ambiguous invocation descriptors · case 03
Duplicate action IDs create ambiguous invocation descriptors.
Duplicate action IDs create ambiguous invocation descriptors · case 04
Duplicate action IDs create ambiguous invocation descriptors.
Duplicate action IDs create ambiguous invocation descriptors · case 05
Duplicate action IDs create ambiguous invocation descriptors.
An intentionally blank action translation falls back to authored text · case 01
An intentionally blank action translation falls back to authored text.
An intentionally blank action translation falls back to authored text · case 02
An intentionally blank action translation falls back to authored text.
An intentionally blank action translation falls back to authored text · case 03
An intentionally blank action translation falls back to authored text.
An intentionally blank action translation falls back to authored text · case 04
An intentionally blank action translation falls back to authored text.
An intentionally blank action translation falls back to authored text · case 05
An intentionally blank action translation falls back to authored text.
Action labels are replaced by internal operation names · case 01
Action labels are replaced by internal operation names.
Action labels are replaced by internal operation names · case 02
Action labels are replaced by internal operation names.
Action labels are replaced by internal operation names · case 03
Action labels are replaced by internal operation names.
Action labels are replaced by internal operation names · case 04
Action labels are replaced by internal operation names.
Action labels are replaced by internal operation names · case 05
Action labels are replaced by internal operation names.
Unlabeled actions become nameless descriptors · case 01
Unlabeled actions become nameless descriptors.
Unlabeled actions become nameless descriptors · case 02
Unlabeled actions become nameless descriptors.
Unlabeled actions become nameless descriptors · case 03
Unlabeled actions become nameless descriptors.
Unlabeled actions become nameless descriptors · case 04
Unlabeled actions become nameless descriptors.
Unlabeled actions become nameless descriptors · case 05
Unlabeled actions become nameless descriptors.
Priority values are sorted in the opposite direction · case 01
Priority values are sorted in the opposite direction.
Priority values are sorted in the opposite direction · case 02
Priority values are sorted in the opposite direction.
Priority values are sorted in the opposite direction · case 03
Priority values are sorted in the opposite direction.
Priority values are sorted in the opposite direction · case 04
Priority values are sorted in the opposite direction.
Priority values are sorted in the opposite direction · case 05
Priority values are sorted in the opposite direction.
Clients lose the confirmation requirement flag · case 01
Clients lose the confirmation requirement flag.
Clients lose the confirmation requirement flag · case 02
Clients lose the confirmation requirement flag.
Clients lose the confirmation requirement flag · case 03
Clients lose the confirmation requirement flag.
Clients lose the confirmation requirement flag · case 04
Clients lose the confirmation requirement flag.
Clients lose the confirmation requirement flag · case 05
Clients lose the confirmation requirement flag.
Attribute run includes the preceding codepoint · case 01
Attribute run includes the preceding codepoint.
Attribute run includes the preceding codepoint · case 02
Attribute run includes the preceding codepoint.
Attribute run includes the preceding codepoint · case 03
Attribute run includes the preceding codepoint.
Attribute run includes the preceding codepoint · case 04
Attribute run includes the preceding codepoint.
Attribute run includes the preceding codepoint · case 05
Attribute run includes the preceding codepoint.
Attribute run includes its exclusive end character · case 01
Attribute run includes its exclusive end character.
Attribute run includes its exclusive end character · case 02
Attribute run includes its exclusive end character.
Attribute run includes its exclusive end character · case 03
Attribute run includes its exclusive end character.
Attribute run includes its exclusive end character · case 04
Attribute run includes its exclusive end character.
Attribute run includes its exclusive end character · case 05
Attribute run includes its exclusive end character.
Lower priority style overwrites higher priority semantics · case 01
Lower priority style overwrites higher priority semantics.
Lower priority style overwrites higher priority semantics · case 02
Lower priority style overwrites higher priority semantics.
Lower priority style overwrites higher priority semantics · case 03
Lower priority style overwrites higher priority semantics.
Lower priority style overwrites higher priority semantics · case 04
Lower priority style overwrites higher priority semantics.
Lower priority style overwrites higher priority semantics · case 05
Lower priority style overwrites higher priority semantics.
Equal-priority semantic styles reverse source precedence · case 01
Equal-priority semantic styles reverse source precedence.
Equal-priority semantic styles reverse source precedence · case 02
Equal-priority semantic styles reverse source precedence.
Equal-priority semantic styles reverse source precedence · case 03
Equal-priority semantic styles reverse source precedence.
Equal-priority semantic styles reverse source precedence · case 04
Equal-priority semantic styles reverse source precedence.
Equal-priority semantic styles reverse source precedence · case 05
Equal-priority semantic styles reverse source precedence.
Cleared text attributes are serialized as null values · case 01
Cleared text attributes are serialized as null values.
Cleared text attributes are serialized as null values · case 02
Cleared text attributes are serialized as null values.
Cleared text attributes are serialized as null values · case 03
Cleared text attributes are serialized as null values.
Cleared text attributes are serialized as null values · case 04
Cleared text attributes are serialized as null values.
Cleared text attributes are serialized as null values · case 05
Cleared text attributes are serialized as null values.
An attribute patch contaminates subsequent text positions · case 01
An attribute patch contaminates subsequent text positions.
An attribute patch contaminates subsequent text positions · case 02
An attribute patch contaminates subsequent text positions.
An attribute patch contaminates subsequent text positions · case 03
An attribute patch contaminates subsequent text positions.
An attribute patch contaminates subsequent text positions · case 04
An attribute patch contaminates subsequent text positions.
An attribute patch contaminates subsequent text positions · case 05
An attribute patch contaminates subsequent text positions.
Text run updates omit preexisting attribute replacements · case 01
Text run updates omit preexisting attribute replacements.
Text run updates omit preexisting attribute replacements · case 02
Text run updates omit preexisting attribute replacements.
Text run updates omit preexisting attribute replacements · case 03
Text run updates omit preexisting attribute replacements.
Text run updates omit preexisting attribute replacements · case 04
Text run updates omit preexisting attribute replacements.
Text run updates omit preexisting attribute replacements · case 05
Text run updates omit preexisting attribute replacements.
Adjacent equal attribute runs remain fragmented · case 01
Adjacent equal attribute runs remain fragmented.
Adjacent equal attribute runs remain fragmented · case 02
Adjacent equal attribute runs remain fragmented.
Adjacent equal attribute runs remain fragmented · case 03
Adjacent equal attribute runs remain fragmented.
Adjacent equal attribute runs remain fragmented · case 04
Adjacent equal attribute runs remain fragmented.
Adjacent equal attribute runs remain fragmented · case 05
Adjacent equal attribute runs remain fragmented.
Coalesced attribute runs lose their final character · case 01
Coalesced attribute runs lose their final character.
Coalesced attribute runs lose their final character · case 02
Coalesced attribute runs lose their final character.
Coalesced attribute runs lose their final character · case 03
Coalesced attribute runs lose their final character.
Coalesced attribute runs lose their final character · case 04
Coalesced attribute runs lose their final character.
Coalesced attribute runs lose their final character · case 05
Coalesced attribute runs lose their final character.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗