Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Selected state is exported without selection capability · case 01
Selected state is exported without selection capability.
Selected state is exported without selection capability · case 02
Selected state is exported without selection capability.
Selected state is exported without selection capability · case 03
Selected state is exported without selection capability.
Selected state is exported without selection capability · case 04
Selected state is exported without selection capability.
Selected state is exported without selection capability · case 05
Selected state is exported without selection capability.
Expanded state is exported on nonexpandable objects · case 01
Expanded state is exported on nonexpandable objects.
Expanded state is exported on nonexpandable objects · case 02
Expanded state is exported on nonexpandable objects.
Expanded state is exported on nonexpandable objects · case 03
Expanded state is exported on nonexpandable objects.
Expanded state is exported on nonexpandable objects · case 04
Expanded state is exported on nonexpandable objects.
Expanded state is exported on nonexpandable objects · case 05
Expanded state is exported on nonexpandable objects.
Checked state overrides a mixed value in a tri-state semantic · case 01
Checked state overrides a mixed value in a tri-state semantic.
Checked state overrides a mixed value in a tri-state semantic · case 02
Checked state overrides a mixed value in a tri-state semantic.
Checked state overrides a mixed value in a tri-state semantic · case 03
Checked state overrides a mixed value in a tri-state semantic.
Checked state overrides a mixed value in a tri-state semantic · case 04
Checked state overrides a mixed value in a tri-state semantic.
Checked state overrides a mixed value in a tri-state semantic · case 05
Checked state overrides a mixed value in a tri-state semantic.
Checked states leak from objects without check semantics · case 01
Checked states leak from objects without check semantics.
Checked states leak from objects without check semantics · case 02
Checked states leak from objects without check semantics.
Checked states leak from objects without check semantics · case 03
Checked states leak from objects without check semantics.
Checked states leak from objects without check semantics · case 04
Checked states leak from objects without check semantics.
Checked states leak from objects without check semantics · case 05
Checked states leak from objects without check semantics.
Offscreen state is conflated with invisibility · case 01
Offscreen state is conflated with invisibility.
Offscreen state is conflated with invisibility · case 02
Offscreen state is conflated with invisibility.
Offscreen state is conflated with invisibility · case 03
Offscreen state is conflated with invisibility.
Offscreen state is conflated with invisibility · case 04
Offscreen state is conflated with invisibility.
Offscreen state is conflated with invisibility · case 05
Offscreen state is conflated with invisibility.
Focused state is suppressed when focusability changes · case 01
Focused state is suppressed when focusability changes.
Focused state is suppressed when focusability changes · case 02
Focused state is suppressed when focusability changes.
Focused state is suppressed when focusability changes · case 03
Focused state is suppressed when focusability changes.
Focused state is suppressed when focusability changes · case 04
Focused state is suppressed when focusability changes.
Focused state is suppressed when focusability changes · case 05
Focused state is suppressed when focusability changes.
Read-only metadata is omitted on noneditable semantic objects · case 01
Read-only metadata is omitted on noneditable semantic objects.
Read-only metadata is omitted on noneditable semantic objects · case 02
Read-only metadata is omitted on noneditable semantic objects.
Read-only metadata is omitted on noneditable semantic objects · case 03
Read-only metadata is omitted on noneditable semantic objects.
Read-only metadata is omitted on noneditable semantic objects · case 04
Read-only metadata is omitted on noneditable semantic objects.
Read-only metadata is omitted on noneditable semantic objects · case 05
Read-only metadata is omitted on noneditable semantic objects.
Busy state suppresses simultaneous invalid metadata · case 01
Busy state suppresses simultaneous invalid metadata.
Busy state suppresses simultaneous invalid metadata · case 02
Busy state suppresses simultaneous invalid metadata.
Busy state suppresses simultaneous invalid metadata · case 03
Busy state suppresses simultaneous invalid metadata.
Busy state suppresses simultaneous invalid metadata · case 04
Busy state suppresses simultaneous invalid metadata.
Busy state suppresses simultaneous invalid metadata · case 05
Busy state suppresses simultaneous invalid metadata.
Hidden ruby annotations remain exposed as pronunciations · case 01
Hidden ruby annotations remain exposed as pronunciations.
Hidden ruby annotations remain exposed as pronunciations · case 02
Hidden ruby annotations remain exposed as pronunciations.
Hidden ruby annotations remain exposed as pronunciations · case 03
Hidden ruby annotations remain exposed as pronunciations.
Hidden ruby annotations remain exposed as pronunciations · case 04
Hidden ruby annotations remain exposed as pronunciations.
Hidden ruby annotations remain exposed as pronunciations · case 05
Hidden ruby annotations remain exposed as pronunciations.
Ruby base mode unexpectedly substitutes pronunciation text · case 01
Ruby base mode unexpectedly substitutes pronunciation text.
Ruby base mode unexpectedly substitutes pronunciation text · case 02
Ruby base mode unexpectedly substitutes pronunciation text.
Ruby base mode unexpectedly substitutes pronunciation text · case 03
Ruby base mode unexpectedly substitutes pronunciation text.
Ruby base mode unexpectedly substitutes pronunciation text · case 04
Ruby base mode unexpectedly substitutes pronunciation text.
Ruby base mode unexpectedly substitutes pronunciation text · case 05
Ruby base mode unexpectedly substitutes pronunciation text.
An absent pronunciation erases the base text · case 01
An absent pronunciation erases the base text.
An absent pronunciation erases the base text · case 02
An absent pronunciation erases the base text.
An absent pronunciation erases the base text · case 03
An absent pronunciation erases the base text.
An absent pronunciation erases the base text · case 04
An absent pronunciation erases the base text.
An absent pronunciation erases the base text · case 05
An absent pronunciation erases the base text.
Ruby annotations are appended in base-only mode · case 01
Ruby annotations are appended in base-only mode.
Ruby annotations are appended in base-only mode · case 02
Ruby annotations are appended in base-only mode.
Ruby annotations are appended in base-only mode · case 03
Ruby annotations are appended in base-only mode.
Ruby annotations are appended in base-only mode · case 04
Ruby annotations are appended in base-only mode.
Ruby annotations are appended in base-only mode · case 05
Ruby annotations are appended in base-only mode.
Identical base and pronunciation are exposed twice · case 01
Identical base and pronunciation are exposed twice.
Identical base and pronunciation are exposed twice · case 02
Identical base and pronunciation are exposed twice.
Identical base and pronunciation are exposed twice · case 03
Identical base and pronunciation are exposed twice.
Identical base and pronunciation are exposed twice · case 04
Identical base and pronunciation are exposed twice.
Identical base and pronunciation are exposed twice · case 05
Identical base and pronunciation are exposed twice.
Combined ruby output omits pronunciation delimiters · case 01
Combined ruby output omits pronunciation delimiters.
Combined ruby output omits pronunciation delimiters · case 02
Combined ruby output omits pronunciation delimiters.
Combined ruby output omits pronunciation delimiters · case 03
Combined ruby output omits pronunciation delimiters.
Combined ruby output omits pronunciation delimiters · case 04
Combined ruby output omits pronunciation delimiters.
Combined ruby output omits pronunciation delimiters · case 05
Combined ruby output omits pronunciation delimiters.
Ruby fallback markup enters semantic text · case 01
Ruby fallback markup enters semantic text.
Ruby fallback markup enters semantic text · case 02
Ruby fallback markup enters semantic text.
Ruby fallback markup enters semantic text · case 03
Ruby fallback markup enters semantic text.
Ruby fallback markup enters semantic text · case 04
Ruby fallback markup enters semantic text.
Ruby fallback markup enters semantic text · case 05
Ruby fallback markup enters semantic text.
Empty ruby segments create phantom text attribute runs · case 01
Empty ruby segments create phantom text attribute runs.
Empty ruby segments create phantom text attribute runs · case 02
Empty ruby segments create phantom text attribute runs.
Empty ruby segments create phantom text attribute runs · case 03
Empty ruby segments create phantom text attribute runs.
Empty ruby segments create phantom text attribute runs · case 04
Empty ruby segments create phantom text attribute runs.
Empty ruby segments create phantom text attribute runs · case 05
Empty ruby segments create phantom text attribute runs.
Pronunciation language is silently replaced with a default · case 01
Pronunciation language is silently replaced with a default.
Pronunciation language is silently replaced with a default · case 02
Pronunciation language is silently replaced with a default.
Pronunciation language is silently replaced with a default · case 03
Pronunciation language is silently replaced with a default.
Pronunciation language is silently replaced with a default · case 04
Pronunciation language is silently replaced with a default.
Pronunciation language is silently replaced with a default · case 05
Pronunciation language is silently replaced with a default.
Pronunciation ranges are mislabeled as base text · case 01
Pronunciation ranges are mislabeled as base text.
Pronunciation ranges are mislabeled as base text · case 02
Pronunciation ranges are mislabeled as base text.
Pronunciation ranges are mislabeled as base text · case 03
Pronunciation ranges are mislabeled as base text.
Pronunciation ranges are mislabeled as base text · case 04
Pronunciation ranges are mislabeled as base text.
Pronunciation ranges are mislabeled as base text · case 05
Pronunciation ranges are mislabeled as base text.
Math tokens expose their node kind instead of content · case 01
Math tokens expose their node kind instead of content.
Math tokens expose their node kind instead of content · case 02
Math tokens expose their node kind instead of content.
Math tokens expose their node kind instead of content · case 03
Math tokens expose their node kind instead of content.
Math tokens expose their node kind instead of content · case 04
Math tokens expose their node kind instead of content.
Math tokens expose their node kind instead of content · case 05
Math tokens expose their node kind instead of content.
Authored math alternatives lose priority over structure · case 01
Authored math alternatives lose priority over structure.
Authored math alternatives lose priority over structure · case 02
Authored math alternatives lose priority over structure.
Authored math alternatives lose priority over structure · case 03
Authored math alternatives lose priority over structure.
Authored math alternatives lose priority over structure · case 04
Authored math alternatives lose priority over structure.
Authored math alternatives lose priority over structure · case 05
Authored math alternatives lose priority over structure.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗