Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Explicit aria-disabled false is treated as missing · case 01
Explicit aria-disabled false is treated as missing.
Explicit aria-disabled false is treated as missing · case 02
Explicit aria-disabled false is treated as missing.
Explicit aria-disabled false is treated as missing · case 03
Explicit aria-disabled false is treated as missing.
Explicit aria-disabled false is treated as missing · case 04
Explicit aria-disabled false is treated as missing.
Explicit aria-disabled false is treated as missing · case 05
Explicit aria-disabled false is treated as missing.
Ordinary disabled containers disable every descendant · case 01
Ordinary disabled containers disable every descendant.
Ordinary disabled containers disable every descendant · case 02
Ordinary disabled containers disable every descendant.
Ordinary disabled containers disable every descendant · case 03
Ordinary disabled containers disable every descendant.
Ordinary disabled containers disable every descendant · case 04
Ordinary disabled containers disable every descendant.
Ordinary disabled containers disable every descendant · case 05
Ordinary disabled containers disable every descendant.
Enabled fieldsets contribute a native disabled state · case 01
Enabled fieldsets contribute a native disabled state.
Enabled fieldsets contribute a native disabled state · case 02
Enabled fieldsets contribute a native disabled state.
Enabled fieldsets contribute a native disabled state · case 03
Enabled fieldsets contribute a native disabled state.
Enabled fieldsets contribute a native disabled state · case 04
Enabled fieldsets contribute a native disabled state.
Enabled fieldsets contribute a native disabled state · case 05
Enabled fieldsets contribute a native disabled state.
First legend descendants lose their fieldset exemption · case 01
First legend descendants lose their fieldset exemption.
First legend descendants lose their fieldset exemption · case 02
First legend descendants lose their fieldset exemption.
First legend descendants lose their fieldset exemption · case 03
First legend descendants lose their fieldset exemption.
First legend descendants lose their fieldset exemption · case 04
First legend descendants lose their fieldset exemption.
First legend descendants lose their fieldset exemption · case 05
First legend descendants lose their fieldset exemption.
An outer legend exemption clears a nested disabled fieldset · case 01
An outer legend exemption clears a nested disabled fieldset.
An outer legend exemption clears a nested disabled fieldset · case 02
An outer legend exemption clears a nested disabled fieldset.
An outer legend exemption clears a nested disabled fieldset · case 03
An outer legend exemption clears a nested disabled fieldset.
An outer legend exemption clears a nested disabled fieldset · case 04
An outer legend exemption clears a nested disabled fieldset.
An outer legend exemption clears a nested disabled fieldset · case 05
An outer legend exemption clears a nested disabled fieldset.
ARIA override incorrectly cancels native disabled semantics · case 01
ARIA override incorrectly cancels native disabled semantics.
ARIA override incorrectly cancels native disabled semantics · case 02
ARIA override incorrectly cancels native disabled semantics.
ARIA override incorrectly cancels native disabled semantics · case 03
ARIA override incorrectly cancels native disabled semantics.
ARIA override incorrectly cancels native disabled semantics · case 04
ARIA override incorrectly cancels native disabled semantics.
ARIA override incorrectly cancels native disabled semantics · case 05
ARIA override incorrectly cancels native disabled semantics.
Missing disabled metadata is exposed as unknown instead of false · case 01
Missing disabled metadata is exposed as unknown instead of false.
Missing disabled metadata is exposed as unknown instead of false · case 02
Missing disabled metadata is exposed as unknown instead of false.
Missing disabled metadata is exposed as unknown instead of false · case 03
Missing disabled metadata is exposed as unknown instead of false.
Missing disabled metadata is exposed as unknown instead of false · case 04
Missing disabled metadata is exposed as unknown instead of false.
Missing disabled metadata is exposed as unknown instead of false · case 05
Missing disabled metadata is exposed as unknown instead of false.
Disabled inheritance checks only the immediate container · case 01
Disabled inheritance checks only the immediate container.
Disabled inheritance checks only the immediate container · case 02
Disabled inheritance checks only the immediate container.
Disabled inheritance checks only the immediate container · case 03
Disabled inheritance checks only the immediate container.
Disabled inheritance checks only the immediate container · case 04
Disabled inheritance checks only the immediate container.
Disabled inheritance checks only the immediate container · case 05
Disabled inheritance checks only the immediate container.
Name invalidation walks providers instead of their consumers · case 01
Name invalidation walks providers instead of their consumers.
Name invalidation walks providers instead of their consumers · case 02
Name invalidation walks providers instead of their consumers.
Name invalidation walks providers instead of their consumers · case 03
Name invalidation walks providers instead of their consumers.
Name invalidation walks providers instead of their consumers · case 04
Name invalidation walks providers instead of their consumers.
Name invalidation walks providers instead of their consumers · case 05
Name invalidation walks providers instead of their consumers.
Description-only references invalidate cached names · case 01
Description-only references invalidate cached names.
Description-only references invalidate cached names · case 02
Description-only references invalidate cached names.
Description-only references invalidate cached names · case 03
Description-only references invalidate cached names.
Description-only references invalidate cached names · case 04
Description-only references invalidate cached names.
Description-only references invalidate cached names · case 05
Description-only references invalidate cached names.
Style-only changes invalidate dependent accessible names · case 01
Style-only changes invalidate dependent accessible names.
Style-only changes invalidate dependent accessible names · case 02
Style-only changes invalidate dependent accessible names.
Style-only changes invalidate dependent accessible names · case 03
Style-only changes invalidate dependent accessible names.
Style-only changes invalidate dependent accessible names · case 04
Style-only changes invalidate dependent accessible names.
Style-only changes invalidate dependent accessible names · case 05
Style-only changes invalidate dependent accessible names.
Style changes fail to invalidate their own computed name · case 01
Style changes fail to invalidate their own computed name.
Style changes fail to invalidate their own computed name · case 02
Style changes fail to invalidate their own computed name.
Style changes fail to invalidate their own computed name · case 03
Style changes fail to invalidate their own computed name.
Style changes fail to invalidate their own computed name · case 04
Style changes fail to invalidate their own computed name.
Style changes fail to invalidate their own computed name · case 05
Style changes fail to invalidate their own computed name.
Removed label providers do not invalidate consumers · case 01
Removed label providers do not invalidate consumers.
Removed label providers do not invalidate consumers · case 02
Removed label providers do not invalidate consumers.
Removed label providers do not invalidate consumers · case 03
Removed label providers do not invalidate consumers.
Removed label providers do not invalidate consumers · case 04
Removed label providers do not invalidate consumers.
Removed label providers do not invalidate consumers · case 05
Removed label providers do not invalidate consumers.
Nonsemantic mutations invalidate name caches · case 01
Nonsemantic mutations invalidate name caches.
Nonsemantic mutations invalidate name caches · case 02
Nonsemantic mutations invalidate name caches.
Nonsemantic mutations invalidate name caches · case 03
Nonsemantic mutations invalidate name caches.
Nonsemantic mutations invalidate name caches · case 04
Nonsemantic mutations invalidate name caches.
Nonsemantic mutations invalidate name caches · case 05
Nonsemantic mutations invalidate name caches.
Name dependency traversal stops at uncached providers · case 01
Name dependency traversal stops at uncached providers.
Name dependency traversal stops at uncached providers · case 02
Name dependency traversal stops at uncached providers.
Name dependency traversal stops at uncached providers · case 03
Name dependency traversal stops at uncached providers.
Name dependency traversal stops at uncached providers · case 04
Name dependency traversal stops at uncached providers.
Name dependency traversal stops at uncached providers · case 05
Name dependency traversal stops at uncached providers.
Name changes invalidate only direct references · case 01
Name changes invalidate only direct references.
Name changes invalidate only direct references · case 02
Name changes invalidate only direct references.
Name changes invalidate only direct references · case 03
Name changes invalidate only direct references.
Name changes invalidate only direct references · case 04
Name changes invalidate only direct references.
Name changes invalidate only direct references · case 05
Name changes invalidate only direct references.
Later mutations erase previously discovered invalidations · case 01
Later mutations erase previously discovered invalidations.
Later mutations erase previously discovered invalidations · case 02
Later mutations erase previously discovered invalidations.
Later mutations erase previously discovered invalidations · case 03
Later mutations erase previously discovered invalidations.
Later mutations erase previously discovered invalidations · case 04
Later mutations erase previously discovered invalidations.
Later mutations erase previously discovered invalidations · case 05
Later mutations erase previously discovered invalidations.
Invalidation output loses stable accessibility cache order · case 01
Invalidation output loses stable accessibility cache order.
Invalidation output loses stable accessibility cache order · case 02
Invalidation output loses stable accessibility cache order.
Invalidation output loses stable accessibility cache order · case 03
Invalidation output loses stable accessibility cache order.
Invalidation output loses stable accessibility cache order · case 04
Invalidation output loses stable accessibility cache order.
Invalidation output loses stable accessibility cache order · case 05
Invalidation output loses stable accessibility cache order.
Disabled controls advertise writable accessibility text · case 01
Disabled controls advertise writable accessibility text.
Disabled controls advertise writable accessibility text · case 02
Disabled controls advertise writable accessibility text.
Disabled controls advertise writable accessibility text · case 03
Disabled controls advertise writable accessibility text.
Disabled controls advertise writable accessibility text · case 04
Disabled controls advertise writable accessibility text.
Disabled controls advertise writable accessibility text · case 05
Disabled controls advertise writable accessibility text.
Read-only controls advertise writable accessibility text · case 01
Read-only controls advertise writable accessibility text.
Read-only controls advertise writable accessibility text · case 02
Read-only controls advertise writable accessibility text.
Read-only controls advertise writable accessibility text · case 03
Read-only controls advertise writable accessibility text.
Read-only controls advertise writable accessibility text · case 04
Read-only controls advertise writable accessibility text.
Read-only controls advertise writable accessibility text · case 05
Read-only controls advertise writable accessibility text.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗