Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Removal deltas retain arbitrary transport insertion order · case 01
Removal deltas retain arbitrary transport insertion order.
Removal deltas retain arbitrary transport insertion order · case 02
Removal deltas retain arbitrary transport insertion order.
Removal deltas retain arbitrary transport insertion order · case 03
Removal deltas retain arbitrary transport insertion order.
Removal deltas retain arbitrary transport insertion order · case 04
Removal deltas retain arbitrary transport insertion order.
Removal deltas retain arbitrary transport insertion order · case 05
Removal deltas retain arbitrary transport insertion order.
Added objects ignore declared semantic sibling order · case 01
Added objects ignore declared semantic sibling order.
Added objects ignore declared semantic sibling order · case 02
Added objects ignore declared semantic sibling order.
Added objects ignore declared semantic sibling order · case 03
Added objects ignore declared semantic sibling order.
Added objects ignore declared semantic sibling order · case 04
Added objects ignore declared semantic sibling order.
Added objects ignore declared semantic sibling order · case 05
Added objects ignore declared semantic sibling order.
Role replacement delta repeats the old role · case 01
Role replacement delta repeats the old role.
Role replacement delta repeats the old role · case 02
Role replacement delta repeats the old role.
Role replacement delta repeats the old role · case 03
Role replacement delta repeats the old role.
Role replacement delta repeats the old role · case 04
Role replacement delta repeats the old role.
Role replacement delta repeats the old role · case 05
Role replacement delta repeats the old role.
Role replacement also emits an incompatible property-only update · case 01
Role replacement also emits an incompatible property-only update.
Role replacement also emits an incompatible property-only update · case 02
Role replacement also emits an incompatible property-only update.
Role replacement also emits an incompatible property-only update · case 03
Role replacement also emits an incompatible property-only update.
Role replacement also emits an incompatible property-only update · case 04
Role replacement also emits an incompatible property-only update.
Role replacement also emits an incompatible property-only update · case 05
Role replacement also emits an incompatible property-only update.
Clearing a name does not emit a semantic update · case 01
Clearing a name does not emit a semantic update.
Clearing a name does not emit a semantic update · case 02
Clearing a name does not emit a semantic update.
Clearing a name does not emit a semantic update · case 03
Clearing a name does not emit a semantic update.
Clearing a name does not emit a semantic update · case 04
Clearing a name does not emit a semantic update.
Clearing a name does not emit a semantic update · case 05
Clearing a name does not emit a semantic update.
Reparented semantic objects omit their move delta · case 01
Reparented semantic objects omit their move delta.
Reparented semantic objects omit their move delta · case 02
Reparented semantic objects omit their move delta.
Reparented semantic objects omit their move delta · case 03
Reparented semantic objects omit their move delta.
Reparented semantic objects omit their move delta · case 04
Reparented semantic objects omit their move delta.
Reparented semantic objects omit their move delta · case 05
Reparented semantic objects omit their move delta.
Sibling reorder leaves accessibility snapshot order stale · case 01
Sibling reorder leaves accessibility snapshot order stale.
Sibling reorder leaves accessibility snapshot order stale · case 02
Sibling reorder leaves accessibility snapshot order stale.
Sibling reorder leaves accessibility snapshot order stale · case 03
Sibling reorder leaves accessibility snapshot order stale.
Sibling reorder leaves accessibility snapshot order stale · case 04
Sibling reorder leaves accessibility snapshot order stale.
Sibling reorder leaves accessibility snapshot order stale · case 05
Sibling reorder leaves accessibility snapshot order stale.
Move records contain the departed parent · case 01
Move records contain the departed parent.
Move records contain the departed parent · case 02
Move records contain the departed parent.
Move records contain the departed parent · case 03
Move records contain the departed parent.
Move records contain the departed parent · case 04
Move records contain the departed parent.
Move records contain the departed parent · case 05
Move records contain the departed parent.
Move records contain the previous sibling position · case 01
Move records contain the previous sibling position.
Move records contain the previous sibling position · case 02
Move records contain the previous sibling position.
Move records contain the previous sibling position · case 03
Move records contain the previous sibling position.
Move records contain the previous sibling position · case 04
Move records contain the previous sibling position.
Move records contain the previous sibling position · case 05
Move records contain the previous sibling position.
A label query returns controls from unrelated documents · case 01
A label query returns controls from unrelated documents.
A label query returns controls from unrelated documents · case 02
A label query returns controls from unrelated documents.
A label query returns controls from unrelated documents · case 03
A label query returns controls from unrelated documents.
A label query returns controls from unrelated documents · case 04
A label query returns controls from unrelated documents.
A label query returns controls from unrelated documents · case 05
A label query returns controls from unrelated documents.
Nonlabelable semantic objects receive native label associations · case 01
Nonlabelable semantic objects receive native label associations.
Nonlabelable semantic objects receive native label associations · case 02
Nonlabelable semantic objects receive native label associations.
Nonlabelable semantic objects receive native label associations · case 03
Nonlabelable semantic objects receive native label associations.
Nonlabelable semantic objects receive native label associations · case 04
Nonlabelable semantic objects receive native label associations.
Nonlabelable semantic objects receive native label associations · case 05
Nonlabelable semantic objects receive native label associations.
Cross-document label identifiers collide · case 01
Cross-document label identifiers collide.
Cross-document label identifiers collide · case 02
Cross-document label identifiers collide.
Cross-document label identifiers collide · case 03
Cross-document label identifiers collide.
Cross-document label identifiers collide · case 04
Cross-document label identifiers collide.
Cross-document label identifiers collide · case 05
Cross-document label identifiers collide.
Empty labels create empty pieces in the name channel · case 01
Empty labels create empty pieces in the name channel.
Empty labels create empty pieces in the name channel · case 02
Empty labels create empty pieces in the name channel.
Empty labels create empty pieces in the name channel · case 03
Empty labels create empty pieces in the name channel.
Empty labels create empty pieces in the name channel · case 04
Empty labels create empty pieces in the name channel.
Empty labels create empty pieces in the name channel · case 05
Empty labels create empty pieces in the name channel.
Wrapping labels override an explicit target pointing elsewhere · case 01
Wrapping labels override an explicit target pointing elsewhere.
Wrapping labels override an explicit target pointing elsewhere · case 02
Wrapping labels override an explicit target pointing elsewhere.
Wrapping labels override an explicit target pointing elsewhere · case 03
Wrapping labels override an explicit target pointing elsewhere.
Wrapping labels override an explicit target pointing elsewhere · case 04
Wrapping labels override an explicit target pointing elsewhere.
Wrapping labels override an explicit target pointing elsewhere · case 05
Wrapping labels override an explicit target pointing elsewhere.
An explicit empty label target is treated as absent · case 01
An explicit empty label target is treated as absent.
An explicit empty label target is treated as absent · case 02
An explicit empty label target is treated as absent.
An explicit empty label target is treated as absent · case 03
An explicit empty label target is treated as absent.
An explicit empty label target is treated as absent · case 04
An explicit empty label target is treated as absent.
An explicit empty label target is treated as absent · case 05
An explicit empty label target is treated as absent.
Repeated label elements duplicate the name contribution · case 01
Repeated label elements duplicate the name contribution.
Repeated label elements duplicate the name contribution · case 02
Repeated label elements duplicate the name contribution.
Repeated label elements duplicate the name contribution · case 03
Repeated label elements duplicate the name contribution.
Repeated label elements duplicate the name contribution · case 04
Repeated label elements duplicate the name contribution.
Repeated label elements duplicate the name contribution · case 05
Repeated label elements duplicate the name contribution.
Distinct labels with equal text lose their second contribution · case 01
Distinct labels with equal text lose their second contribution.
Distinct labels with equal text lose their second contribution · case 02
Distinct labels with equal text lose their second contribution.
Distinct labels with equal text lose their second contribution · case 03
Distinct labels with equal text lose their second contribution.
Distinct labels with equal text lose their second contribution · case 04
Distinct labels with equal text lose their second contribution.
Distinct labels with equal text lose their second contribution · case 05
Distinct labels with equal text lose their second contribution.
Association strips intentional label whitespace · case 01
Association strips intentional label whitespace.
Association strips intentional label whitespace · case 02
Association strips intentional label whitespace.
Association strips intentional label whitespace · case 03
Association strips intentional label whitespace.
Association strips intentional label whitespace · case 04
Association strips intentional label whitespace.
Association strips intentional label whitespace · case 05
Association strips intentional label whitespace.
Explicit native disabled state is lost outside fieldsets · case 01
Explicit native disabled state is lost outside fieldsets.
Explicit native disabled state is lost outside fieldsets · case 02
Explicit native disabled state is lost outside fieldsets.
Explicit native disabled state is lost outside fieldsets · case 03
Explicit native disabled state is lost outside fieldsets.
Explicit native disabled state is lost outside fieldsets · case 04
Explicit native disabled state is lost outside fieldsets.
Explicit native disabled state is lost outside fieldsets · case 05
Explicit native disabled state is lost outside fieldsets.
An ancestor overwrites a nearer explicit disabled override · case 01
An ancestor overwrites a nearer explicit disabled override.
An ancestor overwrites a nearer explicit disabled override · case 02
An ancestor overwrites a nearer explicit disabled override.
An ancestor overwrites a nearer explicit disabled override · case 03
An ancestor overwrites a nearer explicit disabled override.
An ancestor overwrites a nearer explicit disabled override · case 04
An ancestor overwrites a nearer explicit disabled override.
An ancestor overwrites a nearer explicit disabled override · case 05
An ancestor overwrites a nearer explicit disabled override.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗