Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Group operand counts describe direct children rather than descendant leaves · case 01
Group operand counts describe direct children rather than descendant leaves is violated by the widget projection.
Group operand counts describe direct children rather than descendant leaves · case 02
Group operand counts describe direct children rather than descendant leaves is violated by the widget projection.
Group operand counts describe direct children rather than descendant leaves · case 03
Group operand counts describe direct children rather than descendant leaves is violated by the widget projection.
Group operand counts describe direct children rather than descendant leaves · case 04
Group operand counts describe direct children rather than descendant leaves is violated by the widget projection.
Group operand counts describe direct children rather than descendant leaves · case 05
Group operand counts describe direct children rather than descendant leaves is violated by the widget projection.
Active operand counts exclude disabled children without counting descendants · case 01
Active operand counts exclude disabled children without counting descendants is violated by the widget projection.
Active operand counts exclude disabled children without counting descendants · case 02
Active operand counts exclude disabled children without counting descendants is violated by the widget projection.
Active operand counts exclude disabled children without counting descendants · case 03
Active operand counts exclude disabled children without counting descendants is violated by the widget projection.
Active operand counts exclude disabled children without counting descendants · case 04
Active operand counts exclude disabled children without counting descendants is violated by the widget projection.
Active operand counts exclude disabled children without counting descendants · case 05
Active operand counts exclude disabled children without counting descendants is violated by the widget projection.
Empty and disabled-only groups have different summaries · case 01
Empty and disabled-only groups have different summaries is violated by the widget projection.
Empty and disabled-only groups have different summaries · case 02
Empty and disabled-only groups have different summaries is violated by the widget projection.
Empty and disabled-only groups have different summaries · case 03
Empty and disabled-only groups have different summaries is violated by the widget projection.
Empty and disabled-only groups have different summaries · case 04
Empty and disabled-only groups have different summaries is violated by the widget projection.
Empty and disabled-only groups have different summaries · case 05
Empty and disabled-only groups have different summaries is violated by the widget projection.
Mixed multi-operand groups require summary parentheses · case 01
Mixed multi-operand groups require summary parentheses is violated by the widget projection.
Mixed multi-operand groups require summary parentheses · case 02
Mixed multi-operand groups require summary parentheses is violated by the widget projection.
Mixed multi-operand groups require summary parentheses · case 03
Mixed multi-operand groups require summary parentheses is violated by the widget projection.
Mixed multi-operand groups require summary parentheses · case 04
Mixed multi-operand groups require summary parentheses is violated by the widget projection.
Mixed multi-operand groups require summary parentheses · case 05
Mixed multi-operand groups require summary parentheses is violated by the widget projection.
Preset scope equality must not accept substring scopes · case 01
Preset scope equality must not accept substring scopes is violated by the widget projection.
Preset scope equality must not accept substring scopes · case 02
Preset scope equality must not accept substring scopes is violated by the widget projection.
Preset scope equality must not accept substring scopes · case 03
Preset scope equality must not accept substring scopes is violated by the widget projection.
Preset scope equality must not accept substring scopes · case 04
Preset scope equality must not accept substring scopes is violated by the widget projection.
Preset scope equality must not accept substring scopes · case 05
Preset scope equality must not accept substring scopes is violated by the widget projection.
Unmigrated preset schemas require an exact version match · case 01
Unmigrated preset schemas require an exact version match is violated by the widget projection.
Unmigrated preset schemas require an exact version match · case 02
Unmigrated preset schemas require an exact version match is violated by the widget projection.
Unmigrated preset schemas require an exact version match · case 03
Unmigrated preset schemas require an exact version match is violated by the widget projection.
Unmigrated preset schemas require an exact version match · case 04
Unmigrated preset schemas require an exact version match is violated by the widget projection.
Unmigrated preset schemas require an exact version match · case 05
Unmigrated preset schemas require an exact version match is violated by the widget projection.
Preset matching compares criterion identities independent of presentation order · case 01
Preset matching compares criterion identities independent of presentation order is violated by the widget projection.
Preset matching compares criterion identities independent of presentation order · case 02
Preset matching compares criterion identities independent of presentation order is violated by the widget projection.
Preset matching compares criterion identities independent of presentation order · case 03
Preset matching compares criterion identities independent of presentation order is violated by the widget projection.
Preset matching compares criterion identities independent of presentation order · case 04
Preset matching compares criterion identities independent of presentation order is violated by the widget projection.
Preset matching compares criterion identities independent of presentation order · case 05
Preset matching compares criterion identities independent of presentation order is violated by the widget projection.
Overwrite requires ownership and an unlocked preset · case 01
Overwrite requires ownership and an unlocked preset is violated by the widget projection.
Overwrite requires ownership and an unlocked preset · case 02
Overwrite requires ownership and an unlocked preset is violated by the widget projection.
Overwrite requires ownership and an unlocked preset · case 03
Overwrite requires ownership and an unlocked preset is violated by the widget projection.
Overwrite requires ownership and an unlocked preset · case 04
Overwrite requires ownership and an unlocked preset is violated by the widget projection.
Overwrite requires ownership and an unlocked preset · case 05
Overwrite requires ownership and an unlocked preset is violated by the widget projection.
A copied preset belongs to the copying viewer · case 01
A copied preset belongs to the copying viewer is violated by the widget projection.
A copied preset belongs to the copying viewer · case 02
A copied preset belongs to the copying viewer is violated by the widget projection.
A copied preset belongs to the copying viewer · case 03
A copied preset belongs to the copying viewer is violated by the widget projection.
A copied preset belongs to the copying viewer · case 04
A copied preset belongs to the copying viewer is violated by the widget projection.
A copied preset belongs to the copying viewer · case 05
A copied preset belongs to the copying viewer is violated by the widget projection.
Preset dirtiness includes both criterion and scope changes · case 01
Preset dirtiness includes both criterion and scope changes is violated by the widget projection.
Preset dirtiness includes both criterion and scope changes · case 02
Preset dirtiness includes both criterion and scope changes is violated by the widget projection.
Preset dirtiness includes both criterion and scope changes · case 03
Preset dirtiness includes both criterion and scope changes is violated by the widget projection.
Preset dirtiness includes both criterion and scope changes · case 04
Preset dirtiness includes both criterion and scope changes is violated by the widget projection.
Preset dirtiness includes both criterion and scope changes · case 05
Preset dirtiness includes both criterion and scope changes is violated by the widget projection.
Filter ownership uses the exact namespaced prefix · case 01
Filter ownership uses the exact namespaced prefix is violated by the widget projection.
Filter ownership uses the exact namespaced prefix · case 02
Filter ownership uses the exact namespaced prefix is violated by the widget projection.
Filter ownership uses the exact namespaced prefix · case 03
Filter ownership uses the exact namespaced prefix is violated by the widget projection.
Filter ownership uses the exact namespaced prefix · case 04
Filter ownership uses the exact namespaced prefix is violated by the widget projection.
Filter ownership uses the exact namespaced prefix · case 05
Filter ownership uses the exact namespaced prefix is violated by the widget projection.
URL filter reset preserves every nonowned route parameter · case 01
URL filter reset preserves every nonowned route parameter is violated by the widget projection.
URL filter reset preserves every nonowned route parameter · case 02
URL filter reset preserves every nonowned route parameter is violated by the widget projection.
URL filter reset preserves every nonowned route parameter · case 03
URL filter reset preserves every nonowned route parameter is violated by the widget projection.
URL filter reset preserves every nonowned route parameter · case 04
URL filter reset preserves every nonowned route parameter is violated by the widget projection.
URL filter reset preserves every nonowned route parameter · case 05
URL filter reset preserves every nonowned route parameter is violated by the widget projection.
Repeated selected values serialize as repeated query pairs · case 01
Repeated selected values serialize as repeated query pairs is violated by the widget projection.
Repeated selected values serialize as repeated query pairs · case 02
Repeated selected values serialize as repeated query pairs is violated by the widget projection.
Repeated selected values serialize as repeated query pairs · case 03
Repeated selected values serialize as repeated query pairs is violated by the widget projection.
Repeated selected values serialize as repeated query pairs · case 04
Repeated selected values serialize as repeated query pairs is violated by the widget projection.
Repeated selected values serialize as repeated query pairs · case 05
Repeated selected values serialize as repeated query pairs is violated by the widget projection.
A comma inside a selected value remains literal · case 01
A comma inside a selected value remains literal is violated by the widget projection.
A comma inside a selected value remains literal · case 02
A comma inside a selected value remains literal is violated by the widget projection.
A comma inside a selected value remains literal · case 03
A comma inside a selected value remains literal is violated by the widget projection.
A comma inside a selected value remains literal · case 04
A comma inside a selected value remains literal is violated by the widget projection.
A comma inside a selected value remains literal · case 05
A comma inside a selected value remains literal is violated by the widget projection.
Explicit empty text is serialized while an absent filter is omitted · case 01
Explicit empty text is serialized while an absent filter is omitted is violated by the widget projection.
Explicit empty text is serialized while an absent filter is omitted · case 02
Explicit empty text is serialized while an absent filter is omitted is violated by the widget projection.
Explicit empty text is serialized while an absent filter is omitted · case 03
Explicit empty text is serialized while an absent filter is omitted is violated by the widget projection.
Explicit empty text is serialized while an absent filter is omitted · case 04
Explicit empty text is serialized while an absent filter is omitted is violated by the widget projection.
Explicit empty text is serialized while an absent filter is omitted · case 05
Explicit empty text is serialized while an absent filter is omitted is violated by the widget projection.
Serialized filter field identity includes its widget scope · case 01
Serialized filter field identity includes its widget scope is violated by the widget projection.
Serialized filter field identity includes its widget scope · case 02
Serialized filter field identity includes its widget scope is violated by the widget projection.
Serialized filter field identity includes its widget scope · case 03
Serialized filter field identity includes its widget scope is violated by the widget projection.
Serialized filter field identity includes its widget scope · case 04
Serialized filter field identity includes its widget scope is violated by the widget projection.
Serialized filter field identity includes its widget scope · case 05
Serialized filter field identity includes its widget scope is violated by the widget projection.
Pending status requires a sent revision newer than acknowledgment · case 01
Pending status requires a sent revision newer than acknowledgment is violated by the widget projection.
Pending status requires a sent revision newer than acknowledgment · case 02
Pending status requires a sent revision newer than acknowledgment is violated by the widget projection.
Pending status requires a sent revision newer than acknowledgment · case 03
Pending status requires a sent revision newer than acknowledgment is violated by the widget projection.
Pending status requires a sent revision newer than acknowledgment · case 04
Pending status requires a sent revision newer than acknowledgment is violated by the widget projection.
Pending status requires a sent revision newer than acknowledgment · case 05
Pending status requires a sent revision newer than acknowledgment is violated by the widget projection.
Result freshness is tied to the accepted filter revision · case 01
Result freshness is tied to the accepted filter revision is violated by the widget projection.
Result freshness is tied to the accepted filter revision · case 02
Result freshness is tied to the accepted filter revision is violated by the widget projection.
Result freshness is tied to the accepted filter revision · case 03
Result freshness is tied to the accepted filter revision is violated by the widget projection.
Result freshness is tied to the accepted filter revision · case 04
Result freshness is tied to the accepted filter revision is violated by the widget projection.
Result freshness is tied to the accepted filter revision · case 05
Result freshness is tied to the accepted filter revision is violated by the widget projection.
Only errors for the current submission appear on its filter summary · case 01
Only errors for the current submission appear on its filter summary is violated by the widget projection.
Only errors for the current submission appear on its filter summary · case 02
Only errors for the current submission appear on its filter summary is violated by the widget projection.
Only errors for the current submission appear on its filter summary · case 03
Only errors for the current submission appear on its filter summary is violated by the widget projection.
Only errors for the current submission appear on its filter summary · case 04
Only errors for the current submission appear on its filter summary is violated by the widget projection.
Only errors for the current submission appear on its filter summary · case 05
Only errors for the current submission appear on its filter summary is violated by the widget projection.
Pending change counts include both added and removed criteria · case 01
Pending change counts include both added and removed criteria is violated by the widget projection.
Pending change counts include both added and removed criteria · case 02
Pending change counts include both added and removed criteria is violated by the widget projection.
Pending change counts include both added and removed criteria · case 03
Pending change counts include both added and removed criteria is violated by the widget projection.
Pending change counts include both added and removed criteria · case 04
Pending change counts include both added and removed criteria is violated by the widget projection.
Pending change counts include both added and removed criteria · case 05
Pending change counts include both added and removed criteria is violated by the widget projection.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗