Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Missing-value operators require both nullable fields and advertised support · case 01
Missing-value operators require both nullable fields and advertised support is violated by the widget projection.
Missing-value operators require both nullable fields and advertised support · case 02
Missing-value operators require both nullable fields and advertised support is violated by the widget projection.
Missing-value operators require both nullable fields and advertised support · case 03
Missing-value operators require both nullable fields and advertised support is violated by the widget projection.
Missing-value operators require both nullable fields and advertised support · case 04
Missing-value operators require both nullable fields and advertised support is violated by the widget projection.
Missing-value operators require both nullable fields and advertised support · case 05
Missing-value operators require both nullable fields and advertised support is violated by the widget projection.
A complete row requires a known field, supported operator and appropriate operand · case 01
A complete row requires a known field, supported operator and appropriate operand is violated by the widget projection.
A complete row requires a known field, supported operator and appropriate operand · case 02
A complete row requires a known field, supported operator and appropriate operand is violated by the widget projection.
A complete row requires a known field, supported operator and appropriate operand · case 03
A complete row requires a known field, supported operator and appropriate operand is violated by the widget projection.
A complete row requires a known field, supported operator and appropriate operand · case 04
A complete row requires a known field, supported operator and appropriate operand is violated by the widget projection.
A complete row requires a known field, supported operator and appropriate operand · case 05
A complete row requires a known field, supported operator and appropriate operand is violated by the widget projection.
Lower-bound and unknown facet count modes have distinct prefixes · case 01
Lower-bound and unknown facet count modes have distinct prefixes is violated by the widget projection.
Lower-bound and unknown facet count modes have distinct prefixes · case 02
Lower-bound and unknown facet count modes have distinct prefixes is violated by the widget projection.
Lower-bound and unknown facet count modes have distinct prefixes · case 03
Lower-bound and unknown facet count modes have distinct prefixes is violated by the widget projection.
Lower-bound and unknown facet count modes have distinct prefixes · case 04
Lower-bound and unknown facet count modes have distinct prefixes is violated by the widget projection.
Lower-bound and unknown facet count modes have distinct prefixes · case 05
Lower-bound and unknown facet count modes have distinct prefixes is violated by the widget projection.
Unknown mode suppresses the cached numeric count without hiding exact zero · case 01
Unknown mode suppresses the cached numeric count without hiding exact zero is violated by the widget projection.
Unknown mode suppresses the cached numeric count without hiding exact zero · case 02
Unknown mode suppresses the cached numeric count without hiding exact zero is violated by the widget projection.
Unknown mode suppresses the cached numeric count without hiding exact zero · case 03
Unknown mode suppresses the cached numeric count without hiding exact zero is violated by the widget projection.
Unknown mode suppresses the cached numeric count without hiding exact zero · case 04
Unknown mode suppresses the cached numeric count without hiding exact zero is violated by the widget projection.
Unknown mode suppresses the cached numeric count without hiding exact zero · case 05
Unknown mode suppresses the cached numeric count without hiding exact zero is violated by the widget projection.
Only exact zero disables an unselected choice · case 01
Only exact zero disables an unselected choice is violated by the widget projection.
Only exact zero disables an unselected choice · case 02
Only exact zero disables an unselected choice is violated by the widget projection.
Only exact zero disables an unselected choice · case 03
Only exact zero disables an unselected choice is violated by the widget projection.
Only exact zero disables an unselected choice · case 04
Only exact zero disables an unselected choice is violated by the widget projection.
Only exact zero disables an unselected choice · case 05
Only exact zero disables an unselected choice is violated by the widget projection.
Facet summary totals use supplied distinct-result totals · case 01
Facet summary totals use supplied distinct-result totals is violated by the widget projection.
Facet summary totals use supplied distinct-result totals · case 02
Facet summary totals use supplied distinct-result totals is violated by the widget projection.
Facet summary totals use supplied distinct-result totals · case 03
Facet summary totals use supplied distinct-result totals is violated by the widget projection.
Facet summary totals use supplied distinct-result totals · case 04
Facet summary totals use supplied distinct-result totals is violated by the widget projection.
Facet summary totals use supplied distinct-result totals · case 05
Facet summary totals use supplied distinct-result totals is violated by the widget projection.
Approximation badges identify lower-bound count mode · case 01
Approximation badges identify lower-bound count mode is violated by the widget projection.
Approximation badges identify lower-bound count mode · case 02
Approximation badges identify lower-bound count mode is violated by the widget projection.
Approximation badges identify lower-bound count mode · case 03
Approximation badges identify lower-bound count mode is violated by the widget projection.
Approximation badges identify lower-bound count mode · case 04
Approximation badges identify lower-bound count mode is violated by the widget projection.
Approximation badges identify lower-bound count mode · case 05
Approximation badges identify lower-bound count mode is violated by the widget projection.
Count-based sorting activates only on settled exact counts · case 01
Count-based sorting activates only on settled exact counts is violated by the widget projection.
Count-based sorting activates only on settled exact counts · case 02
Count-based sorting activates only on settled exact counts is violated by the widget projection.
Count-based sorting activates only on settled exact counts · case 03
Count-based sorting activates only on settled exact counts is violated by the widget projection.
Count-based sorting activates only on settled exact counts · case 04
Count-based sorting activates only on settled exact counts is violated by the widget projection.
Count-based sorting activates only on settled exact counts · case 05
Count-based sorting activates only on settled exact counts is violated by the widget projection.
Literal text operands preserve wildcard-looking punctuation · case 01
Literal text operands preserve wildcard-looking punctuation is violated by the widget projection.
Literal text operands preserve wildcard-looking punctuation · case 02
Literal text operands preserve wildcard-looking punctuation is violated by the widget projection.
Literal text operands preserve wildcard-looking punctuation · case 03
Literal text operands preserve wildcard-looking punctuation is violated by the widget projection.
Literal text operands preserve wildcard-looking punctuation · case 04
Literal text operands preserve wildcard-looking punctuation is violated by the widget projection.
Literal text operands preserve wildcard-looking punctuation · case 05
Literal text operands preserve wildcard-looking punctuation is violated by the widget projection.
Text normalization honors the selected trim policy · case 01
Text normalization honors the selected trim policy is violated by the widget projection.
Text normalization honors the selected trim policy · case 02
Text normalization honors the selected trim policy is violated by the widget projection.
Text normalization honors the selected trim policy · case 03
Text normalization honors the selected trim policy is violated by the widget projection.
Text normalization honors the selected trim policy · case 04
Text normalization honors the selected trim policy is violated by the widget projection.
Text normalization honors the selected trim policy · case 05
Text normalization honors the selected trim policy is violated by the widget projection.
Case-insensitive text filters use casefold while sensitive filters preserve case · case 01
Case-insensitive text filters use casefold while sensitive filters preserve case is violated by the widget projection.
Case-insensitive text filters use casefold while sensitive filters preserve case · case 02
Case-insensitive text filters use casefold while sensitive filters preserve case is violated by the widget projection.
Case-insensitive text filters use casefold while sensitive filters preserve case · case 03
Case-insensitive text filters use casefold while sensitive filters preserve case is violated by the widget projection.
Case-insensitive text filters use casefold while sensitive filters preserve case · case 04
Case-insensitive text filters use casefold while sensitive filters preserve case is violated by the widget projection.
Case-insensitive text filters use casefold while sensitive filters preserve case · case 05
Case-insensitive text filters use casefold while sensitive filters preserve case is violated by the widget projection.
Text-filter summaries retain the selected match mode · case 01
Text-filter summaries retain the selected match mode is violated by the widget projection.
Text-filter summaries retain the selected match mode · case 02
Text-filter summaries retain the selected match mode is violated by the widget projection.
Text-filter summaries retain the selected match mode · case 03
Text-filter summaries retain the selected match mode is violated by the widget projection.
Text-filter summaries retain the selected match mode · case 04
Text-filter summaries retain the selected match mode is violated by the widget projection.
Text-filter summaries retain the selected match mode · case 05
Text-filter summaries retain the selected match mode is violated by the widget projection.
Explicit empty equality is valid while empty broad-match operands are not · case 01
Explicit empty equality is valid while empty broad-match operands are not is violated by the widget projection.
Explicit empty equality is valid while empty broad-match operands are not · case 02
Explicit empty equality is valid while empty broad-match operands are not is violated by the widget projection.
Explicit empty equality is valid while empty broad-match operands are not · case 03
Explicit empty equality is valid while empty broad-match operands are not is violated by the widget projection.
Explicit empty equality is valid while empty broad-match operands are not · case 04
Explicit empty equality is valid while empty broad-match operands are not is violated by the widget projection.
Explicit empty equality is valid while empty broad-match operands are not · case 05
Explicit empty equality is valid while empty broad-match operands are not is violated by the widget projection.
Serialized case policy uses positive case-sensitive polarity · case 01
Serialized case policy uses positive case-sensitive polarity is violated by the widget projection.
Serialized case policy uses positive case-sensitive polarity · case 02
Serialized case policy uses positive case-sensitive polarity is violated by the widget projection.
Serialized case policy uses positive case-sensitive polarity · case 03
Serialized case policy uses positive case-sensitive polarity is violated by the widget projection.
Serialized case policy uses positive case-sensitive polarity · case 04
Serialized case policy uses positive case-sensitive polarity is violated by the widget projection.
Serialized case policy uses positive case-sensitive polarity · case 05
Serialized case policy uses positive case-sensitive polarity is violated by the widget projection.
Null labels are selected by semantic kind rather than falsy captions · case 01
Null labels are selected by semantic kind rather than falsy captions is violated by the widget projection.
Null labels are selected by semantic kind rather than falsy captions · case 02
Null labels are selected by semantic kind rather than falsy captions is violated by the widget projection.
Null labels are selected by semantic kind rather than falsy captions · case 03
Null labels are selected by semantic kind rather than falsy captions is violated by the widget projection.
Null labels are selected by semantic kind rather than falsy captions · case 04
Null labels are selected by semantic kind rather than falsy captions is violated by the widget projection.
Null labels are selected by semantic kind rather than falsy captions · case 05
Null labels are selected by semantic kind rather than falsy captions is violated by the widget projection.
A null facet serializes a null predicate instead of text equality · case 01
A null facet serializes a null predicate instead of text equality is violated by the widget projection.
A null facet serializes a null predicate instead of text equality · case 02
A null facet serializes a null predicate instead of text equality is violated by the widget projection.
A null facet serializes a null predicate instead of text equality · case 03
A null facet serializes a null predicate instead of text equality is violated by the widget projection.
A null facet serializes a null predicate instead of text equality · case 04
A null facet serializes a null predicate instead of text equality is violated by the widget projection.
A null facet serializes a null predicate instead of text equality · case 05
A null facet serializes a null predicate instead of text equality is violated by the widget projection.
Missing-field indicators do not collapse null or empty-string options · case 01
Missing-field indicators do not collapse null or empty-string options is violated by the widget projection.
Missing-field indicators do not collapse null or empty-string options · case 02
Missing-field indicators do not collapse null or empty-string options is violated by the widget projection.
Missing-field indicators do not collapse null or empty-string options · case 03
Missing-field indicators do not collapse null or empty-string options is violated by the widget projection.
Missing-field indicators do not collapse null or empty-string options · case 04
Missing-field indicators do not collapse null or empty-string options is violated by the widget projection.
Missing-field indicators do not collapse null or empty-string options · case 05
Missing-field indicators do not collapse null or empty-string options is violated by the widget projection.
Empty text receives its own display caption · case 01
Empty text receives its own display caption is violated by the widget projection.
Empty text receives its own display caption · case 02
Empty text receives its own display caption is violated by the widget projection.
Empty text receives its own display caption · case 03
Empty text receives its own display caption is violated by the widget projection.
Empty text receives its own display caption · case 04
Empty text receives its own display caption is violated by the widget projection.
Empty text receives its own display caption · case 05
Empty text receives its own display caption is violated by the widget projection.
Facet identities preserve both semantic kind and empty-string payload · case 01
Facet identities preserve both semantic kind and empty-string payload is violated by the widget projection.
Facet identities preserve both semantic kind and empty-string payload · case 02
Facet identities preserve both semantic kind and empty-string payload is violated by the widget projection.
Facet identities preserve both semantic kind and empty-string payload · case 03
Facet identities preserve both semantic kind and empty-string payload is violated by the widget projection.
Facet identities preserve both semantic kind and empty-string payload · case 04
Facet identities preserve both semantic kind and empty-string payload is violated by the widget projection.
Facet identities preserve both semantic kind and empty-string payload · case 05
Facet identities preserve both semantic kind and empty-string payload is violated by the widget projection.
Count lookup keeps null and missing buckets in separate namespaces · case 01
Count lookup keeps null and missing buckets in separate namespaces is violated by the widget projection.
Count lookup keeps null and missing buckets in separate namespaces · case 02
Count lookup keeps null and missing buckets in separate namespaces is violated by the widget projection.
Count lookup keeps null and missing buckets in separate namespaces · case 03
Count lookup keeps null and missing buckets in separate namespaces is violated by the widget projection.
Count lookup keeps null and missing buckets in separate namespaces · case 04
Count lookup keeps null and missing buckets in separate namespaces is violated by the widget projection.
Count lookup keeps null and missing buckets in separate namespaces · case 05
Count lookup keeps null and missing buckets in separate namespaces is violated by the widget projection.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗