Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
A delete-vector scan also removes surviving null-valued rows · case 01
A delete-vector scan also removes surviving null-valued rows.
A delete-vector scan also removes surviving null-valued rows · case 02
A delete-vector scan also removes surviving null-valued rows.
A delete-vector scan also removes surviving null-valued rows · case 03
A delete-vector scan also removes surviving null-valued rows.
A delete-vector scan also removes surviving null-valued rows · case 04
A delete-vector scan also removes surviving null-valued rows.
A delete-vector scan also removes surviving null-valued rows · case 05
A delete-vector scan also removes surviving null-valued rows.
Delete-vector scanning sorts fragments by physical filename · case 01
Delete-vector scanning sorts fragments by physical filename.
Delete-vector scanning sorts fragments by physical filename · case 02
Delete-vector scanning sorts fragments by physical filename.
Delete-vector scanning sorts fragments by physical filename · case 03
Delete-vector scanning sorts fragments by physical filename.
Delete-vector scanning sorts fragments by physical filename · case 04
Delete-vector scanning sorts fragments by physical filename.
Delete-vector scanning sorts fragments by physical filename · case 05
Delete-vector scanning sorts fragments by physical filename.
Transaction coalescing replaces the original before-image on every update · case 01
Transaction coalescing replaces the original before-image on every update.
Transaction coalescing replaces the original before-image on every update · case 02
Transaction coalescing replaces the original before-image on every update.
Transaction coalescing replaces the original before-image on every update · case 03
Transaction coalescing replaces the original before-image on every update.
Transaction coalescing replaces the original before-image on every update · case 04
Transaction coalescing replaces the original before-image on every update.
Transaction coalescing replaces the original before-image on every update · case 05
Transaction coalescing replaces the original before-image on every update.
Transaction coalescing retains the first after-image · case 01
Transaction coalescing retains the first after-image.
Transaction coalescing retains the first after-image · case 02
Transaction coalescing retains the first after-image.
Transaction coalescing retains the first after-image · case 03
Transaction coalescing retains the first after-image.
Transaction coalescing retains the first after-image · case 04
Transaction coalescing retains the first after-image.
Transaction coalescing retains the first after-image · case 05
Transaction coalescing retains the first after-image.
Transaction coalescing emits identities whose net state is unchanged · case 01
Transaction coalescing emits identities whose net state is unchanged.
Transaction coalescing emits identities whose net state is unchanged · case 02
Transaction coalescing emits identities whose net state is unchanged.
Transaction coalescing emits identities whose net state is unchanged · case 03
Transaction coalescing emits identities whose net state is unchanged.
Transaction coalescing emits identities whose net state is unchanged · case 04
Transaction coalescing emits identities whose net state is unchanged.
Transaction coalescing emits identities whose net state is unchanged · case 05
Transaction coalescing emits identities whose net state is unchanged.
Transaction coalescing sorts IDs instead of preserving first-touch order · case 01
Transaction coalescing sorts IDs instead of preserving first-touch order.
Transaction coalescing sorts IDs instead of preserving first-touch order · case 02
Transaction coalescing sorts IDs instead of preserving first-touch order.
Transaction coalescing sorts IDs instead of preserving first-touch order · case 03
Transaction coalescing sorts IDs instead of preserving first-touch order.
Transaction coalescing sorts IDs instead of preserving first-touch order · case 04
Transaction coalescing sorts IDs instead of preserving first-touch order.
Transaction coalescing sorts IDs instead of preserving first-touch order · case 05
Transaction coalescing sorts IDs instead of preserving first-touch order.
Transaction coalescing initializes each identity as an insertion · case 01
Transaction coalescing initializes each identity as an insertion.
Transaction coalescing initializes each identity as an insertion · case 02
Transaction coalescing initializes each identity as an insertion.
Transaction coalescing initializes each identity as an insertion · case 03
Transaction coalescing initializes each identity as an insertion.
Transaction coalescing initializes each identity as an insertion · case 04
Transaction coalescing initializes each identity as an insertion.
Transaction coalescing initializes each identity as an insertion · case 05
Transaction coalescing initializes each identity as an insertion.
Transaction coalescing appends an output identity on every update · case 01
Transaction coalescing appends an output identity on every update.
Transaction coalescing appends an output identity on every update · case 02
Transaction coalescing appends an output identity on every update.
Transaction coalescing appends an output identity on every update · case 03
Transaction coalescing appends an output identity on every update.
Transaction coalescing appends an output identity on every update · case 04
Transaction coalescing appends an output identity on every update.
Transaction coalescing appends an output identity on every update · case 05
Transaction coalescing appends an output identity on every update.
Membership maintenance overwrites repeated right-key deltas · case 01
Membership maintenance overwrites repeated right-key deltas.
Membership maintenance overwrites repeated right-key deltas · case 02
Membership maintenance overwrites repeated right-key deltas.
Membership maintenance overwrites repeated right-key deltas · case 03
Membership maintenance overwrites repeated right-key deltas.
Membership maintenance overwrites repeated right-key deltas · case 04
Membership maintenance overwrites repeated right-key deltas.
Membership maintenance overwrites repeated right-key deltas · case 05
Membership maintenance overwrites repeated right-key deltas.
Membership crossings emit one row regardless of left multiplicity · case 01
Membership crossings emit one row regardless of left multiplicity.
Membership crossings emit one row regardless of left multiplicity · case 02
Membership crossings emit one row regardless of left multiplicity.
Membership crossings emit one row regardless of left multiplicity · case 03
Membership crossings emit one row regardless of left multiplicity.
Membership crossings emit one row regardless of left multiplicity · case 04
Membership crossings emit one row regardless of left multiplicity.
Membership crossings emit one row regardless of left multiplicity · case 05
Membership crossings emit one row regardless of left multiplicity.
Membership maintenance forwards right count changes into left weights · case 01
Membership maintenance forwards right count changes into left weights.
Membership maintenance forwards right count changes into left weights · case 02
Membership maintenance forwards right count changes into left weights.
Membership maintenance forwards right count changes into left weights · case 03
Membership maintenance forwards right count changes into left weights.
Membership maintenance forwards right count changes into left weights · case 04
Membership maintenance forwards right count changes into left weights.
Membership maintenance forwards right count changes into left weights · case 05
Membership maintenance forwards right count changes into left weights.
Membership maintenance matches null keys against right counts · case 01
Membership maintenance matches null keys against right counts.
Membership maintenance matches null keys against right counts · case 02
Membership maintenance matches null keys against right counts.
Membership maintenance matches null keys against right counts · case 03
Membership maintenance matches null keys against right counts.
Membership maintenance matches null keys against right counts · case 04
Membership maintenance matches null keys against right counts.
Membership maintenance matches null keys against right counts · case 05
Membership maintenance matches null keys against right counts.
Membership maintenance uses whole-right emptiness for every left key · case 01
Membership maintenance uses whole-right emptiness for every left key.
Membership maintenance uses whole-right emptiness for every left key · case 02
Membership maintenance uses whole-right emptiness for every left key.
Membership maintenance uses whole-right emptiness for every left key · case 03
Membership maintenance uses whole-right emptiness for every left key.
Membership maintenance uses whole-right emptiness for every left key · case 04
Membership maintenance uses whole-right emptiness for every left key.
Membership maintenance uses whole-right emptiness for every left key · case 05
Membership maintenance uses whole-right emptiness for every left key.
Right membership disappearance produces positive left changes · case 01
Right membership disappearance produces positive left changes.
Right membership disappearance produces positive left changes · case 02
Right membership disappearance produces positive left changes.
Right membership disappearance produces positive left changes · case 03
Right membership disappearance produces positive left changes.
Right membership disappearance produces positive left changes · case 04
Right membership disappearance produces positive left changes.
Right membership disappearance produces positive left changes · case 05
Right membership disappearance produces positive left changes.
Default materialization overwrites explicit null columns · case 01
Default materialization overwrites explicit null columns.
Default materialization overwrites explicit null columns · case 02
Default materialization overwrites explicit null columns.
Default materialization overwrites explicit null columns · case 03
Default materialization overwrites explicit null columns.
Default materialization overwrites explicit null columns · case 04
Default materialization overwrites explicit null columns.
Default materialization overwrites explicit null columns · case 05
Default materialization overwrites explicit null columns.
Default evaluation discards rules whose dependencies appear later · case 01
Default evaluation discards rules whose dependencies appear later.
Default evaluation discards rules whose dependencies appear later · case 02
Default evaluation discards rules whose dependencies appear later.
Default evaluation discards rules whose dependencies appear later · case 03
Default evaluation discards rules whose dependencies appear later.
Default evaluation discards rules whose dependencies appear later · case 04
Default evaluation discards rules whose dependencies appear later.
Default evaluation discards rules whose dependencies appear later · case 05
Default evaluation discards rules whose dependencies appear later.
Dependent defaults treat an explicit null source as zero · case 01
Dependent defaults treat an explicit null source as zero.
Dependent defaults treat an explicit null source as zero · case 02
Dependent defaults treat an explicit null source as zero.
Dependent defaults treat an explicit null source as zero · case 03
Dependent defaults treat an explicit null source as zero.
Dependent defaults treat an explicit null source as zero · case 04
Dependent defaults treat an explicit null source as zero.
Dependent defaults treat an explicit null source as zero · case 05
Dependent defaults treat an explicit null source as zero.
A dependent default writes only its constant without reading the source · case 01
A dependent default writes only its constant without reading the source.
A dependent default writes only its constant without reading the source · case 02
A dependent default writes only its constant without reading the source.
A dependent default writes only its constant without reading the source · case 03
A dependent default writes only its constant without reading the source.
A dependent default writes only its constant without reading the source · case 04
A dependent default writes only its constant without reading the source.
A dependent default writes only its constant without reading the source · case 05
A dependent default writes only its constant without reading the source.
Default dependency cycles silently return a partial row · case 01
Default dependency cycles silently return a partial row.
Default dependency cycles silently return a partial row · case 02
Default dependency cycles silently return a partial row.
Default dependency cycles silently return a partial row · case 03
Default dependency cycles silently return a partial row.
Default dependency cycles silently return a partial row · case 04
Default dependency cycles silently return a partial row.
Default dependency cycles silently return a partial row · case 05
Default dependency cycles silently return a partial row.
Default materialization discards explicitly provided columns · case 01
Default materialization discards explicitly provided columns.
Default materialization discards explicitly provided columns · case 02
Default materialization discards explicitly provided columns.
Default materialization discards explicitly provided columns · case 03
Default materialization discards explicitly provided columns.
Default materialization discards explicitly provided columns · case 04
Default materialization discards explicitly provided columns.
Default materialization discards explicitly provided columns · case 05
Default materialization discards explicitly provided columns.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗