Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Batch packing drops the final partially filled batch · case 01
Batch packing drops the final partially filled batch.
Batch packing drops the final partially filled batch · case 02
Batch packing drops the final partially filled batch.
Batch packing drops the final partially filled batch · case 03
Batch packing drops the final partially filled batch.
Batch packing drops the final partially filled batch · case 04
Batch packing drops the final partially filled batch.
Batch packing drops the final partially filled batch · case 05
Batch packing drops the final partially filled batch.
Batch packing creates an empty terminal batch · case 01
Batch packing creates an empty terminal batch.
Batch packing creates an empty terminal batch · case 02
Batch packing creates an empty terminal batch.
Batch packing creates an empty terminal batch · case 03
Batch packing creates an empty terminal batch.
Batch packing creates an empty terminal batch · case 04
Batch packing creates an empty terminal batch.
Batch packing creates an empty terminal batch · case 05
Batch packing creates an empty terminal batch.
A structural path splits literal dots inside field names · case 01
A structural path splits literal dots inside field names.
A structural path splits literal dots inside field names · case 02
A structural path splits literal dots inside field names.
A structural path splits literal dots inside field names · case 03
A structural path splits literal dots inside field names.
A structural path splits literal dots inside field names · case 04
A structural path splits literal dots inside field names.
A structural path splits literal dots inside field names · case 05
A structural path splits literal dots inside field names.
Nested path resolution restarts from the root for each segment · case 01
Nested path resolution restarts from the root for each segment.
Nested path resolution restarts from the root for each segment · case 02
Nested path resolution restarts from the root for each segment.
Nested path resolution restarts from the root for each segment · case 03
Nested path resolution restarts from the root for each segment.
Nested path resolution restarts from the root for each segment · case 04
Nested path resolution restarts from the root for each segment.
Nested path resolution restarts from the root for each segment · case 05
Nested path resolution restarts from the root for each segment.
Nested field resolution reuses the current object when a field is absent · case 01
Nested field resolution reuses the current object when a field is absent.
Nested field resolution reuses the current object when a field is absent · case 02
Nested field resolution reuses the current object when a field is absent.
Nested field resolution reuses the current object when a field is absent · case 03
Nested field resolution reuses the current object when a field is absent.
Nested field resolution reuses the current object when a field is absent · case 04
Nested field resolution reuses the current object when a field is absent.
Nested field resolution reuses the current object when a field is absent · case 05
Nested field resolution reuses the current object when a field is absent.
A non-record intermediate is returned as a successful nested path · case 01
A non-record intermediate is returned as a successful nested path.
A non-record intermediate is returned as a successful nested path · case 02
A non-record intermediate is returned as a successful nested path.
A non-record intermediate is returned as a successful nested path · case 03
A non-record intermediate is returned as a successful nested path.
A non-record intermediate is returned as a successful nested path · case 04
A non-record intermediate is returned as a successful nested path.
A non-record intermediate is returned as a successful nested path · case 05
A non-record intermediate is returned as a successful nested path.
Nested path extraction converts valid falsy leaves to null · case 01
Nested path extraction converts valid falsy leaves to null.
Nested path extraction converts valid falsy leaves to null · case 02
Nested path extraction converts valid falsy leaves to null.
Nested path extraction converts valid falsy leaves to null · case 03
Nested path extraction converts valid falsy leaves to null.
Nested path extraction converts valid falsy leaves to null · case 04
Nested path extraction converts valid falsy leaves to null.
Nested path extraction converts valid falsy leaves to null · case 05
Nested path extraction converts valid falsy leaves to null.
An empty nested path returns null rather than the source row · case 01
An empty nested path returns null rather than the source row.
An empty nested path returns null rather than the source row · case 02
An empty nested path returns null rather than the source row.
An empty nested path returns null rather than the source row · case 03
An empty nested path returns null rather than the source row.
An empty nested path returns null rather than the source row · case 04
An empty nested path returns null rather than the source row.
An empty nested path returns null rather than the source row · case 05
An empty nested path returns null rather than the source row.
A stale physical column overwrites its partition value · case 01
A stale physical column overwrites its partition value.
A stale physical column overwrites its partition value · case 02
A stale physical column overwrites its partition value.
A stale physical column overwrites its partition value · case 03
A stale physical column overwrites its partition value.
A stale physical column overwrites its partition value · case 04
A stale physical column overwrites its partition value.
A stale physical column overwrites its partition value · case 05
A stale physical column overwrites its partition value.
Partition injection reuses the first file fragment partition · case 01
Partition injection reuses the first file fragment partition.
Partition injection reuses the first file fragment partition · case 02
Partition injection reuses the first file fragment partition.
Partition injection reuses the first file fragment partition · case 03
Partition injection reuses the first file fragment partition.
Partition injection reuses the first file fragment partition · case 04
Partition injection reuses the first file fragment partition.
Partition injection reuses the first file fragment partition · case 05
Partition injection reuses the first file fragment partition.
Partition injection invents one row for an empty file fragment · case 01
Partition injection invents one row for an empty file fragment.
Partition injection invents one row for an empty file fragment · case 02
Partition injection invents one row for an empty file fragment.
Partition injection invents one row for an empty file fragment · case 03
Partition injection invents one row for an empty file fragment.
Partition injection invents one row for an empty file fragment · case 04
Partition injection invents one row for an empty file fragment.
Partition injection invents one row for an empty file fragment · case 05
Partition injection invents one row for an empty file fragment.
Partition injection sorts requested result columns · case 01
Partition injection sorts requested result columns.
Partition injection sorts requested result columns · case 02
Partition injection sorts requested result columns.
Partition injection sorts requested result columns · case 03
Partition injection sorts requested result columns.
Partition injection sorts requested result columns · case 04
Partition injection sorts requested result columns.
Partition injection sorts requested result columns · case 05
Partition injection sorts requested result columns.
Partition injection uses an empty string for missing fields · case 01
Partition injection uses an empty string for missing fields.
Partition injection uses an empty string for missing fields · case 02
Partition injection uses an empty string for missing fields.
Partition injection uses an empty string for missing fields · case 03
Partition injection uses an empty string for missing fields.
Partition injection uses an empty string for missing fields · case 04
Partition injection uses an empty string for missing fields.
Partition injection uses an empty string for missing fields · case 05
Partition injection uses an empty string for missing fields.
Partition scan deduplicates identical physical rows · case 01
Partition scan deduplicates identical physical rows.
Partition scan deduplicates identical physical rows · case 02
Partition scan deduplicates identical physical rows.
Partition scan deduplicates identical physical rows · case 03
Partition scan deduplicates identical physical rows.
Partition scan deduplicates identical physical rows · case 04
Partition scan deduplicates identical physical rows.
Partition scan deduplicates identical physical rows · case 05
Partition scan deduplicates identical physical rows.
Column binding ignores explicit relation qualifiers · case 01
Column binding ignores explicit relation qualifiers.
Column binding ignores explicit relation qualifiers · case 02
Column binding ignores explicit relation qualifiers.
Column binding ignores explicit relation qualifiers · case 03
Column binding ignores explicit relation qualifiers.
Column binding ignores explicit relation qualifiers · case 04
Column binding ignores explicit relation qualifiers.
Column binding ignores explicit relation qualifiers · case 05
Column binding ignores explicit relation qualifiers.
Column binding folds case in a case-sensitive schema · case 01
Column binding folds case in a case-sensitive schema.
Column binding folds case in a case-sensitive schema · case 02
Column binding folds case in a case-sensitive schema.
Column binding folds case in a case-sensitive schema · case 03
Column binding folds case in a case-sensitive schema.
Column binding folds case in a case-sensitive schema · case 04
Column binding folds case in a case-sensitive schema.
Column binding folds case in a case-sensitive schema · case 05
Column binding folds case in a case-sensitive schema.
Column binding silently takes the first ambiguous candidate · case 01
Column binding silently takes the first ambiguous candidate.
Column binding silently takes the first ambiguous candidate · case 02
Column binding silently takes the first ambiguous candidate.
Column binding silently takes the first ambiguous candidate · case 03
Column binding silently takes the first ambiguous candidate.
Column binding silently takes the first ambiguous candidate · case 04
Column binding silently takes the first ambiguous candidate.
Column binding silently takes the first ambiguous candidate · case 05
Column binding silently takes the first ambiguous candidate.
A missing query column binds to field ID zero · case 01
A missing query column binds to field ID zero.
A missing query column binds to field ID zero · case 02
A missing query column binds to field ID zero.
A missing query column binds to field ID zero · case 03
A missing query column binds to field ID zero.
A missing query column binds to field ID zero · case 04
A missing query column binds to field ID zero.
A missing query column binds to field ID zero · case 05
A missing query column binds to field ID zero.
Column binding emits display names instead of stable field IDs · case 01
Column binding emits display names instead of stable field IDs.
Column binding emits display names instead of stable field IDs · case 02
Column binding emits display names instead of stable field IDs.
Column binding emits display names instead of stable field IDs · case 03
Column binding emits display names instead of stable field IDs.
Column binding emits display names instead of stable field IDs · case 04
Column binding emits display names instead of stable field IDs.
Column binding emits display names instead of stable field IDs · case 05
Column binding emits display names instead of stable field IDs.
Column binding sorts expression references before binding · case 01
Column binding sorts expression references before binding.
Column binding sorts expression references before binding · case 02
Column binding sorts expression references before binding.
Column binding sorts expression references before binding · case 03
Column binding sorts expression references before binding.
Column binding sorts expression references before binding · case 04
Column binding sorts expression references before binding.
Column binding sorts expression references before binding · case 05
Column binding sorts expression references before binding.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗