FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-44701

A keyed upsert looks up its old row by new key instead of identity · case 01

A keyed upsert looks up its old row by new key instead of identity.

Data systems● Open access↗
FA-44702

A keyed upsert looks up its old row by new key instead of identity · case 02

A keyed upsert looks up its old row by new key instead of identity.

Data systems◈ Members↗
FA-44703

A keyed upsert looks up its old row by new key instead of identity · case 03

A keyed upsert looks up its old row by new key instead of identity.

Data systems◈ Members↗
FA-44704

A keyed upsert looks up its old row by new key instead of identity · case 04

A keyed upsert looks up its old row by new key instead of identity.

Data systems◈ Members↗
FA-44705

A keyed upsert looks up its old row by new key instead of identity · case 05

A keyed upsert looks up its old row by new key instead of identity.

Data systems◈ Members↗
FA-44706

An upsert suppresses a changed payload when the key stays equal · case 01

An upsert suppresses a changed payload when the key stays equal.

Data systems● Open access↗
FA-44707

An upsert suppresses a changed payload when the key stays equal · case 02

An upsert suppresses a changed payload when the key stays equal.

Data systems◈ Members↗
FA-44708

An upsert suppresses a changed payload when the key stays equal · case 03

An upsert suppresses a changed payload when the key stays equal.

Data systems◈ Members↗
FA-44709

An upsert suppresses a changed payload when the key stays equal · case 04

An upsert suppresses a changed payload when the key stays equal.

Data systems◈ Members↗
FA-44710

An upsert suppresses a changed payload when the key stays equal · case 05

An upsert suppresses a changed payload when the key stays equal.

Data systems◈ Members↗
FA-44711

A key-changing retraction is sent to the new key · case 01

A key-changing retraction is sent to the new key.

Data systems● Open access↗
FA-44712

A key-changing retraction is sent to the new key · case 02

A key-changing retraction is sent to the new key.

Data systems◈ Members↗
FA-44713

A key-changing retraction is sent to the new key · case 03

A key-changing retraction is sent to the new key.

Data systems◈ Members↗
FA-44714

A key-changing retraction is sent to the new key · case 04

A key-changing retraction is sent to the new key.

Data systems◈ Members↗
FA-44715

A key-changing retraction is sent to the new key · case 05

A key-changing retraction is sent to the new key.

Data systems◈ Members↗
FA-44716

A moved row emits changes without updating identity state · case 01

A moved row emits changes without updating identity state.

Data systems● Open access↗
FA-44717

A moved row emits changes without updating identity state · case 02

A moved row emits changes without updating identity state.

Data systems◈ Members↗
FA-44718

A moved row emits changes without updating identity state · case 03

A moved row emits changes without updating identity state.

Data systems◈ Members↗
FA-44719

A moved row emits changes without updating identity state · case 04

A moved row emits changes without updating identity state.

Data systems◈ Members↗
FA-44720

A moved row emits changes without updating identity state · case 05

A moved row emits changes without updating identity state.

Data systems◈ Members↗
FA-44721

Upsert insertion uses the partition key as row identity · case 01

Upsert insertion uses the partition key as row identity.

Data systems● Open access↗
FA-44722

Upsert insertion uses the partition key as row identity · case 02

Upsert insertion uses the partition key as row identity.

Data systems◈ Members↗
FA-44723

Upsert insertion uses the partition key as row identity · case 03

Upsert insertion uses the partition key as row identity.

Data systems◈ Members↗
FA-44724

Upsert insertion uses the partition key as row identity · case 04

Upsert insertion uses the partition key as row identity.

Data systems◈ Members↗
FA-44725

Upsert insertion uses the partition key as row identity · case 05

Upsert insertion uses the partition key as row identity.

Data systems◈ Members↗
FA-44726

The initial identity map is indexed by partition keys · case 01

The initial identity map is indexed by partition keys.

Data systems● Open access↗
FA-44727

The initial identity map is indexed by partition keys · case 02

The initial identity map is indexed by partition keys.

Data systems◈ Members↗
FA-44728

The initial identity map is indexed by partition keys · case 03

The initial identity map is indexed by partition keys.

Data systems◈ Members↗
FA-44729

The initial identity map is indexed by partition keys · case 04

The initial identity map is indexed by partition keys.

Data systems◈ Members↗
FA-44730

The initial identity map is indexed by partition keys · case 05

The initial identity map is indexed by partition keys.

Data systems◈ Members↗
FA-44731

Schema union binds fields by display name after a rename · case 01

Schema union binds fields by display name after a rename.

Data systems● Open access↗
FA-44732

Schema union binds fields by display name after a rename · case 02

Schema union binds fields by display name after a rename.

Data systems◈ Members↗
FA-44733

Schema union binds fields by display name after a rename · case 03

Schema union binds fields by display name after a rename.

Data systems◈ Members↗
FA-44734

Schema union binds fields by display name after a rename · case 04

Schema union binds fields by display name after a rename.

Data systems◈ Members↗
FA-44735

Schema union binds fields by display name after a rename · case 05

Schema union binds fields by display name after a rename.

Data systems◈ Members↗
FA-44736

Schema union reuses the first batch schema for later batches · case 01

Schema union reuses the first batch schema for later batches.

Data systems● Open access↗
FA-44737

Schema union reuses the first batch schema for later batches · case 02

Schema union reuses the first batch schema for later batches.

Data systems◈ Members↗
FA-44738

Schema union reuses the first batch schema for later batches · case 03

Schema union reuses the first batch schema for later batches.

Data systems◈ Members↗
FA-44739

Schema union reuses the first batch schema for later batches · case 04

Schema union reuses the first batch schema for later batches.

Data systems◈ Members↗
FA-44740

Schema union reuses the first batch schema for later batches · case 05

Schema union reuses the first batch schema for later batches.

Data systems◈ Members↗
FA-44741

Schema union sorts stable field IDs instead of output order · case 01

Schema union sorts stable field IDs instead of output order.

Data systems● Open access↗
FA-44742

Schema union sorts stable field IDs instead of output order · case 02

Schema union sorts stable field IDs instead of output order.

Data systems◈ Members↗
FA-44743

Schema union sorts stable field IDs instead of output order · case 03

Schema union sorts stable field IDs instead of output order.

Data systems◈ Members↗
FA-44744

Schema union sorts stable field IDs instead of output order · case 04

Schema union sorts stable field IDs instead of output order.

Data systems◈ Members↗
FA-44745

Schema union sorts stable field IDs instead of output order · case 05

Schema union sorts stable field IDs instead of output order.

Data systems◈ Members↗
FA-44746

Schema union applies defaults to explicit null cells · case 01

Schema union applies defaults to explicit null cells.

Data systems● Open access↗
FA-44747

Schema union applies defaults to explicit null cells · case 02

Schema union applies defaults to explicit null cells.

Data systems◈ Members↗
FA-44748

Schema union applies defaults to explicit null cells · case 03

Schema union applies defaults to explicit null cells.

Data systems◈ Members↗
FA-44749

Schema union applies defaults to explicit null cells · case 04

Schema union applies defaults to explicit null cells.

Data systems◈ Members↗
FA-44750

Schema union applies defaults to explicit null cells · case 05

Schema union applies defaults to explicit null cells.

Data systems◈ Members↗
FA-44751

Schema union ignores non-null defaults for missing columns · case 01

Schema union ignores non-null defaults for missing columns.

Data systems● Open access↗
FA-44752

Schema union ignores non-null defaults for missing columns · case 02

Schema union ignores non-null defaults for missing columns.

Data systems◈ Members↗
FA-44753

Schema union ignores non-null defaults for missing columns · case 03

Schema union ignores non-null defaults for missing columns.

Data systems◈ Members↗
FA-44754

Schema union ignores non-null defaults for missing columns · case 04

Schema union ignores non-null defaults for missing columns.

Data systems◈ Members↗
FA-44755

Schema union ignores non-null defaults for missing columns · case 05

Schema union ignores non-null defaults for missing columns.

Data systems◈ Members↗
FA-44756

Schema union deduplicates equal projected rows · case 01

Schema union deduplicates equal projected rows.

Data systems● Open access↗
FA-44757

Schema union deduplicates equal projected rows · case 02

Schema union deduplicates equal projected rows.

Data systems◈ Members↗
FA-44758

Schema union deduplicates equal projected rows · case 03

Schema union deduplicates equal projected rows.

Data systems◈ Members↗
FA-44759

Schema union deduplicates equal projected rows · case 04

Schema union deduplicates equal projected rows.

Data systems◈ Members↗
FA-44760

Schema union deduplicates equal projected rows · case 05

Schema union deduplicates equal projected rows.

Data systems◈ Members↗
FA-44761

Projection aliases overwrite the input name environment · case 01

Projection aliases overwrite the input name environment.

Data systems● Open access↗
FA-44762

Projection aliases overwrite the input name environment · case 02

Projection aliases overwrite the input name environment.

Data systems◈ Members↗
FA-44763

Projection aliases overwrite the input name environment · case 03

Projection aliases overwrite the input name environment.

Data systems◈ Members↗
FA-44764

Projection aliases overwrite the input name environment · case 04

Projection aliases overwrite the input name environment.

Data systems◈ Members↗
FA-44765

Projection aliases overwrite the input name environment · case 05

Projection aliases overwrite the input name environment.

Data systems◈ Members↗
FA-44766

Projection reads the alias rather than the input field · case 01

Projection reads the alias rather than the input field.

Data systems● Open access↗
FA-44767

Projection reads the alias rather than the input field · case 02

Projection reads the alias rather than the input field.

Data systems◈ Members↗
FA-44768

Projection reads the alias rather than the input field · case 03

Projection reads the alias rather than the input field.

Data systems◈ Members↗
FA-44769

Projection reads the alias rather than the input field · case 04

Projection reads the alias rather than the input field.

Data systems◈ Members↗
FA-44770

Projection reads the alias rather than the input field · case 05

Projection reads the alias rather than the input field.

Data systems◈ Members↗
FA-44771

Projection deduplicates repeated output labels · case 01

Projection deduplicates repeated output labels.

Data systems● Open access↗
FA-44772

Projection deduplicates repeated output labels · case 02

Projection deduplicates repeated output labels.

Data systems◈ Members↗
FA-44773

Projection deduplicates repeated output labels · case 03

Projection deduplicates repeated output labels.

Data systems◈ Members↗
FA-44774

Projection deduplicates repeated output labels · case 04

Projection deduplicates repeated output labels.

Data systems◈ Members↗
FA-44775

Projection deduplicates repeated output labels · case 05

Projection deduplicates repeated output labels.

Data systems◈ Members↗
FA-44776

Projection evaluates every row against the first source record · case 01

Projection evaluates every row against the first source record.

Data systems● Open access↗
FA-44777

Projection evaluates every row against the first source record · case 02

Projection evaluates every row against the first source record.

Data systems◈ Members↗
FA-44778

Projection evaluates every row against the first source record · case 03

Projection evaluates every row against the first source record.

Data systems◈ Members↗
FA-44779

Projection evaluates every row against the first source record · case 04

Projection evaluates every row against the first source record.

Data systems◈ Members↗
FA-44780

Projection evaluates every row against the first source record · case 05

Projection evaluates every row against the first source record.

Data systems◈ Members↗
FA-44781

Projection silently drops columns whose source is absent · case 01

Projection silently drops columns whose source is absent.

Data systems● Open access↗
FA-44782

Projection silently drops columns whose source is absent · case 02

Projection silently drops columns whose source is absent.

Data systems◈ Members↗
FA-44783

Projection silently drops columns whose source is absent · case 03

Projection silently drops columns whose source is absent.

Data systems◈ Members↗
FA-44784

Projection silently drops columns whose source is absent · case 04

Projection silently drops columns whose source is absent.

Data systems◈ Members↗
FA-44785

Projection silently drops columns whose source is absent · case 05

Projection silently drops columns whose source is absent.

Data systems◈ Members↗
FA-44786

Zero-column projection removes all source rows · case 01

Zero-column projection removes all source rows.

Data systems● Open access↗
FA-44787

Zero-column projection removes all source rows · case 02

Zero-column projection removes all source rows.

Data systems◈ Members↗
FA-44788

Zero-column projection removes all source rows · case 03

Zero-column projection removes all source rows.

Data systems◈ Members↗
FA-44789

Zero-column projection removes all source rows · case 04

Zero-column projection removes all source rows.

Data systems◈ Members↗
FA-44790

Zero-column projection removes all source rows · case 05

Zero-column projection removes all source rows.

Data systems◈ Members↗
FA-44791

Lateral execution reuses the first outer row correlation key · case 01

Lateral execution reuses the first outer row correlation key.

Data systems● Open access↗
FA-44792

Lateral execution reuses the first outer row correlation key · case 02

Lateral execution reuses the first outer row correlation key.

Data systems◈ Members↗
FA-44793

Lateral execution reuses the first outer row correlation key · case 03

Lateral execution reuses the first outer row correlation key.

Data systems◈ Members↗
FA-44794

Lateral execution reuses the first outer row correlation key · case 04

Lateral execution reuses the first outer row correlation key.

Data systems◈ Members↗
FA-44795

Lateral execution reuses the first outer row correlation key · case 05

Lateral execution reuses the first outer row correlation key.

Data systems◈ Members↗
FA-44796

Lateral execution reuses the first outer predicate parameter · case 01

Lateral execution reuses the first outer predicate parameter.

Data systems● Open access↗
FA-44797

Lateral execution reuses the first outer predicate parameter · case 02

Lateral execution reuses the first outer predicate parameter.

Data systems◈ Members↗
FA-44798

Lateral execution reuses the first outer predicate parameter · case 03

Lateral execution reuses the first outer predicate parameter.

Data systems◈ Members↗
FA-44799

Lateral execution reuses the first outer predicate parameter · case 04

Lateral execution reuses the first outer predicate parameter.

Data systems◈ Members↗
FA-44800

Lateral execution reuses the first outer predicate parameter · case 05

Lateral execution reuses the first outer predicate parameter.

Data systems◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗