FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-45401

Rejected MERGE returns a source-modified target · case 01

Rejected MERGE returns a source-modified target.

Data systems● Open access↗
FA-45402

Rejected MERGE returns a source-modified target · case 02

Rejected MERGE returns a source-modified target.

Data systems◈ Members↗
FA-45403

Rejected MERGE returns a source-modified target · case 03

Rejected MERGE returns a source-modified target.

Data systems◈ Members↗
FA-45404

Rejected MERGE returns a source-modified target · case 04

Rejected MERGE returns a source-modified target.

Data systems◈ Members↗
FA-45405

Rejected MERGE returns a source-modified target · case 05

Rejected MERGE returns a source-modified target.

Data systems◈ Members↗
FA-45406

MERGE treats matched rows as insert-if-absent · case 01

MERGE treats matched rows as insert-if-absent.

Data systems● Open access↗
FA-45407

MERGE treats matched rows as insert-if-absent · case 02

MERGE treats matched rows as insert-if-absent.

Data systems◈ Members↗
FA-45408

MERGE treats matched rows as insert-if-absent · case 03

MERGE treats matched rows as insert-if-absent.

Data systems◈ Members↗
FA-45409

MERGE treats matched rows as insert-if-absent · case 04

MERGE treats matched rows as insert-if-absent.

Data systems◈ Members↗
FA-45410

MERGE treats matched rows as insert-if-absent · case 05

MERGE treats matched rows as insert-if-absent.

Data systems◈ Members↗
FA-45411

MERGE updates matched rows but drops new source keys · case 01

MERGE updates matched rows but drops new source keys.

Data systems● Open access↗
FA-45412

MERGE updates matched rows but drops new source keys · case 02

MERGE updates matched rows but drops new source keys.

Data systems◈ Members↗
FA-45413

MERGE updates matched rows but drops new source keys · case 03

MERGE updates matched rows but drops new source keys.

Data systems◈ Members↗
FA-45414

MERGE updates matched rows but drops new source keys · case 04

MERGE updates matched rows but drops new source keys.

Data systems◈ Members↗
FA-45415

MERGE updates matched rows but drops new source keys · case 05

MERGE updates matched rows but drops new source keys.

Data systems◈ Members↗
FA-45416

MERGE writes payloads as target identities · case 01

MERGE writes payloads as target identities.

Data systems● Open access↗
FA-45417

MERGE writes payloads as target identities · case 02

MERGE writes payloads as target identities.

Data systems◈ Members↗
FA-45418

MERGE writes payloads as target identities · case 03

MERGE writes payloads as target identities.

Data systems◈ Members↗
FA-45419

MERGE writes payloads as target identities · case 04

MERGE writes payloads as target identities.

Data systems◈ Members↗
FA-45420

MERGE writes payloads as target identities · case 05

MERGE writes payloads as target identities.

Data systems◈ Members↗
FA-45421

UNION pagination resets its offset for each branch · case 01

UNION pagination resets its offset for each branch.

Data systems● Open access↗
FA-45422

UNION pagination resets its offset for each branch · case 02

UNION pagination resets its offset for each branch.

Data systems◈ Members↗
FA-45423

UNION pagination resets its offset for each branch · case 03

UNION pagination resets its offset for each branch.

Data systems◈ Members↗
FA-45424

UNION pagination resets its offset for each branch · case 04

UNION pagination resets its offset for each branch.

Data systems◈ Members↗
FA-45425

UNION pagination resets its offset for each branch · case 05

UNION pagination resets its offset for each branch.

Data systems◈ Members↗
FA-45426

UNION pagination applies output limit independently to each branch · case 01

UNION pagination applies output limit independently to each branch.

Data systems● Open access↗
FA-45427

UNION pagination applies output limit independently to each branch · case 02

UNION pagination applies output limit independently to each branch.

Data systems◈ Members↗
FA-45428

UNION pagination applies output limit independently to each branch · case 03

UNION pagination applies output limit independently to each branch.

Data systems◈ Members↗
FA-45429

UNION pagination applies output limit independently to each branch · case 04

UNION pagination applies output limit independently to each branch.

Data systems◈ Members↗
FA-45430

UNION pagination applies output limit independently to each branch · case 05

UNION pagination applies output limit independently to each branch.

Data systems◈ Members↗
FA-45431

UNION pagination stops skipping after the first branch · case 01

UNION pagination stops skipping after the first branch.

Data systems● Open access↗
FA-45432

UNION pagination stops skipping after the first branch · case 02

UNION pagination stops skipping after the first branch.

Data systems◈ Members↗
FA-45433

UNION pagination stops skipping after the first branch · case 03

UNION pagination stops skipping after the first branch.

Data systems◈ Members↗
FA-45434

UNION pagination stops skipping after the first branch · case 04

UNION pagination stops skipping after the first branch.

Data systems◈ Members↗
FA-45435

UNION pagination stops skipping after the first branch · case 05

UNION pagination stops skipping after the first branch.

Data systems◈ Members↗
FA-45436

UNION pagination reverses branch traversal · case 01

UNION pagination reverses branch traversal.

Data systems● Open access↗
FA-45437

UNION pagination reverses branch traversal · case 02

UNION pagination reverses branch traversal.

Data systems◈ Members↗
FA-45438

UNION pagination reverses branch traversal · case 03

UNION pagination reverses branch traversal.

Data systems◈ Members↗
FA-45439

UNION pagination reverses branch traversal · case 04

UNION pagination reverses branch traversal.

Data systems◈ Members↗
FA-45440

UNION pagination reverses branch traversal · case 05

UNION pagination reverses branch traversal.

Data systems◈ Members↗
FA-45441

UNION pagination discards duplicate result rows · case 01

UNION pagination discards duplicate result rows.

Data systems● Open access↗
FA-45442

UNION pagination discards duplicate result rows · case 02

UNION pagination discards duplicate result rows.

Data systems◈ Members↗
FA-45443

UNION pagination discards duplicate result rows · case 03

UNION pagination discards duplicate result rows.

Data systems◈ Members↗
FA-45444

UNION pagination discards duplicate result rows · case 04

UNION pagination discards duplicate result rows.

Data systems◈ Members↗
FA-45445

UNION pagination discards duplicate result rows · case 05

UNION pagination discards duplicate result rows.

Data systems◈ Members↗
FA-45446

UNION pagination allows one row past its global limit · case 01

UNION pagination allows one row past its global limit.

Data systems● Open access↗
FA-45447

UNION pagination allows one row past its global limit · case 02

UNION pagination allows one row past its global limit.

Data systems◈ Members↗
FA-45448

UNION pagination allows one row past its global limit · case 03

UNION pagination allows one row past its global limit.

Data systems◈ Members↗
FA-45449

UNION pagination allows one row past its global limit · case 04

UNION pagination allows one row past its global limit.

Data systems◈ Members↗
FA-45450

UNION pagination allows one row past its global limit · case 05

UNION pagination allows one row past its global limit.

Data systems◈ Members↗
FA-45451

Row-group pruning drops groups with missing minimum statistics · case 01

Row-group pruning drops groups with missing minimum statistics.

Data systems● Open access↗
FA-45452

Row-group pruning drops groups with missing minimum statistics · case 02

Row-group pruning drops groups with missing minimum statistics.

Data systems◈ Members↗
FA-45453

Row-group pruning drops groups with missing minimum statistics · case 03

Row-group pruning drops groups with missing minimum statistics.

Data systems◈ Members↗
FA-45454

Row-group pruning drops groups with missing minimum statistics · case 04

Row-group pruning drops groups with missing minimum statistics.

Data systems◈ Members↗
FA-45455

Row-group pruning drops groups with missing minimum statistics · case 05

Row-group pruning drops groups with missing minimum statistics.

Data systems◈ Members↗
FA-45456

Row-group pruning drops groups with missing maximum statistics · case 01

Row-group pruning drops groups with missing maximum statistics.

Data systems● Open access↗
FA-45457

Row-group pruning drops groups with missing maximum statistics · case 02

Row-group pruning drops groups with missing maximum statistics.

Data systems◈ Members↗
FA-45458

Row-group pruning drops groups with missing maximum statistics · case 03

Row-group pruning drops groups with missing maximum statistics.

Data systems◈ Members↗
FA-45459

Row-group pruning drops groups with missing maximum statistics · case 04

Row-group pruning drops groups with missing maximum statistics.

Data systems◈ Members↗
FA-45460

Row-group pruning drops groups with missing maximum statistics · case 05

Row-group pruning drops groups with missing maximum statistics.

Data systems◈ Members↗
FA-45461

Row-group pruning excludes a maximum equal to the range lower bound · case 01

Row-group pruning excludes a maximum equal to the range lower bound.

Data systems● Open access↗
FA-45462

Row-group pruning excludes a maximum equal to the range lower bound · case 02

Row-group pruning excludes a maximum equal to the range lower bound.

Data systems◈ Members↗
FA-45463

Row-group pruning excludes a maximum equal to the range lower bound · case 03

Row-group pruning excludes a maximum equal to the range lower bound.

Data systems◈ Members↗
FA-45464

Row-group pruning excludes a maximum equal to the range lower bound · case 04

Row-group pruning excludes a maximum equal to the range lower bound.

Data systems◈ Members↗
FA-45465

Row-group pruning excludes a maximum equal to the range lower bound · case 05

Row-group pruning excludes a maximum equal to the range lower bound.

Data systems◈ Members↗
FA-45466

Row-group pruning excludes a minimum equal to the range upper bound · case 01

Row-group pruning excludes a minimum equal to the range upper bound.

Data systems● Open access↗
FA-45467

Row-group pruning excludes a minimum equal to the range upper bound · case 02

Row-group pruning excludes a minimum equal to the range upper bound.

Data systems◈ Members↗
FA-45468

Row-group pruning excludes a minimum equal to the range upper bound · case 03

Row-group pruning excludes a minimum equal to the range upper bound.

Data systems◈ Members↗
FA-45469

Row-group pruning excludes a minimum equal to the range upper bound · case 04

Row-group pruning excludes a minimum equal to the range upper bound.

Data systems◈ Members↗
FA-45470

Row-group pruning excludes a minimum equal to the range upper bound · case 05

Row-group pruning excludes a minimum equal to the range upper bound.

Data systems◈ Members↗
FA-45471

Row-group pruning admits null-only groups to a non-null scan · case 01

Row-group pruning admits null-only groups to a non-null scan.

Data systems● Open access↗
FA-45472

Row-group pruning admits null-only groups to a non-null scan · case 02

Row-group pruning admits null-only groups to a non-null scan.

Data systems◈ Members↗
FA-45473

Row-group pruning admits null-only groups to a non-null scan · case 03

Row-group pruning admits null-only groups to a non-null scan.

Data systems◈ Members↗
FA-45474

Row-group pruning admits null-only groups to a non-null scan · case 04

Row-group pruning admits null-only groups to a non-null scan.

Data systems◈ Members↗
FA-45475

Row-group pruning admits null-only groups to a non-null scan · case 05

Row-group pruning admits null-only groups to a non-null scan.

Data systems◈ Members↗
FA-45476

Row-group pruning reports physically empty groups as scan candidates · case 01

Row-group pruning reports physically empty groups as scan candidates.

Data systems● Open access↗
FA-45477

Row-group pruning reports physically empty groups as scan candidates · case 02

Row-group pruning reports physically empty groups as scan candidates.

Data systems◈ Members↗
FA-45478

Row-group pruning reports physically empty groups as scan candidates · case 03

Row-group pruning reports physically empty groups as scan candidates.

Data systems◈ Members↗
FA-45479

Row-group pruning reports physically empty groups as scan candidates · case 04

Row-group pruning reports physically empty groups as scan candidates.

Data systems◈ Members↗
FA-45480

Row-group pruning reports physically empty groups as scan candidates · case 05

Row-group pruning reports physically empty groups as scan candidates.

Data systems◈ Members↗
FA-45481

Position deletes erase the same row ordinal in unrelated files · case 01

Position deletes erase the same row ordinal in unrelated files.

Data systems● Open access↗
FA-45482

Position deletes erase the same row ordinal in unrelated files · case 02

Position deletes erase the same row ordinal in unrelated files.

Data systems◈ Members↗
FA-45483

Position deletes erase the same row ordinal in unrelated files · case 03

Position deletes erase the same row ordinal in unrelated files.

Data systems◈ Members↗
FA-45484

Position deletes erase the same row ordinal in unrelated files · case 04

Position deletes erase the same row ordinal in unrelated files.

Data systems◈ Members↗
FA-45485

Position deletes erase the same row ordinal in unrelated files · case 05

Position deletes erase the same row ordinal in unrelated files.

Data systems◈ Members↗
FA-45486

Position deletes use fragment-local row positions · case 01

Position deletes use fragment-local row positions.

Data systems● Open access↗
FA-45487

Position deletes use fragment-local row positions · case 02

Position deletes use fragment-local row positions.

Data systems◈ Members↗
FA-45488

Position deletes use fragment-local row positions · case 03

Position deletes use fragment-local row positions.

Data systems◈ Members↗
FA-45489

Position deletes use fragment-local row positions · case 04

Position deletes use fragment-local row positions.

Data systems◈ Members↗
FA-45490

Position deletes use fragment-local row positions · case 05

Position deletes use fragment-local row positions.

Data systems◈ Members↗
FA-45491

Position deletes number rows after previous deletions · case 01

Position deletes number rows after previous deletions.

Data systems● Open access↗
FA-45492

Position deletes number rows after previous deletions · case 02

Position deletes number rows after previous deletions.

Data systems◈ Members↗
FA-45493

Position deletes number rows after previous deletions · case 03

Position deletes number rows after previous deletions.

Data systems◈ Members↗
FA-45494

Position deletes number rows after previous deletions · case 04

Position deletes number rows after previous deletions.

Data systems◈ Members↗
FA-45495

Position deletes number rows after previous deletions · case 05

Position deletes number rows after previous deletions.

Data systems◈ Members↗
FA-45496

A repeated position-delete entry cancels itself · case 01

A repeated position-delete entry cancels itself.

Data systems● Open access↗
FA-45497

A repeated position-delete entry cancels itself · case 02

A repeated position-delete entry cancels itself.

Data systems◈ Members↗
FA-45498

A repeated position-delete entry cancels itself · case 03

A repeated position-delete entry cancels itself.

Data systems◈ Members↗
FA-45499

A repeated position-delete entry cancels itself · case 04

A repeated position-delete entry cancels itself.

Data systems◈ Members↗
FA-45500

A repeated position-delete entry cancels itself · case 05

A repeated position-delete entry cancels itself.

Data systems◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗