FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-24401

Client attachment resource ownership: Other previews preserved · case 01

Other previews preserved.

Client state● Open access↗
FA-24402

Client attachment resource ownership: Other previews preserved · case 02

Other previews preserved.

Client state◈ Members↗
FA-24403

Client attachment resource ownership: Other previews preserved · case 03

Other previews preserved.

Client state◈ Members↗
FA-24404

Client attachment resource ownership: Other previews preserved · case 04

Other previews preserved.

Client state◈ Members↗
FA-24405

Client attachment resource ownership: Other previews preserved · case 05

Other previews preserved.

Client state◈ Members↗
FA-24406

Client attachment resource ownership: Submitted attachment retention · case 01

Submitted attachment retention.

Client state● Open access↗
FA-24407

Client attachment resource ownership: Submitted attachment retention · case 02

Submitted attachment retention.

Client state◈ Members↗
FA-24408

Client attachment resource ownership: Submitted attachment retention · case 03

Submitted attachment retention.

Client state◈ Members↗
FA-24409

Client attachment resource ownership: Submitted attachment retention · case 04

Submitted attachment retention.

Client state◈ Members↗
FA-24410

Client attachment resource ownership: Submitted attachment retention · case 05

Submitted attachment retention.

Client state◈ Members↗
FA-24411

Client attachment resource ownership: New attachment dirty set · case 01

New attachment dirty set.

Client state● Open access↗
FA-24412

Client attachment resource ownership: New attachment dirty set · case 02

New attachment dirty set.

Client state◈ Members↗
FA-24413

Client attachment resource ownership: New attachment dirty set · case 03

New attachment dirty set.

Client state◈ Members↗
FA-24414

Client attachment resource ownership: New attachment dirty set · case 04

New attachment dirty set.

Client state◈ Members↗
FA-24415

Client attachment resource ownership: New attachment dirty set · case 05

New attachment dirty set.

Client state◈ Members↗
FA-24416

Client attachment resource ownership: Selected id deduplication · case 01

Selected id deduplication.

Client state● Open access↗
FA-24417

Client attachment resource ownership: Selected id deduplication · case 02

Selected id deduplication.

Client state◈ Members↗
FA-24418

Client attachment resource ownership: Selected id deduplication · case 03

Selected id deduplication.

Client state◈ Members↗
FA-24419

Client attachment resource ownership: Selected id deduplication · case 04

Selected id deduplication.

Client state◈ Members↗
FA-24420

Client attachment resource ownership: Selected id deduplication · case 05

Selected id deduplication.

Client state◈ Members↗
FA-24421

Client attachment resource ownership: Readonly remove command · case 01

Readonly remove command.

Client state● Open access↗
FA-24422

Client attachment resource ownership: Readonly remove command · case 02

Readonly remove command.

Client state◈ Members↗
FA-24423

Client attachment resource ownership: Readonly remove command · case 03

Readonly remove command.

Client state◈ Members↗
FA-24424

Client attachment resource ownership: Readonly remove command · case 04

Readonly remove command.

Client state◈ Members↗
FA-24425

Client attachment resource ownership: Readonly remove command · case 05

Readonly remove command.

Client state◈ Members↗
FA-24426

Client attachment resource ownership: Selection removal propagation · case 01

Selection removal propagation.

Client state● Open access↗
FA-24427

Client attachment resource ownership: Selection removal propagation · case 02

Selection removal propagation.

Client state◈ Members↗
FA-24428

Client attachment resource ownership: Selection removal propagation · case 03

Selection removal propagation.

Client state◈ Members↗
FA-24429

Client attachment resource ownership: Selection removal propagation · case 04

Selection removal propagation.

Client state◈ Members↗
FA-24430

Client attachment resource ownership: Selection removal propagation · case 05

Selection removal propagation.

Client state◈ Members↗
FA-24431

Client attachment resource ownership: Orphan preview cleanup · case 01

Orphan preview cleanup.

Client state● Open access↗
FA-24432

Client attachment resource ownership: Orphan preview cleanup · case 02

Orphan preview cleanup.

Client state◈ Members↗
FA-24433

Client attachment resource ownership: Orphan preview cleanup · case 03

Orphan preview cleanup.

Client state◈ Members↗
FA-24434

Client attachment resource ownership: Orphan preview cleanup · case 04

Orphan preview cleanup.

Client state◈ Members↗
FA-24435

Client attachment resource ownership: Orphan preview cleanup · case 05

Orphan preview cleanup.

Client state◈ Members↗
FA-24436

Keyed component instance reconciliation: Type and key reuse · case 01

Type and key reuse.

Client state● Open access↗
FA-24437

Keyed component instance reconciliation: Type and key reuse · case 02

Type and key reuse.

Client state◈ Members↗
FA-24438

Keyed component instance reconciliation: Type and key reuse · case 03

Type and key reuse.

Client state◈ Members↗
FA-24439

Keyed component instance reconciliation: Type and key reuse · case 04

Type and key reuse.

Client state◈ Members↗
FA-24440

Keyed component instance reconciliation: Type and key reuse · case 05

Type and key reuse.

Client state◈ Members↗
FA-24441

Keyed component instance reconciliation: New instance mounts · case 01

New instance mounts.

Client state● Open access↗
FA-24442

Keyed component instance reconciliation: New instance mounts · case 02

New instance mounts.

Client state◈ Members↗
FA-24443

Keyed component instance reconciliation: New instance mounts · case 03

New instance mounts.

Client state◈ Members↗
FA-24444

Keyed component instance reconciliation: New instance mounts · case 04

New instance mounts.

Client state◈ Members↗
FA-24445

Keyed component instance reconciliation: New instance mounts · case 05

New instance mounts.

Client state◈ Members↗
FA-24446

Keyed component instance reconciliation: Old instance unmounts · case 01

Old instance unmounts.

Client state● Open access↗
FA-24447

Keyed component instance reconciliation: Old instance unmounts · case 02

Old instance unmounts.

Client state◈ Members↗
FA-24448

Keyed component instance reconciliation: Old instance unmounts · case 03

Old instance unmounts.

Client state◈ Members↗
FA-24449

Keyed component instance reconciliation: Old instance unmounts · case 04

Old instance unmounts.

Client state◈ Members↗
FA-24450

Keyed component instance reconciliation: Old instance unmounts · case 05

Old instance unmounts.

Client state◈ Members↗
FA-24451

Keyed component instance reconciliation: State follows key through reorder · case 01

State follows key through reorder.

Client state● Open access↗
FA-24452

Keyed component instance reconciliation: State follows key through reorder · case 02

State follows key through reorder.

Client state◈ Members↗
FA-24453

Keyed component instance reconciliation: State follows key through reorder · case 03

State follows key through reorder.

Client state◈ Members↗
FA-24454

Keyed component instance reconciliation: State follows key through reorder · case 04

State follows key through reorder.

Client state◈ Members↗
FA-24455

Keyed component instance reconciliation: State follows key through reorder · case 05

State follows key through reorder.

Client state◈ Members↗
FA-24456

Keyed component instance reconciliation: Render order follows incoming · case 01

Render order follows incoming.

Client state● Open access↗
FA-24457

Keyed component instance reconciliation: Render order follows incoming · case 02

Render order follows incoming.

Client state◈ Members↗
FA-24458

Keyed component instance reconciliation: Render order follows incoming · case 03

Render order follows incoming.

Client state◈ Members↗
FA-24459

Keyed component instance reconciliation: Render order follows incoming · case 04

Render order follows incoming.

Client state◈ Members↗
FA-24460

Keyed component instance reconciliation: Render order follows incoming · case 05

Render order follows incoming.

Client state◈ Members↗
FA-24461

Keyed component instance reconciliation: Changed type state reset · case 01

Changed type state reset.

Client state● Open access↗
FA-24462

Keyed component instance reconciliation: Changed type state reset · case 02

Changed type state reset.

Client state◈ Members↗
FA-24463

Keyed component instance reconciliation: Changed type state reset · case 03

Changed type state reset.

Client state◈ Members↗
FA-24464

Keyed component instance reconciliation: Changed type state reset · case 04

Changed type state reset.

Client state◈ Members↗
FA-24465

Keyed component instance reconciliation: Changed type state reset · case 05

Changed type state reset.

Client state◈ Members↗
FA-24466

Keyed component instance reconciliation: Cleanup before replacement mount · case 01

Cleanup before replacement mount.

Client state● Open access↗
FA-24467

Keyed component instance reconciliation: Cleanup before replacement mount · case 02

Cleanup before replacement mount.

Client state◈ Members↗
FA-24468

Keyed component instance reconciliation: Cleanup before replacement mount · case 03

Cleanup before replacement mount.

Client state◈ Members↗
FA-24469

Keyed component instance reconciliation: Cleanup before replacement mount · case 04

Cleanup before replacement mount.

Client state◈ Members↗
FA-24470

Keyed component instance reconciliation: Cleanup before replacement mount · case 05

Cleanup before replacement mount.

Client state◈ Members↗
FA-24471

Keyed component instance reconciliation: Removed state pruning · case 01

Removed state pruning.

Client state● Open access↗
FA-24472

Keyed component instance reconciliation: Removed state pruning · case 02

Removed state pruning.

Client state◈ Members↗
FA-24473

Keyed component instance reconciliation: Removed state pruning · case 03

Removed state pruning.

Client state◈ Members↗
FA-24474

Keyed component instance reconciliation: Removed state pruning · case 04

Removed state pruning.

Client state◈ Members↗
FA-24475

Keyed component instance reconciliation: Removed state pruning · case 05

Removed state pruning.

Client state◈ Members↗
FA-24476

Keyed component instance reconciliation: Insertion position · case 01

Insertion position.

Client state● Open access↗
FA-24477

Keyed component instance reconciliation: Insertion position · case 02

Insertion position.

Client state◈ Members↗
FA-24478

Keyed component instance reconciliation: Insertion position · case 03

Insertion position.

Client state◈ Members↗
FA-24479

Keyed component instance reconciliation: Insertion position · case 04

Insertion position.

Client state◈ Members↗
FA-24480

Keyed component instance reconciliation: Insertion position · case 05

Insertion position.

Client state◈ Members↗
FA-24481

Keyed component instance reconciliation: Retained instance moves · case 01

Retained instance moves.

Client state● Open access↗
FA-24482

Keyed component instance reconciliation: Retained instance moves · case 02

Retained instance moves.

Client state◈ Members↗
FA-24483

Keyed component instance reconciliation: Retained instance moves · case 03

Retained instance moves.

Client state◈ Members↗
FA-24484

Keyed component instance reconciliation: Retained instance moves · case 04

Retained instance moves.

Client state◈ Members↗
FA-24485

Keyed component instance reconciliation: Retained instance moves · case 05

Retained instance moves.

Client state◈ Members↗
FA-24486

Nested client render failure boundaries: Nearest eligible boundary · case 01

Nearest eligible boundary.

Client state● Open access↗
FA-24487

Nested client render failure boundaries: Nearest eligible boundary · case 02

Nearest eligible boundary.

Client state◈ Members↗
FA-24488

Nested client render failure boundaries: Nearest eligible boundary · case 03

Nearest eligible boundary.

Client state◈ Members↗
FA-24489

Nested client render failure boundaries: Nearest eligible boundary · case 04

Nearest eligible boundary.

Client state◈ Members↗
FA-24490

Nested client render failure boundaries: Nearest eligible boundary · case 05

Nearest eligible boundary.

Client state◈ Members↗
FA-24491

Nested client render failure boundaries: Boundary cannot catch itself · case 01

Boundary cannot catch itself.

Client state● Open access↗
FA-24492

Nested client render failure boundaries: Boundary cannot catch itself · case 02

Boundary cannot catch itself.

Client state◈ Members↗
FA-24493

Nested client render failure boundaries: Boundary cannot catch itself · case 03

Boundary cannot catch itself.

Client state◈ Members↗
FA-24494

Nested client render failure boundaries: Boundary cannot catch itself · case 04

Boundary cannot catch itself.

Client state◈ Members↗
FA-24495

Nested client render failure boundaries: Boundary cannot catch itself · case 05

Boundary cannot catch itself.

Client state◈ Members↗
FA-24496

Nested client render failure boundaries: Reset key type and length · case 01

Reset key type and length.

Client state● Open access↗
FA-24497

Nested client render failure boundaries: Reset key type and length · case 02

Reset key type and length.

Client state◈ Members↗
FA-24498

Nested client render failure boundaries: Reset key type and length · case 03

Reset key type and length.

Client state◈ Members↗
FA-24499

Nested client render failure boundaries: Reset key type and length · case 04

Reset key type and length.

Client state◈ Members↗
FA-24500

Nested client render failure boundaries: Reset key type and length · case 05

Reset key type and length.

Client state◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗