FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-23501

Route loader ownership: Empty loader result · case 01

Empty loader result.

Client state● Open access↗
FA-23502

Route loader ownership: Empty loader result · case 02

Empty loader result.

Client state◈ Members↗
FA-23503

Route loader ownership: Empty loader result · case 03

Empty loader result.

Client state◈ Members↗
FA-23504

Route loader ownership: Empty loader result · case 04

Empty loader result.

Client state◈ Members↗
FA-23505

Route loader ownership: Empty loader result · case 05

Empty loader result.

Client state◈ Members↗
FA-23506

Route loader ownership: Stale error isolation · case 01

Stale error isolation.

Client state● Open access↗
FA-23507

Route loader ownership: Stale error isolation · case 02

Stale error isolation.

Client state◈ Members↗
FA-23508

Route loader ownership: Stale error isolation · case 03

Stale error isolation.

Client state◈ Members↗
FA-23509

Route loader ownership: Stale error isolation · case 04

Stale error isolation.

Client state◈ Members↗
FA-23510

Route loader ownership: Stale error isolation · case 05

Stale error isolation.

Client state◈ Members↗
FA-23511

Route loader ownership: Retained data on error · case 01

Retained data on error.

Client state● Open access↗
FA-23512

Route loader ownership: Retained data on error · case 02

Retained data on error.

Client state◈ Members↗
FA-23513

Route loader ownership: Retained data on error · case 03

Retained data on error.

Client state◈ Members↗
FA-23514

Route loader ownership: Retained data on error · case 04

Retained data on error.

Client state◈ Members↗
FA-23515

Route loader ownership: Retained data on error · case 05

Retained data on error.

Client state◈ Members↗
FA-23516

Route loader ownership: Route transition clear · case 01

Route transition clear.

Client state● Open access↗
FA-23517

Route loader ownership: Route transition clear · case 02

Route transition clear.

Client state◈ Members↗
FA-23518

Route loader ownership: Route transition clear · case 03

Route transition clear.

Client state◈ Members↗
FA-23519

Route loader ownership: Route transition clear · case 04

Route transition clear.

Client state◈ Members↗
FA-23520

Route loader ownership: Route transition clear · case 05

Route transition clear.

Client state◈ Members↗
FA-23521

Route loader ownership: Resource disposition · case 01

Resource disposition.

Client state● Open access↗
FA-23522

Route loader ownership: Resource disposition · case 02

Resource disposition.

Client state◈ Members↗
FA-23523

Route loader ownership: Resource disposition · case 03

Resource disposition.

Client state◈ Members↗
FA-23524

Route loader ownership: Resource disposition · case 04

Resource disposition.

Client state◈ Members↗
FA-23525

Route loader ownership: Resource disposition · case 05

Resource disposition.

Client state◈ Members↗
FA-23526

Persisted client snapshot admission: Unknown field projection · case 01

Unknown field projection.

Client state● Open access↗
FA-23527

Persisted client snapshot admission: Unknown field projection · case 02

Unknown field projection.

Client state◈ Members↗
FA-23528

Persisted client snapshot admission: Unknown field projection · case 03

Unknown field projection.

Client state◈ Members↗
FA-23529

Persisted client snapshot admission: Unknown field projection · case 04

Unknown field projection.

Client state◈ Members↗
FA-23530

Persisted client snapshot admission: Unknown field projection · case 05

Unknown field projection.

Client state◈ Members↗
FA-23531

Persisted client snapshot admission: Default overlay order · case 01

Default overlay order.

Client state● Open access↗
FA-23532

Persisted client snapshot admission: Default overlay order · case 02

Default overlay order.

Client state◈ Members↗
FA-23533

Persisted client snapshot admission: Default overlay order · case 03

Default overlay order.

Client state◈ Members↗
FA-23534

Persisted client snapshot admission: Default overlay order · case 04

Default overlay order.

Client state◈ Members↗
FA-23535

Persisted client snapshot admission: Default overlay order · case 05

Default overlay order.

Client state◈ Members↗
FA-23536

Persisted client snapshot admission: Future version readonly · case 01

Future version readonly.

Client state● Open access↗
FA-23537

Persisted client snapshot admission: Future version readonly · case 02

Future version readonly.

Client state◈ Members↗
FA-23538

Persisted client snapshot admission: Future version readonly · case 03

Future version readonly.

Client state◈ Members↗
FA-23539

Persisted client snapshot admission: Future version readonly · case 04

Future version readonly.

Client state◈ Members↗
FA-23540

Persisted client snapshot admission: Future version readonly · case 05

Future version readonly.

Client state◈ Members↗
FA-23541

Persisted client snapshot admission: Migration step list · case 01

Migration step list.

Client state● Open access↗
FA-23542

Persisted client snapshot admission: Migration step list · case 02

Migration step list.

Client state◈ Members↗
FA-23543

Persisted client snapshot admission: Migration step list · case 03

Migration step list.

Client state◈ Members↗
FA-23544

Persisted client snapshot admission: Migration step list · case 04

Migration step list.

Client state◈ Members↗
FA-23545

Persisted client snapshot admission: Migration step list · case 05

Migration step list.

Client state◈ Members↗
FA-23546

Persisted client snapshot admission: Transient exclusion · case 01

Transient exclusion.

Client state● Open access↗
FA-23547

Persisted client snapshot admission: Transient exclusion · case 02

Transient exclusion.

Client state◈ Members↗
FA-23548

Persisted client snapshot admission: Transient exclusion · case 03

Transient exclusion.

Client state◈ Members↗
FA-23549

Persisted client snapshot admission: Transient exclusion · case 04

Transient exclusion.

Client state◈ Members↗
FA-23550

Persisted client snapshot admission: Transient exclusion · case 05

Transient exclusion.

Client state◈ Members↗
FA-23551

Persisted client snapshot admission: Missing default identification · case 01

Missing default identification.

Client state● Open access↗
FA-23552

Persisted client snapshot admission: Missing default identification · case 02

Missing default identification.

Client state◈ Members↗
FA-23553

Persisted client snapshot admission: Missing default identification · case 03

Missing default identification.

Client state◈ Members↗
FA-23554

Persisted client snapshot admission: Missing default identification · case 04

Missing default identification.

Client state◈ Members↗
FA-23555

Persisted client snapshot admission: Missing default identification · case 05

Missing default identification.

Client state◈ Members↗
FA-23556

Persisted client snapshot admission: Nullable persisted value · case 01

Nullable persisted value.

Client state● Open access↗
FA-23557

Persisted client snapshot admission: Nullable persisted value · case 02

Nullable persisted value.

Client state◈ Members↗
FA-23558

Persisted client snapshot admission: Nullable persisted value · case 03

Nullable persisted value.

Client state◈ Members↗
FA-23559

Persisted client snapshot admission: Nullable persisted value · case 04

Nullable persisted value.

Client state◈ Members↗
FA-23560

Persisted client snapshot admission: Nullable persisted value · case 05

Nullable persisted value.

Client state◈ Members↗
FA-23561

Persisted client snapshot admission: Write version stamp · case 01

Write version stamp.

Client state● Open access↗
FA-23562

Persisted client snapshot admission: Write version stamp · case 02

Write version stamp.

Client state◈ Members↗
FA-23563

Persisted client snapshot admission: Write version stamp · case 03

Write version stamp.

Client state◈ Members↗
FA-23564

Persisted client snapshot admission: Write version stamp · case 04

Write version stamp.

Client state◈ Members↗
FA-23565

Persisted client snapshot admission: Write version stamp · case 05

Write version stamp.

Client state◈ Members↗
FA-23566

Persisted client snapshot admission: Schema fallback policy · case 01

Schema fallback policy.

Client state● Open access↗
FA-23567

Persisted client snapshot admission: Schema fallback policy · case 02

Schema fallback policy.

Client state◈ Members↗
FA-23568

Persisted client snapshot admission: Schema fallback policy · case 03

Schema fallback policy.

Client state◈ Members↗
FA-23569

Persisted client snapshot admission: Schema fallback policy · case 04

Schema fallback policy.

Client state◈ Members↗
FA-23570

Persisted client snapshot admission: Schema fallback policy · case 05

Schema fallback policy.

Client state◈ Members↗
FA-23571

Persisted client snapshot admission: Serialized field order · case 01

Serialized field order.

Client state● Open access↗
FA-23572

Persisted client snapshot admission: Serialized field order · case 02

Serialized field order.

Client state◈ Members↗
FA-23573

Persisted client snapshot admission: Serialized field order · case 03

Serialized field order.

Client state◈ Members↗
FA-23574

Persisted client snapshot admission: Serialized field order · case 04

Serialized field order.

Client state◈ Members↗
FA-23575

Persisted client snapshot admission: Serialized field order · case 05

Serialized field order.

Client state◈ Members↗
FA-23576

Client persistence write transaction: Commit only on success · case 01

Commit only on success.

Client state● Open access↗
FA-23577

Client persistence write transaction: Commit only on success · case 02

Commit only on success.

Client state◈ Members↗
FA-23578

Client persistence write transaction: Commit only on success · case 03

Commit only on success.

Client state◈ Members↗
FA-23579

Client persistence write transaction: Commit only on success · case 04

Commit only on success.

Client state◈ Members↗
FA-23580

Client persistence write transaction: Commit only on success · case 05

Commit only on success.

Client state◈ Members↗
FA-23581

Client persistence write transaction: Retain dirty on quota · case 01

Retain dirty on quota.

Client state● Open access↗
FA-23582

Client persistence write transaction: Retain dirty on quota · case 02

Retain dirty on quota.

Client state◈ Members↗
FA-23583

Client persistence write transaction: Retain dirty on quota · case 03

Retain dirty on quota.

Client state◈ Members↗
FA-23584

Client persistence write transaction: Retain dirty on quota · case 04

Retain dirty on quota.

Client state◈ Members↗
FA-23585

Client persistence write transaction: Retain dirty on quota · case 05

Retain dirty on quota.

Client state◈ Members↗
FA-23586

Client persistence write transaction: Schedule debounce · case 01

Schedule debounce.

Client state● Open access↗
FA-23587

Client persistence write transaction: Schedule debounce · case 02

Schedule debounce.

Client state◈ Members↗
FA-23588

Client persistence write transaction: Schedule debounce · case 03

Schedule debounce.

Client state◈ Members↗
FA-23589

Client persistence write transaction: Schedule debounce · case 04

Schedule debounce.

Client state◈ Members↗
FA-23590

Client persistence write transaction: Schedule debounce · case 05

Schedule debounce.

Client state◈ Members↗
FA-23591

Client persistence write transaction: Flush deadline inclusive · case 01

Flush deadline inclusive.

Client state● Open access↗
FA-23592

Client persistence write transaction: Flush deadline inclusive · case 02

Flush deadline inclusive.

Client state◈ Members↗
FA-23593

Client persistence write transaction: Flush deadline inclusive · case 03

Flush deadline inclusive.

Client state◈ Members↗
FA-23594

Client persistence write transaction: Flush deadline inclusive · case 04

Flush deadline inclusive.

Client state◈ Members↗
FA-23595

Client persistence write transaction: Flush deadline inclusive · case 05

Flush deadline inclusive.

Client state◈ Members↗
FA-23596

Client persistence write transaction: Write permission gate · case 01

Write permission gate.

Client state● Open access↗
FA-23597

Client persistence write transaction: Write permission gate · case 02

Write permission gate.

Client state◈ Members↗
FA-23598

Client persistence write transaction: Write permission gate · case 03

Write permission gate.

Client state◈ Members↗
FA-23599

Client persistence write transaction: Write permission gate · case 04

Write permission gate.

Client state◈ Members↗
FA-23600

Client persistence write transaction: Write permission gate · case 05

Write permission gate.

Client state◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗