FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-22301

Cached autocomplete presentation: cached suggestions cross dependent-picker scopes · case 01

The scope-match completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22302

Cached autocomplete presentation: cached suggestions cross dependent-picker scopes · case 02

The scope-match completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22303

Cached autocomplete presentation: cached suggestions cross dependent-picker scopes · case 03

The scope-match completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22304

Cached autocomplete presentation: cached suggestions cross dependent-picker scopes · case 04

The scope-match completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22305

Cached autocomplete presentation: cached suggestions cross dependent-picker scopes · case 05

The scope-match completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22306

Cached autocomplete presentation: empty-result cache entries are treated as misses · case 01

The empty-hit completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22307

Cached autocomplete presentation: empty-result cache entries are treated as misses · case 02

The empty-hit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22308

Cached autocomplete presentation: empty-result cache entries are treated as misses · case 03

The empty-hit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22309

Cached autocomplete presentation: empty-result cache entries are treated as misses · case 04

The empty-hit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22310

Cached autocomplete presentation: empty-result cache entries are treated as misses · case 05

The empty-hit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22311

Cached autocomplete presentation: cached results hide their revalidation state · case 01

The stale-badge completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22312

Cached autocomplete presentation: cached results hide their revalidation state · case 02

The stale-badge completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22313

Cached autocomplete presentation: cached results hide their revalidation state · case 03

The stale-badge completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22314

Cached autocomplete presentation: cached results hide their revalidation state · case 04

The stale-badge completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22315

Cached autocomplete presentation: cached results hide their revalidation state · case 05

The stale-badge completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22316

Cached autocomplete presentation: presence of cached suggestions suppresses needed revalidation · case 01

The refresh completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22317

Cached autocomplete presentation: presence of cached suggestions suppresses needed revalidation · case 02

The refresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22318

Cached autocomplete presentation: presence of cached suggestions suppresses needed revalidation · case 03

The refresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22319

Cached autocomplete presentation: presence of cached suggestions suppresses needed revalidation · case 04

The refresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22320

Cached autocomplete presentation: presence of cached suggestions suppresses needed revalidation · case 05

The refresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22321

Cached autocomplete presentation: previous query cached rows remain selectable after a miss · case 01

The miss-rows completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22322

Cached autocomplete presentation: previous query cached rows remain selectable after a miss · case 02

The miss-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22323

Cached autocomplete presentation: previous query cached rows remain selectable after a miss · case 03

The miss-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22324

Cached autocomplete presentation: previous query cached rows remain selectable after a miss · case 04

The miss-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22325

Cached autocomplete presentation: previous query cached rows remain selectable after a miss · case 05

The miss-rows completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22326

Cached autocomplete presentation: cache invalidation destroys the committed display label · case 01

The value-label completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22327

Cached autocomplete presentation: cache invalidation destroys the committed display label · case 02

The value-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22328

Cached autocomplete presentation: cache invalidation destroys the committed display label · case 03

The value-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22329

Cached autocomplete presentation: cache invalidation destroys the committed display label · case 04

The value-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22330

Cached autocomplete presentation: cache invalidation destroys the committed display label · case 05

The value-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22331

Cached autocomplete presentation: cache-backed rows falsely claim the current network response provenance · case 01

The cache-provenance completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22332

Cached autocomplete presentation: cache-backed rows falsely claim the current network response provenance · case 02

The cache-provenance completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22333

Cached autocomplete presentation: cache-backed rows falsely claim the current network response provenance · case 03

The cache-provenance completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22334

Cached autocomplete presentation: cache-backed rows falsely claim the current network response provenance · case 04

The cache-provenance completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22335

Cached autocomplete presentation: cache-backed rows falsely claim the current network response provenance · case 05

The cache-provenance completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22336

Cached autocomplete presentation: background refresh failure removes usable cache state · case 01

The refresh-error completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22337

Cached autocomplete presentation: background refresh failure removes usable cache state · case 02

The refresh-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22338

Cached autocomplete presentation: background refresh failure removes usable cache state · case 03

The refresh-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22339

Cached autocomplete presentation: background refresh failure removes usable cache state · case 04

The refresh-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22340

Cached autocomplete presentation: background refresh failure removes usable cache state · case 05

The refresh-error completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22341

Federated suggestion sections: remote completion results displace the local-first section · case 01

The order completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22342

Federated suggestion sections: remote completion results displace the local-first section · case 02

The order completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22343

Federated suggestion sections: remote completion results displace the local-first section · case 03

The order completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22344

Federated suggestion sections: remote completion results displace the local-first section · case 04

The order completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22345

Federated suggestion sections: remote completion results displace the local-first section · case 05

The order completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22346

Federated suggestion sections: same identifier from different completion sources collides · case 01

The identity completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22347

Federated suggestion sections: same identifier from different completion sources collides · case 02

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22348

Federated suggestion sections: same identifier from different completion sources collides · case 03

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22349

Federated suggestion sections: same identifier from different completion sources collides · case 04

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22350

Federated suggestion sections: same identifier from different completion sources collides · case 05

The identity completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22351

Federated suggestion sections: empty recent-suggestions section keeps a dead header · case 01

The local-header completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22352

Federated suggestion sections: empty recent-suggestions section keeps a dead header · case 02

The local-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22353

Federated suggestion sections: empty recent-suggestions section keeps a dead header · case 03

The local-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22354

Federated suggestion sections: empty recent-suggestions section keeps a dead header · case 04

The local-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22355

Federated suggestion sections: empty recent-suggestions section keeps a dead header · case 05

The local-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22356

Federated suggestion sections: remote section borrows the recent-history title · case 01

The remote-header completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22357

Federated suggestion sections: remote section borrows the recent-history title · case 02

The remote-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22358

Federated suggestion sections: remote section borrows the recent-history title · case 03

The remote-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22359

Federated suggestion sections: remote section borrows the recent-history title · case 04

The remote-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22360

Federated suggestion sections: remote section borrows the recent-history title · case 05

The remote-header completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22361

Federated suggestion sections: pending remote query suppresses available local suggestions · case 01

The local-ready completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22362

Federated suggestion sections: pending remote query suppresses available local suggestions · case 02

The local-ready completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22363

Federated suggestion sections: pending remote query suppresses available local suggestions · case 03

The local-ready completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22364

Federated suggestion sections: pending remote query suppresses available local suggestions · case 04

The local-ready completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22365

Federated suggestion sections: pending remote query suppresses available local suggestions · case 05

The local-ready completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22366

Federated suggestion sections: section header is accepted as a completion value · case 01

The header-commit completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22367

Federated suggestion sections: section header is accepted as a completion value · case 02

The header-commit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22368

Federated suggestion sections: section header is accepted as a completion value · case 03

The header-commit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22369

Federated suggestion sections: section header is accepted as a completion value · case 04

The header-commit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22370

Federated suggestion sections: section header is accepted as a completion value · case 05

The header-commit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22371

Federated suggestion sections: suggestion count includes section headings · case 01

The count completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22372

Federated suggestion sections: suggestion count includes section headings · case 02

The count completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22373

Federated suggestion sections: suggestion count includes section headings · case 03

The count completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22374

Federated suggestion sections: suggestion count includes section headings · case 04

The count completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22375

Federated suggestion sections: suggestion count includes section headings · case 05

The count completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22376

Federated suggestion sections: empty local section causes the entire picker to show no results · case 01

The source-empty completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22377

Federated suggestion sections: empty local section causes the entire picker to show no results · case 02

The source-empty completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22378

Federated suggestion sections: empty local section causes the entire picker to show no results · case 03

The source-empty completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22379

Federated suggestion sections: empty local section causes the entire picker to show no results · case 04

The source-empty completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22380

Federated suggestion sections: empty local section causes the entire picker to show no results · case 05

The source-empty completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22381

Federated suggestion sections: remote pending marker is shown after the source completes · case 01

The remote-marker completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22382

Federated suggestion sections: remote pending marker is shown after the source completes · case 02

The remote-marker completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22383

Federated suggestion sections: remote pending marker is shown after the source completes · case 03

The remote-marker completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22384

Federated suggestion sections: remote pending marker is shown after the source completes · case 04

The remote-marker completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22385

Federated suggestion sections: remote pending marker is shown after the source completes · case 05

The remote-marker completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22386

Federated suggestion sections: section offsets count the local header when the local section is absent · case 01

The remote-offset completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22387

Federated suggestion sections: section offsets count the local header when the local section is absent · case 02

The remote-offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22388

Federated suggestion sections: section offsets count the local header when the local section is absent · case 03

The remote-offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22389

Federated suggestion sections: section offsets count the local header when the local section is absent · case 04

The remote-offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22390

Federated suggestion sections: section offsets count the local header when the local section is absent · case 05

The remote-offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22391

Unavailable suggestion presentation: unavailable suggestions disappear rather than explain rejection · case 01

The visible completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22392

Unavailable suggestion presentation: unavailable suggestions disappear rather than explain rejection · case 02

The visible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22393

Unavailable suggestion presentation: unavailable suggestions disappear rather than explain rejection · case 03

The visible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22394

Unavailable suggestion presentation: unavailable suggestions disappear rather than explain rejection · case 04

The visible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22395

Unavailable suggestion presentation: unavailable suggestions disappear rather than explain rejection · case 05

The visible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22396

Unavailable suggestion presentation: automatic completion selects an unavailable first result · case 01

The eligible completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22397

Unavailable suggestion presentation: automatic completion selects an unavailable first result · case 02

The eligible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22398

Unavailable suggestion presentation: automatic completion selects an unavailable first result · case 03

The eligible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22399

Unavailable suggestion presentation: automatic completion selects an unavailable first result · case 04

The eligible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22400

Unavailable suggestion presentation: automatic completion selects an unavailable first result · case 05

The eligible completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗