FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-23201

Search normalization versus displayed autocomplete text: accepted option display uses normalized search text · case 01

The commit-label completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23202

Search normalization versus displayed autocomplete text: accepted option display uses normalized search text · case 02

The commit-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23203

Search normalization versus displayed autocomplete text: accepted option display uses normalized search text · case 03

The commit-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23204

Search normalization versus displayed autocomplete text: accepted option display uses normalized search text · case 04

The commit-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23205

Search normalization versus displayed autocomplete text: accepted option display uses normalized search text · case 05

The commit-label completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23206

Search normalization versus displayed autocomplete text: normalization key is submitted instead of option identifier · case 01

The commit-id completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23207

Search normalization versus displayed autocomplete text: normalization key is submitted instead of option identifier · case 02

The commit-id completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23208

Search normalization versus displayed autocomplete text: normalization key is submitted instead of option identifier · case 03

The commit-id completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23209

Search normalization versus displayed autocomplete text: normalization key is submitted instead of option identifier · case 04

The commit-id completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23210

Search normalization versus displayed autocomplete text: normalization key is submitted instead of option identifier · case 05

The commit-id completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23211

Search normalization versus displayed autocomplete text: result query is compared with unnormalized visible draft · case 01

The match-key completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23212

Search normalization versus displayed autocomplete text: result query is compared with unnormalized visible draft · case 02

The match-key completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23213

Search normalization versus displayed autocomplete text: result query is compared with unnormalized visible draft · case 03

The match-key completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23214

Search normalization versus displayed autocomplete text: result query is compared with unnormalized visible draft · case 04

The match-key completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23215

Search normalization versus displayed autocomplete text: result query is compared with unnormalized visible draft · case 05

The match-key completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23216

Search normalization versus displayed autocomplete text: normalized match span ignores stripped leading whitespace · case 01

The offset completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23217

Search normalization versus displayed autocomplete text: normalized match span ignores stripped leading whitespace · case 02

The offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23218

Search normalization versus displayed autocomplete text: normalized match span ignores stripped leading whitespace · case 03

The offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23219

Search normalization versus displayed autocomplete text: normalized match span ignores stripped leading whitespace · case 04

The offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23220

Search normalization versus displayed autocomplete text: normalized match span ignores stripped leading whitespace · case 05

The offset completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23221

Search normalization versus displayed autocomplete text: equivalent normalized query suppresses required display revision · case 01

The display-epoch completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23222

Search normalization versus displayed autocomplete text: equivalent normalized query suppresses required display revision · case 02

The display-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23223

Search normalization versus displayed autocomplete text: equivalent normalized query suppresses required display revision · case 03

The display-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23224

Search normalization versus displayed autocomplete text: equivalent normalized query suppresses required display revision · case 04

The display-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23225

Search normalization versus displayed autocomplete text: equivalent normalized query suppresses required display revision · case 05

The display-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23226

Search normalization versus displayed autocomplete text: normalization-equivalent drafts trigger distinct lookup identities · case 01

The query-equivalent completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23227

Search normalization versus displayed autocomplete text: normalization-equivalent drafts trigger distinct lookup identities · case 02

The query-equivalent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23228

Search normalization versus displayed autocomplete text: normalization-equivalent drafts trigger distinct lookup identities · case 03

The query-equivalent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23229

Search normalization versus displayed autocomplete text: normalization-equivalent drafts trigger distinct lookup identities · case 04

The query-equivalent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23230

Search normalization versus displayed autocomplete text: normalization-equivalent drafts trigger distinct lookup identities · case 05

The query-equivalent completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23231

Search normalization versus displayed autocomplete text: lookup normalization shifts caret out of the visible draft coordinate · case 01

The caret-display completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23232

Search normalization versus displayed autocomplete text: lookup normalization shifts caret out of the visible draft coordinate · case 02

The caret-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23233

Search normalization versus displayed autocomplete text: lookup normalization shifts caret out of the visible draft coordinate · case 03

The caret-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23234

Search normalization versus displayed autocomplete text: lookup normalization shifts caret out of the visible draft coordinate · case 04

The caret-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23235

Search normalization versus displayed autocomplete text: lookup normalization shifts caret out of the visible draft coordinate · case 05

The caret-display completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23236

Search normalization versus displayed autocomplete text: whitespace normalization loses the intentional empty-query mode · case 01

The empty-query completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23237

Search normalization versus displayed autocomplete text: whitespace normalization loses the intentional empty-query mode · case 02

The empty-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23238

Search normalization versus displayed autocomplete text: whitespace normalization loses the intentional empty-query mode · case 03

The empty-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23239

Search normalization versus displayed autocomplete text: whitespace normalization loses the intentional empty-query mode · case 04

The empty-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23240

Search normalization versus displayed autocomplete text: whitespace normalization loses the intentional empty-query mode · case 05

The empty-query completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23241

Unresolved autocomplete draft on blur: strict-selection blur retains an uncommitted arbitrary draft · case 01

The revert completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23242

Unresolved autocomplete draft on blur: strict-selection blur retains an uncommitted arbitrary draft · case 02

The revert completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23243

Unresolved autocomplete draft on blur: strict-selection blur retains an uncommitted arbitrary draft · case 03

The revert completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23244

Unresolved autocomplete draft on blur: strict-selection blur retains an uncommitted arbitrary draft · case 04

The revert completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23245

Unresolved autocomplete draft on blur: strict-selection blur retains an uncommitted arbitrary draft · case 05

The revert completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23246

Unresolved autocomplete draft on blur: blur commits whichever suggestion happens to be highlighted · case 01

The value completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23247

Unresolved autocomplete draft on blur: blur commits whichever suggestion happens to be highlighted · case 02

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23248

Unresolved autocomplete draft on blur: blur commits whichever suggestion happens to be highlighted · case 03

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23249

Unresolved autocomplete draft on blur: blur commits whichever suggestion happens to be highlighted · case 04

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23250

Unresolved autocomplete draft on blur: blur commits whichever suggestion happens to be highlighted · case 05

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23251

Unresolved autocomplete draft on blur: blur reversion runs before a captured suggestion click completes · case 01

The pointer completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23252

Unresolved autocomplete draft on blur: blur reversion runs before a captured suggestion click completes · case 02

The pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23253

Unresolved autocomplete draft on blur: blur reversion runs before a captured suggestion click completes · case 03

The pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23254

Unresolved autocomplete draft on blur: blur reversion runs before a captured suggestion click completes · case 04

The pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23255

Unresolved autocomplete draft on blur: blur reversion runs before a captured suggestion click completes · case 05

The pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23256

Unresolved autocomplete draft on blur: blur reversion discards active IME composition text · case 01

The composition completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23257

Unresolved autocomplete draft on blur: blur reversion discards active IME composition text · case 02

The composition completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23258

Unresolved autocomplete draft on blur: blur reversion discards active IME composition text · case 03

The composition completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23259

Unresolved autocomplete draft on blur: blur reversion discards active IME composition text · case 04

The composition completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23260

Unresolved autocomplete draft on blur: blur reversion discards active IME composition text · case 05

The composition completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23261

Unresolved autocomplete draft on blur: ambiguous exact-label candidates are arbitrarily auto-confirmed · case 01

The exact completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23262

Unresolved autocomplete draft on blur: ambiguous exact-label candidates are arbitrarily auto-confirmed · case 02

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23263

Unresolved autocomplete draft on blur: ambiguous exact-label candidates are arbitrarily auto-confirmed · case 03

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23264

Unresolved autocomplete draft on blur: ambiguous exact-label candidates are arbitrarily auto-confirmed · case 04

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23265

Unresolved autocomplete draft on blur: ambiguous exact-label candidates are arbitrarily auto-confirmed · case 05

The exact completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23266

Unresolved autocomplete draft on blur: blur leaves autocomplete validation untouched · case 01

The touched completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23267

Unresolved autocomplete draft on blur: blur leaves autocomplete validation untouched · case 02

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23268

Unresolved autocomplete draft on blur: blur leaves autocomplete validation untouched · case 03

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23269

Unresolved autocomplete draft on blur: blur leaves autocomplete validation untouched · case 04

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23270

Unresolved autocomplete draft on blur: blur leaves autocomplete validation untouched · case 05

The touched completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23271

Unresolved autocomplete draft on blur: blur leaves a draft-only completion search scheduled · case 01

The pending completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23272

Unresolved autocomplete draft on blur: blur leaves a draft-only completion search scheduled · case 02

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23273

Unresolved autocomplete draft on blur: blur leaves a draft-only completion search scheduled · case 03

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23274

Unresolved autocomplete draft on blur: blur leaves a draft-only completion search scheduled · case 04

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23275

Unresolved autocomplete draft on blur: blur leaves a draft-only completion search scheduled · case 05

The pending completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23276

Unresolved autocomplete draft on blur: strict-selection blur treats unresolved text as a new free-text option · case 01

The free-text-rejection completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23277

Unresolved autocomplete draft on blur: strict-selection blur treats unresolved text as a new free-text option · case 02

The free-text-rejection completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23278

Unresolved autocomplete draft on blur: strict-selection blur treats unresolved text as a new free-text option · case 03

The free-text-rejection completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23279

Unresolved autocomplete draft on blur: strict-selection blur treats unresolved text as a new free-text option · case 04

The free-text-rejection completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23280

Unresolved autocomplete draft on blur: strict-selection blur treats unresolved text as a new free-text option · case 05

The free-text-rejection completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23281

Unresolved autocomplete draft on blur: blur validation attributes an unresolved draft to the highlighted candidate · case 01

The unresolved-validation completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23282

Unresolved autocomplete draft on blur: blur validation attributes an unresolved draft to the highlighted candidate · case 02

The unresolved-validation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23283

Unresolved autocomplete draft on blur: blur validation attributes an unresolved draft to the highlighted candidate · case 03

The unresolved-validation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23284

Unresolved autocomplete draft on blur: blur validation attributes an unresolved draft to the highlighted candidate · case 04

The unresolved-validation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23285

Unresolved autocomplete draft on blur: blur validation attributes an unresolved draft to the highlighted candidate · case 05

The unresolved-validation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23286

Unresolved autocomplete draft on blur: blur emits a value change solely because search draft differs · case 01

The changed completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23287

Unresolved autocomplete draft on blur: blur emits a value change solely because search draft differs · case 02

The changed completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23288

Unresolved autocomplete draft on blur: blur emits a value change solely because search draft differs · case 03

The changed completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23289

Unresolved autocomplete draft on blur: blur emits a value change solely because search draft differs · case 04

The changed completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23290

Unresolved autocomplete draft on blur: blur emits a value change solely because search draft differs · case 05

The changed completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23291

Reopening a committed autocomplete: reopening the picker resurrects its previous search fragment · case 01

The initial-draft completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23292

Reopening a committed autocomplete: reopening the picker resurrects its previous search fragment · case 02

The initial-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23293

Reopening a committed autocomplete: reopening the picker resurrects its previous search fragment · case 03

The initial-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23294

Reopening a committed autocomplete: reopening the picker resurrects its previous search fragment · case 04

The initial-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23295

Reopening a committed autocomplete: reopening the picker resurrects its previous search fragment · case 05

The initial-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23296

Reopening a committed autocomplete: reopen discards an explicitly preserved unresolved edit · case 01

The unresolved-draft completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-23297

Reopening a committed autocomplete: reopen discards an explicitly preserved unresolved edit · case 02

The unresolved-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23298

Reopening a committed autocomplete: reopen discards an explicitly preserved unresolved edit · case 03

The unresolved-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23299

Reopening a committed autocomplete: reopen discards an explicitly preserved unresolved edit · case 04

The unresolved-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-23300

Reopening a committed autocomplete: reopen discards an explicitly preserved unresolved edit · case 05

The unresolved-draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗