FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-22501

Paged autocomplete interaction: more-results action resends the consumed cursor · case 01

The continuation completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22502

Paged autocomplete interaction: more-results action resends the consumed cursor · case 02

The continuation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22503

Paged autocomplete interaction: more-results action resends the consumed cursor · case 03

The continuation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22504

Paged autocomplete interaction: more-results action resends the consumed cursor · case 04

The continuation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22505

Paged autocomplete interaction: more-results action resends the consumed cursor · case 05

The continuation completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22506

Paged autocomplete interaction: end-of-results still displays the more-results affordance · case 01

The has-more completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22507

Paged autocomplete interaction: end-of-results still displays the more-results affordance · case 02

The has-more completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22508

Paged autocomplete interaction: end-of-results still displays the more-results affordance · case 03

The has-more completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22509

Paged autocomplete interaction: end-of-results still displays the more-results affordance · case 04

The has-more completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22510

Paged autocomplete interaction: end-of-results still displays the more-results affordance · case 05

The has-more completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22511

Paged autocomplete interaction: late page from the prior draft is appended · case 01

The page-epoch completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22512

Paged autocomplete interaction: late page from the prior draft is appended · case 02

The page-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22513

Paged autocomplete interaction: late page from the prior draft is appended · case 03

The page-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22514

Paged autocomplete interaction: late page from the prior draft is appended · case 04

The page-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22515

Paged autocomplete interaction: late page from the prior draft is appended · case 05

The page-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22516

Paged autocomplete interaction: appending suggestions adjusts active position by the new page length · case 01

The active completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22517

Paged autocomplete interaction: appending suggestions adjusts active position by the new page length · case 02

The active completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22518

Paged autocomplete interaction: appending suggestions adjusts active position by the new page length · case 03

The active completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22519

Paged autocomplete interaction: appending suggestions adjusts active position by the new page length · case 04

The active completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22520

Paged autocomplete interaction: appending suggestions adjusts active position by the new page length · case 05

The active completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22521

Paged autocomplete interaction: paging clears the already committed autocomplete value · case 01

The value completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22522

Paged autocomplete interaction: paging clears the already committed autocomplete value · case 02

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22523

Paged autocomplete interaction: paging clears the already committed autocomplete value · case 03

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22524

Paged autocomplete interaction: paging clears the already committed autocomplete value · case 04

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22525

Paged autocomplete interaction: paging clears the already committed autocomplete value · case 05

The value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22526

Paged autocomplete interaction: paging substitutes the cursor for the search draft · case 01

The draft completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22527

Paged autocomplete interaction: paging substitutes the cursor for the search draft · case 02

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22528

Paged autocomplete interaction: paging substitutes the cursor for the search draft · case 03

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22529

Paged autocomplete interaction: paging substitutes the cursor for the search draft · case 04

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22530

Paged autocomplete interaction: paging substitutes the cursor for the search draft · case 05

The draft completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22531

Paged autocomplete interaction: a second more-results gesture is admitted while a page is pending · case 01

The more-busy completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22532

Paged autocomplete interaction: a second more-results gesture is admitted while a page is pending · case 02

The more-busy completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22533

Paged autocomplete interaction: a second more-results gesture is admitted while a page is pending · case 03

The more-busy completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22534

Paged autocomplete interaction: a second more-results gesture is admitted while a page is pending · case 04

The more-busy completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22535

Paged autocomplete interaction: a second more-results gesture is admitted while a page is pending · case 05

The more-busy completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22536

Paged autocomplete interaction: more-results footer is counted as a selectable suggestion · case 01

The footer completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22537

Paged autocomplete interaction: more-results footer is counted as a selectable suggestion · case 02

The footer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22538

Paged autocomplete interaction: more-results footer is counted as a selectable suggestion · case 03

The footer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22539

Paged autocomplete interaction: more-results footer is counted as a selectable suggestion · case 04

The footer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22540

Paged autocomplete interaction: more-results footer is counted as a selectable suggestion · case 05

The footer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22541

Suggestion pointer acceptance transaction: option press captures the hovered row rather than pressed identity · case 01

The capture completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22542

Suggestion pointer acceptance transaction: option press captures the hovered row rather than pressed identity · case 02

The capture completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22543

Suggestion pointer acceptance transaction: option press captures the hovered row rather than pressed identity · case 03

The capture completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22544

Suggestion pointer acceptance transaction: option press captures the hovered row rather than pressed identity · case 04

The capture completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22545

Suggestion pointer acceptance transaction: option press captures the hovered row rather than pressed identity · case 05

The capture completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22546

Suggestion pointer acceptance transaction: release on another suggestion commits the original row · case 01

The same-row completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22547

Suggestion pointer acceptance transaction: release on another suggestion commits the original row · case 02

The same-row completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22548

Suggestion pointer acceptance transaction: release on another suggestion commits the original row · case 03

The same-row completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22549

Suggestion pointer acceptance transaction: release on another suggestion commits the original row · case 04

The same-row completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22550

Suggestion pointer acceptance transaction: release on another suggestion commits the original row · case 05

The same-row completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22551

Suggestion pointer acceptance transaction: second pointer completes another pointer acceptance gesture · case 01

The same-pointer completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22552

Suggestion pointer acceptance transaction: second pointer completes another pointer acceptance gesture · case 02

The same-pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22553

Suggestion pointer acceptance transaction: second pointer completes another pointer acceptance gesture · case 03

The same-pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22554

Suggestion pointer acceptance transaction: second pointer completes another pointer acceptance gesture · case 04

The same-pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22555

Suggestion pointer acceptance transaction: second pointer completes another pointer acceptance gesture · case 05

The same-pointer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22556

Suggestion pointer acceptance transaction: release outside suggestions still accepts a captured option · case 01

The inside completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22557

Suggestion pointer acceptance transaction: release outside suggestions still accepts a captured option · case 02

The inside completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22558

Suggestion pointer acceptance transaction: release outside suggestions still accepts a captured option · case 03

The inside completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22559

Suggestion pointer acceptance transaction: release outside suggestions still accepts a captured option · case 04

The inside completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22560

Suggestion pointer acceptance transaction: release outside suggestions still accepts a captured option · case 05

The inside completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22561

Suggestion pointer acceptance transaction: dragging a suggestions list is interpreted as a click · case 01

The slop completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22562

Suggestion pointer acceptance transaction: dragging a suggestions list is interpreted as a click · case 02

The slop completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22563

Suggestion pointer acceptance transaction: dragging a suggestions list is interpreted as a click · case 03

The slop completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22564

Suggestion pointer acceptance transaction: dragging a suggestions list is interpreted as a click · case 04

The slop completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22565

Suggestion pointer acceptance transaction: dragging a suggestions list is interpreted as a click · case 05

The slop completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22566

Suggestion pointer acceptance transaction: pointer release accepts an option from the pre-edit query · case 01

The fresh completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22567

Suggestion pointer acceptance transaction: pointer release accepts an option from the pre-edit query · case 02

The fresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22568

Suggestion pointer acceptance transaction: pointer release accepts an option from the pre-edit query · case 03

The fresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22569

Suggestion pointer acceptance transaction: pointer release accepts an option from the pre-edit query · case 04

The fresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22570

Suggestion pointer acceptance transaction: pointer release accepts an option from the pre-edit query · case 05

The fresh completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22571

Suggestion pointer acceptance transaction: input blur destroys a pending suggestion press transaction · case 01

The blur-defer completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22572

Suggestion pointer acceptance transaction: input blur destroys a pending suggestion press transaction · case 02

The blur-defer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22573

Suggestion pointer acceptance transaction: input blur destroys a pending suggestion press transaction · case 03

The blur-defer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22574

Suggestion pointer acceptance transaction: input blur destroys a pending suggestion press transaction · case 04

The blur-defer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22575

Suggestion pointer acceptance transaction: input blur destroys a pending suggestion press transaction · case 05

The blur-defer completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22576

Suggestion pointer acceptance transaction: pointer hover commits a suggestion before acceptance · case 01

The hover-value completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22577

Suggestion pointer acceptance transaction: pointer hover commits a suggestion before acceptance · case 02

The hover-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22578

Suggestion pointer acceptance transaction: pointer hover commits a suggestion before acceptance · case 03

The hover-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22579

Suggestion pointer acceptance transaction: pointer hover commits a suggestion before acceptance · case 04

The hover-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22580

Suggestion pointer acceptance transaction: pointer hover commits a suggestion before acceptance · case 05

The hover-value completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22581

Suggestion pointer acceptance transaction: pointer cancellation leaves a captured option ready to commit · case 01

The cancel completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22582

Suggestion pointer acceptance transaction: pointer cancellation leaves a captured option ready to commit · case 02

The cancel completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22583

Suggestion pointer acceptance transaction: pointer cancellation leaves a captured option ready to commit · case 03

The cancel completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22584

Suggestion pointer acceptance transaction: pointer cancellation leaves a captured option ready to commit · case 04

The cancel completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22585

Suggestion pointer acceptance transaction: pointer cancellation leaves a captured option ready to commit · case 05

The cancel completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22586

Suggestion pointer acceptance transaction: press stores the next query epoch rather than its rendered epoch · case 01

The press-epoch completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22587

Suggestion pointer acceptance transaction: press stores the next query epoch rather than its rendered epoch · case 02

The press-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22588

Suggestion pointer acceptance transaction: press stores the next query epoch rather than its rendered epoch · case 03

The press-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22589

Suggestion pointer acceptance transaction: press stores the next query epoch rather than its rendered epoch · case 04

The press-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22590

Suggestion pointer acceptance transaction: press stores the next query epoch rather than its rendered epoch · case 05

The press-epoch completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22591

Recent accepted suggestions: accepted suggestion is recorded behind older completions · case 01

The record completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22592

Recent accepted suggestions: accepted suggestion is recorded behind older completions · case 02

The record completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22593

Recent accepted suggestions: accepted suggestion is recorded behind older completions · case 03

The record completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22594

Recent accepted suggestions: accepted suggestion is recorded behind older completions · case 04

The record completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22595

Recent accepted suggestions: accepted suggestion is recorded behind older completions · case 05

The record completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22596

Recent accepted suggestions: recent suggestions ignore the configured visible limit · case 01

The limit completion transition produces an incorrect observable state.

Autocomplete interactions● Open access↗
FA-22597

Recent accepted suggestions: recent suggestions ignore the configured visible limit · case 02

The limit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22598

Recent accepted suggestions: recent suggestions ignore the configured visible limit · case 03

The limit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22599

Recent accepted suggestions: recent suggestions ignore the configured visible limit · case 04

The limit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗
FA-22600

Recent accepted suggestions: recent suggestions ignore the configured visible limit · case 05

The limit completion transition produces an incorrect observable state.

Autocomplete interactions◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗