FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-53501

Protected line separators are replaced by bullets · case 01

Protected line separators are replaced by bullets.

Accessibility interaction semantics● Open access↗
FA-53502

Protected line separators are replaced by bullets · case 02

Protected line separators are replaced by bullets.

Accessibility interaction semantics◈ Members↗
FA-53503

Protected line separators are replaced by bullets · case 03

Protected line separators are replaced by bullets.

Accessibility interaction semantics◈ Members↗
FA-53504

Protected line separators are replaced by bullets · case 04

Protected line separators are replaced by bullets.

Accessibility interaction semantics◈ Members↗
FA-53505

Protected line separators are replaced by bullets · case 05

Protected line separators are replaced by bullets.

Accessibility interaction semantics◈ Members↗
FA-53506

Placeholder text replaces a nonempty accessible value hint · case 01

Placeholder text replaces a nonempty accessible value hint.

Accessibility interaction semantics● Open access↗
FA-53507

Placeholder text replaces a nonempty accessible value hint · case 02

Placeholder text replaces a nonempty accessible value hint.

Accessibility interaction semantics◈ Members↗
FA-53508

Placeholder text replaces a nonempty accessible value hint · case 03

Placeholder text replaces a nonempty accessible value hint.

Accessibility interaction semantics◈ Members↗
FA-53509

Placeholder text replaces a nonempty accessible value hint · case 04

Placeholder text replaces a nonempty accessible value hint.

Accessibility interaction semantics◈ Members↗
FA-53510

Placeholder text replaces a nonempty accessible value hint · case 05

Placeholder text replaces a nonempty accessible value hint.

Accessibility interaction semantics◈ Members↗
FA-53511

Read-only values are exposed as editable · case 01

Read-only values are exposed as editable.

Accessibility interaction semantics● Open access↗
FA-53512

Read-only values are exposed as editable · case 02

Read-only values are exposed as editable.

Accessibility interaction semantics◈ Members↗
FA-53513

Read-only values are exposed as editable · case 03

Read-only values are exposed as editable.

Accessibility interaction semantics◈ Members↗
FA-53514

Read-only values are exposed as editable · case 04

Read-only values are exposed as editable.

Accessibility interaction semantics◈ Members↗
FA-53515

Read-only values are exposed as editable · case 05

Read-only values are exposed as editable.

Accessibility interaction semantics◈ Members↗
FA-53516

Revealed values lose their protected semantic flag · case 01

Revealed values lose their protected semantic flag.

Accessibility interaction semantics● Open access↗
FA-53517

Revealed values lose their protected semantic flag · case 02

Revealed values lose their protected semantic flag.

Accessibility interaction semantics◈ Members↗
FA-53518

Revealed values lose their protected semantic flag · case 03

Revealed values lose their protected semantic flag.

Accessibility interaction semantics◈ Members↗
FA-53519

Revealed values lose their protected semantic flag · case 04

Revealed values lose their protected semantic flag.

Accessibility interaction semantics◈ Members↗
FA-53520

Revealed values lose their protected semantic flag · case 05

Revealed values lose their protected semantic flag.

Accessibility interaction semantics◈ Members↗
FA-53521

Destroyed frame hosts retain semantic children · case 01

Destroyed frame hosts retain semantic children.

Accessibility interaction semantics● Open access↗
FA-53522

Destroyed frame hosts retain semantic children · case 02

Destroyed frame hosts retain semantic children.

Accessibility interaction semantics◈ Members↗
FA-53523

Destroyed frame hosts retain semantic children · case 03

Destroyed frame hosts retain semantic children.

Accessibility interaction semantics◈ Members↗
FA-53524

Destroyed frame hosts retain semantic children · case 04

Destroyed frame hosts retain semantic children.

Accessibility interaction semantics◈ Members↗
FA-53525

Destroyed frame hosts retain semantic children · case 05

Destroyed frame hosts retain semantic children.

Accessibility interaction semantics◈ Members↗
FA-53526

Unloaded embedded documents expose cached children · case 01

Unloaded embedded documents expose cached children.

Accessibility interaction semantics● Open access↗
FA-53527

Unloaded embedded documents expose cached children · case 02

Unloaded embedded documents expose cached children.

Accessibility interaction semantics◈ Members↗
FA-53528

Unloaded embedded documents expose cached children · case 03

Unloaded embedded documents expose cached children.

Accessibility interaction semantics◈ Members↗
FA-53529

Unloaded embedded documents expose cached children · case 04

Unloaded embedded documents expose cached children.

Accessibility interaction semantics◈ Members↗
FA-53530

Unloaded embedded documents expose cached children · case 05

Unloaded embedded documents expose cached children.

Accessibility interaction semantics◈ Members↗
FA-53531

Same origin is mistaken for accessibility permission · case 01

Same origin is mistaken for accessibility permission.

Accessibility interaction semantics● Open access↗
FA-53532

Same origin is mistaken for accessibility permission · case 02

Same origin is mistaken for accessibility permission.

Accessibility interaction semantics◈ Members↗
FA-53533

Same origin is mistaken for accessibility permission · case 03

Same origin is mistaken for accessibility permission.

Accessibility interaction semantics◈ Members↗
FA-53534

Same origin is mistaken for accessibility permission · case 04

Same origin is mistaken for accessibility permission.

Accessibility interaction semantics◈ Members↗
FA-53535

Same origin is mistaken for accessibility permission · case 05

Same origin is mistaken for accessibility permission.

Accessibility interaction semantics◈ Members↗
FA-53536

Empty child document IDs are traversable · case 01

Empty child document IDs are traversable.

Accessibility interaction semantics● Open access↗
FA-53537

Empty child document IDs are traversable · case 02

Empty child document IDs are traversable.

Accessibility interaction semantics◈ Members↗
FA-53538

Empty child document IDs are traversable · case 03

Empty child document IDs are traversable.

Accessibility interaction semantics◈ Members↗
FA-53539

Empty child document IDs are traversable · case 04

Empty child document IDs are traversable.

Accessibility interaction semantics◈ Members↗
FA-53540

Empty child document IDs are traversable · case 05

Empty child document IDs are traversable.

Accessibility interaction semantics◈ Members↗
FA-53541

A document embeds itself in the semantic bridge · case 01

A document embeds itself in the semantic bridge.

Accessibility interaction semantics● Open access↗
FA-53542

A document embeds itself in the semantic bridge · case 02

A document embeds itself in the semantic bridge.

Accessibility interaction semantics◈ Members↗
FA-53543

A document embeds itself in the semantic bridge · case 03

A document embeds itself in the semantic bridge.

Accessibility interaction semantics◈ Members↗
FA-53544

A document embeds itself in the semantic bridge · case 04

A document embeds itself in the semantic bridge.

Accessibility interaction semantics◈ Members↗
FA-53545

A document embeds itself in the semantic bridge · case 05

A document embeds itself in the semantic bridge.

Accessibility interaction semantics◈ Members↗
FA-53546

The frame host reappears among its own descendants · case 01

The frame host reappears among its own descendants.

Accessibility interaction semantics● Open access↗
FA-53547

The frame host reappears among its own descendants · case 02

The frame host reappears among its own descendants.

Accessibility interaction semantics◈ Members↗
FA-53548

The frame host reappears among its own descendants · case 03

The frame host reappears among its own descendants.

Accessibility interaction semantics◈ Members↗
FA-53549

The frame host reappears among its own descendants · case 04

The frame host reappears among its own descendants.

Accessibility interaction semantics◈ Members↗
FA-53550

The frame host reappears among its own descendants · case 05

The frame host reappears among its own descendants.

Accessibility interaction semantics◈ Members↗
FA-53551

Child document title overwrites the authored frame name · case 01

Child document title overwrites the authored frame name.

Accessibility interaction semantics● Open access↗
FA-53552

Child document title overwrites the authored frame name · case 02

Child document title overwrites the authored frame name.

Accessibility interaction semantics◈ Members↗
FA-53553

Child document title overwrites the authored frame name · case 03

Child document title overwrites the authored frame name.

Accessibility interaction semantics◈ Members↗
FA-53554

Child document title overwrites the authored frame name · case 04

Child document title overwrites the authored frame name.

Accessibility interaction semantics◈ Members↗
FA-53555

Child document title overwrites the authored frame name · case 05

Child document title overwrites the authored frame name.

Accessibility interaction semantics◈ Members↗
FA-53556

Unreadable embedded documents leak their title · case 01

Unreadable embedded documents leak their title.

Accessibility interaction semantics● Open access↗
FA-53557

Unreadable embedded documents leak their title · case 02

Unreadable embedded documents leak their title.

Accessibility interaction semantics◈ Members↗
FA-53558

Unreadable embedded documents leak their title · case 03

Unreadable embedded documents leak their title.

Accessibility interaction semantics◈ Members↗
FA-53559

Unreadable embedded documents leak their title · case 04

Unreadable embedded documents leak their title.

Accessibility interaction semantics◈ Members↗
FA-53560

Unreadable embedded documents leak their title · case 05

Unreadable embedded documents leak their title.

Accessibility interaction semantics◈ Members↗
FA-53561

Loading frames are exposed as available and idle · case 01

Loading frames are exposed as available and idle.

Accessibility interaction semantics● Open access↗
FA-53562

Loading frames are exposed as available and idle · case 02

Loading frames are exposed as available and idle.

Accessibility interaction semantics◈ Members↗
FA-53563

Loading frames are exposed as available and idle · case 03

Loading frames are exposed as available and idle.

Accessibility interaction semantics◈ Members↗
FA-53564

Loading frames are exposed as available and idle · case 04

Loading frames are exposed as available and idle.

Accessibility interaction semantics◈ Members↗
FA-53565

Loading frames are exposed as available and idle · case 05

Loading frames are exposed as available and idle.

Accessibility interaction semantics◈ Members↗
FA-53566

Embedded child IDs collide with host document IDs · case 01

Embedded child IDs collide with host document IDs.

Accessibility interaction semantics● Open access↗
FA-53567

Embedded child IDs collide with host document IDs · case 02

Embedded child IDs collide with host document IDs.

Accessibility interaction semantics◈ Members↗
FA-53568

Embedded child IDs collide with host document IDs · case 03

Embedded child IDs collide with host document IDs.

Accessibility interaction semantics◈ Members↗
FA-53569

Embedded child IDs collide with host document IDs · case 04

Embedded child IDs collide with host document IDs.

Accessibility interaction semantics◈ Members↗
FA-53570

Embedded child IDs collide with host document IDs · case 05

Embedded child IDs collide with host document IDs.

Accessibility interaction semantics◈ Members↗
FA-53571

Stale create replaces a newer semantic proxy · case 01

Stale create replaces a newer semantic proxy.

Accessibility interaction semantics● Open access↗
FA-53572

Stale create replaces a newer semantic proxy · case 02

Stale create replaces a newer semantic proxy.

Accessibility interaction semantics◈ Members↗
FA-53573

Stale create replaces a newer semantic proxy · case 03

Stale create replaces a newer semantic proxy.

Accessibility interaction semantics◈ Members↗
FA-53574

Stale create replaces a newer semantic proxy · case 04

Stale create replaces a newer semantic proxy.

Accessibility interaction semantics◈ Members↗
FA-53575

Stale create replaces a newer semantic proxy · case 05

Stale create replaces a newer semantic proxy.

Accessibility interaction semantics◈ Members↗
FA-53576

Negative generation creates a platform proxy · case 01

Negative generation creates a platform proxy.

Accessibility interaction semantics● Open access↗
FA-53577

Negative generation creates a platform proxy · case 02

Negative generation creates a platform proxy.

Accessibility interaction semantics◈ Members↗
FA-53578

Negative generation creates a platform proxy · case 03

Negative generation creates a platform proxy.

Accessibility interaction semantics◈ Members↗
FA-53579

Negative generation creates a platform proxy · case 04

Negative generation creates a platform proxy.

Accessibility interaction semantics◈ Members↗
FA-53580

Negative generation creates a platform proxy · case 05

Negative generation creates a platform proxy.

Accessibility interaction semantics◈ Members↗
FA-53581

Stale proxy handles mutate the replacement object · case 01

Stale proxy handles mutate the replacement object.

Accessibility interaction semantics● Open access↗
FA-53582

Stale proxy handles mutate the replacement object · case 02

Stale proxy handles mutate the replacement object.

Accessibility interaction semantics◈ Members↗
FA-53583

Stale proxy handles mutate the replacement object · case 03

Stale proxy handles mutate the replacement object.

Accessibility interaction semantics◈ Members↗
FA-53584

Stale proxy handles mutate the replacement object · case 04

Stale proxy handles mutate the replacement object.

Accessibility interaction semantics◈ Members↗
FA-53585

Stale proxy handles mutate the replacement object · case 05

Stale proxy handles mutate the replacement object.

Accessibility interaction semantics◈ Members↗
FA-53586

Pinned proxies remain semantically live after destruction · case 01

Pinned proxies remain semantically live after destruction.

Accessibility interaction semantics● Open access↗
FA-53587

Pinned proxies remain semantically live after destruction · case 02

Pinned proxies remain semantically live after destruction.

Accessibility interaction semantics◈ Members↗
FA-53588

Pinned proxies remain semantically live after destruction · case 03

Pinned proxies remain semantically live after destruction.

Accessibility interaction semantics◈ Members↗
FA-53589

Pinned proxies remain semantically live after destruction · case 04

Pinned proxies remain semantically live after destruction.

Accessibility interaction semantics◈ Members↗
FA-53590

Pinned proxies remain semantically live after destruction · case 05

Pinned proxies remain semantically live after destruction.

Accessibility interaction semantics◈ Members↗
FA-53591

Destroyed proxy retains sensitive value payload · case 01

Destroyed proxy retains sensitive value payload.

Accessibility interaction semantics● Open access↗
FA-53592

Destroyed proxy retains sensitive value payload · case 02

Destroyed proxy retains sensitive value payload.

Accessibility interaction semantics◈ Members↗
FA-53593

Destroyed proxy retains sensitive value payload · case 03

Destroyed proxy retains sensitive value payload.

Accessibility interaction semantics◈ Members↗
FA-53594

Destroyed proxy retains sensitive value payload · case 04

Destroyed proxy retains sensitive value payload.

Accessibility interaction semantics◈ Members↗
FA-53595

Destroyed proxy retains sensitive value payload · case 05

Destroyed proxy retains sensitive value payload.

Accessibility interaction semantics◈ Members↗
FA-53596

A value update resurrects data on a defunct proxy · case 01

A value update resurrects data on a defunct proxy.

Accessibility interaction semantics● Open access↗
FA-53597

A value update resurrects data on a defunct proxy · case 02

A value update resurrects data on a defunct proxy.

Accessibility interaction semantics◈ Members↗
FA-53598

A value update resurrects data on a defunct proxy · case 03

A value update resurrects data on a defunct proxy.

Accessibility interaction semantics◈ Members↗
FA-53599

A value update resurrects data on a defunct proxy · case 04

A value update resurrects data on a defunct proxy.

Accessibility interaction semantics◈ Members↗
FA-53600

A value update resurrects data on a defunct proxy · case 05

A value update resurrects data on a defunct proxy.

Accessibility interaction semantics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗