FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-54101

Deletion is reported as positive text growth · case 01

Deletion is reported as positive text growth.

Accessibility interaction semantics● Open access↗
FA-54102

Deletion is reported as positive text growth · case 02

Deletion is reported as positive text growth.

Accessibility interaction semantics◈ Members↗
FA-54103

Deletion is reported as positive text growth · case 03

Deletion is reported as positive text growth.

Accessibility interaction semantics◈ Members↗
FA-54104

Deletion is reported as positive text growth · case 04

Deletion is reported as positive text growth.

Accessibility interaction semantics◈ Members↗
FA-54105

Deletion is reported as positive text growth · case 05

Deletion is reported as positive text growth.

Accessibility interaction semantics◈ Members↗
FA-54106

Read-only text incorrectly blocks selection APIs · case 01

Read-only text incorrectly blocks selection APIs.

Accessibility interaction semantics● Open access↗
FA-54107

Read-only text incorrectly blocks selection APIs · case 02

Read-only text incorrectly blocks selection APIs.

Accessibility interaction semantics◈ Members↗
FA-54108

Read-only text incorrectly blocks selection APIs · case 03

Read-only text incorrectly blocks selection APIs.

Accessibility interaction semantics◈ Members↗
FA-54109

Read-only text incorrectly blocks selection APIs · case 04

Read-only text incorrectly blocks selection APIs.

Accessibility interaction semantics◈ Members↗
FA-54110

Read-only text incorrectly blocks selection APIs · case 05

Read-only text incorrectly blocks selection APIs.

Accessibility interaction semantics◈ Members↗
FA-54111

Selection API accepts a negative anchor · case 01

Selection API accepts a negative anchor.

Accessibility interaction semantics● Open access↗
FA-54112

Selection API accepts a negative anchor · case 02

Selection API accepts a negative anchor.

Accessibility interaction semantics◈ Members↗
FA-54113

Selection API accepts a negative anchor · case 03

Selection API accepts a negative anchor.

Accessibility interaction semantics◈ Members↗
FA-54114

Selection API accepts a negative anchor · case 04

Selection API accepts a negative anchor.

Accessibility interaction semantics◈ Members↗
FA-54115

Selection API accepts a negative anchor · case 05

Selection API accepts a negative anchor.

Accessibility interaction semantics◈ Members↗
FA-54116

Selection API accepts focus beyond text extent · case 01

Selection API accepts focus beyond text extent.

Accessibility interaction semantics● Open access↗
FA-54117

Selection API accepts focus beyond text extent · case 02

Selection API accepts focus beyond text extent.

Accessibility interaction semantics◈ Members↗
FA-54118

Selection API accepts focus beyond text extent · case 03

Selection API accepts focus beyond text extent.

Accessibility interaction semantics◈ Members↗
FA-54119

Selection API accepts focus beyond text extent · case 04

Selection API accepts focus beyond text extent.

Accessibility interaction semantics◈ Members↗
FA-54120

Selection API accepts focus beyond text extent · case 05

Selection API accepts focus beyond text extent.

Accessibility interaction semantics◈ Members↗
FA-54121

A caret at the text end is rejected · case 01

A caret at the text end is rejected.

Accessibility interaction semantics● Open access↗
FA-54122

A caret at the text end is rejected · case 02

A caret at the text end is rejected.

Accessibility interaction semantics◈ Members↗
FA-54123

A caret at the text end is rejected · case 03

A caret at the text end is rejected.

Accessibility interaction semantics◈ Members↗
FA-54124

A caret at the text end is rejected · case 04

A caret at the text end is rejected.

Accessibility interaction semantics◈ Members↗
FA-54125

A caret at the text end is rejected · case 05

A caret at the text end is rejected.

Accessibility interaction semantics◈ Members↗
FA-54126

Single-selection adapters append a second range · case 01

Single-selection adapters append a second range.

Accessibility interaction semantics● Open access↗
FA-54127

Single-selection adapters append a second range · case 02

Single-selection adapters append a second range.

Accessibility interaction semantics◈ Members↗
FA-54128

Single-selection adapters append a second range · case 03

Single-selection adapters append a second range.

Accessibility interaction semantics◈ Members↗
FA-54129

Single-selection adapters append a second range · case 04

Single-selection adapters append a second range.

Accessibility interaction semantics◈ Members↗
FA-54130

Single-selection adapters append a second range · case 05

Single-selection adapters append a second range.

Accessibility interaction semantics◈ Members↗
FA-54131

Reverse text selections lose their active end · case 01

Reverse text selections lose their active end.

Accessibility interaction semantics● Open access↗
FA-54132

Reverse text selections lose their active end · case 02

Reverse text selections lose their active end.

Accessibility interaction semantics◈ Members↗
FA-54133

Reverse text selections lose their active end · case 03

Reverse text selections lose their active end.

Accessibility interaction semantics◈ Members↗
FA-54134

Reverse text selections lose their active end · case 04

Reverse text selections lose their active end.

Accessibility interaction semantics◈ Members↗
FA-54135

Reverse text selections lose their active end · case 05

Reverse text selections lose their active end.

Accessibility interaction semantics◈ Members↗
FA-54136

Negative range indices replace the final selection · case 01

Negative range indices replace the final selection.

Accessibility interaction semantics● Open access↗
FA-54137

Negative range indices replace the final selection · case 02

Negative range indices replace the final selection.

Accessibility interaction semantics◈ Members↗
FA-54138

Negative range indices replace the final selection · case 03

Negative range indices replace the final selection.

Accessibility interaction semantics◈ Members↗
FA-54139

Negative range indices replace the final selection · case 04

Negative range indices replace the final selection.

Accessibility interaction semantics◈ Members↗
FA-54140

Negative range indices replace the final selection · case 05

Negative range indices replace the final selection.

Accessibility interaction semantics◈ Members↗
FA-54141

Removing one range clears every text selection · case 01

Removing one range clears every text selection.

Accessibility interaction semantics● Open access↗
FA-54142

Removing one range clears every text selection · case 02

Removing one range clears every text selection.

Accessibility interaction semantics◈ Members↗
FA-54143

Removing one range clears every text selection · case 03

Removing one range clears every text selection.

Accessibility interaction semantics◈ Members↗
FA-54144

Removing one range clears every text selection · case 04

Removing one range clears every text selection.

Accessibility interaction semantics◈ Members↗
FA-54145

Removing one range clears every text selection · case 05

Removing one range clears every text selection.

Accessibility interaction semantics◈ Members↗
FA-54146

Clearing selections unnecessarily validates stale endpoint arguments · case 01

Clearing selections unnecessarily validates stale endpoint arguments.

Accessibility interaction semantics● Open access↗
FA-54147

Clearing selections unnecessarily validates stale endpoint arguments · case 02

Clearing selections unnecessarily validates stale endpoint arguments.

Accessibility interaction semantics◈ Members↗
FA-54148

Clearing selections unnecessarily validates stale endpoint arguments · case 03

Clearing selections unnecessarily validates stale endpoint arguments.

Accessibility interaction semantics◈ Members↗
FA-54149

Clearing selections unnecessarily validates stale endpoint arguments · case 04

Clearing selections unnecessarily validates stale endpoint arguments.

Accessibility interaction semantics◈ Members↗
FA-54150

Clearing selections unnecessarily validates stale endpoint arguments · case 05

Clearing selections unnecessarily validates stale endpoint arguments.

Accessibility interaction semantics◈ Members↗
FA-54151

Text API reports anchor as active selection position · case 01

Text API reports anchor as active selection position.

Accessibility interaction semantics● Open access↗
FA-54152

Text API reports anchor as active selection position · case 02

Text API reports anchor as active selection position.

Accessibility interaction semantics◈ Members↗
FA-54153

Text API reports anchor as active selection position · case 03

Text API reports anchor as active selection position.

Accessibility interaction semantics◈ Members↗
FA-54154

Text API reports anchor as active selection position · case 04

Text API reports anchor as active selection position.

Accessibility interaction semantics◈ Members↗
FA-54155

Text API reports anchor as active selection position · case 05

Text API reports anchor as active selection position.

Accessibility interaction semantics◈ Members↗
FA-54156

Unrecognized annotation kinds cross the accessibility bridge · case 01

Unrecognized annotation kinds cross the accessibility bridge.

Accessibility interaction semantics● Open access↗
FA-54157

Unrecognized annotation kinds cross the accessibility bridge · case 02

Unrecognized annotation kinds cross the accessibility bridge.

Accessibility interaction semantics◈ Members↗
FA-54158

Unrecognized annotation kinds cross the accessibility bridge · case 03

Unrecognized annotation kinds cross the accessibility bridge.

Accessibility interaction semantics◈ Members↗
FA-54159

Unrecognized annotation kinds cross the accessibility bridge · case 04

Unrecognized annotation kinds cross the accessibility bridge.

Accessibility interaction semantics◈ Members↗
FA-54160

Unrecognized annotation kinds cross the accessibility bridge · case 05

Unrecognized annotation kinds cross the accessibility bridge.

Accessibility interaction semantics◈ Members↗
FA-54161

Annotation queries ignore the requested type mask · case 01

Annotation queries ignore the requested type mask.

Accessibility interaction semantics● Open access↗
FA-54162

Annotation queries ignore the requested type mask · case 02

Annotation queries ignore the requested type mask.

Accessibility interaction semantics◈ Members↗
FA-54163

Annotation queries ignore the requested type mask · case 03

Annotation queries ignore the requested type mask.

Accessibility interaction semantics◈ Members↗
FA-54164

Annotation queries ignore the requested type mask · case 04

Annotation queries ignore the requested type mask.

Accessibility interaction semantics◈ Members↗
FA-54165

Annotation queries ignore the requested type mask · case 05

Annotation queries ignore the requested type mask.

Accessibility interaction semantics◈ Members↗
FA-54166

Resolved comments remain in active annotation queries · case 01

Resolved comments remain in active annotation queries.

Accessibility interaction semantics● Open access↗
FA-54167

Resolved comments remain in active annotation queries · case 02

Resolved comments remain in active annotation queries.

Accessibility interaction semantics◈ Members↗
FA-54168

Resolved comments remain in active annotation queries · case 03

Resolved comments remain in active annotation queries.

Accessibility interaction semantics◈ Members↗
FA-54169

Resolved comments remain in active annotation queries · case 04

Resolved comments remain in active annotation queries.

Accessibility interaction semantics◈ Members↗
FA-54170

Resolved comments remain in active annotation queries · case 05

Resolved comments remain in active annotation queries.

Accessibility interaction semantics◈ Members↗
FA-54171

Nameless annotation markers enter text attribute ranges · case 01

Nameless annotation markers enter text attribute ranges.

Accessibility interaction semantics● Open access↗
FA-54172

Nameless annotation markers enter text attribute ranges · case 02

Nameless annotation markers enter text attribute ranges.

Accessibility interaction semantics◈ Members↗
FA-54173

Nameless annotation markers enter text attribute ranges · case 03

Nameless annotation markers enter text attribute ranges.

Accessibility interaction semantics◈ Members↗
FA-54174

Nameless annotation markers enter text attribute ranges · case 04

Nameless annotation markers enter text attribute ranges.

Accessibility interaction semantics◈ Members↗
FA-54175

Nameless annotation markers enter text attribute ranges · case 05

Nameless annotation markers enter text attribute ranges.

Accessibility interaction semantics◈ Members↗
FA-54176

Annotation endpoints extend beyond accessible text · case 01

Annotation endpoints extend beyond accessible text.

Accessibility interaction semantics● Open access↗
FA-54177

Annotation endpoints extend beyond accessible text · case 02

Annotation endpoints extend beyond accessible text.

Accessibility interaction semantics◈ Members↗
FA-54178

Annotation endpoints extend beyond accessible text · case 03

Annotation endpoints extend beyond accessible text.

Accessibility interaction semantics◈ Members↗
FA-54179

Annotation endpoints extend beyond accessible text · case 04

Annotation endpoints extend beyond accessible text.

Accessibility interaction semantics◈ Members↗
FA-54180

Annotation endpoints extend beyond accessible text · case 05

Annotation endpoints extend beyond accessible text.

Accessibility interaction semantics◈ Members↗
FA-54181

Zero-width annotations are exposed as text spans · case 01

Zero-width annotations are exposed as text spans.

Accessibility interaction semantics● Open access↗
FA-54182

Zero-width annotations are exposed as text spans · case 02

Zero-width annotations are exposed as text spans.

Accessibility interaction semantics◈ Members↗
FA-54183

Zero-width annotations are exposed as text spans · case 03

Zero-width annotations are exposed as text spans.

Accessibility interaction semantics◈ Members↗
FA-54184

Zero-width annotations are exposed as text spans · case 04

Zero-width annotations are exposed as text spans.

Accessibility interaction semantics◈ Members↗
FA-54185

Zero-width annotations are exposed as text spans · case 05

Zero-width annotations are exposed as text spans.

Accessibility interaction semantics◈ Members↗
FA-54186

Annotation ID collisions produce ambiguous descriptors · case 01

Annotation ID collisions produce ambiguous descriptors.

Accessibility interaction semantics● Open access↗
FA-54187

Annotation ID collisions produce ambiguous descriptors · case 02

Annotation ID collisions produce ambiguous descriptors.

Accessibility interaction semantics◈ Members↗
FA-54188

Annotation ID collisions produce ambiguous descriptors · case 03

Annotation ID collisions produce ambiguous descriptors.

Accessibility interaction semantics◈ Members↗
FA-54189

Annotation ID collisions produce ambiguous descriptors · case 04

Annotation ID collisions produce ambiguous descriptors.

Accessibility interaction semantics◈ Members↗
FA-54190

Annotation ID collisions produce ambiguous descriptors · case 05

Annotation ID collisions produce ambiguous descriptors.

Accessibility interaction semantics◈ Members↗
FA-54191

Annotation results use identifier order instead of text order · case 01

Annotation results use identifier order instead of text order.

Accessibility interaction semantics● Open access↗
FA-54192

Annotation results use identifier order instead of text order · case 02

Annotation results use identifier order instead of text order.

Accessibility interaction semantics◈ Members↗
FA-54193

Annotation results use identifier order instead of text order · case 03

Annotation results use identifier order instead of text order.

Accessibility interaction semantics◈ Members↗
FA-54194

Annotation results use identifier order instead of text order · case 04

Annotation results use identifier order instead of text order.

Accessibility interaction semantics◈ Members↗
FA-54195

Annotation results use identifier order instead of text order · case 05

Annotation results use identifier order instead of text order.

Accessibility interaction semantics◈ Members↗
FA-54196

Annotation descriptors return internal kind in the explanation channel · case 01

Annotation descriptors return internal kind in the explanation channel.

Accessibility interaction semantics● Open access↗
FA-54197

Annotation descriptors return internal kind in the explanation channel · case 02

Annotation descriptors return internal kind in the explanation channel.

Accessibility interaction semantics◈ Members↗
FA-54198

Annotation descriptors return internal kind in the explanation channel · case 03

Annotation descriptors return internal kind in the explanation channel.

Accessibility interaction semantics◈ Members↗
FA-54199

Annotation descriptors return internal kind in the explanation channel · case 04

Annotation descriptors return internal kind in the explanation channel.

Accessibility interaction semantics◈ Members↗
FA-54200

Annotation descriptors return internal kind in the explanation channel · case 05

Annotation descriptors return internal kind in the explanation channel.

Accessibility interaction semantics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗