FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-26201

Effective filtering retains all drilldown ancestor constraints · case 01

Effective filtering retains all drilldown ancestor constraints is violated by the widget projection.

Filter interfaces● Open access↗
FA-26202

Effective filtering retains all drilldown ancestor constraints · case 02

Effective filtering retains all drilldown ancestor constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26203

Effective filtering retains all drilldown ancestor constraints · case 03

Effective filtering retains all drilldown ancestor constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26204

Effective filtering retains all drilldown ancestor constraints · case 04

Effective filtering retains all drilldown ancestor constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26205

Effective filtering retains all drilldown ancestor constraints · case 05

Effective filtering retains all drilldown ancestor constraints is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26206

A new drilldown after backing up replaces the abandoned trail suffix · case 01

A new drilldown after backing up replaces the abandoned trail suffix is violated by the widget projection.

Filter interfaces● Open access↗
FA-26207

A new drilldown after backing up replaces the abandoned trail suffix · case 02

A new drilldown after backing up replaces the abandoned trail suffix is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26208

A new drilldown after backing up replaces the abandoned trail suffix · case 03

A new drilldown after backing up replaces the abandoned trail suffix is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26209

A new drilldown after backing up replaces the abandoned trail suffix · case 04

A new drilldown after backing up replaces the abandoned trail suffix is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26210

A new drilldown after backing up replaces the abandoned trail suffix · case 05

A new drilldown after backing up replaces the abandoned trail suffix is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26211

The active breadcrumb identifies the final actual drilldown step · case 01

The active breadcrumb identifies the final actual drilldown step is violated by the widget projection.

Filter interfaces● Open access↗
FA-26212

The active breadcrumb identifies the final actual drilldown step · case 02

The active breadcrumb identifies the final actual drilldown step is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26213

The active breadcrumb identifies the final actual drilldown step · case 03

The active breadcrumb identifies the final actual drilldown step is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26214

The active breadcrumb identifies the final actual drilldown step · case 04

The active breadcrumb identifies the final actual drilldown step is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26215

The active breadcrumb identifies the final actual drilldown step · case 05

The active breadcrumb identifies the final actual drilldown step is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26216

Drilldown depth counts ordered steps including repeated field criteria · case 01

Drilldown depth counts ordered steps including repeated field criteria is violated by the widget projection.

Filter interfaces● Open access↗
FA-26217

Drilldown depth counts ordered steps including repeated field criteria · case 02

Drilldown depth counts ordered steps including repeated field criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26218

Drilldown depth counts ordered steps including repeated field criteria · case 03

Drilldown depth counts ordered steps including repeated field criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26219

Drilldown depth counts ordered steps including repeated field criteria · case 04

Drilldown depth counts ordered steps including repeated field criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26220

Drilldown depth counts ordered steps including repeated field criteria · case 05

Drilldown depth counts ordered steps including repeated field criteria is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26221

View application honors replace versus overlay intent · case 01

View application honors replace versus overlay intent is violated by the widget projection.

Filter interfaces● Open access↗
FA-26222

View application honors replace versus overlay intent · case 02

View application honors replace versus overlay intent is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26223

View application honors replace versus overlay intent · case 03

View application honors replace versus overlay intent is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26224

View application honors replace versus overlay intent · case 04

View application honors replace versus overlay intent is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26225

View application honors replace versus overlay intent · case 05

View application honors replace versus overlay intent is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26226

Saved-view criteria cannot erase same-field enforced scope · case 01

Saved-view criteria cannot erase same-field enforced scope is violated by the widget projection.

Filter interfaces● Open access↗
FA-26227

Saved-view criteria cannot erase same-field enforced scope · case 02

Saved-view criteria cannot erase same-field enforced scope is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26228

Saved-view criteria cannot erase same-field enforced scope · case 03

Saved-view criteria cannot erase same-field enforced scope is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26229

Saved-view criteria cannot erase same-field enforced scope · case 04

Saved-view criteria cannot erase same-field enforced scope is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26230

Saved-view criteria cannot erase same-field enforced scope · case 05

Saved-view criteria cannot erase same-field enforced scope is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26231

Overlaying a view records mixed filter provenance · case 01

Overlaying a view records mixed filter provenance is violated by the widget projection.

Filter interfaces● Open access↗
FA-26232

Overlaying a view records mixed filter provenance · case 02

Overlaying a view records mixed filter provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26233

Overlaying a view records mixed filter provenance · case 03

Overlaying a view records mixed filter provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26234

Overlaying a view records mixed filter provenance · case 04

Overlaying a view records mixed filter provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26235

Overlaying a view records mixed filter provenance · case 05

Overlaying a view records mixed filter provenance is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26236

Overlay preserves hidden current criteria while replacement clears them · case 01

Overlay preserves hidden current criteria while replacement clears them is violated by the widget projection.

Filter interfaces● Open access↗
FA-26237

Overlay preserves hidden current criteria while replacement clears them · case 02

Overlay preserves hidden current criteria while replacement clears them is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26238

Overlay preserves hidden current criteria while replacement clears them · case 03

Overlay preserves hidden current criteria while replacement clears them is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26239

Overlay preserves hidden current criteria while replacement clears them · case 04

Overlay preserves hidden current criteria while replacement clears them is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26240

Overlay preserves hidden current criteria while replacement clears them · case 05

Overlay preserves hidden current criteria while replacement clears them is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26241

Saved view overlay follows each field keep replace or append policy · case 01

Saved view overlay follows each field keep replace or append policy is violated by the widget projection.

Filter interfaces● Open access↗
FA-26242

Saved view overlay follows each field keep replace or append policy · case 02

Saved view overlay follows each field keep replace or append policy is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26243

Saved view overlay follows each field keep replace or append policy · case 03

Saved view overlay follows each field keep replace or append policy is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26244

Saved view overlay follows each field keep replace or append policy · case 04

Saved view overlay follows each field keep replace or append policy is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26245

Saved view overlay follows each field keep replace or append policy · case 05

Saved view overlay follows each field keep replace or append policy is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26246

Effective view summaries count enforced and user constraints separately · case 01

Effective view summaries count enforced and user constraints separately is violated by the widget projection.

Filter interfaces● Open access↗
FA-26247

Effective view summaries count enforced and user constraints separately · case 02

Effective view summaries count enforced and user constraints separately is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26248

Effective view summaries count enforced and user constraints separately · case 03

Effective view summaries count enforced and user constraints separately is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26249

Effective view summaries count enforced and user constraints separately · case 04

Effective view summaries count enforced and user constraints separately is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26250

Effective view summaries count enforced and user constraints separately · case 05

Effective view summaries count enforced and user constraints separately is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26251

Reverse histogram drags normalize their endpoint order · case 01

Reverse histogram drags normalize their endpoint order is violated by the widget projection.

Filter interfaces● Open access↗
FA-26252

Reverse histogram drags normalize their endpoint order · case 02

Reverse histogram drags normalize their endpoint order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26253

Reverse histogram drags normalize their endpoint order · case 03

Reverse histogram drags normalize their endpoint order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26254

Reverse histogram drags normalize their endpoint order · case 04

Reverse histogram drags normalize their endpoint order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26255

Reverse histogram drags normalize their endpoint order · case 05

Reverse histogram drags normalize their endpoint order is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26256

Brush overlap excludes touching-only buckets and includes partially intersected ones · case 01

Brush overlap excludes touching-only buckets and includes partially intersected ones is violated by the widget projection.

Filter interfaces● Open access↗
FA-26257

Brush overlap excludes touching-only buckets and includes partially intersected ones · case 02

Brush overlap excludes touching-only buckets and includes partially intersected ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26258

Brush overlap excludes touching-only buckets and includes partially intersected ones · case 03

Brush overlap excludes touching-only buckets and includes partially intersected ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26259

Brush overlap excludes touching-only buckets and includes partially intersected ones · case 04

Brush overlap excludes touching-only buckets and includes partially intersected ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26260

Brush overlap excludes touching-only buckets and includes partially intersected ones · case 05

Brush overlap excludes touching-only buckets and includes partially intersected ones is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26261

Only zero-width histogram gestures are treated as clicks · case 01

Only zero-width histogram gestures are treated as clicks is violated by the widget projection.

Filter interfaces● Open access↗
FA-26262

Only zero-width histogram gestures are treated as clicks · case 02

Only zero-width histogram gestures are treated as clicks is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26263

Only zero-width histogram gestures are treated as clicks · case 03

Only zero-width histogram gestures are treated as clicks is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26264

Only zero-width histogram gestures are treated as clicks · case 04

Only zero-width histogram gestures are treated as clicks is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26265

Only zero-width histogram gestures are treated as clicks · case 05

Only zero-width histogram gestures are treated as clicks is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26266

Brush lower bounds clamp to the domain after drag normalization · case 01

Brush lower bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces● Open access↗
FA-26267

Brush lower bounds clamp to the domain after drag normalization · case 02

Brush lower bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26268

Brush lower bounds clamp to the domain after drag normalization · case 03

Brush lower bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26269

Brush lower bounds clamp to the domain after drag normalization · case 04

Brush lower bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26270

Brush lower bounds clamp to the domain after drag normalization · case 05

Brush lower bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26271

Brush upper bounds clamp to the domain after drag normalization · case 01

Brush upper bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces● Open access↗
FA-26272

Brush upper bounds clamp to the domain after drag normalization · case 02

Brush upper bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26273

Brush upper bounds clamp to the domain after drag normalization · case 03

Brush upper bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26274

Brush upper bounds clamp to the domain after drag normalization · case 04

Brush upper bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26275

Brush upper bounds clamp to the domain after drag normalization · case 05

Brush upper bounds clamp to the domain after drag normalization is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26276

Histogram filters commit only on release of a nonempty brush · case 01

Histogram filters commit only on release of a nonempty brush is violated by the widget projection.

Filter interfaces● Open access↗
FA-26277

Histogram filters commit only on release of a nonempty brush · case 02

Histogram filters commit only on release of a nonempty brush is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26278

Histogram filters commit only on release of a nonempty brush · case 03

Histogram filters commit only on release of a nonempty brush is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26279

Histogram filters commit only on release of a nonempty brush · case 04

Histogram filters commit only on release of a nonempty brush is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26280

Histogram filters commit only on release of a nonempty brush · case 05

Histogram filters commit only on release of a nonempty brush is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26281

Collection filter summaries preserve quantifier meaning · case 01

Collection filter summaries preserve quantifier meaning is violated by the widget projection.

Filter interfaces● Open access↗
FA-26282

Collection filter summaries preserve quantifier meaning · case 02

Collection filter summaries preserve quantifier meaning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26283

Collection filter summaries preserve quantifier meaning · case 03

Collection filter summaries preserve quantifier meaning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26284

Collection filter summaries preserve quantifier meaning · case 04

Collection filter summaries preserve quantifier meaning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26285

Collection filter summaries preserve quantifier meaning · case 05

Collection filter summaries preserve quantifier meaning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26286

No-element matching still has operands while empty and missing modes do not · case 01

No-element matching still has operands while empty and missing modes do not is violated by the widget projection.

Filter interfaces● Open access↗
FA-26287

No-element matching still has operands while empty and missing modes do not · case 02

No-element matching still has operands while empty and missing modes do not is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26288

No-element matching still has operands while empty and missing modes do not · case 03

No-element matching still has operands while empty and missing modes do not is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26289

No-element matching still has operands while empty and missing modes do not · case 04

No-element matching still has operands while empty and missing modes do not is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26290

No-element matching still has operands while empty and missing modes do not · case 05

No-element matching still has operands while empty and missing modes do not is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26291

Unary collection predicates discard element-value payloads · case 01

Unary collection predicates discard element-value payloads is violated by the widget projection.

Filter interfaces● Open access↗
FA-26292

Unary collection predicates discard element-value payloads · case 02

Unary collection predicates discard element-value payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26293

Unary collection predicates discard element-value payloads · case 03

Unary collection predicates discard element-value payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26294

Unary collection predicates discard element-value payloads · case 04

Unary collection predicates discard element-value payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26295

Unary collection predicates discard element-value payloads · case 05

Unary collection predicates discard element-value payloads is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26296

Empty all-element constraints receive their explicit vacuity warning · case 01

Empty all-element constraints receive their explicit vacuity warning is violated by the widget projection.

Filter interfaces● Open access↗
FA-26297

Empty all-element constraints receive their explicit vacuity warning · case 02

Empty all-element constraints receive their explicit vacuity warning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26298

Empty all-element constraints receive their explicit vacuity warning · case 03

Empty all-element constraints receive their explicit vacuity warning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26299

Empty all-element constraints receive their explicit vacuity warning · case 04

Empty all-element constraints receive their explicit vacuity warning is violated by the widget projection.

Filter interfaces◈ Members↗
FA-26300

Empty all-element constraints receive their explicit vacuity warning · case 05

Empty all-element constraints receive their explicit vacuity warning is violated by the widget projection.

Filter interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗