FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-24301

Client generated-file delivery state: File assembly part order · case 01

File assembly part order.

Client state● Open access↗
FA-24302

Client generated-file delivery state: File assembly part order · case 02

File assembly part order.

Client state◈ Members↗
FA-24303

Client generated-file delivery state: File assembly part order · case 03

File assembly part order.

Client state◈ Members↗
FA-24304

Client generated-file delivery state: File assembly part order · case 04

File assembly part order.

Client state◈ Members↗
FA-24305

Client generated-file delivery state: File assembly part order · case 05

File assembly part order.

Client state◈ Members↗
FA-24306

Client generated-file delivery state: Save requires current gesture · case 01

Save requires current gesture.

Client state● Open access↗
FA-24307

Client generated-file delivery state: Save requires current gesture · case 02

Save requires current gesture.

Client state◈ Members↗
FA-24308

Client generated-file delivery state: Save requires current gesture · case 03

Save requires current gesture.

Client state◈ Members↗
FA-24309

Client generated-file delivery state: Save requires current gesture · case 04

Save requires current gesture.

Client state◈ Members↗
FA-24310

Client generated-file delivery state: Save requires current gesture · case 05

Save requires current gesture.

Client state◈ Members↗
FA-24311

Client generated-file delivery state: Size mismatch error · case 01

Size mismatch error.

Client state● Open access↗
FA-24312

Client generated-file delivery state: Size mismatch error · case 02

Size mismatch error.

Client state◈ Members↗
FA-24313

Client generated-file delivery state: Size mismatch error · case 03

Size mismatch error.

Client state◈ Members↗
FA-24314

Client generated-file delivery state: Size mismatch error · case 04

Size mismatch error.

Client state◈ Members↗
FA-24315

Client generated-file delivery state: Size mismatch error · case 05

Size mismatch error.

Client state◈ Members↗
FA-24316

Client generated-file delivery state: Blob reader reference release · case 01

Blob reader reference release.

Client state● Open access↗
FA-24317

Client generated-file delivery state: Blob reader reference release · case 02

Blob reader reference release.

Client state◈ Members↗
FA-24318

Client generated-file delivery state: Blob reader reference release · case 03

Blob reader reference release.

Client state◈ Members↗
FA-24319

Client generated-file delivery state: Blob reader reference release · case 04

Blob reader reference release.

Client state◈ Members↗
FA-24320

Client generated-file delivery state: Blob reader reference release · case 05

Blob reader reference release.

Client state◈ Members↗
FA-24321

Client generated-file delivery state: Download action status · case 01

Download action status.

Client state● Open access↗
FA-24322

Client generated-file delivery state: Download action status · case 02

Download action status.

Client state◈ Members↗
FA-24323

Client generated-file delivery state: Download action status · case 03

Download action status.

Client state◈ Members↗
FA-24324

Client generated-file delivery state: Download action status · case 04

Download action status.

Client state◈ Members↗
FA-24325

Client generated-file delivery state: Download action status · case 05

Download action status.

Client state◈ Members↗
FA-24326

Client generated-file delivery state: Missing part display · case 01

Missing part display.

Client state● Open access↗
FA-24327

Client generated-file delivery state: Missing part display · case 02

Missing part display.

Client state◈ Members↗
FA-24328

Client generated-file delivery state: Missing part display · case 03

Missing part display.

Client state◈ Members↗
FA-24329

Client generated-file delivery state: Missing part display · case 04

Missing part display.

Client state◈ Members↗
FA-24330

Client generated-file delivery state: Missing part display · case 05

Missing part display.

Client state◈ Members↗
FA-24331

Client generated-file delivery state: Remaining download bytes · case 01

Remaining download bytes.

Client state● Open access↗
FA-24332

Client generated-file delivery state: Remaining download bytes · case 02

Remaining download bytes.

Client state◈ Members↗
FA-24333

Client generated-file delivery state: Remaining download bytes · case 03

Remaining download bytes.

Client state◈ Members↗
FA-24334

Client generated-file delivery state: Remaining download bytes · case 04

Remaining download bytes.

Client state◈ Members↗
FA-24335

Client generated-file delivery state: Remaining download bytes · case 05

Remaining download bytes.

Client state◈ Members↗
FA-24336

Client generated-file delivery state: Complete empty download · case 01

Complete empty download.

Client state● Open access↗
FA-24337

Client generated-file delivery state: Complete empty download · case 02

Complete empty download.

Client state◈ Members↗
FA-24338

Client generated-file delivery state: Complete empty download · case 03

Complete empty download.

Client state◈ Members↗
FA-24339

Client generated-file delivery state: Complete empty download · case 04

Complete empty download.

Client state◈ Members↗
FA-24340

Client generated-file delivery state: Complete empty download · case 05

Complete empty download.

Client state◈ Members↗
FA-24341

Editor autosave revision reconciliation: Acknowledge sent revision · case 01

Acknowledge sent revision.

Client state● Open access↗
FA-24342

Editor autosave revision reconciliation: Acknowledge sent revision · case 02

Acknowledge sent revision.

Client state◈ Members↗
FA-24343

Editor autosave revision reconciliation: Acknowledge sent revision · case 03

Acknowledge sent revision.

Client state◈ Members↗
FA-24344

Editor autosave revision reconciliation: Acknowledge sent revision · case 04

Acknowledge sent revision.

Client state◈ Members↗
FA-24345

Editor autosave revision reconciliation: Acknowledge sent revision · case 05

Acknowledge sent revision.

Client state◈ Members↗
FA-24346

Editor autosave revision reconciliation: Newer edit retains dirty · case 01

Newer edit retains dirty.

Client state● Open access↗
FA-24347

Editor autosave revision reconciliation: Newer edit retains dirty · case 02

Newer edit retains dirty.

Client state◈ Members↗
FA-24348

Editor autosave revision reconciliation: Newer edit retains dirty · case 03

Newer edit retains dirty.

Client state◈ Members↗
FA-24349

Editor autosave revision reconciliation: Newer edit retains dirty · case 04

Newer edit retains dirty.

Client state◈ Members↗
FA-24350

Editor autosave revision reconciliation: Newer edit retains dirty · case 05

Newer edit retains dirty.

Client state◈ Members↗
FA-24351

Editor autosave revision reconciliation: Composition defers save · case 01

Composition defers save.

Client state● Open access↗
FA-24352

Editor autosave revision reconciliation: Composition defers save · case 02

Composition defers save.

Client state◈ Members↗
FA-24353

Editor autosave revision reconciliation: Composition defers save · case 03

Composition defers save.

Client state◈ Members↗
FA-24354

Editor autosave revision reconciliation: Composition defers save · case 04

Composition defers save.

Client state◈ Members↗
FA-24355

Editor autosave revision reconciliation: Composition defers save · case 05

Composition defers save.

Client state◈ Members↗
FA-24356

Editor autosave revision reconciliation: Save completion status · case 01

Save completion status.

Client state● Open access↗
FA-24357

Editor autosave revision reconciliation: Save completion status · case 02

Save completion status.

Client state◈ Members↗
FA-24358

Editor autosave revision reconciliation: Save completion status · case 03

Save completion status.

Client state◈ Members↗
FA-24359

Editor autosave revision reconciliation: Save completion status · case 04

Save completion status.

Client state◈ Members↗
FA-24360

Editor autosave revision reconciliation: Save completion status · case 05

Save completion status.

Client state◈ Members↗
FA-24361

Editor autosave revision reconciliation: Next save revision · case 01

Next save revision.

Client state● Open access↗
FA-24362

Editor autosave revision reconciliation: Next save revision · case 02

Next save revision.

Client state◈ Members↗
FA-24363

Editor autosave revision reconciliation: Next save revision · case 03

Next save revision.

Client state◈ Members↗
FA-24364

Editor autosave revision reconciliation: Next save revision · case 04

Next save revision.

Client state◈ Members↗
FA-24365

Editor autosave revision reconciliation: Next save revision · case 05

Next save revision.

Client state◈ Members↗
FA-24366

Editor autosave revision reconciliation: Unsent field difference · case 01

Unsent field difference.

Client state● Open access↗
FA-24367

Editor autosave revision reconciliation: Unsent field difference · case 02

Unsent field difference.

Client state◈ Members↗
FA-24368

Editor autosave revision reconciliation: Unsent field difference · case 03

Unsent field difference.

Client state◈ Members↗
FA-24369

Editor autosave revision reconciliation: Unsent field difference · case 04

Unsent field difference.

Client state◈ Members↗
FA-24370

Editor autosave revision reconciliation: Unsent field difference · case 05

Unsent field difference.

Client state◈ Members↗
FA-24371

Editor autosave revision reconciliation: Conflict preserves local fields · case 01

Conflict preserves local fields.

Client state● Open access↗
FA-24372

Editor autosave revision reconciliation: Conflict preserves local fields · case 02

Conflict preserves local fields.

Client state◈ Members↗
FA-24373

Editor autosave revision reconciliation: Conflict preserves local fields · case 03

Conflict preserves local fields.

Client state◈ Members↗
FA-24374

Editor autosave revision reconciliation: Conflict preserves local fields · case 04

Conflict preserves local fields.

Client state◈ Members↗
FA-24375

Editor autosave revision reconciliation: Conflict preserves local fields · case 05

Conflict preserves local fields.

Client state◈ Members↗
FA-24376

Editor autosave revision reconciliation: Unacknowledged edit distance · case 01

Unacknowledged edit distance.

Client state● Open access↗
FA-24377

Editor autosave revision reconciliation: Unacknowledged edit distance · case 02

Unacknowledged edit distance.

Client state◈ Members↗
FA-24378

Editor autosave revision reconciliation: Unacknowledged edit distance · case 03

Unacknowledged edit distance.

Client state◈ Members↗
FA-24379

Editor autosave revision reconciliation: Unacknowledged edit distance · case 04

Unacknowledged edit distance.

Client state◈ Members↗
FA-24380

Editor autosave revision reconciliation: Unacknowledged edit distance · case 05

Unacknowledged edit distance.

Client state◈ Members↗
FA-24381

Editor autosave revision reconciliation: Resave after ack · case 01

Resave after ack.

Client state● Open access↗
FA-24382

Editor autosave revision reconciliation: Resave after ack · case 02

Resave after ack.

Client state◈ Members↗
FA-24383

Editor autosave revision reconciliation: Resave after ack · case 03

Resave after ack.

Client state◈ Members↗
FA-24384

Editor autosave revision reconciliation: Resave after ack · case 04

Resave after ack.

Client state◈ Members↗
FA-24385

Editor autosave revision reconciliation: Resave after ack · case 05

Resave after ack.

Client state◈ Members↗
FA-24386

Client attachment resource ownership: Remove by file identity · case 01

Remove by file identity.

Client state● Open access↗
FA-24387

Client attachment resource ownership: Remove by file identity · case 02

Remove by file identity.

Client state◈ Members↗
FA-24388

Client attachment resource ownership: Remove by file identity · case 03

Remove by file identity.

Client state◈ Members↗
FA-24389

Client attachment resource ownership: Remove by file identity · case 04

Remove by file identity.

Client state◈ Members↗
FA-24390

Client attachment resource ownership: Remove by file identity · case 05

Remove by file identity.

Client state◈ Members↗
FA-24391

Client attachment resource ownership: Duplicate filenames kept · case 01

Duplicate filenames kept.

Client state● Open access↗
FA-24392

Client attachment resource ownership: Duplicate filenames kept · case 02

Duplicate filenames kept.

Client state◈ Members↗
FA-24393

Client attachment resource ownership: Duplicate filenames kept · case 03

Duplicate filenames kept.

Client state◈ Members↗
FA-24394

Client attachment resource ownership: Duplicate filenames kept · case 04

Duplicate filenames kept.

Client state◈ Members↗
FA-24395

Client attachment resource ownership: Duplicate filenames kept · case 05

Duplicate filenames kept.

Client state◈ Members↗
FA-24396

Client attachment resource ownership: Removed preview release · case 01

Removed preview release.

Client state● Open access↗
FA-24397

Client attachment resource ownership: Removed preview release · case 02

Removed preview release.

Client state◈ Members↗
FA-24398

Client attachment resource ownership: Removed preview release · case 03

Removed preview release.

Client state◈ Members↗
FA-24399

Client attachment resource ownership: Removed preview release · case 04

Removed preview release.

Client state◈ Members↗
FA-24400

Client attachment resource ownership: Removed preview release · case 05

Removed preview release.

Client state◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗