FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-36301

Comparison tab pair: left comparison binding · case 01

The tab workspace reports an incorrect left comparison binding.

Tab interfaces● Open access↗
FA-36302

Comparison tab pair: left comparison binding · case 02

The tab workspace reports an incorrect left comparison binding.

Tab interfaces◈ Members↗
FA-36303

Comparison tab pair: left comparison binding · case 03

The tab workspace reports an incorrect left comparison binding.

Tab interfaces◈ Members↗
FA-36304

Comparison tab pair: left comparison binding · case 04

The tab workspace reports an incorrect left comparison binding.

Tab interfaces◈ Members↗
FA-36305

Comparison tab pair: left comparison binding · case 05

The tab workspace reports an incorrect left comparison binding.

Tab interfaces◈ Members↗
FA-36306

Comparison tab pair: right comparison binding · case 01

The tab workspace reports an incorrect right comparison binding.

Tab interfaces● Open access↗
FA-36307

Comparison tab pair: right comparison binding · case 02

The tab workspace reports an incorrect right comparison binding.

Tab interfaces◈ Members↗
FA-36308

Comparison tab pair: right comparison binding · case 03

The tab workspace reports an incorrect right comparison binding.

Tab interfaces◈ Members↗
FA-36309

Comparison tab pair: right comparison binding · case 04

The tab workspace reports an incorrect right comparison binding.

Tab interfaces◈ Members↗
FA-36310

Comparison tab pair: right comparison binding · case 05

The tab workspace reports an incorrect right comparison binding.

Tab interfaces◈ Members↗
FA-36311

Comparison tab pair: direction label · case 01

The tab workspace reports an incorrect direction label.

Tab interfaces● Open access↗
FA-36312

Comparison tab pair: direction label · case 02

The tab workspace reports an incorrect direction label.

Tab interfaces◈ Members↗
FA-36313

Comparison tab pair: direction label · case 03

The tab workspace reports an incorrect direction label.

Tab interfaces◈ Members↗
FA-36314

Comparison tab pair: direction label · case 04

The tab workspace reports an incorrect direction label.

Tab interfaces◈ Members↗
FA-36315

Comparison tab pair: direction label · case 05

The tab workspace reports an incorrect direction label.

Tab interfaces◈ Members↗
FA-36316

Comparison tab pair: revision sensitive identity · case 01

The tab workspace reports an incorrect revision sensitive identity.

Tab interfaces● Open access↗
FA-36317

Comparison tab pair: revision sensitive identity · case 02

The tab workspace reports an incorrect revision sensitive identity.

Tab interfaces◈ Members↗
FA-36318

Comparison tab pair: revision sensitive identity · case 03

The tab workspace reports an incorrect revision sensitive identity.

Tab interfaces◈ Members↗
FA-36319

Comparison tab pair: revision sensitive identity · case 04

The tab workspace reports an incorrect revision sensitive identity.

Tab interfaces◈ Members↗
FA-36320

Comparison tab pair: revision sensitive identity · case 05

The tab workspace reports an incorrect revision sensitive identity.

Tab interfaces◈ Members↗
FA-36321

Comparison tab pair: right edit affordance · case 01

The tab workspace reports an incorrect right edit affordance.

Tab interfaces● Open access↗
FA-36322

Comparison tab pair: right edit affordance · case 02

The tab workspace reports an incorrect right edit affordance.

Tab interfaces◈ Members↗
FA-36323

Comparison tab pair: right edit affordance · case 03

The tab workspace reports an incorrect right edit affordance.

Tab interfaces◈ Members↗
FA-36324

Comparison tab pair: right edit affordance · case 04

The tab workspace reports an incorrect right edit affordance.

Tab interfaces◈ Members↗
FA-36325

Comparison tab pair: right edit affordance · case 05

The tab workspace reports an incorrect right edit affordance.

Tab interfaces◈ Members↗
FA-36326

Comparison tab pair: identical version shortcut · case 01

The tab workspace reports an incorrect identical version shortcut.

Tab interfaces● Open access↗
FA-36327

Comparison tab pair: identical version shortcut · case 02

The tab workspace reports an incorrect identical version shortcut.

Tab interfaces◈ Members↗
FA-36328

Comparison tab pair: identical version shortcut · case 03

The tab workspace reports an incorrect identical version shortcut.

Tab interfaces◈ Members↗
FA-36329

Comparison tab pair: identical version shortcut · case 04

The tab workspace reports an incorrect identical version shortcut.

Tab interfaces◈ Members↗
FA-36330

Comparison tab pair: identical version shortcut · case 05

The tab workspace reports an incorrect identical version shortcut.

Tab interfaces◈ Members↗
FA-36331

Maximize pane restore: maximized visible pane · case 01

The tab workspace reports an incorrect maximized visible pane.

Tab interfaces● Open access↗
FA-36332

Maximize pane restore: maximized visible pane · case 02

The tab workspace reports an incorrect maximized visible pane.

Tab interfaces◈ Members↗
FA-36333

Maximize pane restore: maximized visible pane · case 03

The tab workspace reports an incorrect maximized visible pane.

Tab interfaces◈ Members↗
FA-36334

Maximize pane restore: maximized visible pane · case 04

The tab workspace reports an incorrect maximized visible pane.

Tab interfaces◈ Members↗
FA-36335

Maximize pane restore: maximized visible pane · case 05

The tab workspace reports an incorrect maximized visible pane.

Tab interfaces◈ Members↗
FA-36336

Maximize pane restore: split weights preservation · case 01

The tab workspace reports an incorrect split weights preservation.

Tab interfaces● Open access↗
FA-36337

Maximize pane restore: split weights preservation · case 02

The tab workspace reports an incorrect split weights preservation.

Tab interfaces◈ Members↗
FA-36338

Maximize pane restore: split weights preservation · case 03

The tab workspace reports an incorrect split weights preservation.

Tab interfaces◈ Members↗
FA-36339

Maximize pane restore: split weights preservation · case 04

The tab workspace reports an incorrect split weights preservation.

Tab interfaces◈ Members↗
FA-36340

Maximize pane restore: split weights preservation · case 05

The tab workspace reports an incorrect split weights preservation.

Tab interfaces◈ Members↗
FA-36341

Maximize pane restore: peer mount retention · case 01

The tab workspace reports an incorrect peer mount retention.

Tab interfaces● Open access↗
FA-36342

Maximize pane restore: peer mount retention · case 02

The tab workspace reports an incorrect peer mount retention.

Tab interfaces◈ Members↗
FA-36343

Maximize pane restore: peer mount retention · case 03

The tab workspace reports an incorrect peer mount retention.

Tab interfaces◈ Members↗
FA-36344

Maximize pane restore: peer mount retention · case 04

The tab workspace reports an incorrect peer mount retention.

Tab interfaces◈ Members↗
FA-36345

Maximize pane restore: peer mount retention · case 05

The tab workspace reports an incorrect peer mount retention.

Tab interfaces◈ Members↗
FA-36346

Maximize pane restore: peer hidden sets · case 01

The tab workspace reports an incorrect peer hidden sets.

Tab interfaces● Open access↗
FA-36347

Maximize pane restore: peer hidden sets · case 02

The tab workspace reports an incorrect peer hidden sets.

Tab interfaces◈ Members↗
FA-36348

Maximize pane restore: peer hidden sets · case 03

The tab workspace reports an incorrect peer hidden sets.

Tab interfaces◈ Members↗
FA-36349

Maximize pane restore: peer hidden sets · case 04

The tab workspace reports an incorrect peer hidden sets.

Tab interfaces◈ Members↗
FA-36350

Maximize pane restore: peer hidden sets · case 05

The tab workspace reports an incorrect peer hidden sets.

Tab interfaces◈ Members↗
FA-36351

Maximize pane restore: per pane scroll retention · case 01

The tab workspace reports an incorrect per pane scroll retention.

Tab interfaces● Open access↗
FA-36352

Maximize pane restore: per pane scroll retention · case 02

The tab workspace reports an incorrect per pane scroll retention.

Tab interfaces◈ Members↗
FA-36353

Maximize pane restore: per pane scroll retention · case 03

The tab workspace reports an incorrect per pane scroll retention.

Tab interfaces◈ Members↗
FA-36354

Maximize pane restore: per pane scroll retention · case 04

The tab workspace reports an incorrect per pane scroll retention.

Tab interfaces◈ Members↗
FA-36355

Maximize pane restore: per pane scroll retention · case 05

The tab workspace reports an incorrect per pane scroll retention.

Tab interfaces◈ Members↗
FA-36356

Maximize pane restore: restore active pane · case 01

The tab workspace reports an incorrect restore active pane.

Tab interfaces● Open access↗
FA-36357

Maximize pane restore: restore active pane · case 02

The tab workspace reports an incorrect restore active pane.

Tab interfaces◈ Members↗
FA-36358

Maximize pane restore: restore active pane · case 03

The tab workspace reports an incorrect restore active pane.

Tab interfaces◈ Members↗
FA-36359

Maximize pane restore: restore active pane · case 04

The tab workspace reports an incorrect restore active pane.

Tab interfaces◈ Members↗
FA-36360

Maximize pane restore: restore active pane · case 05

The tab workspace reports an incorrect restore active pane.

Tab interfaces◈ Members↗
FA-36361

Zen strip mode: zen strip visibility · case 01

The tab workspace reports an incorrect zen strip visibility.

Tab interfaces● Open access↗
FA-36362

Zen strip mode: zen strip visibility · case 02

The tab workspace reports an incorrect zen strip visibility.

Tab interfaces◈ Members↗
FA-36363

Zen strip mode: zen strip visibility · case 03

The tab workspace reports an incorrect zen strip visibility.

Tab interfaces◈ Members↗
FA-36364

Zen strip mode: zen strip visibility · case 04

The tab workspace reports an incorrect zen strip visibility.

Tab interfaces◈ Members↗
FA-36365

Zen strip mode: zen strip visibility · case 05

The tab workspace reports an incorrect zen strip visibility.

Tab interfaces◈ Members↗
FA-36366

Zen strip mode: zen panel height · case 01

The tab workspace reports an incorrect zen panel height.

Tab interfaces● Open access↗
FA-36367

Zen strip mode: zen panel height · case 02

The tab workspace reports an incorrect zen panel height.

Tab interfaces◈ Members↗
FA-36368

Zen strip mode: zen panel height · case 03

The tab workspace reports an incorrect zen panel height.

Tab interfaces◈ Members↗
FA-36369

Zen strip mode: zen panel height · case 04

The tab workspace reports an incorrect zen panel height.

Tab interfaces◈ Members↗
FA-36370

Zen strip mode: zen panel height · case 05

The tab workspace reports an incorrect zen panel height.

Tab interfaces◈ Members↗
FA-36371

Zen strip mode: zen tab retention · case 01

The tab workspace reports an incorrect zen tab retention.

Tab interfaces● Open access↗
FA-36372

Zen strip mode: zen tab retention · case 02

The tab workspace reports an incorrect zen tab retention.

Tab interfaces◈ Members↗
FA-36373

Zen strip mode: zen tab retention · case 03

The tab workspace reports an incorrect zen tab retention.

Tab interfaces◈ Members↗
FA-36374

Zen strip mode: zen tab retention · case 04

The tab workspace reports an incorrect zen tab retention.

Tab interfaces◈ Members↗
FA-36375

Zen strip mode: zen tab retention · case 05

The tab workspace reports an incorrect zen tab retention.

Tab interfaces◈ Members↗
FA-36376

Zen strip mode: zen selected retention · case 01

The tab workspace reports an incorrect zen selected retention.

Tab interfaces● Open access↗
FA-36377

Zen strip mode: zen selected retention · case 02

The tab workspace reports an incorrect zen selected retention.

Tab interfaces◈ Members↗
FA-36378

Zen strip mode: zen selected retention · case 03

The tab workspace reports an incorrect zen selected retention.

Tab interfaces◈ Members↗
FA-36379

Zen strip mode: zen selected retention · case 04

The tab workspace reports an incorrect zen selected retention.

Tab interfaces◈ Members↗
FA-36380

Zen strip mode: zen selected retention · case 05

The tab workspace reports an incorrect zen selected retention.

Tab interfaces◈ Members↗
FA-36381

Zen strip mode: exit visibility snapshot · case 01

The tab workspace reports an incorrect exit visibility snapshot.

Tab interfaces● Open access↗
FA-36382

Zen strip mode: exit visibility snapshot · case 02

The tab workspace reports an incorrect exit visibility snapshot.

Tab interfaces◈ Members↗
FA-36383

Zen strip mode: exit visibility snapshot · case 03

The tab workspace reports an incorrect exit visibility snapshot.

Tab interfaces◈ Members↗
FA-36384

Zen strip mode: exit visibility snapshot · case 04

The tab workspace reports an incorrect exit visibility snapshot.

Tab interfaces◈ Members↗
FA-36385

Zen strip mode: exit visibility snapshot · case 05

The tab workspace reports an incorrect exit visibility snapshot.

Tab interfaces◈ Members↗
FA-36386

Zen strip mode: zen hover reveal · case 01

The tab workspace reports an incorrect zen hover reveal.

Tab interfaces● Open access↗
FA-36387

Zen strip mode: zen hover reveal · case 02

The tab workspace reports an incorrect zen hover reveal.

Tab interfaces◈ Members↗
FA-36388

Zen strip mode: zen hover reveal · case 03

The tab workspace reports an incorrect zen hover reveal.

Tab interfaces◈ Members↗
FA-36389

Zen strip mode: zen hover reveal · case 04

The tab workspace reports an incorrect zen hover reveal.

Tab interfaces◈ Members↗
FA-36390

Zen strip mode: zen hover reveal · case 05

The tab workspace reports an incorrect zen hover reveal.

Tab interfaces◈ Members↗
FA-36391

Dock target regions: center join region · case 01

The tab workspace reports an incorrect center join region.

Tab interfaces● Open access↗
FA-36392

Dock target regions: center join region · case 02

The tab workspace reports an incorrect center join region.

Tab interfaces◈ Members↗
FA-36393

Dock target regions: center join region · case 03

The tab workspace reports an incorrect center join region.

Tab interfaces◈ Members↗
FA-36394

Dock target regions: center join region · case 04

The tab workspace reports an incorrect center join region.

Tab interfaces◈ Members↗
FA-36395

Dock target regions: center join region · case 05

The tab workspace reports an incorrect center join region.

Tab interfaces◈ Members↗
FA-36396

Dock target regions: horizontal edge choice · case 01

The tab workspace reports an incorrect horizontal edge choice.

Tab interfaces● Open access↗
FA-36397

Dock target regions: horizontal edge choice · case 02

The tab workspace reports an incorrect horizontal edge choice.

Tab interfaces◈ Members↗
FA-36398

Dock target regions: horizontal edge choice · case 03

The tab workspace reports an incorrect horizontal edge choice.

Tab interfaces◈ Members↗
FA-36399

Dock target regions: horizontal edge choice · case 04

The tab workspace reports an incorrect horizontal edge choice.

Tab interfaces◈ Members↗
FA-36400

Dock target regions: horizontal edge choice · case 05

The tab workspace reports an incorrect horizontal edge choice.

Tab interfaces◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗