FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-9301

Direct rebuild trigger selection: Duplicate declarations schedule duplicate jobs · case 01

Duplicate declarations schedule duplicate jobs.

Build systems● Open access↗
FA-9302

Direct rebuild trigger selection: Duplicate declarations schedule duplicate jobs · case 02

Duplicate declarations schedule duplicate jobs.

Build systems◈ Members↗
FA-9303

Direct rebuild trigger selection: Duplicate declarations schedule duplicate jobs · case 03

Duplicate declarations schedule duplicate jobs.

Build systems◈ Members↗
FA-9304

Direct rebuild trigger selection: Duplicate declarations schedule duplicate jobs · case 04

Duplicate declarations schedule duplicate jobs.

Build systems◈ Members↗
FA-9305

Direct rebuild trigger selection: Duplicate declarations schedule duplicate jobs · case 05

Duplicate declarations schedule duplicate jobs.

Build systems◈ Members↗
FA-9306

Generated file ownership: Disabled generators reserve output ownership · case 01

Disabled generators reserve output ownership.

Build systems● Open access↗
FA-9307

Generated file ownership: Disabled generators reserve output ownership · case 02

Disabled generators reserve output ownership.

Build systems◈ Members↗
FA-9308

Generated file ownership: Disabled generators reserve output ownership · case 03

Disabled generators reserve output ownership.

Build systems◈ Members↗
FA-9309

Generated file ownership: Disabled generators reserve output ownership · case 04

Disabled generators reserve output ownership.

Build systems◈ Members↗
FA-9310

Generated file ownership: Disabled generators reserve output ownership · case 05

Disabled generators reserve output ownership.

Build systems◈ Members↗
FA-9311

Generated file ownership: Only one output of a generator is registered · case 01

Only one output of a generator is registered.

Build systems● Open access↗
FA-9312

Generated file ownership: Only one output of a generator is registered · case 02

Only one output of a generator is registered.

Build systems◈ Members↗
FA-9313

Generated file ownership: Only one output of a generator is registered · case 03

Only one output of a generator is registered.

Build systems◈ Members↗
FA-9314

Generated file ownership: Only one output of a generator is registered · case 04

Only one output of a generator is registered.

Build systems◈ Members↗
FA-9315

Generated file ownership: Only one output of a generator is registered · case 05

Only one output of a generator is registered.

Build systems◈ Members↗
FA-9316

Generated file ownership: Multiple writers silently overwrite ownership · case 01

Multiple writers silently overwrite ownership.

Build systems● Open access↗
FA-9317

Generated file ownership: Multiple writers silently overwrite ownership · case 02

Multiple writers silently overwrite ownership.

Build systems◈ Members↗
FA-9318

Generated file ownership: Multiple writers silently overwrite ownership · case 03

Multiple writers silently overwrite ownership.

Build systems◈ Members↗
FA-9319

Generated file ownership: Multiple writers silently overwrite ownership · case 04

Multiple writers silently overwrite ownership.

Build systems◈ Members↗
FA-9320

Generated file ownership: Multiple writers silently overwrite ownership · case 05

Multiple writers silently overwrite ownership.

Build systems◈ Members↗
FA-9321

Generated file ownership: Output names replace producing rule identities · case 01

Output names replace producing rule identities.

Build systems● Open access↗
FA-9322

Generated file ownership: Output names replace producing rule identities · case 02

Output names replace producing rule identities.

Build systems◈ Members↗
FA-9323

Generated file ownership: Output names replace producing rule identities · case 03

Output names replace producing rule identities.

Build systems◈ Members↗
FA-9324

Generated file ownership: Output names replace producing rule identities · case 04

Output names replace producing rule identities.

Build systems◈ Members↗
FA-9325

Generated file ownership: Output names replace producing rule identities · case 05

Output names replace producing rule identities.

Build systems◈ Members↗
FA-9326

Generated file ownership: Ownership results depend on rule order · case 01

Ownership results depend on rule order.

Build systems● Open access↗
FA-9327

Generated file ownership: Ownership results depend on rule order · case 02

Ownership results depend on rule order.

Build systems◈ Members↗
FA-9328

Generated file ownership: Ownership results depend on rule order · case 03

Ownership results depend on rule order.

Build systems◈ Members↗
FA-9329

Generated file ownership: Ownership results depend on rule order · case 04

Ownership results depend on rule order.

Build systems◈ Members↗
FA-9330

Generated file ownership: Ownership results depend on rule order · case 05

Ownership results depend on rule order.

Build systems◈ Members↗
FA-9331

Release candidate selection: Yanked versions remain eligible · case 01

Yanked versions remain eligible.

Dependency resolution● Open access↗
FA-9332

Release candidate selection: Yanked versions remain eligible · case 02

Yanked versions remain eligible.

Dependency resolution◈ Members↗
FA-9333

Release candidate selection: Yanked versions remain eligible · case 03

Yanked versions remain eligible.

Dependency resolution◈ Members↗
FA-9334

Release candidate selection: Yanked versions remain eligible · case 04

Yanked versions remain eligible.

Dependency resolution◈ Members↗
FA-9335

Release candidate selection: Yanked versions remain eligible · case 05

Yanked versions remain eligible.

Dependency resolution◈ Members↗
FA-9336

Release candidate selection: Prereleases displace stable releases · case 01

Prereleases displace stable releases.

Dependency resolution● Open access↗
FA-9337

Release candidate selection: Prereleases displace stable releases · case 02

Prereleases displace stable releases.

Dependency resolution◈ Members↗
FA-9338

Release candidate selection: Prereleases displace stable releases · case 03

Prereleases displace stable releases.

Dependency resolution◈ Members↗
FA-9339

Release candidate selection: Prereleases displace stable releases · case 04

Prereleases displace stable releases.

Dependency resolution◈ Members↗
FA-9340

Release candidate selection: Prereleases displace stable releases · case 05

Prereleases displace stable releases.

Dependency resolution◈ Members↗
FA-9341

Release candidate selection: Wrong-platform builds satisfy a requirement · case 01

Wrong-platform builds satisfy a requirement.

Dependency resolution● Open access↗
FA-9342

Release candidate selection: Wrong-platform builds satisfy a requirement · case 02

Wrong-platform builds satisfy a requirement.

Dependency resolution◈ Members↗
FA-9343

Release candidate selection: Wrong-platform builds satisfy a requirement · case 03

Wrong-platform builds satisfy a requirement.

Dependency resolution◈ Members↗
FA-9344

Release candidate selection: Wrong-platform builds satisfy a requirement · case 04

Wrong-platform builds satisfy a requirement.

Dependency resolution◈ Members↗
FA-9345

Release candidate selection: Wrong-platform builds satisfy a requirement · case 05

Wrong-platform builds satisfy a requirement.

Dependency resolution◈ Members↗
FA-9346

Release candidate selection: Versions below the required minimum are selected · case 01

Versions below the required minimum are selected.

Dependency resolution● Open access↗
FA-9347

Release candidate selection: Versions below the required minimum are selected · case 02

Versions below the required minimum are selected.

Dependency resolution◈ Members↗
FA-9348

Release candidate selection: Versions below the required minimum are selected · case 03

Versions below the required minimum are selected.

Dependency resolution◈ Members↗
FA-9349

Release candidate selection: Versions below the required minimum are selected · case 04

Versions below the required minimum are selected.

Dependency resolution◈ Members↗
FA-9350

Release candidate selection: Versions below the required minimum are selected · case 05

Versions below the required minimum are selected.

Dependency resolution◈ Members↗
FA-9351

Release candidate selection: The oldest compatible version wins · case 01

The oldest compatible version wins.

Dependency resolution● Open access↗
FA-9352

Release candidate selection: The oldest compatible version wins · case 02

The oldest compatible version wins.

Dependency resolution◈ Members↗
FA-9353

Release candidate selection: The oldest compatible version wins · case 03

The oldest compatible version wins.

Dependency resolution◈ Members↗
FA-9354

Release candidate selection: The oldest compatible version wins · case 04

The oldest compatible version wins.

Dependency resolution◈ Members↗
FA-9355

Release candidate selection: The oldest compatible version wins · case 05

The oldest compatible version wins.

Dependency resolution◈ Members↗
FA-9356

Closed-open version range intersection: A zero lower bound is treated as absent · case 01

A zero lower bound is treated as absent.

Version constraints● Open access↗
FA-9357

Closed-open version range intersection: A zero lower bound is treated as absent · case 02

A zero lower bound is treated as absent.

Version constraints◈ Members↗
FA-9358

Closed-open version range intersection: A zero lower bound is treated as absent · case 03

A zero lower bound is treated as absent.

Version constraints◈ Members↗
FA-9359

Closed-open version range intersection: A zero lower bound is treated as absent · case 04

A zero lower bound is treated as absent.

Version constraints◈ Members↗
FA-9360

Closed-open version range intersection: A zero lower bound is treated as absent · case 05

A zero lower bound is treated as absent.

Version constraints◈ Members↗
FA-9361

Closed-open version range intersection: A zero upper bound is treated as absent · case 01

A zero upper bound is treated as absent.

Version constraints● Open access↗
FA-9362

Closed-open version range intersection: A zero upper bound is treated as absent · case 02

A zero upper bound is treated as absent.

Version constraints◈ Members↗
FA-9363

Closed-open version range intersection: A zero upper bound is treated as absent · case 03

A zero upper bound is treated as absent.

Version constraints◈ Members↗
FA-9364

Closed-open version range intersection: A zero upper bound is treated as absent · case 04

A zero upper bound is treated as absent.

Version constraints◈ Members↗
FA-9365

Closed-open version range intersection: A zero upper bound is treated as absent · case 05

A zero upper bound is treated as absent.

Version constraints◈ Members↗
FA-9366

Closed-open version range intersection: Intersection chooses the least restrictive lower bound · case 01

Intersection chooses the least restrictive lower bound.

Version constraints● Open access↗
FA-9367

Closed-open version range intersection: Intersection chooses the least restrictive lower bound · case 02

Intersection chooses the least restrictive lower bound.

Version constraints◈ Members↗
FA-9368

Closed-open version range intersection: Intersection chooses the least restrictive lower bound · case 03

Intersection chooses the least restrictive lower bound.

Version constraints◈ Members↗
FA-9369

Closed-open version range intersection: Intersection chooses the least restrictive lower bound · case 04

Intersection chooses the least restrictive lower bound.

Version constraints◈ Members↗
FA-9370

Closed-open version range intersection: Intersection chooses the least restrictive lower bound · case 05

Intersection chooses the least restrictive lower bound.

Version constraints◈ Members↗
FA-9371

Closed-open version range intersection: Intersection chooses the least restrictive upper bound · case 01

Intersection chooses the least restrictive upper bound.

Version constraints● Open access↗
FA-9372

Closed-open version range intersection: Intersection chooses the least restrictive upper bound · case 02

Intersection chooses the least restrictive upper bound.

Version constraints◈ Members↗
FA-9373

Closed-open version range intersection: Intersection chooses the least restrictive upper bound · case 03

Intersection chooses the least restrictive upper bound.

Version constraints◈ Members↗
FA-9374

Closed-open version range intersection: Intersection chooses the least restrictive upper bound · case 04

Intersection chooses the least restrictive upper bound.

Version constraints◈ Members↗
FA-9375

Closed-open version range intersection: Intersection chooses the least restrictive upper bound · case 05

Intersection chooses the least restrictive upper bound.

Version constraints◈ Members↗
FA-9376

Closed-open version range intersection: An empty touching range is reported satisfiable · case 01

An empty touching range is reported satisfiable.

Version constraints● Open access↗
FA-9377

Closed-open version range intersection: An empty touching range is reported satisfiable · case 02

An empty touching range is reported satisfiable.

Version constraints◈ Members↗
FA-9378

Closed-open version range intersection: An empty touching range is reported satisfiable · case 03

An empty touching range is reported satisfiable.

Version constraints◈ Members↗
FA-9379

Closed-open version range intersection: An empty touching range is reported satisfiable · case 04

An empty touching range is reported satisfiable.

Version constraints◈ Members↗
FA-9380

Closed-open version range intersection: An empty touching range is reported satisfiable · case 05

An empty touching range is reported satisfiable.

Version constraints◈ Members↗
FA-9381

Dependency group activation: Runtime dependencies require opt-in · case 01

Runtime dependencies require opt-in.

Dependency resolution● Open access↗
FA-9382

Dependency group activation: Runtime dependencies require opt-in · case 02

Runtime dependencies require opt-in.

Dependency resolution◈ Members↗
FA-9383

Dependency group activation: Runtime dependencies require opt-in · case 03

Runtime dependencies require opt-in.

Dependency resolution◈ Members↗
FA-9384

Dependency group activation: Runtime dependencies require opt-in · case 04

Runtime dependencies require opt-in.

Dependency resolution◈ Members↗
FA-9385

Dependency group activation: Runtime dependencies require opt-in · case 05

Runtime dependencies require opt-in.

Dependency resolution◈ Members↗
FA-9386

Dependency group activation: Inactive optional groups are installed · case 01

Inactive optional groups are installed.

Dependency resolution● Open access↗
FA-9387

Dependency group activation: Inactive optional groups are installed · case 02

Inactive optional groups are installed.

Dependency resolution◈ Members↗
FA-9388

Dependency group activation: Inactive optional groups are installed · case 03

Inactive optional groups are installed.

Dependency resolution◈ Members↗
FA-9389

Dependency group activation: Inactive optional groups are installed · case 04

Inactive optional groups are installed.

Dependency resolution◈ Members↗
FA-9390

Dependency group activation: Inactive optional groups are installed · case 05

Inactive optional groups are installed.

Dependency resolution◈ Members↗
FA-9391

Dependency group activation: False environment markers are ignored · case 01

False environment markers are ignored.

Dependency resolution● Open access↗
FA-9392

Dependency group activation: False environment markers are ignored · case 02

False environment markers are ignored.

Dependency resolution◈ Members↗
FA-9393

Dependency group activation: False environment markers are ignored · case 03

False environment markers are ignored.

Dependency resolution◈ Members↗
FA-9394

Dependency group activation: False environment markers are ignored · case 04

False environment markers are ignored.

Dependency resolution◈ Members↗
FA-9395

Dependency group activation: False environment markers are ignored · case 05

False environment markers are ignored.

Dependency resolution◈ Members↗
FA-9396

Dependency group activation: Disabled declarations remain active · case 01

Disabled declarations remain active.

Dependency resolution● Open access↗
FA-9397

Dependency group activation: Disabled declarations remain active · case 02

Disabled declarations remain active.

Dependency resolution◈ Members↗
FA-9398

Dependency group activation: Disabled declarations remain active · case 03

Disabled declarations remain active.

Dependency resolution◈ Members↗
FA-9399

Dependency group activation: Disabled declarations remain active · case 04

Disabled declarations remain active.

Dependency resolution◈ Members↗
FA-9400

Dependency group activation: Disabled declarations remain active · case 05

Disabled declarations remain active.

Dependency resolution◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗