FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-14301

Capped weight effective size: The effective size is replaced by the number of records. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14302

Capped weight effective size: The effective size is replaced by the number of records. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14303

Capped weight effective size: The effective size is replaced by the number of records. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14304

Capped weight effective size: The effective size is replaced by the number of records. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14305

Capped weight effective size: The effective size is replaced by the number of records. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14306

Capped weight effective size: Clipping is applied to total weight rather than each weight. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14307

Capped weight effective size: Clipping is applied to total weight rather than each weight. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14308

Capped weight effective size: Clipping is applied to total weight rather than each weight. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14309

Capped weight effective size: Clipping is applied to total weight rather than each weight. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14310

Capped weight effective size: Clipping is applied to total weight rather than each weight. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14311

Capped weight effective size: Only the squared-weight denominator uses clipped weights. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14312

Capped weight effective size: Only the squared-weight denominator uses clipped weights. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14313

Capped weight effective size: Only the squared-weight denominator uses clipped weights. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14314

Capped weight effective size: Only the squared-weight denominator uses clipped weights. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14315

Capped weight effective size: Only the squared-weight denominator uses clipped weights. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14316

Capped weight effective size: Squared weights are clipped instead of squaring clipped weights. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14317

Capped weight effective size: Squared weights are clipped instead of squaring clipped weights. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14318

Capped weight effective size: Squared weights are clipped instead of squaring clipped weights. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14319

Capped weight effective size: Squared weights are clipped instead of squaring clipped weights. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14320

Capped weight effective size: Squared weights are clipped instead of squaring clipped weights. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14321

Capped weight effective size: The concentration index is returned without inversion. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14322

Capped weight effective size: The concentration index is returned without inversion. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14323

Capped weight effective size: The concentration index is returned without inversion. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14324

Capped weight effective size: The concentration index is returned without inversion. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14325

Capped weight effective size: The concentration index is returned without inversion. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14326

Capped weight effective size: Negative importance weights are silently converted to magnitudes. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14327

Capped weight effective size: Negative importance weights are silently converted to magnitudes. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14328

Capped weight effective size: Negative importance weights are silently converted to magnitudes. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14329

Capped weight effective size: Negative importance weights are silently converted to magnitudes. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14330

Capped weight effective size: Negative importance weights are silently converted to magnitudes. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14331

Capped weight effective size: Effective size is truncated to an integer. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14332

Capped weight effective size: Effective size is truncated to an integer. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14333

Capped weight effective size: Effective size is truncated to an integer. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14334

Capped weight effective size: Effective size is truncated to an integer. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14335

Capped weight effective size: Effective size is truncated to an integer. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14336

Capped weight effective size: Zero weight population is assigned a zero measured effective size. · case 01

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation● Open access↗
FA-14337

Capped weight effective size: Zero weight population is assigned a zero measured effective size. · case 02

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14338

Capped weight effective size: Zero weight population is assigned a zero measured effective size. · case 03

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14339

Capped weight effective size: Zero weight population is assigned a zero measured effective size. · case 04

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14340

Capped weight effective size: Zero weight population is assigned a zero measured effective size. · case 05

The reduction disagrees with its explicit aggregation oracle.

Numerical aggregation◈ Members↗
FA-14341

Generalized crt: compatibility divisibility · case 01

The exact generalized crt result violates the stated contract at compatibility divisibility.

Numerics● Open access↗
FA-14342

Generalized crt: compatibility divisibility · case 02

The exact generalized crt result violates the stated contract at compatibility divisibility.

Numerics◈ Members↗
FA-14343

Generalized crt: compatibility divisibility · case 03

The exact generalized crt result violates the stated contract at compatibility divisibility.

Numerics◈ Members↗
FA-14344

Generalized crt: compatibility divisibility · case 04

The exact generalized crt result violates the stated contract at compatibility divisibility.

Numerics◈ Members↗
FA-14345

Generalized crt: compatibility divisibility · case 05

The exact generalized crt result violates the stated contract at compatibility divisibility.

Numerics◈ Members↗
FA-14346

Generalized crt: reduced congruence multiplier · case 01

The exact generalized crt result violates the stated contract at reduced congruence multiplier.

Numerics● Open access↗
FA-14347

Generalized crt: reduced congruence multiplier · case 02

The exact generalized crt result violates the stated contract at reduced congruence multiplier.

Numerics◈ Members↗
FA-14348

Generalized crt: reduced congruence multiplier · case 03

The exact generalized crt result violates the stated contract at reduced congruence multiplier.

Numerics◈ Members↗
FA-14349

Generalized crt: reduced congruence multiplier · case 04

The exact generalized crt result violates the stated contract at reduced congruence multiplier.

Numerics◈ Members↗
FA-14350

Generalized crt: reduced congruence multiplier · case 05

The exact generalized crt result violates the stated contract at reduced congruence multiplier.

Numerics◈ Members↗
FA-14351

Generalized crt: combined period · case 01

The exact generalized crt result violates the stated contract at combined period.

Numerics● Open access↗
FA-14352

Generalized crt: combined period · case 02

The exact generalized crt result violates the stated contract at combined period.

Numerics◈ Members↗
FA-14353

Generalized crt: combined period · case 03

The exact generalized crt result violates the stated contract at combined period.

Numerics◈ Members↗
FA-14354

Generalized crt: combined period · case 04

The exact generalized crt result violates the stated contract at combined period.

Numerics◈ Members↗
FA-14355

Generalized crt: combined period · case 05

The exact generalized crt result violates the stated contract at combined period.

Numerics◈ Members↗
FA-14356

Generalized crt: solution reconstruction · case 01

The exact generalized crt result violates the stated contract at solution reconstruction.

Numerics● Open access↗
FA-14357

Generalized crt: solution reconstruction · case 02

The exact generalized crt result violates the stated contract at solution reconstruction.

Numerics◈ Members↗
FA-14358

Generalized crt: solution reconstruction · case 03

The exact generalized crt result violates the stated contract at solution reconstruction.

Numerics◈ Members↗
FA-14359

Generalized crt: solution reconstruction · case 04

The exact generalized crt result violates the stated contract at solution reconstruction.

Numerics◈ Members↗
FA-14360

Generalized crt: solution reconstruction · case 05

The exact generalized crt result violates the stated contract at solution reconstruction.

Numerics◈ Members↗
FA-14361

Generalized crt: canonical residue · case 01

The exact generalized crt result violates the stated contract at canonical residue.

Numerics● Open access↗
FA-14362

Generalized crt: canonical residue · case 02

The exact generalized crt result violates the stated contract at canonical residue.

Numerics◈ Members↗
FA-14363

Generalized crt: canonical residue · case 03

The exact generalized crt result violates the stated contract at canonical residue.

Numerics◈ Members↗
FA-14364

Generalized crt: canonical residue · case 04

The exact generalized crt result violates the stated contract at canonical residue.

Numerics◈ Members↗
FA-14365

Generalized crt: canonical residue · case 05

The exact generalized crt result violates the stated contract at canonical residue.

Numerics◈ Members↗
FA-14366

Linear congruence solutions: solvability · case 01

The exact linear congruence solutions result violates the stated contract at solvability.

Numerics● Open access↗
FA-14367

Linear congruence solutions: solvability · case 02

The exact linear congruence solutions result violates the stated contract at solvability.

Numerics◈ Members↗
FA-14368

Linear congruence solutions: solvability · case 03

The exact linear congruence solutions result violates the stated contract at solvability.

Numerics◈ Members↗
FA-14369

Linear congruence solutions: solvability · case 04

The exact linear congruence solutions result violates the stated contract at solvability.

Numerics◈ Members↗
FA-14370

Linear congruence solutions: solvability · case 05

The exact linear congruence solutions result violates the stated contract at solvability.

Numerics◈ Members↗
FA-14371

Linear congruence solutions: quotient modulus · case 01

The exact linear congruence solutions result violates the stated contract at quotient modulus.

Numerics● Open access↗
FA-14372

Linear congruence solutions: quotient modulus · case 02

The exact linear congruence solutions result violates the stated contract at quotient modulus.

Numerics◈ Members↗
FA-14373

Linear congruence solutions: quotient modulus · case 03

The exact linear congruence solutions result violates the stated contract at quotient modulus.

Numerics◈ Members↗
FA-14374

Linear congruence solutions: quotient modulus · case 04

The exact linear congruence solutions result violates the stated contract at quotient modulus.

Numerics◈ Members↗
FA-14375

Linear congruence solutions: quotient modulus · case 05

The exact linear congruence solutions result violates the stated contract at quotient modulus.

Numerics◈ Members↗
FA-14376

Linear congruence solutions: reduced residue · case 01

The exact linear congruence solutions result violates the stated contract at reduced residue.

Numerics● Open access↗
FA-14377

Linear congruence solutions: reduced residue · case 02

The exact linear congruence solutions result violates the stated contract at reduced residue.

Numerics◈ Members↗
FA-14378

Linear congruence solutions: reduced residue · case 03

The exact linear congruence solutions result violates the stated contract at reduced residue.

Numerics◈ Members↗
FA-14379

Linear congruence solutions: reduced residue · case 04

The exact linear congruence solutions result violates the stated contract at reduced residue.

Numerics◈ Members↗
FA-14380

Linear congruence solutions: reduced residue · case 05

The exact linear congruence solutions result violates the stated contract at reduced residue.

Numerics◈ Members↗
FA-14381

Linear congruence solutions: coset spacing · case 01

The exact linear congruence solutions result violates the stated contract at coset spacing.

Numerics● Open access↗
FA-14382

Linear congruence solutions: coset spacing · case 02

The exact linear congruence solutions result violates the stated contract at coset spacing.

Numerics◈ Members↗
FA-14383

Linear congruence solutions: coset spacing · case 03

The exact linear congruence solutions result violates the stated contract at coset spacing.

Numerics◈ Members↗
FA-14384

Linear congruence solutions: coset spacing · case 04

The exact linear congruence solutions result violates the stated contract at coset spacing.

Numerics◈ Members↗
FA-14385

Linear congruence solutions: coset spacing · case 05

The exact linear congruence solutions result violates the stated contract at coset spacing.

Numerics◈ Members↗
FA-14386

Linear congruence solutions: coset cardinality · case 01

The exact linear congruence solutions result violates the stated contract at coset cardinality.

Numerics● Open access↗
FA-14387

Linear congruence solutions: coset cardinality · case 02

The exact linear congruence solutions result violates the stated contract at coset cardinality.

Numerics◈ Members↗
FA-14388

Linear congruence solutions: coset cardinality · case 03

The exact linear congruence solutions result violates the stated contract at coset cardinality.

Numerics◈ Members↗
FA-14389

Linear congruence solutions: coset cardinality · case 04

The exact linear congruence solutions result violates the stated contract at coset cardinality.

Numerics◈ Members↗
FA-14390

Linear congruence solutions: coset cardinality · case 05

The exact linear congruence solutions result violates the stated contract at coset cardinality.

Numerics◈ Members↗
FA-14391

Bounded diophantine: first coordinate endpoint · case 01

The exact bounded diophantine result violates the stated contract at first coordinate endpoint.

Numerics● Open access↗
FA-14392

Bounded diophantine: first coordinate endpoint · case 02

The exact bounded diophantine result violates the stated contract at first coordinate endpoint.

Numerics◈ Members↗
FA-14393

Bounded diophantine: first coordinate endpoint · case 03

The exact bounded diophantine result violates the stated contract at first coordinate endpoint.

Numerics◈ Members↗
FA-14394

Bounded diophantine: first coordinate endpoint · case 04

The exact bounded diophantine result violates the stated contract at first coordinate endpoint.

Numerics◈ Members↗
FA-14395

Bounded diophantine: first coordinate endpoint · case 05

The exact bounded diophantine result violates the stated contract at first coordinate endpoint.

Numerics◈ Members↗
FA-14396

Bounded diophantine: remaining right hand side · case 01

The exact bounded diophantine result violates the stated contract at remaining right hand side.

Numerics● Open access↗
FA-14397

Bounded diophantine: remaining right hand side · case 02

The exact bounded diophantine result violates the stated contract at remaining right hand side.

Numerics◈ Members↗
FA-14398

Bounded diophantine: remaining right hand side · case 03

The exact bounded diophantine result violates the stated contract at remaining right hand side.

Numerics◈ Members↗
FA-14399

Bounded diophantine: remaining right hand side · case 04

The exact bounded diophantine result violates the stated contract at remaining right hand side.

Numerics◈ Members↗
FA-14400

Bounded diophantine: remaining right hand side · case 05

The exact bounded diophantine result violates the stated contract at remaining right hand side.

Numerics◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗