FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-3301

URL-safe base64 uses the standard alphabet · case 01

URL-safe base64 uses the standard alphabet.

Encodings● Open access↗
FA-3302

URL-safe base64 uses the standard alphabet · case 02

URL-safe base64 uses the standard alphabet.

Encodings◈ Members↗
FA-3303

URL-safe base64 uses the standard alphabet · case 03

URL-safe base64 uses the standard alphabet.

Encodings◈ Members↗
FA-3304

URL-safe base64 uses the standard alphabet · case 04

URL-safe base64 uses the standard alphabet.

Encodings◈ Members↗
FA-3305

URL-safe base64 uses the standard alphabet · case 05

URL-safe base64 uses the standard alphabet.

Encodings◈ Members↗
FA-3306

Base64 decoding silently ignores foreign characters · case 01

Base64 decoding silently ignores foreign characters.

Encodings● Open access↗
FA-3307

Base64 decoding silently ignores foreign characters · case 02

Base64 decoding silently ignores foreign characters.

Encodings◈ Members↗
FA-3308

Base64 decoding silently ignores foreign characters · case 03

Base64 decoding silently ignores foreign characters.

Encodings◈ Members↗
FA-3309

Base64 decoding silently ignores foreign characters · case 04

Base64 decoding silently ignores foreign characters.

Encodings◈ Members↗
FA-3310

Base64 decoding silently ignores foreign characters · case 05

Base64 decoding silently ignores foreign characters.

Encodings◈ Members↗
FA-3311

Case-sensitive Base32 accepts lowercase input · case 01

Case-sensitive Base32 accepts lowercase input.

Encodings● Open access↗
FA-3312

Case-sensitive Base32 accepts lowercase input · case 02

Case-sensitive Base32 accepts lowercase input.

Encodings◈ Members↗
FA-3313

Case-sensitive Base32 accepts lowercase input · case 03

Case-sensitive Base32 accepts lowercase input.

Encodings◈ Members↗
FA-3314

Case-sensitive Base32 accepts lowercase input · case 04

Case-sensitive Base32 accepts lowercase input.

Encodings◈ Members↗
FA-3315

Case-sensitive Base32 accepts lowercase input · case 05

Case-sensitive Base32 accepts lowercase input.

Encodings◈ Members↗
FA-3316

Human Base32 digit aliases are rejected · case 01

Human Base32 digit aliases are rejected.

Encodings● Open access↗
FA-3317

Human Base32 digit aliases are rejected · case 02

Human Base32 digit aliases are rejected.

Encodings◈ Members↗
FA-3318

Human Base32 digit aliases are rejected · case 03

Human Base32 digit aliases are rejected.

Encodings◈ Members↗
FA-3319

Human Base32 digit aliases are rejected · case 04

Human Base32 digit aliases are rejected.

Encodings◈ Members↗
FA-3320

Human Base32 digit aliases are rejected · case 05

Human Base32 digit aliases are rejected.

Encodings◈ Members↗
FA-3321

Two base85 alphabets are confused · case 01

Two base85 alphabets are confused.

Encodings● Open access↗
FA-3322

Two base85 alphabets are confused · case 02

Two base85 alphabets are confused.

Encodings◈ Members↗
FA-3323

Two base85 alphabets are confused · case 03

Two base85 alphabets are confused.

Encodings◈ Members↗
FA-3324

Two base85 alphabets are confused · case 04

Two base85 alphabets are confused.

Encodings◈ Members↗
FA-3325

Two base85 alphabets are confused · case 05

Two base85 alphabets are confused.

Encodings◈ Members↗
FA-3326

ASCII85 expands the zero tuple incorrectly · case 01

ASCII85 expands the zero tuple incorrectly.

Encodings● Open access↗
FA-3327

ASCII85 expands the zero tuple incorrectly · case 02

ASCII85 expands the zero tuple incorrectly.

Encodings◈ Members↗
FA-3328

ASCII85 expands the zero tuple incorrectly · case 03

ASCII85 expands the zero tuple incorrectly.

Encodings◈ Members↗
FA-3329

ASCII85 expands the zero tuple incorrectly · case 04

ASCII85 expands the zero tuple incorrectly.

Encodings◈ Members↗
FA-3330

ASCII85 expands the zero tuple incorrectly · case 05

ASCII85 expands the zero tuple incorrectly.

Encodings◈ Members↗
FA-3331

Canonical hexadecimal output mixes letter case · case 01

Canonical hexadecimal output mixes letter case.

Encodings● Open access↗
FA-3332

Canonical hexadecimal output mixes letter case · case 02

Canonical hexadecimal output mixes letter case.

Encodings◈ Members↗
FA-3333

Canonical hexadecimal output mixes letter case · case 03

Canonical hexadecimal output mixes letter case.

Encodings◈ Members↗
FA-3334

Canonical hexadecimal output mixes letter case · case 04

Canonical hexadecimal output mixes letter case.

Encodings◈ Members↗
FA-3335

Canonical hexadecimal output mixes letter case · case 05

Canonical hexadecimal output mixes letter case.

Encodings◈ Members↗
FA-3336

Quoted-printable soft line breaks become content · case 01

Quoted-printable soft line breaks become content.

Encodings● Open access↗
FA-3337

Quoted-printable soft line breaks become content · case 02

Quoted-printable soft line breaks become content.

Encodings◈ Members↗
FA-3338

Quoted-printable soft line breaks become content · case 03

Quoted-printable soft line breaks become content.

Encodings◈ Members↗
FA-3339

Quoted-printable soft line breaks become content · case 04

Quoted-printable soft line breaks become content.

Encodings◈ Members↗
FA-3340

Quoted-printable soft line breaks become content · case 05

Quoted-printable soft line breaks become content.

Encodings◈ Members↗
FA-3341

Encoded-word underscores remain underscores · case 01

Encoded-word underscores remain underscores.

Encodings● Open access↗
FA-3342

Encoded-word underscores remain underscores · case 02

Encoded-word underscores remain underscores.

Encodings◈ Members↗
FA-3343

Encoded-word underscores remain underscores · case 03

Encoded-word underscores remain underscores.

Encodings◈ Members↗
FA-3344

Encoded-word underscores remain underscores · case 04

Encoded-word underscores remain underscores.

Encodings◈ Members↗
FA-3345

Encoded-word underscores remain underscores · case 05

Encoded-word underscores remain underscores.

Encodings◈ Members↗
FA-3346

Adjacent encoded words retain separating whitespace · case 01

Adjacent encoded words retain separating whitespace.

Encodings● Open access↗
FA-3347

Adjacent encoded words retain separating whitespace · case 02

Adjacent encoded words retain separating whitespace.

Encodings◈ Members↗
FA-3348

Adjacent encoded words retain separating whitespace · case 03

Adjacent encoded words retain separating whitespace.

Encodings◈ Members↗
FA-3349

Adjacent encoded words retain separating whitespace · case 04

Adjacent encoded words retain separating whitespace.

Encodings◈ Members↗
FA-3350

Adjacent encoded words retain separating whitespace · case 05

Adjacent encoded words retain separating whitespace.

Encodings◈ Members↗
FA-3351

ROT13 rotates non-ASCII letters · case 01

ROT13 rotates non-ASCII letters.

Encodings● Open access↗
FA-3352

ROT13 rotates non-ASCII letters · case 02

ROT13 rotates non-ASCII letters.

Encodings◈ Members↗
FA-3353

ROT13 rotates non-ASCII letters · case 03

ROT13 rotates non-ASCII letters.

Encodings◈ Members↗
FA-3354

ROT13 rotates non-ASCII letters · case 04

ROT13 rotates non-ASCII letters.

Encodings◈ Members↗
FA-3355

ROT13 rotates non-ASCII letters · case 05

ROT13 rotates non-ASCII letters.

Encodings◈ Members↗
FA-3356

A decimal token admits ambiguous leading zeros · case 01

A decimal token admits ambiguous leading zeros.

Lexical grammars● Open access↗
FA-3357

A decimal token admits ambiguous leading zeros · case 02

A decimal token admits ambiguous leading zeros.

Lexical grammars◈ Members↗
FA-3358

A decimal token admits ambiguous leading zeros · case 03

A decimal token admits ambiguous leading zeros.

Lexical grammars◈ Members↗
FA-3359

A decimal token admits ambiguous leading zeros · case 04

A decimal token admits ambiguous leading zeros.

Lexical grammars◈ Members↗
FA-3360

A decimal token admits ambiguous leading zeros · case 05

A decimal token admits ambiguous leading zeros.

Lexical grammars◈ Members↗
FA-3361

Signed integer parsing excludes zero or duplicates signs · case 01

Signed integer parsing excludes zero or duplicates signs.

Lexical grammars● Open access↗
FA-3362

Signed integer parsing excludes zero or duplicates signs · case 02

Signed integer parsing excludes zero or duplicates signs.

Lexical grammars◈ Members↗
FA-3363

Signed integer parsing excludes zero or duplicates signs · case 03

Signed integer parsing excludes zero or duplicates signs.

Lexical grammars◈ Members↗
FA-3364

Signed integer parsing excludes zero or duplicates signs · case 04

Signed integer parsing excludes zero or duplicates signs.

Lexical grammars◈ Members↗
FA-3365

Signed integer parsing excludes zero or duplicates signs · case 05

Signed integer parsing excludes zero or duplicates signs.

Lexical grammars◈ Members↗
FA-3366

A decimal point has no fractional digits · case 01

A decimal point has no fractional digits.

Lexical grammars● Open access↗
FA-3367

A decimal point has no fractional digits · case 02

A decimal point has no fractional digits.

Lexical grammars◈ Members↗
FA-3368

A decimal point has no fractional digits · case 03

A decimal point has no fractional digits.

Lexical grammars◈ Members↗
FA-3369

A decimal point has no fractional digits · case 04

A decimal point has no fractional digits.

Lexical grammars◈ Members↗
FA-3370

A decimal point has no fractional digits · case 05

A decimal point has no fractional digits.

Lexical grammars◈ Members↗
FA-3371

Scientific notation accepts an empty exponent · case 01

Scientific notation accepts an empty exponent.

Lexical grammars● Open access↗
FA-3372

Scientific notation accepts an empty exponent · case 02

Scientific notation accepts an empty exponent.

Lexical grammars◈ Members↗
FA-3373

Scientific notation accepts an empty exponent · case 03

Scientific notation accepts an empty exponent.

Lexical grammars◈ Members↗
FA-3374

Scientific notation accepts an empty exponent · case 04

Scientific notation accepts an empty exponent.

Lexical grammars◈ Members↗
FA-3375

Scientific notation accepts an empty exponent · case 05

Scientific notation accepts an empty exponent.

Lexical grammars◈ Members↗
FA-3376

A hexadecimal prefix is accepted without a body · case 01

A hexadecimal prefix is accepted without a body.

Lexical grammars● Open access↗
FA-3377

A hexadecimal prefix is accepted without a body · case 02

A hexadecimal prefix is accepted without a body.

Lexical grammars◈ Members↗
FA-3378

A hexadecimal prefix is accepted without a body · case 03

A hexadecimal prefix is accepted without a body.

Lexical grammars◈ Members↗
FA-3379

A hexadecimal prefix is accepted without a body · case 04

A hexadecimal prefix is accepted without a body.

Lexical grammars◈ Members↗
FA-3380

A hexadecimal prefix is accepted without a body · case 05

A hexadecimal prefix is accepted without a body.

Lexical grammars◈ Members↗
FA-3381

A binary literal admits decimal digits · case 01

A binary literal admits decimal digits.

Lexical grammars● Open access↗
FA-3382

A binary literal admits decimal digits · case 02

A binary literal admits decimal digits.

Lexical grammars◈ Members↗
FA-3383

A binary literal admits decimal digits · case 03

A binary literal admits decimal digits.

Lexical grammars◈ Members↗
FA-3384

A binary literal admits decimal digits · case 04

A binary literal admits decimal digits.

Lexical grammars◈ Members↗
FA-3385

A binary literal admits decimal digits · case 05

A binary literal admits decimal digits.

Lexical grammars◈ Members↗
FA-3386

An explicit octal literal uses legacy leading-zero syntax · case 01

An explicit octal literal uses legacy leading-zero syntax.

Lexical grammars● Open access↗
FA-3387

An explicit octal literal uses legacy leading-zero syntax · case 02

An explicit octal literal uses legacy leading-zero syntax.

Lexical grammars◈ Members↗
FA-3388

An explicit octal literal uses legacy leading-zero syntax · case 03

An explicit octal literal uses legacy leading-zero syntax.

Lexical grammars◈ Members↗
FA-3389

An explicit octal literal uses legacy leading-zero syntax · case 04

An explicit octal literal uses legacy leading-zero syntax.

Lexical grammars◈ Members↗
FA-3390

An explicit octal literal uses legacy leading-zero syntax · case 05

An explicit octal literal uses legacy leading-zero syntax.

Lexical grammars◈ Members↗
FA-3391

Digit separators occur at token edges · case 01

Digit separators occur at token edges.

Lexical grammars● Open access↗
FA-3392

Digit separators occur at token edges · case 02

Digit separators occur at token edges.

Lexical grammars◈ Members↗
FA-3393

Digit separators occur at token edges · case 03

Digit separators occur at token edges.

Lexical grammars◈ Members↗
FA-3394

Digit separators occur at token edges · case 04

Digit separators occur at token edges.

Lexical grammars◈ Members↗
FA-3395

Digit separators occur at token edges · case 05

Digit separators occur at token edges.

Lexical grammars◈ Members↗
FA-3396

A currency amount has an incomplete minor unit · case 01

A currency amount has an incomplete minor unit.

Lexical grammars● Open access↗
FA-3397

A currency amount has an incomplete minor unit · case 02

A currency amount has an incomplete minor unit.

Lexical grammars◈ Members↗
FA-3398

A currency amount has an incomplete minor unit · case 03

A currency amount has an incomplete minor unit.

Lexical grammars◈ Members↗
FA-3399

A currency amount has an incomplete minor unit · case 04

A currency amount has an incomplete minor unit.

Lexical grammars◈ Members↗
FA-3400

A currency amount has an incomplete minor unit · case 05

A currency amount has an incomplete minor unit.

Lexical grammars◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗