FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-76501

Validate Content-Transfer-Encoding across a MIME tree: encoding normalization · case 01

A declared "Base64" or a padded value is reported as an unknown encoding.

Email MIME structure● Open access↗
FA-76502

Validate Content-Transfer-Encoding across a MIME tree: encoding normalization · case 02

A declared "Base64" or a padded value is reported as an unknown encoding.

Email MIME structure◈ Members↗
FA-76503

Validate Content-Transfer-Encoding across a MIME tree: encoding normalization · case 03

A declared "Base64" or a padded value is reported as an unknown encoding.

Email MIME structure◈ Members↗
FA-76504

Validate Content-Transfer-Encoding across a MIME tree: encoding normalization · case 04

A declared "Base64" or a padded value is reported as an unknown encoding.

Email MIME structure◈ Members↗
FA-76505

Validate Content-Transfer-Encoding across a MIME tree: encoding normalization · case 05

A declared "Base64" or a padded value is reported as an unknown encoding.

Email MIME structure◈ Members↗
FA-76506

Validate Content-Transfer-Encoding across a MIME tree: composite scope · case 01

A message/rfc822 part transferred as base64 is accepted although encapsulated messages may not be encoded.

Email MIME structure● Open access↗
FA-76507

Validate Content-Transfer-Encoding across a MIME tree: composite scope · case 02

A message/rfc822 part transferred as base64 is accepted although encapsulated messages may not be encoded.

Email MIME structure◈ Members↗
FA-76508

Validate Content-Transfer-Encoding across a MIME tree: composite scope · case 03

A message/rfc822 part transferred as base64 is accepted although encapsulated messages may not be encoded.

Email MIME structure◈ Members↗
FA-76509

Validate Content-Transfer-Encoding across a MIME tree: composite scope · case 04

A message/rfc822 part transferred as base64 is accepted although encapsulated messages may not be encoded.

Email MIME structure◈ Members↗
FA-76510

Validate Content-Transfer-Encoding across a MIME tree: composite scope · case 05

A message/rfc822 part transferred as base64 is accepted although encapsulated messages may not be encoded.

Email MIME structure◈ Members↗
FA-76511

Validate Content-Transfer-Encoding across a MIME tree: ceiling inheritance · case 01

An 8bit part nested two levels below a 7bit container is not reported.

Email MIME structure● Open access↗
FA-76512

Validate Content-Transfer-Encoding across a MIME tree: ceiling inheritance · case 02

An 8bit part nested two levels below a 7bit container is not reported.

Email MIME structure◈ Members↗
FA-76513

Validate Content-Transfer-Encoding across a MIME tree: ceiling inheritance · case 03

An 8bit part nested two levels below a 7bit container is not reported.

Email MIME structure◈ Members↗
FA-76514

Validate Content-Transfer-Encoding across a MIME tree: ceiling inheritance · case 04

An 8bit part nested two levels below a 7bit container is not reported.

Email MIME structure◈ Members↗
FA-76515

Validate Content-Transfer-Encoding across a MIME tree: ceiling inheritance · case 05

An 8bit part nested two levels below a 7bit container is not reported.

Email MIME structure◈ Members↗
FA-76516

Validate Content-Transfer-Encoding across a MIME tree: high character threshold · case 01

Latin-1 characters inside a 7bit part are accepted.

Email MIME structure● Open access↗
FA-76517

Validate Content-Transfer-Encoding across a MIME tree: high character threshold · case 02

Latin-1 characters inside a 7bit part are accepted.

Email MIME structure◈ Members↗
FA-76518

Validate Content-Transfer-Encoding across a MIME tree: high character threshold · case 03

Latin-1 characters inside a 7bit part are accepted.

Email MIME structure◈ Members↗
FA-76519

Validate Content-Transfer-Encoding across a MIME tree: high character threshold · case 04

Latin-1 characters inside a 7bit part are accepted.

Email MIME structure◈ Members↗
FA-76520

Validate Content-Transfer-Encoding across a MIME tree: high character threshold · case 05

Latin-1 characters inside a 7bit part are accepted.

Email MIME structure◈ Members↗
FA-76521

Validate Content-Transfer-Encoding across a MIME tree: line length limit · case 01

Lines of 999 or 1000 characters pass although the limit excludes line terminators.

Email MIME structure● Open access↗
FA-76522

Validate Content-Transfer-Encoding across a MIME tree: line length limit · case 02

Lines of 999 or 1000 characters pass although the limit excludes line terminators.

Email MIME structure◈ Members↗
FA-76523

Validate Content-Transfer-Encoding across a MIME tree: line length limit · case 03

Lines of 999 or 1000 characters pass although the limit excludes line terminators.

Email MIME structure◈ Members↗
FA-76524

Validate Content-Transfer-Encoding across a MIME tree: line length limit · case 04

Lines of 999 or 1000 characters pass although the limit excludes line terminators.

Email MIME structure◈ Members↗
FA-76525

Validate Content-Transfer-Encoding across a MIME tree: line length limit · case 05

Lines of 999 or 1000 characters pass although the limit excludes line terminators.

Email MIME structure◈ Members↗
FA-76526

Validate Content-Transfer-Encoding across a MIME tree: binary exemption · case 01

Over-long lines in 8bit parts are accepted as if the part were binary.

Email MIME structure● Open access↗
FA-76527

Validate Content-Transfer-Encoding across a MIME tree: binary exemption · case 02

Over-long lines in 8bit parts are accepted as if the part were binary.

Email MIME structure◈ Members↗
FA-76528

Validate Content-Transfer-Encoding across a MIME tree: binary exemption · case 03

Over-long lines in 8bit parts are accepted as if the part were binary.

Email MIME structure◈ Members↗
FA-76529

Validate Content-Transfer-Encoding across a MIME tree: binary exemption · case 04

Over-long lines in 8bit parts are accepted as if the part were binary.

Email MIME structure◈ Members↗
FA-76530

Validate Content-Transfer-Encoding across a MIME tree: binary exemption · case 05

Over-long lines in 8bit parts are accepted as if the part were binary.

Email MIME structure◈ Members↗
FA-76531

Build a bounded MIME tree summary from parser events: depth limit · case 01

One more nesting level than configured is accepted.

Email MIME structure● Open access↗
FA-76532

Build a bounded MIME tree summary from parser events: depth limit · case 02

One more nesting level than configured is accepted.

Email MIME structure◈ Members↗
FA-76533

Build a bounded MIME tree summary from parser events: depth limit · case 03

One more nesting level than configured is accepted.

Email MIME structure◈ Members↗
FA-76534

Build a bounded MIME tree summary from parser events: depth limit · case 04

One more nesting level than configured is accepted.

Email MIME structure◈ Members↗
FA-76535

Build a bounded MIME tree summary from parser events: depth limit · case 05

One more nesting level than configured is accepted.

Email MIME structure◈ Members↗
FA-76536

Build a bounded MIME tree summary from parser events: nested skip depth · case 01

After skipping an over-deep subtree with nested containers, parsing resumes inside it and misattributes its parts.

Email MIME structure● Open access↗
FA-76537

Build a bounded MIME tree summary from parser events: nested skip depth · case 02

After skipping an over-deep subtree with nested containers, parsing resumes inside it and misattributes its parts.

Email MIME structure◈ Members↗
FA-76538

Build a bounded MIME tree summary from parser events: nested skip depth · case 03

After skipping an over-deep subtree with nested containers, parsing resumes inside it and misattributes its parts.

Email MIME structure◈ Members↗
FA-76539

Build a bounded MIME tree summary from parser events: nested skip depth · case 04

After skipping an over-deep subtree with nested containers, parsing resumes inside it and misattributes its parts.

Email MIME structure◈ Members↗
FA-76540

Build a bounded MIME tree summary from parser events: nested skip depth · case 05

After skipping an over-deep subtree with nested containers, parsing resumes inside it and misattributes its parts.

Email MIME structure◈ Members↗
FA-76541

Build a bounded MIME tree summary from parser events: skipped child counted · case 01

A container whose only child was skipped as too deep is additionally reported as an empty multipart.

Email MIME structure● Open access↗
FA-76542

Build a bounded MIME tree summary from parser events: skipped child counted · case 02

A container whose only child was skipped as too deep is additionally reported as an empty multipart.

Email MIME structure◈ Members↗
FA-76543

Build a bounded MIME tree summary from parser events: skipped child counted · case 03

A container whose only child was skipped as too deep is additionally reported as an empty multipart.

Email MIME structure◈ Members↗
FA-76544

Build a bounded MIME tree summary from parser events: skipped child counted · case 04

A container whose only child was skipped as too deep is additionally reported as an empty multipart.

Email MIME structure◈ Members↗
FA-76545

Build a bounded MIME tree summary from parser events: skipped child counted · case 05

A container whose only child was skipped as too deep is additionally reported as an empty multipart.

Email MIME structure◈ Members↗
FA-76546

Build a bounded MIME tree summary from parser events: unclosed report · case 01

A message whose outermost multipart is never closed is accepted as complete.

Email MIME structure● Open access↗
FA-76547

Build a bounded MIME tree summary from parser events: unclosed report · case 02

A message whose outermost multipart is never closed is accepted as complete.

Email MIME structure◈ Members↗
FA-76548

Build a bounded MIME tree summary from parser events: unclosed report · case 03

A message whose outermost multipart is never closed is accepted as complete.

Email MIME structure◈ Members↗
FA-76549

Build a bounded MIME tree summary from parser events: unclosed report · case 04

A message whose outermost multipart is never closed is accepted as complete.

Email MIME structure◈ Members↗
FA-76550

Build a bounded MIME tree summary from parser events: unclosed report · case 05

A message whose outermost multipart is never closed is accepted as complete.

Email MIME structure◈ Members↗
FA-76551

Build a bounded MIME tree summary from parser events: maximum depth · case 01

The reported depth is the depth of the last container opened, not the deepest one.

Email MIME structure● Open access↗
FA-76552

Build a bounded MIME tree summary from parser events: maximum depth · case 02

The reported depth is the depth of the last container opened, not the deepest one.

Email MIME structure◈ Members↗
FA-76553

Build a bounded MIME tree summary from parser events: maximum depth · case 03

The reported depth is the depth of the last container opened, not the deepest one.

Email MIME structure◈ Members↗
FA-76554

Build a bounded MIME tree summary from parser events: maximum depth · case 04

The reported depth is the depth of the last container opened, not the deepest one.

Email MIME structure◈ Members↗
FA-76555

Build a bounded MIME tree summary from parser events: maximum depth · case 05

The reported depth is the depth of the last container opened, not the deepest one.

Email MIME structure◈ Members↗
FA-76556

Choose the MIME skeleton for an outgoing message: orphan inline images · case 01

Inline images of a message without an HTML body are silently dropped.

Email MIME structure● Open access↗
FA-76557

Choose the MIME skeleton for an outgoing message: orphan inline images · case 02

Inline images of a message without an HTML body are silently dropped.

Email MIME structure◈ Members↗
FA-76558

Choose the MIME skeleton for an outgoing message: orphan inline images · case 03

Inline images of a message without an HTML body are silently dropped.

Email MIME structure◈ Members↗
FA-76559

Choose the MIME skeleton for an outgoing message: orphan inline images · case 04

Inline images of a message without an HTML body are silently dropped.

Email MIME structure◈ Members↗
FA-76560

Choose the MIME skeleton for an outgoing message: orphan inline images · case 05

Inline images of a message without an HTML body are silently dropped.

Email MIME structure◈ Members↗
FA-76561

Choose the MIME skeleton for an outgoing message: alternative order · case 01

The plain-text alternative is placed after the HTML one, so clients prefer plain text.

Email MIME structure● Open access↗
FA-76562

Choose the MIME skeleton for an outgoing message: alternative order · case 02

The plain-text alternative is placed after the HTML one, so clients prefer plain text.

Email MIME structure◈ Members↗
FA-76563

Choose the MIME skeleton for an outgoing message: alternative order · case 03

The plain-text alternative is placed after the HTML one, so clients prefer plain text.

Email MIME structure◈ Members↗
FA-76564

Choose the MIME skeleton for an outgoing message: alternative order · case 04

The plain-text alternative is placed after the HTML one, so clients prefer plain text.

Email MIME structure◈ Members↗
FA-76565

Choose the MIME skeleton for an outgoing message: alternative order · case 05

The plain-text alternative is placed after the HTML one, so clients prefer plain text.

Email MIME structure◈ Members↗
FA-76566

Choose the MIME skeleton for an outgoing message: mixed only for attachments · case 01

Messages with inline images but no attachments get an unnecessary multipart/mixed wrapper.

Email MIME structure● Open access↗
FA-76567

Choose the MIME skeleton for an outgoing message: mixed only for attachments · case 02

Messages with inline images but no attachments get an unnecessary multipart/mixed wrapper.

Email MIME structure◈ Members↗
FA-76568

Choose the MIME skeleton for an outgoing message: mixed only for attachments · case 03

Messages with inline images but no attachments get an unnecessary multipart/mixed wrapper.

Email MIME structure◈ Members↗
FA-76569

Choose the MIME skeleton for an outgoing message: mixed only for attachments · case 04

Messages with inline images but no attachments get an unnecessary multipart/mixed wrapper.

Email MIME structure◈ Members↗
FA-76570

Choose the MIME skeleton for an outgoing message: mixed only for attachments · case 05

Messages with inline images but no attachments get an unnecessary multipart/mixed wrapper.

Email MIME structure◈ Members↗
FA-76571

Choose the MIME skeleton for an outgoing message: related root first · case 01

The HTML root is placed after the images inside multipart/related.

Email MIME structure● Open access↗
FA-76572

Choose the MIME skeleton for an outgoing message: related root first · case 02

The HTML root is placed after the images inside multipart/related.

Email MIME structure◈ Members↗
FA-76573

Choose the MIME skeleton for an outgoing message: related root first · case 03

The HTML root is placed after the images inside multipart/related.

Email MIME structure◈ Members↗
FA-76574

Choose the MIME skeleton for an outgoing message: related root first · case 04

The HTML root is placed after the images inside multipart/related.

Email MIME structure◈ Members↗
FA-76575

Choose the MIME skeleton for an outgoing message: related root first · case 05

The HTML root is placed after the images inside multipart/related.

Email MIME structure◈ Members↗
FA-76576

Choose the MIME skeleton for an outgoing message: body before attachments · case 01

Attachments precede the body in multipart/mixed, so clients show an attachment as the message.

Email MIME structure● Open access↗
FA-76577

Choose the MIME skeleton for an outgoing message: body before attachments · case 02

Attachments precede the body in multipart/mixed, so clients show an attachment as the message.

Email MIME structure◈ Members↗
FA-76578

Choose the MIME skeleton for an outgoing message: body before attachments · case 03

Attachments precede the body in multipart/mixed, so clients show an attachment as the message.

Email MIME structure◈ Members↗
FA-76579

Choose the MIME skeleton for an outgoing message: body before attachments · case 04

Attachments precede the body in multipart/mixed, so clients show an attachment as the message.

Email MIME structure◈ Members↗
FA-76580

Choose the MIME skeleton for an outgoing message: body before attachments · case 05

Attachments precede the body in multipart/mixed, so clients show an attachment as the message.

Email MIME structure◈ Members↗
FA-76581

Assemble the structure of a forwarded message: prefix detection · case 01

An existing "FWD:" prefix is not recognised, so forwarded subjects accumulate prefixes.

Email MIME structure● Open access↗
FA-76582

Assemble the structure of a forwarded message: prefix detection · case 02

An existing "FWD:" prefix is not recognised, so forwarded subjects accumulate prefixes.

Email MIME structure◈ Members↗
FA-76583

Assemble the structure of a forwarded message: prefix detection · case 03

An existing "FWD:" prefix is not recognised, so forwarded subjects accumulate prefixes.

Email MIME structure◈ Members↗
FA-76584

Assemble the structure of a forwarded message: prefix detection · case 04

An existing "FWD:" prefix is not recognised, so forwarded subjects accumulate prefixes.

Email MIME structure◈ Members↗
FA-76585

Assemble the structure of a forwarded message: prefix detection · case 05

An existing "FWD:" prefix is not recognised, so forwarded subjects accumulate prefixes.

Email MIME structure◈ Members↗
FA-76586

Assemble the structure of a forwarded message: attach mode no duplicates · case 01

Forwarding as an attachment also copies the original attachments beside the attached message, duplicating them.

Email MIME structure● Open access↗
FA-76587

Assemble the structure of a forwarded message: attach mode no duplicates · case 02

Forwarding as an attachment also copies the original attachments beside the attached message, duplicating them.

Email MIME structure◈ Members↗
FA-76588

Assemble the structure of a forwarded message: attach mode no duplicates · case 03

Forwarding as an attachment also copies the original attachments beside the attached message, duplicating them.

Email MIME structure◈ Members↗
FA-76589

Assemble the structure of a forwarded message: attach mode no duplicates · case 04

Forwarding as an attachment also copies the original attachments beside the attached message, duplicating them.

Email MIME structure◈ Members↗
FA-76590

Assemble the structure of a forwarded message: attach mode no duplicates · case 05

Forwarding as an attachment also copies the original attachments beside the attached message, duplicating them.

Email MIME structure◈ Members↗
FA-76591

Assemble the structure of a forwarded message: inline images need html · case 01

Inline images of the original become attachments of a plain-text forward.

Email MIME structure● Open access↗
FA-76592

Assemble the structure of a forwarded message: inline images need html · case 02

Inline images of the original become attachments of a plain-text forward.

Email MIME structure◈ Members↗
FA-76593

Assemble the structure of a forwarded message: inline images need html · case 03

Inline images of the original become attachments of a plain-text forward.

Email MIME structure◈ Members↗
FA-76594

Assemble the structure of a forwarded message: inline images need html · case 04

Inline images of the original become attachments of a plain-text forward.

Email MIME structure◈ Members↗
FA-76595

Assemble the structure of a forwarded message: inline images need html · case 05

Inline images of the original become attachments of a plain-text forward.

Email MIME structure◈ Members↗
FA-76596

Assemble the structure of a forwarded message: attachment order · case 01

Forwarded attachments are reordered alphabetically.

Email MIME structure● Open access↗
FA-76597

Assemble the structure of a forwarded message: attachment order · case 02

Forwarded attachments are reordered alphabetically.

Email MIME structure◈ Members↗
FA-76598

Assemble the structure of a forwarded message: attachment order · case 03

Forwarded attachments are reordered alphabetically.

Email MIME structure◈ Members↗
FA-76599

Assemble the structure of a forwarded message: attachment order · case 04

Forwarded attachments are reordered alphabetically.

Email MIME structure◈ Members↗
FA-76600

Assemble the structure of a forwarded message: attachment order · case 05

Forwarded attachments are reordered alphabetically.

Email MIME structure◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗