FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-6601

Retry classification includes replacement and deletion methods · case 01

Retry classification includes replacement and deletion methods.

HTTP semantics● Open access↗
FA-6602

Retry classification includes replacement and deletion methods · case 02

Retry classification includes replacement and deletion methods.

HTTP semantics◈ Members↗
FA-6603

Retry classification includes replacement and deletion methods · case 03

Retry classification includes replacement and deletion methods.

HTTP semantics◈ Members↗
FA-6604

Retry classification includes replacement and deletion methods · case 04

Retry classification includes replacement and deletion methods.

HTTP semantics◈ Members↗
FA-6605

Retry classification includes replacement and deletion methods · case 05

Retry classification includes replacement and deletion methods.

HTTP semantics◈ Members↗
FA-6606

An Allow response includes HEAD when GET is available · case 01

An Allow response includes HEAD when GET is available.

HTTP semantics● Open access↗
FA-6607

An Allow response includes HEAD when GET is available · case 02

An Allow response includes HEAD when GET is available.

HTTP semantics◈ Members↗
FA-6608

An Allow response includes HEAD when GET is available · case 03

An Allow response includes HEAD when GET is available.

HTTP semantics◈ Members↗
FA-6609

An Allow response includes HEAD when GET is available · case 04

An Allow response includes HEAD when GET is available.

HTTP semantics◈ Members↗
FA-6610

An Allow response includes HEAD when GET is available · case 05

An Allow response includes HEAD when GET is available.

HTTP semantics◈ Members↗
FA-6611

Method token matching preserves case sensitivity · case 01

Method token matching preserves case sensitivity.

HTTP semantics● Open access↗
FA-6612

Method token matching preserves case sensitivity · case 02

Method token matching preserves case sensitivity.

HTTP semantics◈ Members↗
FA-6613

Method token matching preserves case sensitivity · case 03

Method token matching preserves case sensitivity.

HTTP semantics◈ Members↗
FA-6614

Method token matching preserves case sensitivity · case 04

Method token matching preserves case sensitivity.

HTTP semantics◈ Members↗
FA-6615

Method token matching preserves case sensitivity · case 05

Method token matching preserves case sensitivity.

HTTP semantics◈ Members↗
FA-6616

Continue is emitted only before an expected request body · case 01

Continue is emitted only before an expected request body.

HTTP semantics● Open access↗
FA-6617

Continue is emitted only before an expected request body · case 02

Continue is emitted only before an expected request body.

HTTP semantics◈ Members↗
FA-6618

Continue is emitted only before an expected request body · case 03

Continue is emitted only before an expected request body.

HTTP semantics◈ Members↗
FA-6619

Continue is emitted only before an expected request body · case 04

Continue is emitted only before an expected request body.

HTTP semantics◈ Members↗
FA-6620

Continue is emitted only before an expected request body · case 05

Continue is emitted only before an expected request body.

HTTP semantics◈ Members↗
FA-6621

Unsupported expectations are rejected independently of body length · case 01

Unsupported expectations are rejected independently of body length.

HTTP semantics● Open access↗
FA-6622

Unsupported expectations are rejected independently of body length · case 02

Unsupported expectations are rejected independently of body length.

HTTP semantics◈ Members↗
FA-6623

Unsupported expectations are rejected independently of body length · case 03

Unsupported expectations are rejected independently of body length.

HTTP semantics◈ Members↗
FA-6624

Unsupported expectations are rejected independently of body length · case 04

Unsupported expectations are rejected independently of body length.

HTTP semantics◈ Members↗
FA-6625

Unsupported expectations are rejected independently of body length · case 05

Unsupported expectations are rejected independently of body length.

HTTP semantics◈ Members↗
FA-6626

CONNECT uses authority form and server-wide OPTIONS uses asterisk form · case 01

CONNECT uses authority form and server-wide OPTIONS uses asterisk form.

HTTP semantics● Open access↗
FA-6627

CONNECT uses authority form and server-wide OPTIONS uses asterisk form · case 02

CONNECT uses authority form and server-wide OPTIONS uses asterisk form.

HTTP semantics◈ Members↗
FA-6628

CONNECT uses authority form and server-wide OPTIONS uses asterisk form · case 03

CONNECT uses authority form and server-wide OPTIONS uses asterisk form.

HTTP semantics◈ Members↗
FA-6629

CONNECT uses authority form and server-wide OPTIONS uses asterisk form · case 04

CONNECT uses authority form and server-wide OPTIONS uses asterisk form.

HTTP semantics◈ Members↗
FA-6630

CONNECT uses authority form and server-wide OPTIONS uses asterisk form · case 05

CONNECT uses authority form and server-wide OPTIONS uses asterisk form.

HTTP semantics◈ Members↗
FA-6631

Redirect rewriting preserves methods for 307 and 308 · case 01

Redirect rewriting preserves methods for 307 and 308.

HTTP redirects● Open access↗
FA-6632

Redirect rewriting preserves methods for 307 and 308 · case 02

Redirect rewriting preserves methods for 307 and 308.

HTTP redirects◈ Members↗
FA-6633

Redirect rewriting preserves methods for 307 and 308 · case 03

Redirect rewriting preserves methods for 307 and 308.

HTTP redirects◈ Members↗
FA-6634

Redirect rewriting preserves methods for 307 and 308 · case 04

Redirect rewriting preserves methods for 307 and 308.

HTTP redirects◈ Members↗
FA-6635

Redirect rewriting preserves methods for 307 and 308 · case 05

Redirect rewriting preserves methods for 307 and 308.

HTTP redirects◈ Members↗
FA-6636

A relative Location resolves against the current request URL · case 01

A relative Location resolves against the current request URL.

HTTP redirects● Open access↗
FA-6637

A relative Location resolves against the current request URL · case 02

A relative Location resolves against the current request URL.

HTTP redirects◈ Members↗
FA-6638

A relative Location resolves against the current request URL · case 03

A relative Location resolves against the current request URL.

HTTP redirects◈ Members↗
FA-6639

A relative Location resolves against the current request URL · case 04

A relative Location resolves against the current request URL.

HTTP redirects◈ Members↗
FA-6640

A relative Location resolves against the current request URL · case 05

A relative Location resolves against the current request URL.

HTTP redirects◈ Members↗
FA-6641

A redirect without a fragment inherits the original fragment · case 01

A redirect without a fragment inherits the original fragment.

HTTP redirects● Open access↗
FA-6642

A redirect without a fragment inherits the original fragment · case 02

A redirect without a fragment inherits the original fragment.

HTTP redirects◈ Members↗
FA-6643

A redirect without a fragment inherits the original fragment · case 03

A redirect without a fragment inherits the original fragment.

HTTP redirects◈ Members↗
FA-6644

A redirect without a fragment inherits the original fragment · case 04

A redirect without a fragment inherits the original fragment.

HTTP redirects◈ Members↗
FA-6645

A redirect without a fragment inherits the original fragment · case 05

A redirect without a fragment inherits the original fragment.

HTTP redirects◈ Members↗
FA-6646

Loop detection ignores URL fragments but retains query identity · case 01

Loop detection ignores URL fragments but retains query identity.

HTTP redirects● Open access↗
FA-6647

Loop detection ignores URL fragments but retains query identity · case 02

Loop detection ignores URL fragments but retains query identity.

HTTP redirects◈ Members↗
FA-6648

Loop detection ignores URL fragments but retains query identity · case 03

Loop detection ignores URL fragments but retains query identity.

HTTP redirects◈ Members↗
FA-6649

Loop detection ignores URL fragments but retains query identity · case 04

Loop detection ignores URL fragments but retains query identity.

HTTP redirects◈ Members↗
FA-6650

Loop detection ignores URL fragments but retains query identity · case 05

Loop detection ignores URL fragments but retains query identity.

HTTP redirects◈ Members↗
FA-6651

A redirect budget charges redirects rather than the initial request · case 01

A redirect budget charges redirects rather than the initial request.

HTTP redirects● Open access↗
FA-6652

A redirect budget charges redirects rather than the initial request · case 02

A redirect budget charges redirects rather than the initial request.

HTTP redirects◈ Members↗
FA-6653

A redirect budget charges redirects rather than the initial request · case 03

A redirect budget charges redirects rather than the initial request.

HTTP redirects◈ Members↗
FA-6654

A redirect budget charges redirects rather than the initial request · case 04

A redirect budget charges redirects rather than the initial request.

HTTP redirects◈ Members↗
FA-6655

A redirect budget charges redirects rather than the initial request · case 05

A redirect budget charges redirects rather than the initial request.

HTTP redirects◈ Members↗
FA-6656

Negative Retry-After delays are clamped before imposing a cap · case 01

Negative Retry-After delays are clamped before imposing a cap.

HTTP retries● Open access↗
FA-6657

Negative Retry-After delays are clamped before imposing a cap · case 02

Negative Retry-After delays are clamped before imposing a cap.

HTTP retries◈ Members↗
FA-6658

Negative Retry-After delays are clamped before imposing a cap · case 03

Negative Retry-After delays are clamped before imposing a cap.

HTTP retries◈ Members↗
FA-6659

Negative Retry-After delays are clamped before imposing a cap · case 04

Negative Retry-After delays are clamped before imposing a cap.

HTTP retries◈ Members↗
FA-6660

Negative Retry-After delays are clamped before imposing a cap · case 05

Negative Retry-After delays are clamped before imposing a cap.

HTTP retries◈ Members↗
FA-6661

Status retries require both a configured status and a replayable body · case 01

Status retries require both a configured status and a replayable body.

HTTP retries● Open access↗
FA-6662

Status retries require both a configured status and a replayable body · case 02

Status retries require both a configured status and a replayable body.

HTTP retries◈ Members↗
FA-6663

Status retries require both a configured status and a replayable body · case 03

Status retries require both a configured status and a replayable body.

HTTP retries◈ Members↗
FA-6664

Status retries require both a configured status and a replayable body · case 04

Status retries require both a configured status and a replayable body.

HTTP retries◈ Members↗
FA-6665

Status retries require both a configured status and a replayable body · case 05

Status retries require both a configured status and a replayable body.

HTTP retries◈ Members↗
FA-6666

An unsafe request cannot replay after any bytes may have reached the peer · case 01

An unsafe request cannot replay after any bytes may have reached the peer.

HTTP retries● Open access↗
FA-6667

An unsafe request cannot replay after any bytes may have reached the peer · case 02

An unsafe request cannot replay after any bytes may have reached the peer.

HTTP retries◈ Members↗
FA-6668

An unsafe request cannot replay after any bytes may have reached the peer · case 03

An unsafe request cannot replay after any bytes may have reached the peer.

HTTP retries◈ Members↗
FA-6669

An unsafe request cannot replay after any bytes may have reached the peer · case 04

An unsafe request cannot replay after any bytes may have reached the peer.

HTTP retries◈ Members↗
FA-6670

An unsafe request cannot replay after any bytes may have reached the peer · case 05

An unsafe request cannot replay after any bytes may have reached the peer.

HTTP retries◈ Members↗
FA-6671

A retry starts only when both backoff and minimum service time fit · case 01

A retry starts only when both backoff and minimum service time fit.

HTTP retries● Open access↗
FA-6672

A retry starts only when both backoff and minimum service time fit · case 02

A retry starts only when both backoff and minimum service time fit.

HTTP retries◈ Members↗
FA-6673

A retry starts only when both backoff and minimum service time fit · case 03

A retry starts only when both backoff and minimum service time fit.

HTTP retries◈ Members↗
FA-6674

A retry starts only when both backoff and minimum service time fit · case 04

A retry starts only when both backoff and minimum service time fit.

HTTP retries◈ Members↗
FA-6675

A retry starts only when both backoff and minimum service time fit · case 05

A retry starts only when both backoff and minimum service time fit.

HTTP retries◈ Members↗
FA-6676

Deterministic full jitter spans the entire capped delay interval · case 01

Deterministic full jitter spans the entire capped delay interval.

HTTP retries● Open access↗
FA-6677

Deterministic full jitter spans the entire capped delay interval · case 02

Deterministic full jitter spans the entire capped delay interval.

HTTP retries◈ Members↗
FA-6678

Deterministic full jitter spans the entire capped delay interval · case 03

Deterministic full jitter spans the entire capped delay interval.

HTTP retries◈ Members↗
FA-6679

Deterministic full jitter spans the entire capped delay interval · case 04

Deterministic full jitter spans the entire capped delay interval.

HTTP retries◈ Members↗
FA-6680

Deterministic full jitter spans the entire capped delay interval · case 05

Deterministic full jitter spans the entire capped delay interval.

HTTP retries◈ Members↗
FA-6681

An inclusive byte endpoint yields one more byte than endpoint subtraction · case 01

An inclusive byte endpoint yields one more byte than endpoint subtraction.

HTTP ranges● Open access↗
FA-6682

An inclusive byte endpoint yields one more byte than endpoint subtraction · case 02

An inclusive byte endpoint yields one more byte than endpoint subtraction.

HTTP ranges◈ Members↗
FA-6683

An inclusive byte endpoint yields one more byte than endpoint subtraction · case 03

An inclusive byte endpoint yields one more byte than endpoint subtraction.

HTTP ranges◈ Members↗
FA-6684

An inclusive byte endpoint yields one more byte than endpoint subtraction · case 04

An inclusive byte endpoint yields one more byte than endpoint subtraction.

HTTP ranges◈ Members↗
FA-6685

An inclusive byte endpoint yields one more byte than endpoint subtraction · case 05

An inclusive byte endpoint yields one more byte than endpoint subtraction.

HTTP ranges◈ Members↗
FA-6686

An open byte range clips at representation length and rejects starts beyond it · case 01

An open byte range clips at representation length and rejects starts beyond it.

HTTP ranges● Open access↗
FA-6687

An open byte range clips at representation length and rejects starts beyond it · case 02

An open byte range clips at representation length and rejects starts beyond it.

HTTP ranges◈ Members↗
FA-6688

An open byte range clips at representation length and rejects starts beyond it · case 03

An open byte range clips at representation length and rejects starts beyond it.

HTTP ranges◈ Members↗
FA-6689

An open byte range clips at representation length and rejects starts beyond it · case 04

An open byte range clips at representation length and rejects starts beyond it.

HTTP ranges◈ Members↗
FA-6690

An open byte range clips at representation length and rejects starts beyond it · case 05

An open byte range clips at representation length and rejects starts beyond it.

HTTP ranges◈ Members↗
FA-6691

A suffix range is bounded by representation length and excludes zero suffixes · case 01

A suffix range is bounded by representation length and excludes zero suffixes.

HTTP ranges● Open access↗
FA-6692

A suffix range is bounded by representation length and excludes zero suffixes · case 02

A suffix range is bounded by representation length and excludes zero suffixes.

HTTP ranges◈ Members↗
FA-6693

A suffix range is bounded by representation length and excludes zero suffixes · case 03

A suffix range is bounded by representation length and excludes zero suffixes.

HTTP ranges◈ Members↗
FA-6694

A suffix range is bounded by representation length and excludes zero suffixes · case 04

A suffix range is bounded by representation length and excludes zero suffixes.

HTTP ranges◈ Members↗
FA-6695

A suffix range is bounded by representation length and excludes zero suffixes · case 05

A suffix range is bounded by representation length and excludes zero suffixes.

HTTP ranges◈ Members↗
FA-6696

A range set is unsatisfiable only when every requested start is beyond the representation · case 01

A range set is unsatisfiable only when every requested start is beyond the representation.

HTTP ranges● Open access↗
FA-6697

A range set is unsatisfiable only when every requested start is beyond the representation · case 02

A range set is unsatisfiable only when every requested start is beyond the representation.

HTTP ranges◈ Members↗
FA-6698

A range set is unsatisfiable only when every requested start is beyond the representation · case 03

A range set is unsatisfiable only when every requested start is beyond the representation.

HTTP ranges◈ Members↗
FA-6699

A range set is unsatisfiable only when every requested start is beyond the representation · case 04

A range set is unsatisfiable only when every requested start is beyond the representation.

HTTP ranges◈ Members↗
FA-6700

A range set is unsatisfiable only when every requested start is beyond the representation · case 05

A range set is unsatisfiable only when every requested start is beyond the representation.

HTTP ranges◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗