FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-701

Acknowledge a replicated write concern: Repeated acknowledgements count as separate replicas · case 01

The write concern operation is admitted even though repeated acknowledgements count as separate replicas.

Replication● Open access↗
FA-702

Acknowledge a replicated write concern: Repeated acknowledgements count as separate replicas · case 02

The write concern operation is admitted even though repeated acknowledgements count as separate replicas.

Replication◈ Members↗
FA-703

Acknowledge a replicated write concern: Repeated acknowledgements count as separate replicas · case 03

The write concern operation is admitted even though repeated acknowledgements count as separate replicas.

Replication◈ Members↗
FA-704

Acknowledge a replicated write concern: Repeated acknowledgements count as separate replicas · case 04

The write concern operation is admitted even though repeated acknowledgements count as separate replicas.

Replication◈ Members↗
FA-705

Acknowledge a replicated write concern: Repeated acknowledgements count as separate replicas · case 05

The write concern operation is admitted even though repeated acknowledgements count as separate replicas.

Replication◈ Members↗
FA-706

Acknowledge a replicated write concern: Volatile receipt acknowledgements satisfy durable concern · case 01

The write concern operation is admitted even though volatile receipt acknowledgements satisfy durable concern.

Replication● Open access↗
FA-707

Acknowledge a replicated write concern: Volatile receipt acknowledgements satisfy durable concern · case 02

The write concern operation is admitted even though volatile receipt acknowledgements satisfy durable concern.

Replication◈ Members↗
FA-708

Acknowledge a replicated write concern: Volatile receipt acknowledgements satisfy durable concern · case 03

The write concern operation is admitted even though volatile receipt acknowledgements satisfy durable concern.

Replication◈ Members↗
FA-709

Acknowledge a replicated write concern: Volatile receipt acknowledgements satisfy durable concern · case 04

The write concern operation is admitted even though volatile receipt acknowledgements satisfy durable concern.

Replication◈ Members↗
FA-710

Acknowledge a replicated write concern: Volatile receipt acknowledgements satisfy durable concern · case 05

The write concern operation is admitted even though volatile receipt acknowledgements satisfy durable concern.

Replication◈ Members↗
FA-711

Acknowledge a replicated write concern: Multiple copies in one failure domain satisfy zone concern · case 01

The write concern operation is admitted even though multiple copies in one failure domain satisfy zone concern.

Replication● Open access↗
FA-712

Acknowledge a replicated write concern: Multiple copies in one failure domain satisfy zone concern · case 02

The write concern operation is admitted even though multiple copies in one failure domain satisfy zone concern.

Replication◈ Members↗
FA-713

Acknowledge a replicated write concern: Multiple copies in one failure domain satisfy zone concern · case 03

The write concern operation is admitted even though multiple copies in one failure domain satisfy zone concern.

Replication◈ Members↗
FA-714

Acknowledge a replicated write concern: Multiple copies in one failure domain satisfy zone concern · case 04

The write concern operation is admitted even though multiple copies in one failure domain satisfy zone concern.

Replication◈ Members↗
FA-715

Acknowledge a replicated write concern: Multiple copies in one failure domain satisfy zone concern · case 05

The write concern operation is admitted even though multiple copies in one failure domain satisfy zone concern.

Replication◈ Members↗
FA-716

Acknowledge a replicated write concern: Replica acknowledgements refer to another write · case 01

The write concern operation is admitted even though replica acknowledgements refer to another write.

Replication● Open access↗
FA-717

Acknowledge a replicated write concern: Replica acknowledgements refer to another write · case 02

The write concern operation is admitted even though replica acknowledgements refer to another write.

Replication◈ Members↗
FA-718

Acknowledge a replicated write concern: Replica acknowledgements refer to another write · case 03

The write concern operation is admitted even though replica acknowledgements refer to another write.

Replication◈ Members↗
FA-719

Acknowledge a replicated write concern: Replica acknowledgements refer to another write · case 04

The write concern operation is admitted even though replica acknowledgements refer to another write.

Replication◈ Members↗
FA-720

Acknowledge a replicated write concern: Replica acknowledgements refer to another write · case 05

The write concern operation is admitted even though replica acknowledgements refer to another write.

Replication◈ Members↗
FA-721

Acknowledge a replicated write concern: A write is reported successful after its response deadline · case 01

The write concern operation is admitted even though a write is reported successful after its response deadline.

Replication● Open access↗
FA-722

Acknowledge a replicated write concern: A write is reported successful after its response deadline · case 02

The write concern operation is admitted even though a write is reported successful after its response deadline.

Replication◈ Members↗
FA-723

Acknowledge a replicated write concern: A write is reported successful after its response deadline · case 03

The write concern operation is admitted even though a write is reported successful after its response deadline.

Replication◈ Members↗
FA-724

Acknowledge a replicated write concern: A write is reported successful after its response deadline · case 04

The write concern operation is admitted even though a write is reported successful after its response deadline.

Replication◈ Members↗
FA-725

Acknowledge a replicated write concern: A write is reported successful after its response deadline · case 05

The write concern operation is admitted even though a write is reported successful after its response deadline.

Replication◈ Members↗
FA-726

Accept a durable queue publication: An oversized message bypasses broker frame limits · case 01

The queue publish operation is admitted even though an oversized message bypasses broker frame limits.

Queues● Open access↗
FA-727

Accept a durable queue publication: An oversized message bypasses broker frame limits · case 02

The queue publish operation is admitted even though an oversized message bypasses broker frame limits.

Queues◈ Members↗
FA-728

Accept a durable queue publication: An oversized message bypasses broker frame limits · case 03

The queue publish operation is admitted even though an oversized message bypasses broker frame limits.

Queues◈ Members↗
FA-729

Accept a durable queue publication: An oversized message bypasses broker frame limits · case 04

The queue publish operation is admitted even though an oversized message bypasses broker frame limits.

Queues◈ Members↗
FA-730

Accept a durable queue publication: An oversized message bypasses broker frame limits · case 05

The queue publish operation is admitted even though an oversized message bypasses broker frame limits.

Queues◈ Members↗
FA-731

Accept a durable queue publication: Admission exceeds the queue retained-byte budget · case 01

The queue publish operation is admitted even though admission exceeds the queue retained-byte budget.

Queues● Open access↗
FA-732

Accept a durable queue publication: Admission exceeds the queue retained-byte budget · case 02

The queue publish operation is admitted even though admission exceeds the queue retained-byte budget.

Queues◈ Members↗
FA-733

Accept a durable queue publication: Admission exceeds the queue retained-byte budget · case 03

The queue publish operation is admitted even though admission exceeds the queue retained-byte budget.

Queues◈ Members↗
FA-734

Accept a durable queue publication: Admission exceeds the queue retained-byte budget · case 04

The queue publish operation is admitted even though admission exceeds the queue retained-byte budget.

Queues◈ Members↗
FA-735

Accept a durable queue publication: Admission exceeds the queue retained-byte budget · case 05

The queue publish operation is admitted even though admission exceeds the queue retained-byte budget.

Queues◈ Members↗
FA-736

Accept a durable queue publication: A mandatory message has no matching queue · case 01

The queue publish operation is admitted even though a mandatory message has no matching queue.

Queues● Open access↗
FA-737

Accept a durable queue publication: A mandatory message has no matching queue · case 02

The queue publish operation is admitted even though a mandatory message has no matching queue.

Queues◈ Members↗
FA-738

Accept a durable queue publication: A mandatory message has no matching queue · case 03

The queue publish operation is admitted even though a mandatory message has no matching queue.

Queues◈ Members↗
FA-739

Accept a durable queue publication: A mandatory message has no matching queue · case 04

The queue publish operation is admitted even though a mandatory message has no matching queue.

Queues◈ Members↗
FA-740

Accept a durable queue publication: A mandatory message has no matching queue · case 05

The queue publish operation is admitted even though a mandatory message has no matching queue.

Queues◈ Members↗
FA-741

Accept a durable queue publication: A fenced producer continues publishing · case 01

The queue publish operation is admitted even though a fenced producer continues publishing.

Queues● Open access↗
FA-742

Accept a durable queue publication: A fenced producer continues publishing · case 02

The queue publish operation is admitted even though a fenced producer continues publishing.

Queues◈ Members↗
FA-743

Accept a durable queue publication: A fenced producer continues publishing · case 03

The queue publish operation is admitted even though a fenced producer continues publishing.

Queues◈ Members↗
FA-744

Accept a durable queue publication: A fenced producer continues publishing · case 04

The queue publish operation is admitted even though a fenced producer continues publishing.

Queues◈ Members↗
FA-745

Accept a durable queue publication: A fenced producer continues publishing · case 05

The queue publish operation is admitted even though a fenced producer continues publishing.

Queues◈ Members↗
FA-746

Accept a durable queue publication: A producer sequence gap is accepted as contiguous · case 01

The queue publish operation is admitted even though a producer sequence gap is accepted as contiguous.

Queues● Open access↗
FA-747

Accept a durable queue publication: A producer sequence gap is accepted as contiguous · case 02

The queue publish operation is admitted even though a producer sequence gap is accepted as contiguous.

Queues◈ Members↗
FA-748

Accept a durable queue publication: A producer sequence gap is accepted as contiguous · case 03

The queue publish operation is admitted even though a producer sequence gap is accepted as contiguous.

Queues◈ Members↗
FA-749

Accept a durable queue publication: A producer sequence gap is accepted as contiguous · case 04

The queue publish operation is admitted even though a producer sequence gap is accepted as contiguous.

Queues◈ Members↗
FA-750

Accept a durable queue publication: A producer sequence gap is accepted as contiguous · case 05

The queue publish operation is admitted even though a producer sequence gap is accepted as contiguous.

Queues◈ Members↗
FA-751

Reserve a queued message for delivery: A scheduled message is delivered before its visibility instant · case 01

The queue reservation operation is admitted even though a scheduled message is delivered before its visibility instant.

Queues● Open access↗
FA-752

Reserve a queued message for delivery: A scheduled message is delivered before its visibility instant · case 02

The queue reservation operation is admitted even though a scheduled message is delivered before its visibility instant.

Queues◈ Members↗
FA-753

Reserve a queued message for delivery: A scheduled message is delivered before its visibility instant · case 03

The queue reservation operation is admitted even though a scheduled message is delivered before its visibility instant.

Queues◈ Members↗
FA-754

Reserve a queued message for delivery: A scheduled message is delivered before its visibility instant · case 04

The queue reservation operation is admitted even though a scheduled message is delivered before its visibility instant.

Queues◈ Members↗
FA-755

Reserve a queued message for delivery: A scheduled message is delivered before its visibility instant · case 05

The queue reservation operation is admitted even though a scheduled message is delivered before its visibility instant.

Queues◈ Members↗
FA-756

Reserve a queued message for delivery: A message is delivered after its expiration deadline · case 01

The queue reservation operation is admitted even though a message is delivered after its expiration deadline.

Queues● Open access↗
FA-757

Reserve a queued message for delivery: A message is delivered after its expiration deadline · case 02

The queue reservation operation is admitted even though a message is delivered after its expiration deadline.

Queues◈ Members↗
FA-758

Reserve a queued message for delivery: A message is delivered after its expiration deadline · case 03

The queue reservation operation is admitted even though a message is delivered after its expiration deadline.

Queues◈ Members↗
FA-759

Reserve a queued message for delivery: A message is delivered after its expiration deadline · case 04

The queue reservation operation is admitted even though a message is delivered after its expiration deadline.

Queues◈ Members↗
FA-760

Reserve a queued message for delivery: A message is delivered after its expiration deadline · case 05

The queue reservation operation is admitted even though a message is delivered after its expiration deadline.

Queues◈ Members↗
FA-761

Reserve a queued message for delivery: A second worker reserves a currently leased message · case 01

The queue reservation operation is admitted even though a second worker reserves a currently leased message.

Queues● Open access↗
FA-762

Reserve a queued message for delivery: A second worker reserves a currently leased message · case 02

The queue reservation operation is admitted even though a second worker reserves a currently leased message.

Queues◈ Members↗
FA-763

Reserve a queued message for delivery: A second worker reserves a currently leased message · case 03

The queue reservation operation is admitted even though a second worker reserves a currently leased message.

Queues◈ Members↗
FA-764

Reserve a queued message for delivery: A second worker reserves a currently leased message · case 04

The queue reservation operation is admitted even though a second worker reserves a currently leased message.

Queues◈ Members↗
FA-765

Reserve a queued message for delivery: A second worker reserves a currently leased message · case 05

The queue reservation operation is admitted even though a second worker reserves a currently leased message.

Queues◈ Members↗
FA-766

Reserve a queued message for delivery: The broker exceeds consumer in-flight credit · case 01

The queue reservation operation is admitted even though the broker exceeds consumer in-flight credit.

Queues● Open access↗
FA-767

Reserve a queued message for delivery: The broker exceeds consumer in-flight credit · case 02

The queue reservation operation is admitted even though the broker exceeds consumer in-flight credit.

Queues◈ Members↗
FA-768

Reserve a queued message for delivery: The broker exceeds consumer in-flight credit · case 03

The queue reservation operation is admitted even though the broker exceeds consumer in-flight credit.

Queues◈ Members↗
FA-769

Reserve a queued message for delivery: The broker exceeds consumer in-flight credit · case 04

The queue reservation operation is admitted even though the broker exceeds consumer in-flight credit.

Queues◈ Members↗
FA-770

Reserve a queued message for delivery: The broker exceeds consumer in-flight credit · case 05

The queue reservation operation is admitted even though the broker exceeds consumer in-flight credit.

Queues◈ Members↗
FA-771

Reserve a queued message for delivery: A FIFO message overtakes an earlier group member · case 01

The queue reservation operation is admitted even though a fifo message overtakes an earlier group member.

Queues● Open access↗
FA-772

Reserve a queued message for delivery: A FIFO message overtakes an earlier group member · case 02

The queue reservation operation is admitted even though a fifo message overtakes an earlier group member.

Queues◈ Members↗
FA-773

Reserve a queued message for delivery: A FIFO message overtakes an earlier group member · case 03

The queue reservation operation is admitted even though a fifo message overtakes an earlier group member.

Queues◈ Members↗
FA-774

Reserve a queued message for delivery: A FIFO message overtakes an earlier group member · case 04

The queue reservation operation is admitted even though a fifo message overtakes an earlier group member.

Queues◈ Members↗
FA-775

Reserve a queued message for delivery: A FIFO message overtakes an earlier group member · case 05

The queue reservation operation is admitted even though a fifo message overtakes an earlier group member.

Queues◈ Members↗
FA-776

Settle a queue delivery acknowledgement: A receipt from an older delivery deletes the current message · case 01

The queue acknowledge operation is admitted even though a receipt from an older delivery deletes the current message.

Queues● Open access↗
FA-777

Settle a queue delivery acknowledgement: A receipt from an older delivery deletes the current message · case 02

The queue acknowledge operation is admitted even though a receipt from an older delivery deletes the current message.

Queues◈ Members↗
FA-778

Settle a queue delivery acknowledgement: A receipt from an older delivery deletes the current message · case 03

The queue acknowledge operation is admitted even though a receipt from an older delivery deletes the current message.

Queues◈ Members↗
FA-779

Settle a queue delivery acknowledgement: A receipt from an older delivery deletes the current message · case 04

The queue acknowledge operation is admitted even though a receipt from an older delivery deletes the current message.

Queues◈ Members↗
FA-780

Settle a queue delivery acknowledgement: A receipt from an older delivery deletes the current message · case 05

The queue acknowledge operation is admitted even though a receipt from an older delivery deletes the current message.

Queues◈ Members↗
FA-781

Settle a queue delivery acknowledgement: An acknowledgement settles an already expired reservation · case 01

The queue acknowledge operation is admitted even though an acknowledgement settles an already expired reservation.

Queues● Open access↗
FA-782

Settle a queue delivery acknowledgement: An acknowledgement settles an already expired reservation · case 02

The queue acknowledge operation is admitted even though an acknowledgement settles an already expired reservation.

Queues◈ Members↗
FA-783

Settle a queue delivery acknowledgement: An acknowledgement settles an already expired reservation · case 03

The queue acknowledge operation is admitted even though an acknowledgement settles an already expired reservation.

Queues◈ Members↗
FA-784

Settle a queue delivery acknowledgement: An acknowledgement settles an already expired reservation · case 04

The queue acknowledge operation is admitted even though an acknowledgement settles an already expired reservation.

Queues◈ Members↗
FA-785

Settle a queue delivery acknowledgement: An acknowledgement settles an already expired reservation · case 05

The queue acknowledge operation is admitted even though an acknowledgement settles an already expired reservation.

Queues◈ Members↗
FA-786

Settle a queue delivery acknowledgement: A delivery tag from another channel is settled · case 01

The queue acknowledge operation is admitted even though a delivery tag from another channel is settled.

Queues● Open access↗
FA-787

Settle a queue delivery acknowledgement: A delivery tag from another channel is settled · case 02

The queue acknowledge operation is admitted even though a delivery tag from another channel is settled.

Queues◈ Members↗
FA-788

Settle a queue delivery acknowledgement: A delivery tag from another channel is settled · case 03

The queue acknowledge operation is admitted even though a delivery tag from another channel is settled.

Queues◈ Members↗
FA-789

Settle a queue delivery acknowledgement: A delivery tag from another channel is settled · case 04

The queue acknowledge operation is admitted even though a delivery tag from another channel is settled.

Queues◈ Members↗
FA-790

Settle a queue delivery acknowledgement: A delivery tag from another channel is settled · case 05

The queue acknowledge operation is admitted even though a delivery tag from another channel is settled.

Queues◈ Members↗
FA-791

Settle a queue delivery acknowledgement: A second settlement credits the consumer twice · case 01

The queue acknowledge operation is admitted even though a second settlement credits the consumer twice.

Queues● Open access↗
FA-792

Settle a queue delivery acknowledgement: A second settlement credits the consumer twice · case 02

The queue acknowledge operation is admitted even though a second settlement credits the consumer twice.

Queues◈ Members↗
FA-793

Settle a queue delivery acknowledgement: A second settlement credits the consumer twice · case 03

The queue acknowledge operation is admitted even though a second settlement credits the consumer twice.

Queues◈ Members↗
FA-794

Settle a queue delivery acknowledgement: A second settlement credits the consumer twice · case 04

The queue acknowledge operation is admitted even though a second settlement credits the consumer twice.

Queues◈ Members↗
FA-795

Settle a queue delivery acknowledgement: A second settlement credits the consumer twice · case 05

The queue acknowledge operation is admitted even though a second settlement credits the consumer twice.

Queues◈ Members↗
FA-796

Settle a queue delivery acknowledgement: Cumulative acknowledgement jumps over an unprocessed delivery · case 01

The queue acknowledge operation is admitted even though cumulative acknowledgement jumps over an unprocessed delivery.

Queues● Open access↗
FA-797

Settle a queue delivery acknowledgement: Cumulative acknowledgement jumps over an unprocessed delivery · case 02

The queue acknowledge operation is admitted even though cumulative acknowledgement jumps over an unprocessed delivery.

Queues◈ Members↗
FA-798

Settle a queue delivery acknowledgement: Cumulative acknowledgement jumps over an unprocessed delivery · case 03

The queue acknowledge operation is admitted even though cumulative acknowledgement jumps over an unprocessed delivery.

Queues◈ Members↗
FA-799

Settle a queue delivery acknowledgement: Cumulative acknowledgement jumps over an unprocessed delivery · case 04

The queue acknowledge operation is admitted even though cumulative acknowledgement jumps over an unprocessed delivery.

Queues◈ Members↗
FA-800

Settle a queue delivery acknowledgement: Cumulative acknowledgement jumps over an unprocessed delivery · case 05

The queue acknowledge operation is admitted even though cumulative acknowledgement jumps over an unprocessed delivery.

Queues◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗