FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-1001

Enter a dependency bulkhead: Concurrent calls exceed the dependency execution limit · case 01

The bulkhead admission operation is admitted even though concurrent calls exceed the dependency execution limit.

Reliability● Open access↗
FA-1002

Enter a dependency bulkhead: Concurrent calls exceed the dependency execution limit · case 02

The bulkhead admission operation is admitted even though concurrent calls exceed the dependency execution limit.

Reliability◈ Members↗
FA-1003

Enter a dependency bulkhead: Concurrent calls exceed the dependency execution limit · case 03

The bulkhead admission operation is admitted even though concurrent calls exceed the dependency execution limit.

Reliability◈ Members↗
FA-1004

Enter a dependency bulkhead: Concurrent calls exceed the dependency execution limit · case 04

The bulkhead admission operation is admitted even though concurrent calls exceed the dependency execution limit.

Reliability◈ Members↗
FA-1005

Enter a dependency bulkhead: Concurrent calls exceed the dependency execution limit · case 05

The bulkhead admission operation is admitted even though concurrent calls exceed the dependency execution limit.

Reliability◈ Members↗
FA-1006

Enter a dependency bulkhead: Waiting callers exceed the bounded waiting queue · case 01

The bulkhead admission operation is admitted even though waiting callers exceed the bounded waiting queue.

Reliability● Open access↗
FA-1007

Enter a dependency bulkhead: Waiting callers exceed the bounded waiting queue · case 02

The bulkhead admission operation is admitted even though waiting callers exceed the bounded waiting queue.

Reliability◈ Members↗
FA-1008

Enter a dependency bulkhead: Waiting callers exceed the bounded waiting queue · case 03

The bulkhead admission operation is admitted even though waiting callers exceed the bounded waiting queue.

Reliability◈ Members↗
FA-1009

Enter a dependency bulkhead: Waiting callers exceed the bounded waiting queue · case 04

The bulkhead admission operation is admitted even though waiting callers exceed the bounded waiting queue.

Reliability◈ Members↗
FA-1010

Enter a dependency bulkhead: Waiting callers exceed the bounded waiting queue · case 05

The bulkhead admission operation is admitted even though waiting callers exceed the bounded waiting queue.

Reliability◈ Members↗
FA-1011

Enter a dependency bulkhead: A waiting call starts after its queue deadline · case 01

The bulkhead admission operation is admitted even though a waiting call starts after its queue deadline.

Reliability● Open access↗
FA-1012

Enter a dependency bulkhead: A waiting call starts after its queue deadline · case 02

The bulkhead admission operation is admitted even though a waiting call starts after its queue deadline.

Reliability◈ Members↗
FA-1013

Enter a dependency bulkhead: A waiting call starts after its queue deadline · case 03

The bulkhead admission operation is admitted even though a waiting call starts after its queue deadline.

Reliability◈ Members↗
FA-1014

Enter a dependency bulkhead: A waiting call starts after its queue deadline · case 04

The bulkhead admission operation is admitted even though a waiting call starts after its queue deadline.

Reliability◈ Members↗
FA-1015

Enter a dependency bulkhead: A waiting call starts after its queue deadline · case 05

The bulkhead admission operation is admitted even though a waiting call starts after its queue deadline.

Reliability◈ Members↗
FA-1016

Enter a dependency bulkhead: Normal traffic consumes capacity reserved for recovery · case 01

The bulkhead admission operation is admitted even though normal traffic consumes capacity reserved for recovery.

Reliability● Open access↗
FA-1017

Enter a dependency bulkhead: Normal traffic consumes capacity reserved for recovery · case 02

The bulkhead admission operation is admitted even though normal traffic consumes capacity reserved for recovery.

Reliability◈ Members↗
FA-1018

Enter a dependency bulkhead: Normal traffic consumes capacity reserved for recovery · case 03

The bulkhead admission operation is admitted even though normal traffic consumes capacity reserved for recovery.

Reliability◈ Members↗
FA-1019

Enter a dependency bulkhead: Normal traffic consumes capacity reserved for recovery · case 04

The bulkhead admission operation is admitted even though normal traffic consumes capacity reserved for recovery.

Reliability◈ Members↗
FA-1020

Enter a dependency bulkhead: Normal traffic consumes capacity reserved for recovery · case 05

The bulkhead admission operation is admitted even though normal traffic consumes capacity reserved for recovery.

Reliability◈ Members↗
FA-1021

Enter a dependency bulkhead: Unrelated dependencies share a bulkhead accounting key · case 01

The bulkhead admission operation is admitted even though unrelated dependencies share a bulkhead accounting key.

Reliability● Open access↗
FA-1022

Enter a dependency bulkhead: Unrelated dependencies share a bulkhead accounting key · case 02

The bulkhead admission operation is admitted even though unrelated dependencies share a bulkhead accounting key.

Reliability◈ Members↗
FA-1023

Enter a dependency bulkhead: Unrelated dependencies share a bulkhead accounting key · case 03

The bulkhead admission operation is admitted even though unrelated dependencies share a bulkhead accounting key.

Reliability◈ Members↗
FA-1024

Enter a dependency bulkhead: Unrelated dependencies share a bulkhead accounting key · case 04

The bulkhead admission operation is admitted even though unrelated dependencies share a bulkhead accounting key.

Reliability◈ Members↗
FA-1025

Enter a dependency bulkhead: Unrelated dependencies share a bulkhead accounting key · case 05

The bulkhead admission operation is admitted even though unrelated dependencies share a bulkhead accounting key.

Reliability◈ Members↗
FA-1026

Evict an unhealthy backend: One intermittent failure causes premature eviction · case 01

The health eviction operation is admitted even though one intermittent failure causes premature eviction.

Reliability● Open access↗
FA-1027

Evict an unhealthy backend: One intermittent failure causes premature eviction · case 02

The health eviction operation is admitted even though one intermittent failure causes premature eviction.

Reliability◈ Members↗
FA-1028

Evict an unhealthy backend: One intermittent failure causes premature eviction · case 03

The health eviction operation is admitted even though one intermittent failure causes premature eviction.

Reliability◈ Members↗
FA-1029

Evict an unhealthy backend: One intermittent failure causes premature eviction · case 04

The health eviction operation is admitted even though one intermittent failure causes premature eviction.

Reliability◈ Members↗
FA-1030

Evict an unhealthy backend: One intermittent failure causes premature eviction · case 05

The health eviction operation is admitted even though one intermittent failure causes premature eviction.

Reliability◈ Members↗
FA-1031

Evict an unhealthy backend: Eviction removes the last required healthy capacity · case 01

The health eviction operation is admitted even though eviction removes the last required healthy capacity.

Reliability● Open access↗
FA-1032

Evict an unhealthy backend: Eviction removes the last required healthy capacity · case 02

The health eviction operation is admitted even though eviction removes the last required healthy capacity.

Reliability◈ Members↗
FA-1033

Evict an unhealthy backend: Eviction removes the last required healthy capacity · case 03

The health eviction operation is admitted even though eviction removes the last required healthy capacity.

Reliability◈ Members↗
FA-1034

Evict an unhealthy backend: Eviction removes the last required healthy capacity · case 04

The health eviction operation is admitted even though eviction removes the last required healthy capacity.

Reliability◈ Members↗
FA-1035

Evict an unhealthy backend: Eviction removes the last required healthy capacity · case 05

The health eviction operation is admitted even though eviction removes the last required healthy capacity.

Reliability◈ Members↗
FA-1036

Evict an unhealthy backend: Old failure samples evict a recovered backend · case 01

The health eviction operation is admitted even though old failure samples evict a recovered backend.

Reliability● Open access↗
FA-1037

Evict an unhealthy backend: Old failure samples evict a recovered backend · case 02

The health eviction operation is admitted even though old failure samples evict a recovered backend.

Reliability◈ Members↗
FA-1038

Evict an unhealthy backend: Old failure samples evict a recovered backend · case 03

The health eviction operation is admitted even though old failure samples evict a recovered backend.

Reliability◈ Members↗
FA-1039

Evict an unhealthy backend: Old failure samples evict a recovered backend · case 04

The health eviction operation is admitted even though old failure samples evict a recovered backend.

Reliability◈ Members↗
FA-1040

Evict an unhealthy backend: Old failure samples evict a recovered backend · case 05

The health eviction operation is admitted even though old failure samples evict a recovered backend.

Reliability◈ Members↗
FA-1041

Evict an unhealthy backend: Correlated failures evict more than the allowed pool fraction · case 01

The health eviction operation is admitted even though correlated failures evict more than the allowed pool fraction.

Reliability● Open access↗
FA-1042

Evict an unhealthy backend: Correlated failures evict more than the allowed pool fraction · case 02

The health eviction operation is admitted even though correlated failures evict more than the allowed pool fraction.

Reliability◈ Members↗
FA-1043

Evict an unhealthy backend: Correlated failures evict more than the allowed pool fraction · case 03

The health eviction operation is admitted even though correlated failures evict more than the allowed pool fraction.

Reliability◈ Members↗
FA-1044

Evict an unhealthy backend: Correlated failures evict more than the allowed pool fraction · case 04

The health eviction operation is admitted even though correlated failures evict more than the allowed pool fraction.

Reliability◈ Members↗
FA-1045

Evict an unhealthy backend: Correlated failures evict more than the allowed pool fraction · case 05

The health eviction operation is admitted even though correlated failures evict more than the allowed pool fraction.

Reliability◈ Members↗
FA-1046

Evict an unhealthy backend: A failed probe evicts a replacement process at the same address · case 01

The health eviction operation is admitted even though a failed probe evicts a replacement process at the same address.

Reliability● Open access↗
FA-1047

Evict an unhealthy backend: A failed probe evicts a replacement process at the same address · case 02

The health eviction operation is admitted even though a failed probe evicts a replacement process at the same address.

Reliability◈ Members↗
FA-1048

Evict an unhealthy backend: A failed probe evicts a replacement process at the same address · case 03

The health eviction operation is admitted even though a failed probe evicts a replacement process at the same address.

Reliability◈ Members↗
FA-1049

Evict an unhealthy backend: A failed probe evicts a replacement process at the same address · case 04

The health eviction operation is admitted even though a failed probe evicts a replacement process at the same address.

Reliability◈ Members↗
FA-1050

Evict an unhealthy backend: A failed probe evicts a replacement process at the same address · case 05

The health eviction operation is admitted even though a failed probe evicts a replacement process at the same address.

Reliability◈ Members↗
FA-1051

Finish draining a service instance: Shutdown still permits new work to enter · case 01

The graceful drain operation is admitted even though shutdown still permits new work to enter.

Reliability● Open access↗
FA-1052

Finish draining a service instance: Shutdown still permits new work to enter · case 02

The graceful drain operation is admitted even though shutdown still permits new work to enter.

Reliability◈ Members↗
FA-1053

Finish draining a service instance: Shutdown still permits new work to enter · case 03

The graceful drain operation is admitted even though shutdown still permits new work to enter.

Reliability◈ Members↗
FA-1054

Finish draining a service instance: Shutdown still permits new work to enter · case 04

The graceful drain operation is admitted even though shutdown still permits new work to enter.

Reliability◈ Members↗
FA-1055

Finish draining a service instance: Shutdown still permits new work to enter · case 05

The graceful drain operation is admitted even though shutdown still permits new work to enter.

Reliability◈ Members↗
FA-1056

Finish draining a service instance: Shutdown terminates in-flight requests prematurely · case 01

The graceful drain operation is admitted even though shutdown terminates in-flight requests prematurely.

Reliability● Open access↗
FA-1057

Finish draining a service instance: Shutdown terminates in-flight requests prematurely · case 02

The graceful drain operation is admitted even though shutdown terminates in-flight requests prematurely.

Reliability◈ Members↗
FA-1058

Finish draining a service instance: Shutdown terminates in-flight requests prematurely · case 03

The graceful drain operation is admitted even though shutdown terminates in-flight requests prematurely.

Reliability◈ Members↗
FA-1059

Finish draining a service instance: Shutdown terminates in-flight requests prematurely · case 04

The graceful drain operation is admitted even though shutdown terminates in-flight requests prematurely.

Reliability◈ Members↗
FA-1060

Finish draining a service instance: Shutdown terminates in-flight requests prematurely · case 05

The graceful drain operation is admitted even though shutdown terminates in-flight requests prematurely.

Reliability◈ Members↗
FA-1061

Finish draining a service instance: Shutdown completes while routing still advertises the instance · case 01

The graceful drain operation is admitted even though shutdown completes while routing still advertises the instance.

Reliability● Open access↗
FA-1062

Finish draining a service instance: Shutdown completes while routing still advertises the instance · case 02

The graceful drain operation is admitted even though shutdown completes while routing still advertises the instance.

Reliability◈ Members↗
FA-1063

Finish draining a service instance: Shutdown completes while routing still advertises the instance · case 03

The graceful drain operation is admitted even though shutdown completes while routing still advertises the instance.

Reliability◈ Members↗
FA-1064

Finish draining a service instance: Shutdown completes while routing still advertises the instance · case 04

The graceful drain operation is admitted even though shutdown completes while routing still advertises the instance.

Reliability◈ Members↗
FA-1065

Finish draining a service instance: Shutdown completes while routing still advertises the instance · case 05

The graceful drain operation is admitted even though shutdown completes while routing still advertises the instance.

Reliability◈ Members↗
FA-1066

Finish draining a service instance: Shutdown discards buffered durable work · case 01

The graceful drain operation is admitted even though shutdown discards buffered durable work.

Reliability● Open access↗
FA-1067

Finish draining a service instance: Shutdown discards buffered durable work · case 02

The graceful drain operation is admitted even though shutdown discards buffered durable work.

Reliability◈ Members↗
FA-1068

Finish draining a service instance: Shutdown discards buffered durable work · case 03

The graceful drain operation is admitted even though shutdown discards buffered durable work.

Reliability◈ Members↗
FA-1069

Finish draining a service instance: Shutdown discards buffered durable work · case 04

The graceful drain operation is admitted even though shutdown discards buffered durable work.

Reliability◈ Members↗
FA-1070

Finish draining a service instance: Shutdown discards buffered durable work · case 05

The graceful drain operation is admitted even though shutdown discards buffered durable work.

Reliability◈ Members↗
FA-1071

Finish draining a service instance: Shutdown abandons child workers holding resources · case 01

The graceful drain operation is admitted even though shutdown abandons child workers holding resources.

Reliability● Open access↗
FA-1072

Finish draining a service instance: Shutdown abandons child workers holding resources · case 02

The graceful drain operation is admitted even though shutdown abandons child workers holding resources.

Reliability◈ Members↗
FA-1073

Finish draining a service instance: Shutdown abandons child workers holding resources · case 03

The graceful drain operation is admitted even though shutdown abandons child workers holding resources.

Reliability◈ Members↗
FA-1074

Finish draining a service instance: Shutdown abandons child workers holding resources · case 04

The graceful drain operation is admitted even though shutdown abandons child workers holding resources.

Reliability◈ Members↗
FA-1075

Finish draining a service instance: Shutdown abandons child workers holding resources · case 05

The graceful drain operation is admitted even though shutdown abandons child workers holding resources.

Reliability◈ Members↗
FA-1076

Promote a standby after primary failure: Promotion permits two writable primaries · case 01

The failover promote operation is admitted even though promotion permits two writable primaries.

Reliability● Open access↗
FA-1077

Promote a standby after primary failure: Promotion permits two writable primaries · case 02

The failover promote operation is admitted even though promotion permits two writable primaries.

Reliability◈ Members↗
FA-1078

Promote a standby after primary failure: Promotion permits two writable primaries · case 03

The failover promote operation is admitted even though promotion permits two writable primaries.

Reliability◈ Members↗
FA-1079

Promote a standby after primary failure: Promotion permits two writable primaries · case 04

The failover promote operation is admitted even though promotion permits two writable primaries.

Reliability◈ Members↗
FA-1080

Promote a standby after primary failure: Promotion permits two writable primaries · case 05

The failover promote operation is admitted even though promotion permits two writable primaries.

Reliability◈ Members↗
FA-1081

Promote a standby after primary failure: Standby lag exceeds the declared data-loss allowance · case 01

The failover promote operation is admitted even though standby lag exceeds the declared data-loss allowance.

Reliability● Open access↗
FA-1082

Promote a standby after primary failure: Standby lag exceeds the declared data-loss allowance · case 02

The failover promote operation is admitted even though standby lag exceeds the declared data-loss allowance.

Reliability◈ Members↗
FA-1083

Promote a standby after primary failure: Standby lag exceeds the declared data-loss allowance · case 03

The failover promote operation is admitted even though standby lag exceeds the declared data-loss allowance.

Reliability◈ Members↗
FA-1084

Promote a standby after primary failure: Standby lag exceeds the declared data-loss allowance · case 04

The failover promote operation is admitted even though standby lag exceeds the declared data-loss allowance.

Reliability◈ Members↗
FA-1085

Promote a standby after primary failure: Standby lag exceeds the declared data-loss allowance · case 05

The failover promote operation is admitted even though standby lag exceeds the declared data-loss allowance.

Reliability◈ Members↗
FA-1086

Promote a standby after primary failure: A read-only standby is advertised as write primary · case 01

The failover promote operation is admitted even though a read-only standby is advertised as write primary.

Reliability● Open access↗
FA-1087

Promote a standby after primary failure: A read-only standby is advertised as write primary · case 02

The failover promote operation is admitted even though a read-only standby is advertised as write primary.

Reliability◈ Members↗
FA-1088

Promote a standby after primary failure: A read-only standby is advertised as write primary · case 03

The failover promote operation is admitted even though a read-only standby is advertised as write primary.

Reliability◈ Members↗
FA-1089

Promote a standby after primary failure: A read-only standby is advertised as write primary · case 04

The failover promote operation is admitted even though a read-only standby is advertised as write primary.

Reliability◈ Members↗
FA-1090

Promote a standby after primary failure: A read-only standby is advertised as write primary · case 05

The failover promote operation is admitted even though a read-only standby is advertised as write primary.

Reliability◈ Members↗
FA-1091

Promote a standby after primary failure: A delayed promotion reverses a newer failover · case 01

The failover promote operation is admitted even though a delayed promotion reverses a newer failover.

Reliability● Open access↗
FA-1092

Promote a standby after primary failure: A delayed promotion reverses a newer failover · case 02

The failover promote operation is admitted even though a delayed promotion reverses a newer failover.

Reliability◈ Members↗
FA-1093

Promote a standby after primary failure: A delayed promotion reverses a newer failover · case 03

The failover promote operation is admitted even though a delayed promotion reverses a newer failover.

Reliability◈ Members↗
FA-1094

Promote a standby after primary failure: A delayed promotion reverses a newer failover · case 04

The failover promote operation is admitted even though a delayed promotion reverses a newer failover.

Reliability◈ Members↗
FA-1095

Promote a standby after primary failure: A delayed promotion reverses a newer failover · case 05

The failover promote operation is admitted even though a delayed promotion reverses a newer failover.

Reliability◈ Members↗
FA-1096

Promote a standby after primary failure: Promotion succeeds while writes still route to the old primary · case 01

The failover promote operation is admitted even though promotion succeeds while writes still route to the old primary.

Reliability● Open access↗
FA-1097

Promote a standby after primary failure: Promotion succeeds while writes still route to the old primary · case 02

The failover promote operation is admitted even though promotion succeeds while writes still route to the old primary.

Reliability◈ Members↗
FA-1098

Promote a standby after primary failure: Promotion succeeds while writes still route to the old primary · case 03

The failover promote operation is admitted even though promotion succeeds while writes still route to the old primary.

Reliability◈ Members↗
FA-1099

Promote a standby after primary failure: Promotion succeeds while writes still route to the old primary · case 04

The failover promote operation is admitted even though promotion succeeds while writes still route to the old primary.

Reliability◈ Members↗
FA-1100

Promote a standby after primary failure: Promotion succeeds while writes still route to the old primary · case 05

The failover promote operation is admitted even though promotion succeeds while writes still route to the old primary.

Reliability◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗