FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-7101

Route host comparison ignores dns name case · case 01

Route host comparison ignores dns name case.

Network routing● Open access↗
FA-7102

Route host comparison ignores dns name case · case 02

Route host comparison ignores dns name case.

Network routing◈ Members↗
FA-7103

Route host comparison ignores dns name case · case 03

Route host comparison ignores dns name case.

Network routing◈ Members↗
FA-7104

Route host comparison ignores dns name case · case 04

Route host comparison ignores dns name case.

Network routing◈ Members↗
FA-7105

Route host comparison ignores dns name case · case 05

Route host comparison ignores dns name case.

Network routing◈ Members↗
FA-7106

Wildcard host route covers subdomains but not apex · case 01

Wildcard host route covers subdomains but not apex.

Network routing● Open access↗
FA-7107

Wildcard host route covers subdomains but not apex · case 02

Wildcard host route covers subdomains but not apex.

Network routing◈ Members↗
FA-7108

Wildcard host route covers subdomains but not apex · case 03

Wildcard host route covers subdomains but not apex.

Network routing◈ Members↗
FA-7109

Wildcard host route covers subdomains but not apex · case 04

Wildcard host route covers subdomains but not apex.

Network routing◈ Members↗
FA-7110

Wildcard host route covers subdomains but not apex · case 05

Wildcard host route covers subdomains but not apex.

Network routing◈ Members↗
FA-7111

Route method filter is applied before priority · case 01

Route method filter is applied before priority.

Network routing● Open access↗
FA-7112

Route method filter is applied before priority · case 02

Route method filter is applied before priority.

Network routing◈ Members↗
FA-7113

Route method filter is applied before priority · case 03

Route method filter is applied before priority.

Network routing◈ Members↗
FA-7114

Route method filter is applied before priority · case 04

Route method filter is applied before priority.

Network routing◈ Members↗
FA-7115

Route method filter is applied before priority · case 05

Route method filter is applied before priority.

Network routing◈ Members↗
FA-7116

Route header constraint distinguishes existence from truthiness · case 01

Route header constraint distinguishes existence from truthiness.

Network routing● Open access↗
FA-7117

Route header constraint distinguishes existence from truthiness · case 02

Route header constraint distinguishes existence from truthiness.

Network routing◈ Members↗
FA-7118

Route header constraint distinguishes existence from truthiness · case 03

Route header constraint distinguishes existence from truthiness.

Network routing◈ Members↗
FA-7119

Route header constraint distinguishes existence from truthiness · case 04

Route header constraint distinguishes existence from truthiness.

Network routing◈ Members↗
FA-7120

Route header constraint distinguishes existence from truthiness · case 05

Route header constraint distinguishes existence from truthiness.

Network routing◈ Members↗
FA-7121

Query route matches any repeated value · case 01

Query route matches any repeated value.

Network routing● Open access↗
FA-7122

Query route matches any repeated value · case 02

Query route matches any repeated value.

Network routing◈ Members↗
FA-7123

Query route matches any repeated value · case 03

Query route matches any repeated value.

Network routing◈ Members↗
FA-7124

Query route matches any repeated value · case 04

Query route matches any repeated value.

Network routing◈ Members↗
FA-7125

Query route matches any repeated value · case 05

Query route matches any repeated value.

Network routing◈ Members↗
FA-7126

Weighted route selection uses cumulative half open buckets · case 01

Weighted route selection uses cumulative half open buckets.

Network routing● Open access↗
FA-7127

Weighted route selection uses cumulative half open buckets · case 02

Weighted route selection uses cumulative half open buckets.

Network routing◈ Members↗
FA-7128

Weighted route selection uses cumulative half open buckets · case 03

Weighted route selection uses cumulative half open buckets.

Network routing◈ Members↗
FA-7129

Weighted route selection uses cumulative half open buckets · case 04

Weighted route selection uses cumulative half open buckets.

Network routing◈ Members↗
FA-7130

Weighted route selection uses cumulative half open buckets · case 05

Weighted route selection uses cumulative half open buckets.

Network routing◈ Members↗
FA-7131

Zero weight upstreams never receive traffic · case 01

Zero weight upstreams never receive traffic.

Network routing● Open access↗
FA-7132

Zero weight upstreams never receive traffic · case 02

Zero weight upstreams never receive traffic.

Network routing◈ Members↗
FA-7133

Zero weight upstreams never receive traffic · case 03

Zero weight upstreams never receive traffic.

Network routing◈ Members↗
FA-7134

Zero weight upstreams never receive traffic · case 04

Zero weight upstreams never receive traffic.

Network routing◈ Members↗
FA-7135

Zero weight upstreams never receive traffic · case 05

Zero weight upstreams never receive traffic.

Network routing◈ Members↗
FA-7136

Least loaded route normalizes by capacity · case 01

Least loaded route normalizes by capacity.

Network routing● Open access↗
FA-7137

Least loaded route normalizes by capacity · case 02

Least loaded route normalizes by capacity.

Network routing◈ Members↗
FA-7138

Least loaded route normalizes by capacity · case 03

Least loaded route normalizes by capacity.

Network routing◈ Members↗
FA-7139

Least loaded route normalizes by capacity · case 04

Least loaded route normalizes by capacity.

Network routing◈ Members↗
FA-7140

Least loaded route normalizes by capacity · case 05

Least loaded route normalizes by capacity.

Network routing◈ Members↗
FA-7141

Route failover excludes already attempted upstreams · case 01

Route failover excludes already attempted upstreams.

Network routing● Open access↗
FA-7142

Route failover excludes already attempted upstreams · case 02

Route failover excludes already attempted upstreams.

Network routing◈ Members↗
FA-7143

Route failover excludes already attempted upstreams · case 03

Route failover excludes already attempted upstreams.

Network routing◈ Members↗
FA-7144

Route failover excludes already attempted upstreams · case 04

Route failover excludes already attempted upstreams.

Network routing◈ Members↗
FA-7145

Route failover excludes already attempted upstreams · case 05

Route failover excludes already attempted upstreams.

Network routing◈ Members↗
FA-7146

Failover stays within request replay budget · case 01

Failover stays within request replay budget.

Network routing● Open access↗
FA-7147

Failover stays within request replay budget · case 02

Failover stays within request replay budget.

Network routing◈ Members↗
FA-7148

Failover stays within request replay budget · case 03

Failover stays within request replay budget.

Network routing◈ Members↗
FA-7149

Failover stays within request replay budget · case 04

Failover stays within request replay budget.

Network routing◈ Members↗
FA-7150

Failover stays within request replay budget · case 05

Failover stays within request replay budget.

Network routing◈ Members↗
FA-7151

Healthy endpoint filter retains draining endpoints only for existing flows · case 01

Healthy endpoint filter retains draining endpoints only for existing flows.

Network routing● Open access↗
FA-7152

Healthy endpoint filter retains draining endpoints only for existing flows · case 02

Healthy endpoint filter retains draining endpoints only for existing flows.

Network routing◈ Members↗
FA-7153

Healthy endpoint filter retains draining endpoints only for existing flows · case 03

Healthy endpoint filter retains draining endpoints only for existing flows.

Network routing◈ Members↗
FA-7154

Healthy endpoint filter retains draining endpoints only for existing flows · case 04

Healthy endpoint filter retains draining endpoints only for existing flows.

Network routing◈ Members↗
FA-7155

Healthy endpoint filter retains draining endpoints only for existing flows · case 05

Healthy endpoint filter retains draining endpoints only for existing flows.

Network routing◈ Members↗
FA-7156

Route rewrite removes only the matched leading prefix · case 01

Route rewrite removes only the matched leading prefix.

Network routing● Open access↗
FA-7157

Route rewrite removes only the matched leading prefix · case 02

Route rewrite removes only the matched leading prefix.

Network routing◈ Members↗
FA-7158

Route rewrite removes only the matched leading prefix · case 03

Route rewrite removes only the matched leading prefix.

Network routing◈ Members↗
FA-7159

Route rewrite removes only the matched leading prefix · case 04

Route rewrite removes only the matched leading prefix.

Network routing◈ Members↗
FA-7160

Route rewrite removes only the matched leading prefix · case 05

Route rewrite removes only the matched leading prefix.

Network routing◈ Members↗
FA-7161

Route rewrite adds exactly one path separator · case 01

Route rewrite adds exactly one path separator.

Network routing● Open access↗
FA-7162

Route rewrite adds exactly one path separator · case 02

Route rewrite adds exactly one path separator.

Network routing◈ Members↗
FA-7163

Route rewrite adds exactly one path separator · case 03

Route rewrite adds exactly one path separator.

Network routing◈ Members↗
FA-7164

Route rewrite adds exactly one path separator · case 04

Route rewrite adds exactly one path separator.

Network routing◈ Members↗
FA-7165

Route rewrite adds exactly one path separator · case 05

Route rewrite adds exactly one path separator.

Network routing◈ Members↗
FA-7166

Route priority is secondary to match specificity · case 01

Route priority is secondary to match specificity.

Network routing● Open access↗
FA-7167

Route priority is secondary to match specificity · case 02

Route priority is secondary to match specificity.

Network routing◈ Members↗
FA-7168

Route priority is secondary to match specificity · case 03

Route priority is secondary to match specificity.

Network routing◈ Members↗
FA-7169

Route priority is secondary to match specificity · case 04

Route priority is secondary to match specificity.

Network routing◈ Members↗
FA-7170

Route priority is secondary to match specificity · case 05

Route priority is secondary to match specificity.

Network routing◈ Members↗
FA-7171

Ipv4 network broadcast address is not allocated to host · case 01

Ipv4 network broadcast address is not allocated to host.

Network routing● Open access↗
FA-7172

Ipv4 network broadcast address is not allocated to host · case 02

Ipv4 network broadcast address is not allocated to host.

Network routing◈ Members↗
FA-7173

Ipv4 network broadcast address is not allocated to host · case 03

Ipv4 network broadcast address is not allocated to host.

Network routing◈ Members↗
FA-7174

Ipv4 network broadcast address is not allocated to host · case 04

Ipv4 network broadcast address is not allocated to host.

Network routing◈ Members↗
FA-7175

Ipv4 network broadcast address is not allocated to host · case 05

Ipv4 network broadcast address is not allocated to host.

Network routing◈ Members↗
FA-7176

Link local destination requires interface scope · case 01

Link local destination requires interface scope.

Network routing● Open access↗
FA-7177

Link local destination requires interface scope · case 02

Link local destination requires interface scope.

Network routing◈ Members↗
FA-7178

Link local destination requires interface scope · case 03

Link local destination requires interface scope.

Network routing◈ Members↗
FA-7179

Link local destination requires interface scope · case 04

Link local destination requires interface scope.

Network routing◈ Members↗
FA-7180

Link local destination requires interface scope · case 05

Link local destination requires interface scope.

Network routing◈ Members↗
FA-7181

Ipv4 and ipv6 endpoint identities remain distinct · case 01

Ipv4 and ipv6 endpoint identities remain distinct.

Network routing● Open access↗
FA-7182

Ipv4 and ipv6 endpoint identities remain distinct · case 02

Ipv4 and ipv6 endpoint identities remain distinct.

Network routing◈ Members↗
FA-7183

Ipv4 and ipv6 endpoint identities remain distinct · case 03

Ipv4 and ipv6 endpoint identities remain distinct.

Network routing◈ Members↗
FA-7184

Ipv4 and ipv6 endpoint identities remain distinct · case 04

Ipv4 and ipv6 endpoint identities remain distinct.

Network routing◈ Members↗
FA-7185

Ipv4 and ipv6 endpoint identities remain distinct · case 05

Ipv4 and ipv6 endpoint identities remain distinct.

Network routing◈ Members↗
FA-7186

Ecmp selection uses flow identity not packet ordinal · case 01

Ecmp selection uses flow identity not packet ordinal.

Network routing● Open access↗
FA-7187

Ecmp selection uses flow identity not packet ordinal · case 02

Ecmp selection uses flow identity not packet ordinal.

Network routing◈ Members↗
FA-7188

Ecmp selection uses flow identity not packet ordinal · case 03

Ecmp selection uses flow identity not packet ordinal.

Network routing◈ Members↗
FA-7189

Ecmp selection uses flow identity not packet ordinal · case 04

Ecmp selection uses flow identity not packet ordinal.

Network routing◈ Members↗
FA-7190

Ecmp selection uses flow identity not packet ordinal · case 05

Ecmp selection uses flow identity not packet ordinal.

Network routing◈ Members↗
FA-7191

Policy route fallback occurs only after no policy match · case 01

Policy route fallback occurs only after no policy match.

Network routing● Open access↗
FA-7192

Policy route fallback occurs only after no policy match · case 02

Policy route fallback occurs only after no policy match.

Network routing◈ Members↗
FA-7193

Policy route fallback occurs only after no policy match · case 03

Policy route fallback occurs only after no policy match.

Network routing◈ Members↗
FA-7194

Policy route fallback occurs only after no policy match · case 04

Policy route fallback occurs only after no policy match.

Network routing◈ Members↗
FA-7195

Policy route fallback occurs only after no policy match · case 05

Policy route fallback occurs only after no policy match.

Network routing◈ Members↗
FA-7196

Route table refresh replaces removed routes · case 01

Route table refresh replaces removed routes.

Network routing● Open access↗
FA-7197

Route table refresh replaces removed routes · case 02

Route table refresh replaces removed routes.

Network routing◈ Members↗
FA-7198

Route table refresh replaces removed routes · case 03

Route table refresh replaces removed routes.

Network routing◈ Members↗
FA-7199

Route table refresh replaces removed routes · case 04

Route table refresh replaces removed routes.

Network routing◈ Members↗
FA-7200

Route table refresh replaces removed routes · case 05

Route table refresh replaces removed routes.

Network routing◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗