FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-5101

Cooperative diamond mro: Calls both bases explicitly and duplicates downstream cooperative contributions · case 01

Calls both bases explicitly and duplicates downstream cooperative contributions and changes the required Python-language result.

Method resolution● Open access↗
FA-5102

Cooperative diamond mro: Calls both bases explicitly and duplicates downstream cooperative contributions · case 02

Calls both bases explicitly and duplicates downstream cooperative contributions and changes the required Python-language result.

Method resolution◈ Members↗
FA-5103

Cooperative diamond mro: Calls both bases explicitly and duplicates downstream cooperative contributions · case 03

Calls both bases explicitly and duplicates downstream cooperative contributions and changes the required Python-language result.

Method resolution◈ Members↗
FA-5104

Cooperative diamond mro: Calls both bases explicitly and duplicates downstream cooperative contributions · case 04

Calls both bases explicitly and duplicates downstream cooperative contributions and changes the required Python-language result.

Method resolution◈ Members↗
FA-5105

Cooperative diamond mro: Calls both bases explicitly and duplicates downstream cooperative contributions · case 05

Calls both bases explicitly and duplicates downstream cooperative contributions and changes the required Python-language result.

Method resolution◈ Members↗
FA-5106

Classmethod dynamic binding: Makes the classmethod static and loses automatic class binding · case 01

Makes the classmethod static and loses automatic class binding and changes the required Python-language result.

Method resolution● Open access↗
FA-5107

Classmethod dynamic binding: Makes the classmethod static and loses automatic class binding · case 02

Makes the classmethod static and loses automatic class binding and changes the required Python-language result.

Method resolution◈ Members↗
FA-5108

Classmethod dynamic binding: Makes the classmethod static and loses automatic class binding · case 03

Makes the classmethod static and loses automatic class binding and changes the required Python-language result.

Method resolution◈ Members↗
FA-5109

Classmethod dynamic binding: Makes the classmethod static and loses automatic class binding · case 04

Makes the classmethod static and loses automatic class binding and changes the required Python-language result.

Method resolution◈ Members↗
FA-5110

Classmethod dynamic binding: Makes the classmethod static and loses automatic class binding · case 05

Makes the classmethod static and loses automatic class binding and changes the required Python-language result.

Method resolution◈ Members↗
FA-5111

Classmethod dynamic binding: Uses an ordinary instance method in place of a classmethod · case 01

Uses an ordinary instance method in place of a classmethod and changes the required Python-language result.

Method resolution● Open access↗
FA-5112

Classmethod dynamic binding: Uses an ordinary instance method in place of a classmethod · case 02

Uses an ordinary instance method in place of a classmethod and changes the required Python-language result.

Method resolution◈ Members↗
FA-5113

Classmethod dynamic binding: Uses an ordinary instance method in place of a classmethod · case 03

Uses an ordinary instance method in place of a classmethod and changes the required Python-language result.

Method resolution◈ Members↗
FA-5114

Classmethod dynamic binding: Uses an ordinary instance method in place of a classmethod · case 04

Uses an ordinary instance method in place of a classmethod and changes the required Python-language result.

Method resolution◈ Members↗
FA-5115

Classmethod dynamic binding: Uses an ordinary instance method in place of a classmethod · case 05

Uses an ordinary instance method in place of a classmethod and changes the required Python-language result.

Method resolution◈ Members↗
FA-5116

Classmethod dynamic binding: Uses the defining Base class instead of the bound subclass · case 01

Uses the defining Base class instead of the bound subclass and changes the required Python-language result.

Method resolution● Open access↗
FA-5117

Classmethod dynamic binding: Uses the defining Base class instead of the bound subclass · case 02

Uses the defining Base class instead of the bound subclass and changes the required Python-language result.

Method resolution◈ Members↗
FA-5118

Classmethod dynamic binding: Uses the defining Base class instead of the bound subclass · case 03

Uses the defining Base class instead of the bound subclass and changes the required Python-language result.

Method resolution◈ Members↗
FA-5119

Classmethod dynamic binding: Uses the defining Base class instead of the bound subclass · case 04

Uses the defining Base class instead of the bound subclass and changes the required Python-language result.

Method resolution◈ Members↗
FA-5120

Classmethod dynamic binding: Uses the defining Base class instead of the bound subclass · case 05

Uses the defining Base class instead of the bound subclass and changes the required Python-language result.

Method resolution◈ Members↗
FA-5121

Classmethod dynamic binding: Reports the bound class metaclass instead of the class name · case 01

Reports the bound class metaclass instead of the class name and changes the required Python-language result.

Method resolution● Open access↗
FA-5122

Classmethod dynamic binding: Reports the bound class metaclass instead of the class name · case 02

Reports the bound class metaclass instead of the class name and changes the required Python-language result.

Method resolution◈ Members↗
FA-5123

Classmethod dynamic binding: Reports the bound class metaclass instead of the class name · case 03

Reports the bound class metaclass instead of the class name and changes the required Python-language result.

Method resolution◈ Members↗
FA-5124

Classmethod dynamic binding: Reports the bound class metaclass instead of the class name · case 04

Reports the bound class metaclass instead of the class name and changes the required Python-language result.

Method resolution◈ Members↗
FA-5125

Classmethod dynamic binding: Reports the bound class metaclass instead of the class name · case 05

Reports the bound class metaclass instead of the class name and changes the required Python-language result.

Method resolution◈ Members↗
FA-5126

Classmethod dynamic binding: Ignores subclass shadowing when reading the bound class label · case 01

Ignores subclass shadowing when reading the bound class label and changes the required Python-language result.

Method resolution● Open access↗
FA-5127

Classmethod dynamic binding: Ignores subclass shadowing when reading the bound class label · case 02

Ignores subclass shadowing when reading the bound class label and changes the required Python-language result.

Method resolution◈ Members↗
FA-5128

Classmethod dynamic binding: Ignores subclass shadowing when reading the bound class label · case 03

Ignores subclass shadowing when reading the bound class label and changes the required Python-language result.

Method resolution◈ Members↗
FA-5129

Classmethod dynamic binding: Ignores subclass shadowing when reading the bound class label · case 04

Ignores subclass shadowing when reading the bound class label and changes the required Python-language result.

Method resolution◈ Members↗
FA-5130

Classmethod dynamic binding: Ignores subclass shadowing when reading the bound class label · case 05

Ignores subclass shadowing when reading the bound class label and changes the required Python-language result.

Method resolution◈ Members↗
FA-5131

Context exception suppression: Suppresses unrelated exception types whenever suppression is enabled · case 01

Suppresses unrelated exception types whenever suppression is enabled and changes the required Python-language result.

Context managers● Open access↗
FA-5132

Context exception suppression: Suppresses unrelated exception types whenever suppression is enabled · case 02

Suppresses unrelated exception types whenever suppression is enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5133

Context exception suppression: Suppresses unrelated exception types whenever suppression is enabled · case 03

Suppresses unrelated exception types whenever suppression is enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5134

Context exception suppression: Suppresses unrelated exception types whenever suppression is enabled · case 04

Suppresses unrelated exception types whenever suppression is enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5135

Context exception suppression: Suppresses unrelated exception types whenever suppression is enabled · case 05

Suppresses unrelated exception types whenever suppression is enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5136

Context exception suppression: Discards the truthy __exit__ decision and propagates ValueError · case 01

Discards the truthy __exit__ decision and propagates ValueError and changes the required Python-language result.

Context managers● Open access↗
FA-5137

Context exception suppression: Discards the truthy __exit__ decision and propagates ValueError · case 02

Discards the truthy __exit__ decision and propagates ValueError and changes the required Python-language result.

Context managers◈ Members↗
FA-5138

Context exception suppression: Discards the truthy __exit__ decision and propagates ValueError · case 03

Discards the truthy __exit__ decision and propagates ValueError and changes the required Python-language result.

Context managers◈ Members↗
FA-5139

Context exception suppression: Discards the truthy __exit__ decision and propagates ValueError · case 04

Discards the truthy __exit__ decision and propagates ValueError and changes the required Python-language result.

Context managers◈ Members↗
FA-5140

Context exception suppression: Discards the truthy __exit__ decision and propagates ValueError · case 05

Discards the truthy __exit__ decision and propagates ValueError and changes the required Python-language result.

Context managers◈ Members↗
FA-5141

Context exception suppression: Suppresses ValueError even when the policy is disabled · case 01

Suppresses ValueError even when the policy is disabled and changes the required Python-language result.

Context managers● Open access↗
FA-5142

Context exception suppression: Suppresses ValueError even when the policy is disabled · case 02

Suppresses ValueError even when the policy is disabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5143

Context exception suppression: Suppresses ValueError even when the policy is disabled · case 03

Suppresses ValueError even when the policy is disabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5144

Context exception suppression: Suppresses ValueError even when the policy is disabled · case 04

Suppresses ValueError even when the policy is disabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5145

Context exception suppression: Suppresses ValueError even when the policy is disabled · case 05

Suppresses ValueError even when the policy is disabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5146

Context exception suppression: Passes a normal-exit placeholder to the exception-reporting path · case 01

Passes a normal-exit placeholder to the exception-reporting path and changes the required Python-language result.

Context managers● Open access↗
FA-5147

Context exception suppression: Passes a normal-exit placeholder to the exception-reporting path · case 02

Passes a normal-exit placeholder to the exception-reporting path and changes the required Python-language result.

Context managers◈ Members↗
FA-5148

Context exception suppression: Passes a normal-exit placeholder to the exception-reporting path · case 03

Passes a normal-exit placeholder to the exception-reporting path and changes the required Python-language result.

Context managers◈ Members↗
FA-5149

Context exception suppression: Passes a normal-exit placeholder to the exception-reporting path · case 04

Passes a normal-exit placeholder to the exception-reporting path and changes the required Python-language result.

Context managers◈ Members↗
FA-5150

Context exception suppression: Passes a normal-exit placeholder to the exception-reporting path · case 05

Passes a normal-exit placeholder to the exception-reporting path and changes the required Python-language result.

Context managers◈ Members↗
FA-5151

Context exception suppression: Suppresses exceptions when the policy is disabled instead of enabled · case 01

Suppresses exceptions when the policy is disabled instead of enabled and changes the required Python-language result.

Context managers● Open access↗
FA-5152

Context exception suppression: Suppresses exceptions when the policy is disabled instead of enabled · case 02

Suppresses exceptions when the policy is disabled instead of enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5153

Context exception suppression: Suppresses exceptions when the policy is disabled instead of enabled · case 03

Suppresses exceptions when the policy is disabled instead of enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5154

Context exception suppression: Suppresses exceptions when the policy is disabled instead of enabled · case 04

Suppresses exceptions when the policy is disabled instead of enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5155

Context exception suppression: Suppresses exceptions when the policy is disabled instead of enabled · case 05

Suppresses exceptions when the policy is disabled instead of enabled and changes the required Python-language result.

Context managers◈ Members↗
FA-5156

Context enter binding: Binds the manager object label instead of its __enter__ result · case 01

Binds the manager object label instead of its __enter__ result and changes the required Python-language result.

Context managers● Open access↗
FA-5157

Context enter binding: Binds the manager object label instead of its __enter__ result · case 02

Binds the manager object label instead of its __enter__ result and changes the required Python-language result.

Context managers◈ Members↗
FA-5158

Context enter binding: Binds the manager object label instead of its __enter__ result · case 03

Binds the manager object label instead of its __enter__ result and changes the required Python-language result.

Context managers◈ Members↗
FA-5159

Context enter binding: Binds the manager object label instead of its __enter__ result · case 04

Binds the manager object label instead of its __enter__ result and changes the required Python-language result.

Context managers◈ Members↗
FA-5160

Context enter binding: Binds the manager object label instead of its __enter__ result · case 05

Binds the manager object label instead of its __enter__ result and changes the required Python-language result.

Context managers◈ Members↗
FA-5161

Context enter binding: Replaces a false __enter__ return value with the manager label · case 01

Replaces a false __enter__ return value with the manager label and changes the required Python-language result.

Context managers● Open access↗
FA-5162

Context enter binding: Replaces a false __enter__ return value with the manager label · case 02

Replaces a false __enter__ return value with the manager label and changes the required Python-language result.

Context managers◈ Members↗
FA-5163

Context enter binding: Replaces a false __enter__ return value with the manager label · case 03

Replaces a false __enter__ return value with the manager label and changes the required Python-language result.

Context managers◈ Members↗
FA-5164

Context enter binding: Replaces a false __enter__ return value with the manager label · case 04

Replaces a false __enter__ return value with the manager label and changes the required Python-language result.

Context managers◈ Members↗
FA-5165

Context enter binding: Replaces a false __enter__ return value with the manager label · case 05

Replaces a false __enter__ return value with the manager label and changes the required Python-language result.

Context managers◈ Members↗
FA-5166

Context enter binding: Returns None from __enter__ regardless of its payload · case 01

Returns None from __enter__ regardless of its payload and changes the required Python-language result.

Context managers● Open access↗
FA-5167

Context enter binding: Returns None from __enter__ regardless of its payload · case 02

Returns None from __enter__ regardless of its payload and changes the required Python-language result.

Context managers◈ Members↗
FA-5168

Context enter binding: Returns None from __enter__ regardless of its payload · case 03

Returns None from __enter__ regardless of its payload and changes the required Python-language result.

Context managers◈ Members↗
FA-5169

Context enter binding: Returns None from __enter__ regardless of its payload · case 04

Returns None from __enter__ regardless of its payload and changes the required Python-language result.

Context managers◈ Members↗
FA-5170

Context enter binding: Returns None from __enter__ regardless of its payload · case 05

Returns None from __enter__ regardless of its payload and changes the required Python-language result.

Context managers◈ Members↗
FA-5171

Context enter binding: Calls __enter__ again while constructing the with-body binding · case 01

Calls __enter__ again while constructing the with-body binding and changes the required Python-language result.

Context managers● Open access↗
FA-5172

Context enter binding: Calls __enter__ again while constructing the with-body binding · case 02

Calls __enter__ again while constructing the with-body binding and changes the required Python-language result.

Context managers◈ Members↗
FA-5173

Context enter binding: Calls __enter__ again while constructing the with-body binding · case 03

Calls __enter__ again while constructing the with-body binding and changes the required Python-language result.

Context managers◈ Members↗
FA-5174

Context enter binding: Calls __enter__ again while constructing the with-body binding · case 04

Calls __enter__ again while constructing the with-body binding and changes the required Python-language result.

Context managers◈ Members↗
FA-5175

Context enter binding: Calls __enter__ again while constructing the with-body binding · case 05

Calls __enter__ again while constructing the with-body binding and changes the required Python-language result.

Context managers◈ Members↗
FA-5176

Context enter binding: Calls __enter__ manually and loses guaranteed exit on body failure · case 01

Calls __enter__ manually and loses guaranteed exit on body failure and changes the required Python-language result.

Context managers● Open access↗
FA-5177

Context enter binding: Calls __enter__ manually and loses guaranteed exit on body failure · case 02

Calls __enter__ manually and loses guaranteed exit on body failure and changes the required Python-language result.

Context managers◈ Members↗
FA-5178

Context enter binding: Calls __enter__ manually and loses guaranteed exit on body failure · case 03

Calls __enter__ manually and loses guaranteed exit on body failure and changes the required Python-language result.

Context managers◈ Members↗
FA-5179

Context enter binding: Calls __enter__ manually and loses guaranteed exit on body failure · case 04

Calls __enter__ manually and loses guaranteed exit on body failure and changes the required Python-language result.

Context managers◈ Members↗
FA-5180

Context enter binding: Calls __enter__ manually and loses guaranteed exit on body failure · case 05

Calls __enter__ manually and loses guaranteed exit on body failure and changes the required Python-language result.

Context managers◈ Members↗
FA-5181

Nested context unwinding: Acquires managers in the reverse declaration order · case 01

Acquires managers in the reverse declaration order and changes the required Python-language result.

Context managers● Open access↗
FA-5182

Nested context unwinding: Acquires managers in the reverse declaration order · case 02

Acquires managers in the reverse declaration order and changes the required Python-language result.

Context managers◈ Members↗
FA-5183

Nested context unwinding: Acquires managers in the reverse declaration order · case 03

Acquires managers in the reverse declaration order and changes the required Python-language result.

Context managers◈ Members↗
FA-5184

Nested context unwinding: Acquires managers in the reverse declaration order · case 04

Acquires managers in the reverse declaration order and changes the required Python-language result.

Context managers◈ Members↗
FA-5185

Nested context unwinding: Acquires managers in the reverse declaration order · case 05

Acquires managers in the reverse declaration order and changes the required Python-language result.

Context managers◈ Members↗
FA-5186

Nested context unwinding: Forgets to acquire the outer manager · case 01

Forgets to acquire the outer manager and changes the required Python-language result.

Context managers● Open access↗
FA-5187

Nested context unwinding: Forgets to acquire the outer manager · case 02

Forgets to acquire the outer manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5188

Nested context unwinding: Forgets to acquire the outer manager · case 03

Forgets to acquire the outer manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5189

Nested context unwinding: Forgets to acquire the outer manager · case 04

Forgets to acquire the outer manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5190

Nested context unwinding: Forgets to acquire the outer manager · case 05

Forgets to acquire the outer manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5191

Nested context unwinding: Forgets to acquire the inner manager · case 01

Forgets to acquire the inner manager and changes the required Python-language result.

Context managers● Open access↗
FA-5192

Nested context unwinding: Forgets to acquire the inner manager · case 02

Forgets to acquire the inner manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5193

Nested context unwinding: Forgets to acquire the inner manager · case 03

Forgets to acquire the inner manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5194

Nested context unwinding: Forgets to acquire the inner manager · case 04

Forgets to acquire the inner manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5195

Nested context unwinding: Forgets to acquire the inner manager · case 05

Forgets to acquire the inner manager and changes the required Python-language result.

Context managers◈ Members↗
FA-5196

Nested context unwinding: Releases nested managers in acquisition order · case 01

Releases nested managers in acquisition order and changes the required Python-language result.

Context managers● Open access↗
FA-5197

Nested context unwinding: Releases nested managers in acquisition order · case 02

Releases nested managers in acquisition order and changes the required Python-language result.

Context managers◈ Members↗
FA-5198

Nested context unwinding: Releases nested managers in acquisition order · case 03

Releases nested managers in acquisition order and changes the required Python-language result.

Context managers◈ Members↗
FA-5199

Nested context unwinding: Releases nested managers in acquisition order · case 04

Releases nested managers in acquisition order and changes the required Python-language result.

Context managers◈ Members↗
FA-5200

Nested context unwinding: Releases nested managers in acquisition order · case 05

Releases nested managers in acquisition order and changes the required Python-language result.

Context managers◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗