FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-5201

Nested context unwinding: Registers cleanup before acquisition has succeeded · case 01

Registers cleanup before acquisition has succeeded and changes the required Python-language result.

Context managers● Open access↗
FA-5202

Nested context unwinding: Registers cleanup before acquisition has succeeded · case 02

Registers cleanup before acquisition has succeeded and changes the required Python-language result.

Context managers◈ Members↗
FA-5203

Nested context unwinding: Registers cleanup before acquisition has succeeded · case 03

Registers cleanup before acquisition has succeeded and changes the required Python-language result.

Context managers◈ Members↗
FA-5204

Nested context unwinding: Registers cleanup before acquisition has succeeded · case 04

Registers cleanup before acquisition has succeeded and changes the required Python-language result.

Context managers◈ Members↗
FA-5205

Nested context unwinding: Registers cleanup before acquisition has succeeded · case 05

Registers cleanup before acquisition has succeeded and changes the required Python-language result.

Context managers◈ Members↗
FA-5206

Exception handler hierarchy: Places a broad LookupError handler before its specific subclasses · case 01

Places a broad LookupError handler before its specific subclasses and changes the required Python-language result.

Exception flow● Open access↗
FA-5207

Exception handler hierarchy: Places a broad LookupError handler before its specific subclasses · case 02

Places a broad LookupError handler before its specific subclasses and changes the required Python-language result.

Exception flow◈ Members↗
FA-5208

Exception handler hierarchy: Places a broad LookupError handler before its specific subclasses · case 03

Places a broad LookupError handler before its specific subclasses and changes the required Python-language result.

Exception flow◈ Members↗
FA-5209

Exception handler hierarchy: Places a broad LookupError handler before its specific subclasses · case 04

Places a broad LookupError handler before its specific subclasses and changes the required Python-language result.

Exception flow◈ Members↗
FA-5210

Exception handler hierarchy: Places a broad LookupError handler before its specific subclasses · case 05

Places a broad LookupError handler before its specific subclasses and changes the required Python-language result.

Exception flow◈ Members↗
FA-5211

Exception handler hierarchy: Places Exception before all specific error handlers · case 01

Places Exception before all specific error handlers and changes the required Python-language result.

Exception flow● Open access↗
FA-5212

Exception handler hierarchy: Places Exception before all specific error handlers · case 02

Places Exception before all specific error handlers and changes the required Python-language result.

Exception flow◈ Members↗
FA-5213

Exception handler hierarchy: Places Exception before all specific error handlers · case 03

Places Exception before all specific error handlers and changes the required Python-language result.

Exception flow◈ Members↗
FA-5214

Exception handler hierarchy: Places Exception before all specific error handlers · case 04

Places Exception before all specific error handlers and changes the required Python-language result.

Exception flow◈ Members↗
FA-5215

Exception handler hierarchy: Places Exception before all specific error handlers · case 05

Places Exception before all specific error handlers and changes the required Python-language result.

Exception flow◈ Members↗
FA-5216

Exception handler hierarchy: Catches TypeError in the slot intended for KeyError · case 01

Catches TypeError in the slot intended for KeyError and changes the required Python-language result.

Exception flow● Open access↗
FA-5217

Exception handler hierarchy: Catches TypeError in the slot intended for KeyError · case 02

Catches TypeError in the slot intended for KeyError and changes the required Python-language result.

Exception flow◈ Members↗
FA-5218

Exception handler hierarchy: Catches TypeError in the slot intended for KeyError · case 03

Catches TypeError in the slot intended for KeyError and changes the required Python-language result.

Exception flow◈ Members↗
FA-5219

Exception handler hierarchy: Catches TypeError in the slot intended for KeyError · case 04

Catches TypeError in the slot intended for KeyError and changes the required Python-language result.

Exception flow◈ Members↗
FA-5220

Exception handler hierarchy: Catches TypeError in the slot intended for KeyError · case 05

Catches TypeError in the slot intended for KeyError and changes the required Python-language result.

Exception flow◈ Members↗
FA-5221

Exception handler hierarchy: Removes the specific IndexError handler · case 01

Removes the specific IndexError handler and changes the required Python-language result.

Exception flow● Open access↗
FA-5222

Exception handler hierarchy: Removes the specific IndexError handler · case 02

Removes the specific IndexError handler and changes the required Python-language result.

Exception flow◈ Members↗
FA-5223

Exception handler hierarchy: Removes the specific IndexError handler · case 03

Removes the specific IndexError handler and changes the required Python-language result.

Exception flow◈ Members↗
FA-5224

Exception handler hierarchy: Removes the specific IndexError handler · case 04

Removes the specific IndexError handler and changes the required Python-language result.

Exception flow◈ Members↗
FA-5225

Exception handler hierarchy: Removes the specific IndexError handler · case 05

Removes the specific IndexError handler and changes the required Python-language result.

Exception flow◈ Members↗
FA-5226

Exception handler hierarchy: Uses BaseException for the ordinary fallback and swallows control-flow exceptions · case 01

Uses BaseException for the ordinary fallback and swallows control-flow exceptions and changes the required Python-language result.

Exception flow● Open access↗
FA-5227

Exception handler hierarchy: Uses BaseException for the ordinary fallback and swallows control-flow exceptions · case 02

Uses BaseException for the ordinary fallback and swallows control-flow exceptions and changes the required Python-language result.

Exception flow◈ Members↗
FA-5228

Exception handler hierarchy: Uses BaseException for the ordinary fallback and swallows control-flow exceptions · case 03

Uses BaseException for the ordinary fallback and swallows control-flow exceptions and changes the required Python-language result.

Exception flow◈ Members↗
FA-5229

Exception handler hierarchy: Uses BaseException for the ordinary fallback and swallows control-flow exceptions · case 04

Uses BaseException for the ordinary fallback and swallows control-flow exceptions and changes the required Python-language result.

Exception flow◈ Members↗
FA-5230

Exception handler hierarchy: Uses BaseException for the ordinary fallback and swallows control-flow exceptions · case 05

Uses BaseException for the ordinary fallback and swallows control-flow exceptions and changes the required Python-language result.

Exception flow◈ Members↗
FA-5231

Exception chaining metadata: Raises the wrapper without its requested explicit cause · case 01

Raises the wrapper without its requested explicit cause and changes the required Python-language result.

Exception flow● Open access↗
FA-5232

Exception chaining metadata: Raises the wrapper without its requested explicit cause · case 02

Raises the wrapper without its requested explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5233

Exception chaining metadata: Raises the wrapper without its requested explicit cause · case 03

Raises the wrapper without its requested explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5234

Exception chaining metadata: Raises the wrapper without its requested explicit cause · case 04

Raises the wrapper without its requested explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5235

Exception chaining metadata: Raises the wrapper without its requested explicit cause · case 05

Raises the wrapper without its requested explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5236

Exception chaining metadata: Leaves implicit context visible when from-None suppression was requested · case 01

Leaves implicit context visible when from-None suppression was requested and changes the required Python-language result.

Exception flow● Open access↗
FA-5237

Exception chaining metadata: Leaves implicit context visible when from-None suppression was requested · case 02

Leaves implicit context visible when from-None suppression was requested and changes the required Python-language result.

Exception flow◈ Members↗
FA-5238

Exception chaining metadata: Leaves implicit context visible when from-None suppression was requested · case 03

Leaves implicit context visible when from-None suppression was requested and changes the required Python-language result.

Exception flow◈ Members↗
FA-5239

Exception chaining metadata: Leaves implicit context visible when from-None suppression was requested · case 04

Leaves implicit context visible when from-None suppression was requested and changes the required Python-language result.

Exception flow◈ Members↗
FA-5240

Exception chaining metadata: Leaves implicit context visible when from-None suppression was requested · case 05

Leaves implicit context visible when from-None suppression was requested and changes the required Python-language result.

Exception flow◈ Members↗
FA-5241

Exception chaining metadata: Turns implicit context into an explicit cause · case 01

Turns implicit context into an explicit cause and changes the required Python-language result.

Exception flow● Open access↗
FA-5242

Exception chaining metadata: Turns implicit context into an explicit cause · case 02

Turns implicit context into an explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5243

Exception chaining metadata: Turns implicit context into an explicit cause · case 03

Turns implicit context into an explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5244

Exception chaining metadata: Turns implicit context into an explicit cause · case 04

Turns implicit context into an explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5245

Exception chaining metadata: Turns implicit context into an explicit cause · case 05

Turns implicit context into an explicit cause and changes the required Python-language result.

Exception flow◈ Members↗
FA-5246

Exception chaining metadata: Deletes the stored context when only context display should be suppressed · case 01

Deletes the stored context when only context display should be suppressed and changes the required Python-language result.

Exception flow● Open access↗
FA-5247

Exception chaining metadata: Deletes the stored context when only context display should be suppressed · case 02

Deletes the stored context when only context display should be suppressed and changes the required Python-language result.

Exception flow◈ Members↗
FA-5248

Exception chaining metadata: Deletes the stored context when only context display should be suppressed · case 03

Deletes the stored context when only context display should be suppressed and changes the required Python-language result.

Exception flow◈ Members↗
FA-5249

Exception chaining metadata: Deletes the stored context when only context display should be suppressed · case 04

Deletes the stored context when only context display should be suppressed and changes the required Python-language result.

Exception flow◈ Members↗
FA-5250

Exception chaining metadata: Deletes the stored context when only context display should be suppressed · case 05

Deletes the stored context when only context display should be suppressed and changes the required Python-language result.

Exception flow◈ Members↗
FA-5251

Exception chaining metadata: Reraises the original exception instead of the requested wrapper · case 01

Reraises the original exception instead of the requested wrapper and changes the required Python-language result.

Exception flow● Open access↗
FA-5252

Exception chaining metadata: Reraises the original exception instead of the requested wrapper · case 02

Reraises the original exception instead of the requested wrapper and changes the required Python-language result.

Exception flow◈ Members↗
FA-5253

Exception chaining metadata: Reraises the original exception instead of the requested wrapper · case 03

Reraises the original exception instead of the requested wrapper and changes the required Python-language result.

Exception flow◈ Members↗
FA-5254

Exception chaining metadata: Reraises the original exception instead of the requested wrapper · case 04

Reraises the original exception instead of the requested wrapper and changes the required Python-language result.

Exception flow◈ Members↗
FA-5255

Exception chaining metadata: Reraises the original exception instead of the requested wrapper · case 05

Reraises the original exception instead of the requested wrapper and changes the required Python-language result.

Exception flow◈ Members↗
FA-5256

Finally return precedence: Returns from finally even when replacement is disabled · case 01

Returns from finally even when replacement is disabled and changes the required Python-language result.

Exception flow● Open access↗
FA-5257

Finally return precedence: Returns from finally even when replacement is disabled · case 02

Returns from finally even when replacement is disabled and changes the required Python-language result.

Exception flow◈ Members↗
FA-5258

Finally return precedence: Returns from finally even when replacement is disabled · case 03

Returns from finally even when replacement is disabled and changes the required Python-language result.

Exception flow◈ Members↗
FA-5259

Finally return precedence: Returns from finally even when replacement is disabled · case 04

Returns from finally even when replacement is disabled and changes the required Python-language result.

Exception flow◈ Members↗
FA-5260

Finally return precedence: Returns from finally even when replacement is disabled · case 05

Returns from finally even when replacement is disabled and changes the required Python-language result.

Exception flow◈ Members↗
FA-5261

Finally return precedence: Discards the enabled finally return and preserves the pending body outcome · case 01

Discards the enabled finally return and preserves the pending body outcome and changes the required Python-language result.

Exception flow● Open access↗
FA-5262

Finally return precedence: Discards the enabled finally return and preserves the pending body outcome · case 02

Discards the enabled finally return and preserves the pending body outcome and changes the required Python-language result.

Exception flow◈ Members↗
FA-5263

Finally return precedence: Discards the enabled finally return and preserves the pending body outcome · case 03

Discards the enabled finally return and preserves the pending body outcome and changes the required Python-language result.

Exception flow◈ Members↗
FA-5264

Finally return precedence: Discards the enabled finally return and preserves the pending body outcome · case 04

Discards the enabled finally return and preserves the pending body outcome and changes the required Python-language result.

Exception flow◈ Members↗
FA-5265

Finally return precedence: Discards the enabled finally return and preserves the pending body outcome · case 05

Discards the enabled finally return and preserves the pending body outcome and changes the required Python-language result.

Exception flow◈ Members↗
FA-5266

Finally return precedence: Applies the finally return only to exceptional body completion · case 01

Applies the finally return only to exceptional body completion and changes the required Python-language result.

Exception flow● Open access↗
FA-5267

Finally return precedence: Applies the finally return only to exceptional body completion · case 02

Applies the finally return only to exceptional body completion and changes the required Python-language result.

Exception flow◈ Members↗
FA-5268

Finally return precedence: Applies the finally return only to exceptional body completion · case 03

Applies the finally return only to exceptional body completion and changes the required Python-language result.

Exception flow◈ Members↗
FA-5269

Finally return precedence: Applies the finally return only to exceptional body completion · case 04

Applies the finally return only to exceptional body completion and changes the required Python-language result.

Exception flow◈ Members↗
FA-5270

Finally return precedence: Applies the finally return only to exceptional body completion · case 05

Applies the finally return only to exceptional body completion and changes the required Python-language result.

Exception flow◈ Members↗
FA-5271

Finally return precedence: Refuses to let a finally return suppress a pending exception · case 01

Refuses to let a finally return suppress a pending exception and changes the required Python-language result.

Exception flow● Open access↗
FA-5272

Finally return precedence: Refuses to let a finally return suppress a pending exception · case 02

Refuses to let a finally return suppress a pending exception and changes the required Python-language result.

Exception flow◈ Members↗
FA-5273

Finally return precedence: Refuses to let a finally return suppress a pending exception · case 03

Refuses to let a finally return suppress a pending exception and changes the required Python-language result.

Exception flow◈ Members↗
FA-5274

Finally return precedence: Refuses to let a finally return suppress a pending exception · case 04

Refuses to let a finally return suppress a pending exception and changes the required Python-language result.

Exception flow◈ Members↗
FA-5275

Finally return precedence: Refuses to let a finally return suppress a pending exception · case 05

Refuses to let a finally return suppress a pending exception and changes the required Python-language result.

Exception flow◈ Members↗
FA-5276

Finally return precedence: Conditions finally replacement on payload truthiness · case 01

Conditions finally replacement on payload truthiness and changes the required Python-language result.

Exception flow● Open access↗
FA-5277

Finally return precedence: Conditions finally replacement on payload truthiness · case 02

Conditions finally replacement on payload truthiness and changes the required Python-language result.

Exception flow◈ Members↗
FA-5278

Finally return precedence: Conditions finally replacement on payload truthiness · case 03

Conditions finally replacement on payload truthiness and changes the required Python-language result.

Exception flow◈ Members↗
FA-5279

Finally return precedence: Conditions finally replacement on payload truthiness · case 04

Conditions finally replacement on payload truthiness and changes the required Python-language result.

Exception flow◈ Members↗
FA-5280

Finally return precedence: Conditions finally replacement on payload truthiness · case 05

Conditions finally replacement on payload truthiness and changes the required Python-language result.

Exception flow◈ Members↗
FA-5281

Short circuit operands: Converts the selected operand into a Boolean result · case 01

Converts the selected operand into a Boolean result and changes the required Python-language result.

Python evaluation● Open access↗
FA-5282

Short circuit operands: Converts the selected operand into a Boolean result · case 02

Converts the selected operand into a Boolean result and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5283

Short circuit operands: Converts the selected operand into a Boolean result · case 03

Converts the selected operand into a Boolean result and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5284

Short circuit operands: Converts the selected operand into a Boolean result · case 04

Converts the selected operand into a Boolean result and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5285

Short circuit operands: Converts the selected operand into a Boolean result · case 05

Converts the selected operand into a Boolean result and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5286

Short circuit operands: Evaluates the right operand even when the left short-circuits · case 01

Evaluates the right operand even when the left short-circuits and changes the required Python-language result.

Python evaluation● Open access↗
FA-5287

Short circuit operands: Evaluates the right operand even when the left short-circuits · case 02

Evaluates the right operand even when the left short-circuits and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5288

Short circuit operands: Evaluates the right operand even when the left short-circuits · case 03

Evaluates the right operand even when the left short-circuits and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5289

Short circuit operands: Evaluates the right operand even when the left short-circuits · case 04

Evaluates the right operand even when the left short-circuits and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5290

Short circuit operands: Evaluates the right operand even when the left short-circuits · case 05

Evaluates the right operand even when the left short-circuits and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5291

Short circuit operands: Uses OR semantics for the AND operation · case 01

Uses OR semantics for the AND operation and changes the required Python-language result.

Python evaluation● Open access↗
FA-5292

Short circuit operands: Uses OR semantics for the AND operation · case 02

Uses OR semantics for the AND operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5293

Short circuit operands: Uses OR semantics for the AND operation · case 03

Uses OR semantics for the AND operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5294

Short circuit operands: Uses OR semantics for the AND operation · case 04

Uses OR semantics for the AND operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5295

Short circuit operands: Uses OR semantics for the AND operation · case 05

Uses OR semantics for the AND operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5296

Short circuit operands: Uses AND semantics for the OR operation · case 01

Uses AND semantics for the OR operation and changes the required Python-language result.

Python evaluation● Open access↗
FA-5297

Short circuit operands: Uses AND semantics for the OR operation · case 02

Uses AND semantics for the OR operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5298

Short circuit operands: Uses AND semantics for the OR operation · case 03

Uses AND semantics for the OR operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5299

Short circuit operands: Uses AND semantics for the OR operation · case 04

Uses AND semantics for the OR operation and changes the required Python-language result.

Python evaluation◈ Members↗
FA-5300

Short circuit operands: Uses AND semantics for the OR operation · case 05

Uses AND semantics for the OR operation and changes the required Python-language result.

Python evaluation◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗