FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-12201

A destination-only road becomes a through-road shortcut · case 01

A destination-only road becomes a through-road shortcut in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12202

A destination-only road becomes a through-road shortcut · case 02

A destination-only road becomes a through-road shortcut in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12203

A destination-only road becomes a through-road shortcut · case 03

A destination-only road becomes a through-road shortcut in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12204

A destination-only road becomes a through-road shortcut · case 04

A destination-only road becomes a through-road shortcut in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12205

A destination-only road becomes a through-road shortcut · case 05

A destination-only road becomes a through-road shortcut in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12206

A vehicle is admitted without sufficient surveyed clearance · case 01

A vehicle is admitted without sufficient surveyed clearance in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12207

A vehicle is admitted without sufficient surveyed clearance · case 02

A vehicle is admitted without sufficient surveyed clearance in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12208

A vehicle is admitted without sufficient surveyed clearance · case 03

A vehicle is admitted without sufficient surveyed clearance in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12209

A vehicle is admitted without sufficient surveyed clearance · case 04

A vehicle is admitted without sufficient surveyed clearance in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12210

A vehicle is admitted without sufficient surveyed clearance · case 05

A vehicle is admitted without sufficient surveyed clearance in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12211

Lane guidance invents a connection to an exit lane · case 01

Lane guidance invents a connection to an exit lane in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12212

Lane guidance invents a connection to an exit lane · case 02

Lane guidance invents a connection to an exit lane in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12213

Lane guidance invents a connection to an exit lane · case 03

Lane guidance invents a connection to an exit lane in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12214

Lane guidance invents a connection to an exit lane · case 04

Lane guidance invents a connection to an exit lane in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12215

Lane guidance invents a connection to an exit lane · case 05

Lane guidance invents a connection to an exit lane in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12216

Roundabout instructions count entrances as exits · case 01

Roundabout instructions count entrances as exits in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12217

Roundabout instructions count entrances as exits · case 02

Roundabout instructions count entrances as exits in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12218

Roundabout instructions count entrances as exits · case 03

Roundabout instructions count entrances as exits in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12219

Roundabout instructions count entrances as exits · case 04

Roundabout instructions count entrances as exits in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12220

Roundabout instructions count entrances as exits · case 05

Roundabout instructions count entrances as exits in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12221

Toll avoidance checks only the route endpoints · case 01

Toll avoidance checks only the route endpoints in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12222

Toll avoidance checks only the route endpoints · case 02

Toll avoidance checks only the route endpoints in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12223

Toll avoidance checks only the route endpoints · case 03

Toll avoidance checks only the route endpoints in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12224

Toll avoidance checks only the route endpoints · case 04

Toll avoidance checks only the route endpoints in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12225

Toll avoidance checks only the route endpoints · case 05

Toll avoidance checks only the route endpoints in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12226

A reversible lane is used after its direction changes · case 01

A reversible lane is used after its direction changes in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12227

A reversible lane is used after its direction changes · case 02

A reversible lane is used after its direction changes in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12228

A reversible lane is used after its direction changes · case 03

A reversible lane is used after its direction changes in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12229

A reversible lane is used after its direction changes · case 04

A reversible lane is used after its direction changes in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12230

A reversible lane is used after its direction changes · case 05

A reversible lane is used after its direction changes in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12231

Map matching snaps a waypoint onto an inaccessible bridge deck · case 01

Map matching snaps a waypoint onto an inaccessible bridge deck in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12232

Map matching snaps a waypoint onto an inaccessible bridge deck · case 02

Map matching snaps a waypoint onto an inaccessible bridge deck in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12233

Map matching snaps a waypoint onto an inaccessible bridge deck · case 03

Map matching snaps a waypoint onto an inaccessible bridge deck in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12234

Map matching snaps a waypoint onto an inaccessible bridge deck · case 04

Map matching snaps a waypoint onto an inaccessible bridge deck in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12235

Map matching snaps a waypoint onto an inaccessible bridge deck · case 05

Map matching snaps a waypoint onto an inaccessible bridge deck in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12236

A curbside waypoint accepts arrival from the wrong carriageway · case 01

A curbside waypoint accepts arrival from the wrong carriageway in the controlled route-policy fixture.

Navigation route constraints● Open access↗
FA-12237

A curbside waypoint accepts arrival from the wrong carriageway · case 02

A curbside waypoint accepts arrival from the wrong carriageway in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12238

A curbside waypoint accepts arrival from the wrong carriageway · case 03

A curbside waypoint accepts arrival from the wrong carriageway in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12239

A curbside waypoint accepts arrival from the wrong carriageway · case 04

A curbside waypoint accepts arrival from the wrong carriageway in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12240

A curbside waypoint accepts arrival from the wrong carriageway · case 05

A curbside waypoint accepts arrival from the wrong carriageway in the controlled route-policy fixture.

Navigation route constraints◈ Members↗
FA-12241

A register delta loses complete counter revolutions · case 01

A register delta loses complete counter revolutions.

Power metering accounting● Open access↗
FA-12242

A register delta loses complete counter revolutions · case 02

A register delta loses complete counter revolutions.

Power metering accounting◈ Members↗
FA-12243

A register delta loses complete counter revolutions · case 03

A register delta loses complete counter revolutions.

Power metering accounting◈ Members↗
FA-12244

A register delta loses complete counter revolutions · case 04

A register delta loses complete counter revolutions.

Power metering accounting◈ Members↗
FA-12245

A register delta loses complete counter revolutions · case 05

A register delta loses complete counter revolutions.

Power metering accounting◈ Members↗
FA-12246

Per-phase direction registers are collapsed before settlement · case 01

Per-phase direction registers are collapsed before settlement.

Power metering accounting● Open access↗
FA-12247

Per-phase direction registers are collapsed before settlement · case 02

Per-phase direction registers are collapsed before settlement.

Power metering accounting◈ Members↗
FA-12248

Per-phase direction registers are collapsed before settlement · case 03

Per-phase direction registers are collapsed before settlement.

Power metering accounting◈ Members↗
FA-12249

Per-phase direction registers are collapsed before settlement · case 04

Per-phase direction registers are collapsed before settlement.

Power metering accounting◈ Members↗
FA-12250

Per-phase direction registers are collapsed before settlement · case 05

Per-phase direction registers are collapsed before settlement.

Power metering accounting◈ Members↗
FA-12251

Export in one interval erases import from another · case 01

Export in one interval erases import from another.

Power metering accounting● Open access↗
FA-12252

Export in one interval erases import from another · case 02

Export in one interval erases import from another.

Power metering accounting◈ Members↗
FA-12253

Export in one interval erases import from another · case 03

Export in one interval erases import from another.

Power metering accounting◈ Members↗
FA-12254

Export in one interval erases import from another · case 04

Export in one interval erases import from another.

Power metering accounting◈ Members↗
FA-12255

Export in one interval erases import from another · case 05

Export in one interval erases import from another.

Power metering accounting◈ Members↗
FA-12256

An interval end label selects the next tariff period · case 01

An interval end label selects the next tariff period.

Power metering accounting● Open access↗
FA-12257

An interval end label selects the next tariff period · case 02

An interval end label selects the next tariff period.

Power metering accounting◈ Members↗
FA-12258

An interval end label selects the next tariff period · case 03

An interval end label selects the next tariff period.

Power metering accounting◈ Members↗
FA-12259

An interval end label selects the next tariff period · case 04

An interval end label selects the next tariff period.

Power metering accounting◈ Members↗
FA-12260

An interval end label selects the next tariff period · case 05

An interval end label selects the next tariff period.

Power metering accounting◈ Members↗
FA-12261

A missing interval is reported as measured zero consumption · case 01

A missing interval is reported as measured zero consumption.

Power metering accounting● Open access↗
FA-12262

A missing interval is reported as measured zero consumption · case 02

A missing interval is reported as measured zero consumption.

Power metering accounting◈ Members↗
FA-12263

A missing interval is reported as measured zero consumption · case 03

A missing interval is reported as measured zero consumption.

Power metering accounting◈ Members↗
FA-12264

A missing interval is reported as measured zero consumption · case 04

A missing interval is reported as measured zero consumption.

Power metering accounting◈ Members↗
FA-12265

A missing interval is reported as measured zero consumption · case 05

A missing interval is reported as measured zero consumption.

Power metering accounting◈ Members↗
FA-12266

Independent feeder peaks inflate the site demand register · case 01

Independent feeder peaks inflate the site demand register.

Power metering accounting● Open access↗
FA-12267

Independent feeder peaks inflate the site demand register · case 02

Independent feeder peaks inflate the site demand register.

Power metering accounting◈ Members↗
FA-12268

Independent feeder peaks inflate the site demand register · case 03

Independent feeder peaks inflate the site demand register.

Power metering accounting◈ Members↗
FA-12269

Independent feeder peaks inflate the site demand register · case 04

Independent feeder peaks inflate the site demand register.

Power metering accounting◈ Members↗
FA-12270

Independent feeder peaks inflate the site demand register · case 05

Independent feeder peaks inflate the site demand register.

Power metering accounting◈ Members↗
FA-12271

Partial demand blocks compete with complete tariff blocks · case 01

Partial demand blocks compete with complete tariff blocks.

Power metering accounting● Open access↗
FA-12272

Partial demand blocks compete with complete tariff blocks · case 02

Partial demand blocks compete with complete tariff blocks.

Power metering accounting◈ Members↗
FA-12273

Partial demand blocks compete with complete tariff blocks · case 03

Partial demand blocks compete with complete tariff blocks.

Power metering accounting◈ Members↗
FA-12274

Partial demand blocks compete with complete tariff blocks · case 04

Partial demand blocks compete with complete tariff blocks.

Power metering accounting◈ Members↗
FA-12275

Partial demand blocks compete with complete tariff blocks · case 05

Partial demand blocks compete with complete tariff blocks.

Power metering accounting◈ Members↗
FA-12276

Reactive export quadrants are charged to the import register · case 01

Reactive export quadrants are charged to the import register.

Power metering accounting● Open access↗
FA-12277

Reactive export quadrants are charged to the import register · case 02

Reactive export quadrants are charged to the import register.

Power metering accounting◈ Members↗
FA-12278

Reactive export quadrants are charged to the import register · case 03

Reactive export quadrants are charged to the import register.

Power metering accounting◈ Members↗
FA-12279

Reactive export quadrants are charged to the import register · case 04

Reactive export quadrants are charged to the import register.

Power metering accounting◈ Members↗
FA-12280

Reactive export quadrants are charged to the import register · case 05

Reactive export quadrants are charged to the import register.

Power metering accounting◈ Members↗
FA-12281

Expired export-credit lots reduce current import charges · case 01

Expired export-credit lots reduce current import charges.

Power metering accounting● Open access↗
FA-12282

Expired export-credit lots reduce current import charges · case 02

Expired export-credit lots reduce current import charges.

Power metering accounting◈ Members↗
FA-12283

Expired export-credit lots reduce current import charges · case 03

Expired export-credit lots reduce current import charges.

Power metering accounting◈ Members↗
FA-12284

Expired export-credit lots reduce current import charges · case 04

Expired export-credit lots reduce current import charges.

Power metering accounting◈ Members↗
FA-12285

Expired export-credit lots reduce current import charges · case 05

Expired export-credit lots reduce current import charges.

Power metering accounting◈ Members↗
FA-12286

A replacement meter opening register becomes billed energy · case 01

A replacement meter opening register becomes billed energy.

Power metering accounting● Open access↗
FA-12287

A replacement meter opening register becomes billed energy · case 02

A replacement meter opening register becomes billed energy.

Power metering accounting◈ Members↗
FA-12288

A replacement meter opening register becomes billed energy · case 03

A replacement meter opening register becomes billed energy.

Power metering accounting◈ Members↗
FA-12289

A replacement meter opening register becomes billed energy · case 04

A replacement meter opening register becomes billed energy.

Power metering accounting◈ Members↗
FA-12290

A replacement meter opening register becomes billed energy · case 05

A replacement meter opening register becomes billed energy.

Power metering accounting◈ Members↗
FA-12291

Charging loss is applied to withdrawals · case 01

A shared efficiency transform shrinks both incoming and outgoing charge.

Battery state accounting● Open access↗
FA-12292

Charging loss is applied to withdrawals · case 02

A shared efficiency transform shrinks both incoming and outgoing charge.

Battery state accounting◈ Members↗
FA-12293

Charging loss is applied to withdrawals · case 03

A shared efficiency transform shrinks both incoming and outgoing charge.

Battery state accounting◈ Members↗
FA-12294

Charging loss is applied to withdrawals · case 04

A shared efficiency transform shrinks both incoming and outgoing charge.

Battery state accounting◈ Members↗
FA-12295

Charging loss is applied to withdrawals · case 05

A shared efficiency transform shrinks both incoming and outgoing charge.

Battery state accounting◈ Members↗
FA-12296

Capacity calibration invents stored charge · case 01

Capacity recalibration preserves a displayed fraction instead of stored inventory.

Battery state accounting● Open access↗
FA-12297

Capacity calibration invents stored charge · case 02

Capacity recalibration preserves a displayed fraction instead of stored inventory.

Battery state accounting◈ Members↗
FA-12298

Capacity calibration invents stored charge · case 03

Capacity recalibration preserves a displayed fraction instead of stored inventory.

Battery state accounting◈ Members↗
FA-12299

Capacity calibration invents stored charge · case 04

Capacity recalibration preserves a displayed fraction instead of stored inventory.

Battery state accounting◈ Members↗
FA-12300

Capacity calibration invents stored charge · case 05

Capacity recalibration preserves a displayed fraction instead of stored inventory.

Battery state accounting◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗