FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-66301

Loads at undefined positions silently accepted · case 01

A manifest line for a position that does not exist in this aircraft passes validation.

Aviation weight and balance● Open access↗
FA-66302

Loads at undefined positions silently accepted · case 02

A manifest line for a position that does not exist in this aircraft passes validation.

Aviation weight and balance◈ Members↗
FA-66303

Loads at undefined positions silently accepted · case 03

A manifest line for a position that does not exist in this aircraft passes validation.

Aviation weight and balance◈ Members↗
FA-66304

Loads at undefined positions silently accepted · case 04

A manifest line for a position that does not exist in this aircraft passes validation.

Aviation weight and balance◈ Members↗
FA-66305

Loads at undefined positions silently accepted · case 05

A manifest line for a position that does not exist in this aircraft passes validation.

Aviation weight and balance◈ Members↗
FA-66306

Position findings follow manifest entry order · case 01

Two runs over the same load in different manifest order produce differently ordered findings.

Aviation weight and balance● Open access↗
FA-66307

Position findings follow manifest entry order · case 02

Two runs over the same load in different manifest order produce differently ordered findings.

Aviation weight and balance◈ Members↗
FA-66308

Position findings follow manifest entry order · case 03

Two runs over the same load in different manifest order produce differently ordered findings.

Aviation weight and balance◈ Members↗
FA-66309

Position findings follow manifest entry order · case 04

Two runs over the same load in different manifest order produce differently ordered findings.

Aviation weight and balance◈ Members↗
FA-66310

Position findings follow manifest entry order · case 05

Two runs over the same load in different manifest order produce differently ordered findings.

Aviation weight and balance◈ Members↗
FA-66311

Warm fuel treated as denser · case 01

Hot days produce short-fuelled aircraft because too few gallons are ordered.

Aviation weight and balance● Open access↗
FA-66312

Warm fuel treated as denser · case 02

Hot days produce short-fuelled aircraft because too few gallons are ordered.

Aviation weight and balance◈ Members↗
FA-66313

Warm fuel treated as denser · case 03

Hot days produce short-fuelled aircraft because too few gallons are ordered.

Aviation weight and balance◈ Members↗
FA-66314

Warm fuel treated as denser · case 04

Hot days produce short-fuelled aircraft because too few gallons are ordered.

Aviation weight and balance◈ Members↗
FA-66315

Warm fuel treated as denser · case 05

Hot days produce short-fuelled aircraft because too few gallons are ordered.

Aviation weight and balance◈ Members↗
FA-66316

Uplift truncated to whole gallons · case 01

The aircraft ends up a fraction of a gallon below the planned fuel weight.

Aviation weight and balance● Open access↗
FA-66317

Uplift truncated to whole gallons · case 02

The aircraft ends up a fraction of a gallon below the planned fuel weight.

Aviation weight and balance◈ Members↗
FA-66318

Uplift truncated to whole gallons · case 03

The aircraft ends up a fraction of a gallon below the planned fuel weight.

Aviation weight and balance◈ Members↗
FA-66319

Uplift truncated to whole gallons · case 04

The aircraft ends up a fraction of a gallon below the planned fuel weight.

Aviation weight and balance◈ Members↗
FA-66320

Uplift truncated to whole gallons · case 05

The aircraft ends up a fraction of a gallon below the planned fuel weight.

Aviation weight and balance◈ Members↗
FA-66321

Onboard gallons subtracted from a pound target · case 01

Uplift orders are far too large when fuel is already on board.

Aviation weight and balance● Open access↗
FA-66322

Onboard gallons subtracted from a pound target · case 02

Uplift orders are far too large when fuel is already on board.

Aviation weight and balance◈ Members↗
FA-66323

Onboard gallons subtracted from a pound target · case 03

Uplift orders are far too large when fuel is already on board.

Aviation weight and balance◈ Members↗
FA-66324

Onboard gallons subtracted from a pound target · case 04

Uplift orders are far too large when fuel is already on board.

Aviation weight and balance◈ Members↗
FA-66325

Onboard gallons subtracted from a pound target · case 05

Uplift orders are far too large when fuel is already on board.

Aviation weight and balance◈ Members↗
FA-66326

Tank capacity compared with the fuel weight target · case 01

Ordinary fuel orders are rejected because pounds exceed the gallon capacity number.

Aviation weight and balance● Open access↗
FA-66327

Tank capacity compared with the fuel weight target · case 02

Ordinary fuel orders are rejected because pounds exceed the gallon capacity number.

Aviation weight and balance◈ Members↗
FA-66328

Tank capacity compared with the fuel weight target · case 03

Ordinary fuel orders are rejected because pounds exceed the gallon capacity number.

Aviation weight and balance◈ Members↗
FA-66329

Tank capacity compared with the fuel weight target · case 04

Ordinary fuel orders are rejected because pounds exceed the gallon capacity number.

Aviation weight and balance◈ Members↗
FA-66330

Tank capacity compared with the fuel weight target · case 05

Ordinary fuel orders are rejected because pounds exceed the gallon capacity number.

Aviation weight and balance◈ Members↗
FA-66331

Sufficient onboard fuel reported as a capacity problem · case 01

A tanker-loaded aircraft that needs no fuel gets an ERR_CAPACITY result.

Aviation weight and balance● Open access↗
FA-66332

Sufficient onboard fuel reported as a capacity problem · case 02

A tanker-loaded aircraft that needs no fuel gets an ERR_CAPACITY result.

Aviation weight and balance◈ Members↗
FA-66333

Sufficient onboard fuel reported as a capacity problem · case 03

A tanker-loaded aircraft that needs no fuel gets an ERR_CAPACITY result.

Aviation weight and balance◈ Members↗
FA-66334

Sufficient onboard fuel reported as a capacity problem · case 04

A tanker-loaded aircraft that needs no fuel gets an ERR_CAPACITY result.

Aviation weight and balance◈ Members↗
FA-66335

Sufficient onboard fuel reported as a capacity problem · case 05

A tanker-loaded aircraft that needs no fuel gets an ERR_CAPACITY result.

Aviation weight and balance◈ Members↗
FA-66336

Unrounded density leaks float noise into the order · case 01

The density echoed on the fuel slip shows values like 6.6400000000000001 and gallon orders differ from the slip.

Aviation weight and balance● Open access↗
FA-66337

Unrounded density leaks float noise into the order · case 02

The density echoed on the fuel slip shows values like 6.6400000000000001 and gallon orders differ from the slip.

Aviation weight and balance◈ Members↗
FA-66338

Unrounded density leaks float noise into the order · case 03

The density echoed on the fuel slip shows values like 6.6400000000000001 and gallon orders differ from the slip.

Aviation weight and balance◈ Members↗
FA-66339

Unrounded density leaks float noise into the order · case 04

The density echoed on the fuel slip shows values like 6.6400000000000001 and gallon orders differ from the slip.

Aviation weight and balance◈ Members↗
FA-66340

Unrounded density leaks float noise into the order · case 05

The density echoed on the fuel slip shows values like 6.6400000000000001 and gallon orders differ from the slip.

Aviation weight and balance◈ Members↗
FA-66341

Advance purchase measured in elapsed 24-hour periods · case 01

A ticket bought at 22:30 for a 06:00 departure exactly 14 calendar days later fails a 14-day advance purchase.

Airline fare rule evaluation● Open access↗
FA-66342

Advance purchase measured in elapsed 24-hour periods · case 02

A ticket bought at 22:30 for a 06:00 departure exactly 14 calendar days later fails a 14-day advance purchase.

Airline fare rule evaluation◈ Members↗
FA-66343

Advance purchase measured in elapsed 24-hour periods · case 03

A ticket bought at 22:30 for a 06:00 departure exactly 14 calendar days later fails a 14-day advance purchase.

Airline fare rule evaluation◈ Members↗
FA-66344

Advance purchase measured in elapsed 24-hour periods · case 04

A ticket bought at 22:30 for a 06:00 departure exactly 14 calendar days later fails a 14-day advance purchase.

Airline fare rule evaluation◈ Members↗
FA-66345

Advance purchase measured in elapsed 24-hour periods · case 05

A ticket bought at 22:30 for a 06:00 departure exactly 14 calendar days later fails a 14-day advance purchase.

Airline fare rule evaluation◈ Members↗
FA-66346

Ticket bought exactly AP days ahead rejected · case 01

A 7-day advance purchase fare cannot be ticketed exactly seven days before departure.

Airline fare rule evaluation● Open access↗
FA-66347

Ticket bought exactly AP days ahead rejected · case 02

A 7-day advance purchase fare cannot be ticketed exactly seven days before departure.

Airline fare rule evaluation◈ Members↗
FA-66348

Ticket bought exactly AP days ahead rejected · case 03

A 7-day advance purchase fare cannot be ticketed exactly seven days before departure.

Airline fare rule evaluation◈ Members↗
FA-66349

Ticket bought exactly AP days ahead rejected · case 04

A 7-day advance purchase fare cannot be ticketed exactly seven days before departure.

Airline fare rule evaluation◈ Members↗
FA-66350

Ticket bought exactly AP days ahead rejected · case 05

A 7-day advance purchase fare cannot be ticketed exactly seven days before departure.

Airline fare rule evaluation◈ Members↗
FA-66351

Ticket issued at the exact time limit rejected · case 01

Tickets issued at exactly reservation plus 24 hours fail the ticketing time limit.

Airline fare rule evaluation● Open access↗
FA-66352

Ticket issued at the exact time limit rejected · case 02

Tickets issued at exactly reservation plus 24 hours fail the ticketing time limit.

Airline fare rule evaluation◈ Members↗
FA-66353

Ticket issued at the exact time limit rejected · case 03

Tickets issued at exactly reservation plus 24 hours fail the ticketing time limit.

Airline fare rule evaluation◈ Members↗
FA-66354

Ticket issued at the exact time limit rejected · case 04

Tickets issued at exactly reservation plus 24 hours fail the ticketing time limit.

Airline fare rule evaluation◈ Members↗
FA-66355

Ticket issued at the exact time limit rejected · case 05

Tickets issued at exactly reservation plus 24 hours fail the ticketing time limit.

Airline fare rule evaluation◈ Members↗
FA-66356

Ticketing time limit hours interpreted as days · case 01

A 24-hour ticketing limit allows tickets issued three weeks after booking.

Airline fare rule evaluation● Open access↗
FA-66357

Ticketing time limit hours interpreted as days · case 02

A 24-hour ticketing limit allows tickets issued three weeks after booking.

Airline fare rule evaluation◈ Members↗
FA-66358

Ticketing time limit hours interpreted as days · case 03

A 24-hour ticketing limit allows tickets issued three weeks after booking.

Airline fare rule evaluation◈ Members↗
FA-66359

Ticketing time limit hours interpreted as days · case 04

A 24-hour ticketing limit allows tickets issued three weeks after booking.

Airline fare rule evaluation◈ Members↗
FA-66360

Ticketing time limit hours interpreted as days · case 05

A 24-hour ticketing limit allows tickets issued three weeks after booking.

Airline fare rule evaluation◈ Members↗
FA-66361

Ticket timestamp earlier than the booking accepted · case 01

Records whose ticket predates the reservation silently pass.

Airline fare rule evaluation● Open access↗
FA-66362

Ticket timestamp earlier than the booking accepted · case 02

Records whose ticket predates the reservation silently pass.

Airline fare rule evaluation◈ Members↗
FA-66363

Ticket timestamp earlier than the booking accepted · case 03

Records whose ticket predates the reservation silently pass.

Airline fare rule evaluation◈ Members↗
FA-66364

Ticket timestamp earlier than the booking accepted · case 04

Records whose ticket predates the reservation silently pass.

Airline fare rule evaluation◈ Members↗
FA-66365

Ticket timestamp earlier than the booking accepted · case 05

Records whose ticket predates the reservation silently pass.

Airline fare rule evaluation◈ Members↗
FA-66366

Ticketing time limit reported ahead of an advance purchase failure · case 01

A late ticket that also misses advance purchase is reported only as a time-limit failure.

Airline fare rule evaluation● Open access↗
FA-66367

Ticketing time limit reported ahead of an advance purchase failure · case 02

A late ticket that also misses advance purchase is reported only as a time-limit failure.

Airline fare rule evaluation◈ Members↗
FA-66368

Ticketing time limit reported ahead of an advance purchase failure · case 03

A late ticket that also misses advance purchase is reported only as a time-limit failure.

Airline fare rule evaluation◈ Members↗
FA-66369

Ticketing time limit reported ahead of an advance purchase failure · case 04

A late ticket that also misses advance purchase is reported only as a time-limit failure.

Airline fare rule evaluation◈ Members↗
FA-66370

Ticketing time limit reported ahead of an advance purchase failure · case 05

A late ticket that also misses advance purchase is reported only as a time-limit failure.

Airline fare rule evaluation◈ Members↗
FA-66371

Sunday departures satisfy the Saturday-night rule immediately · case 01

A traveller leaving Sunday and returning Monday meets the Saturday-night stay.

Airline fare rule evaluation● Open access↗
FA-66372

Sunday departures satisfy the Saturday-night rule immediately · case 02

A traveller leaving Sunday and returning Monday meets the Saturday-night stay.

Airline fare rule evaluation◈ Members↗
FA-66373

Sunday departures satisfy the Saturday-night rule immediately · case 03

A traveller leaving Sunday and returning Monday meets the Saturday-night stay.

Airline fare rule evaluation◈ Members↗
FA-66374

Sunday departures satisfy the Saturday-night rule immediately · case 04

A traveller leaving Sunday and returning Monday meets the Saturday-night stay.

Airline fare rule evaluation◈ Members↗
FA-66375

Sunday departures satisfy the Saturday-night rule immediately · case 05

A traveller leaving Sunday and returning Monday meets the Saturday-night stay.

Airline fare rule evaluation◈ Members↗
FA-66376

Maximum stay months approximated as 30 days · case 01

A one-month maximum stay departing 1 January expires on 31 January instead of 1 February.

Airline fare rule evaluation● Open access↗
FA-66377

Maximum stay months approximated as 30 days · case 02

A one-month maximum stay departing 1 January expires on 31 January instead of 1 February.

Airline fare rule evaluation◈ Members↗
FA-66378

Maximum stay months approximated as 30 days · case 03

A one-month maximum stay departing 1 January expires on 31 January instead of 1 February.

Airline fare rule evaluation◈ Members↗
FA-66379

Maximum stay months approximated as 30 days · case 04

A one-month maximum stay departing 1 January expires on 31 January instead of 1 February.

Airline fare rule evaluation◈ Members↗
FA-66380

Maximum stay months approximated as 30 days · case 05

A one-month maximum stay departing 1 January expires on 31 January instead of 1 February.

Airline fare rule evaluation◈ Members↗
FA-66381

Return exactly on the minimum-stay day rejected · case 01

A 7-day minimum stay rejects a return exactly seven days after departure.

Airline fare rule evaluation● Open access↗
FA-66382

Return exactly on the minimum-stay day rejected · case 02

A 7-day minimum stay rejects a return exactly seven days after departure.

Airline fare rule evaluation◈ Members↗
FA-66383

Return exactly on the minimum-stay day rejected · case 03

A 7-day minimum stay rejects a return exactly seven days after departure.

Airline fare rule evaluation◈ Members↗
FA-66384

Return exactly on the minimum-stay day rejected · case 04

A 7-day minimum stay rejects a return exactly seven days after departure.

Airline fare rule evaluation◈ Members↗
FA-66385

Return exactly on the minimum-stay day rejected · case 05

A 7-day minimum stay rejects a return exactly seven days after departure.

Airline fare rule evaluation◈ Members↗
FA-66386

Saturday-night rule applied when disabled · case 01

Fares whose rule explicitly sets sat_night to false still report SAT failures.

Airline fare rule evaluation● Open access↗
FA-66387

Saturday-night rule applied when disabled · case 02

Fares whose rule explicitly sets sat_night to false still report SAT failures.

Airline fare rule evaluation◈ Members↗
FA-66388

Saturday-night rule applied when disabled · case 03

Fares whose rule explicitly sets sat_night to false still report SAT failures.

Airline fare rule evaluation◈ Members↗
FA-66389

Saturday-night rule applied when disabled · case 04

Fares whose rule explicitly sets sat_night to false still report SAT failures.

Airline fare rule evaluation◈ Members↗
FA-66390

Saturday-night rule applied when disabled · case 05

Fares whose rule explicitly sets sat_night to false still report SAT failures.

Airline fare rule evaluation◈ Members↗
FA-66391

Month-end departures lose the end-of-month extension · case 01

Departing 28 February with a one-month maximum expires 28 March instead of 31 March.

Airline fare rule evaluation● Open access↗
FA-66392

Month-end departures lose the end-of-month extension · case 02

Departing 28 February with a one-month maximum expires 28 March instead of 31 March.

Airline fare rule evaluation◈ Members↗
FA-66393

Month-end departures lose the end-of-month extension · case 03

Departing 28 February with a one-month maximum expires 28 March instead of 31 March.

Airline fare rule evaluation◈ Members↗
FA-66394

Month-end departures lose the end-of-month extension · case 04

Departing 28 February with a one-month maximum expires 28 March instead of 31 March.

Airline fare rule evaluation◈ Members↗
FA-66395

Month-end departures lose the end-of-month extension · case 05

Departing 28 February with a one-month maximum expires 28 March instead of 31 March.

Airline fare rule evaluation◈ Members↗
FA-66396

Year carry computed from one-based month · case 01

A November departure with a one-month maximum stay gets a December limit in the following year.

Airline fare rule evaluation● Open access↗
FA-66397

Year carry computed from one-based month · case 02

A November departure with a one-month maximum stay gets a December limit in the following year.

Airline fare rule evaluation◈ Members↗
FA-66398

Year carry computed from one-based month · case 03

A November departure with a one-month maximum stay gets a December limit in the following year.

Airline fare rule evaluation◈ Members↗
FA-66399

Year carry computed from one-based month · case 04

A November departure with a one-month maximum stay gets a December limit in the following year.

Airline fare rule evaluation◈ Members↗
FA-66400

Year carry computed from one-based month · case 05

A November departure with a one-month maximum stay gets a December limit in the following year.

Airline fare rule evaluation◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗