FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-92801

Stage 2 always runs compressor 1 · case 01

When compressor 1 is lead, stage 2 adds no capacity and compressor 0 never runs as lag.

HVAC thermostat control● Open access↗
FA-92802

Stage 2 always runs compressor 1 · case 02

When compressor 1 is lead, stage 2 adds no capacity and compressor 0 never runs as lag.

HVAC thermostat control◈ Members↗
FA-92803

Stage 2 always runs compressor 1 · case 03

When compressor 1 is lead, stage 2 adds no capacity and compressor 0 never runs as lag.

HVAC thermostat control◈ Members↗
FA-92804

Stage 2 always runs compressor 1 · case 04

When compressor 1 is lead, stage 2 adds no capacity and compressor 0 never runs as lag.

HVAC thermostat control◈ Members↗
FA-92805

Stage 2 always runs compressor 1 · case 05

When compressor 1 is lead, stage 2 adds no capacity and compressor 0 never runs as lag.

HVAC thermostat control◈ Members↗
FA-92806

Stage 2 survives the end of a cooling cycle · case 01

The next cooling cycle starts with both compressors at once.

HVAC thermostat control● Open access↗
FA-92807

Stage 2 survives the end of a cooling cycle · case 02

The next cooling cycle starts with both compressors at once.

HVAC thermostat control◈ Members↗
FA-92808

Stage 2 survives the end of a cooling cycle · case 03

The next cooling cycle starts with both compressors at once.

HVAC thermostat control◈ Members↗
FA-92809

Stage 2 survives the end of a cooling cycle · case 04

The next cooling cycle starts with both compressors at once.

HVAC thermostat control◈ Members↗
FA-92810

Stage 2 survives the end of a cooling cycle · case 05

The next cooling cycle starts with both compressors at once.

HVAC thermostat control◈ Members↗
FA-92811

Stage 2 runs until the cooling setpoint · case 01

The lag compressor runs to the end of every cycle, overcooling and short-cycling the lead.

HVAC thermostat control● Open access↗
FA-92812

Stage 2 runs until the cooling setpoint · case 02

The lag compressor runs to the end of every cycle, overcooling and short-cycling the lead.

HVAC thermostat control◈ Members↗
FA-92813

Stage 2 runs until the cooling setpoint · case 03

The lag compressor runs to the end of every cycle, overcooling and short-cycling the lead.

HVAC thermostat control◈ Members↗
FA-92814

Stage 2 runs until the cooling setpoint · case 04

The lag compressor runs to the end of every cycle, overcooling and short-cycling the lead.

HVAC thermostat control◈ Members↗
FA-92815

Stage 2 runs until the cooling setpoint · case 05

The lag compressor runs to the end of every cycle, overcooling and short-cycling the lead.

HVAC thermostat control◈ Members↗
FA-92816

Zoned system picks cooling on a tied zone vote · case 01

With one zone calling heat and one calling cool the system cools first, against the heat-priority rule.

HVAC thermostat control● Open access↗
FA-92817

Zoned system picks cooling on a tied zone vote · case 02

With one zone calling heat and one calling cool the system cools first, against the heat-priority rule.

HVAC thermostat control◈ Members↗
FA-92818

Zoned system picks cooling on a tied zone vote · case 03

With one zone calling heat and one calling cool the system cools first, against the heat-priority rule.

HVAC thermostat control◈ Members↗
FA-92819

Zoned system picks cooling on a tied zone vote · case 04

With one zone calling heat and one calling cool the system cools first, against the heat-priority rule.

HVAC thermostat control◈ Members↗
FA-92820

Zoned system picks cooling on a tied zone vote · case 05

With one zone calling heat and one calling cool the system cools first, against the heat-priority rule.

HVAC thermostat control◈ Members↗
FA-92821

Zoned system never serves a minority mode · case 01

A single zone calling heat waits indefinitely while two zones keep calling cooling.

HVAC thermostat control● Open access↗
FA-92822

Zoned system never serves a minority mode · case 02

A single zone calling heat waits indefinitely while two zones keep calling cooling.

HVAC thermostat control◈ Members↗
FA-92823

Zoned system never serves a minority mode · case 03

A single zone calling heat waits indefinitely while two zones keep calling cooling.

HVAC thermostat control◈ Members↗
FA-92824

Zoned system never serves a minority mode · case 04

A single zone calling heat waits indefinitely while two zones keep calling cooling.

HVAC thermostat control◈ Members↗
FA-92825

Zoned system never serves a minority mode · case 05

A single zone calling heat waits indefinitely while two zones keep calling cooling.

HVAC thermostat control◈ Members↗
FA-92826

Mode run timer is not restarted on a forced switch · case 01

After the first forced changeover the system flips between heat and cool every minute.

HVAC thermostat control● Open access↗
FA-92827

Mode run timer is not restarted on a forced switch · case 02

After the first forced changeover the system flips between heat and cool every minute.

HVAC thermostat control◈ Members↗
FA-92828

Mode run timer is not restarted on a forced switch · case 03

After the first forced changeover the system flips between heat and cool every minute.

HVAC thermostat control◈ Members↗
FA-92829

Mode run timer is not restarted on a forced switch · case 04

After the first forced changeover the system flips between heat and cool every minute.

HVAC thermostat control◈ Members↗
FA-92830

Mode run timer is not restarted on a forced switch · case 05

After the first forced changeover the system flips between heat and cool every minute.

HVAC thermostat control◈ Members↗
FA-92831

Zoned system idles for a minute after a mode is satisfied · case 01

Zones waiting for the opposite mode lose a minute every time the current mode finishes.

HVAC thermostat control● Open access↗
FA-92832

Zoned system idles for a minute after a mode is satisfied · case 02

Zones waiting for the opposite mode lose a minute every time the current mode finishes.

HVAC thermostat control◈ Members↗
FA-92833

Zoned system idles for a minute after a mode is satisfied · case 03

Zones waiting for the opposite mode lose a minute every time the current mode finishes.

HVAC thermostat control◈ Members↗
FA-92834

Zoned system idles for a minute after a mode is satisfied · case 04

Zones waiting for the opposite mode lose a minute every time the current mode finishes.

HVAC thermostat control◈ Members↗
FA-92835

Zoned system idles for a minute after a mode is satisfied · case 05

Zones waiting for the opposite mode lose a minute every time the current mode finishes.

HVAC thermostat control◈ Members↗
FA-92836

Zone dampers open for zones calling the opposite mode · case 01

A zone calling for heat receives cooled air while the system is cooling.

HVAC thermostat control● Open access↗
FA-92837

Zone dampers open for zones calling the opposite mode · case 02

A zone calling for heat receives cooled air while the system is cooling.

HVAC thermostat control◈ Members↗
FA-92838

Zone dampers open for zones calling the opposite mode · case 03

A zone calling for heat receives cooled air while the system is cooling.

HVAC thermostat control◈ Members↗
FA-92839

Zone dampers open for zones calling the opposite mode · case 04

A zone calling for heat receives cooled air while the system is cooling.

HVAC thermostat control◈ Members↗
FA-92840

Zone dampers open for zones calling the opposite mode · case 05

A zone calling for heat receives cooled air while the system is cooling.

HVAC thermostat control◈ Members↗
FA-92841

Time-of-use cheapest slot plan: departure slot exclusivity · case 01

Energy is planned into the slot in which the driver has already unplugged.

EV charging session scheduling● Open access↗
FA-92842

Time-of-use cheapest slot plan: departure slot exclusivity · case 02

Energy is planned into the slot in which the driver has already unplugged.

EV charging session scheduling◈ Members↗
FA-92843

Time-of-use cheapest slot plan: departure slot exclusivity · case 03

Energy is planned into the slot in which the driver has already unplugged.

EV charging session scheduling◈ Members↗
FA-92844

Time-of-use cheapest slot plan: departure slot exclusivity · case 04

Energy is planned into the slot in which the driver has already unplugged.

EV charging session scheduling◈ Members↗
FA-92845

Time-of-use cheapest slot plan: departure slot exclusivity · case 05

Energy is planned into the slot in which the driver has already unplugged.

EV charging session scheduling◈ Members↗
FA-92846

Time-of-use cheapest slot plan: equal-price tie-break · case 01

With a flat tariff the plan charges at the end of the stay instead of as early as possible.

EV charging session scheduling● Open access↗
FA-92847

Time-of-use cheapest slot plan: equal-price tie-break · case 02

With a flat tariff the plan charges at the end of the stay instead of as early as possible.

EV charging session scheduling◈ Members↗
FA-92848

Time-of-use cheapest slot plan: equal-price tie-break · case 03

With a flat tariff the plan charges at the end of the stay instead of as early as possible.

EV charging session scheduling◈ Members↗
FA-92849

Time-of-use cheapest slot plan: equal-price tie-break · case 04

With a flat tariff the plan charges at the end of the stay instead of as early as possible.

EV charging session scheduling◈ Members↗
FA-92850

Time-of-use cheapest slot plan: equal-price tie-break · case 05

With a flat tariff the plan charges at the end of the stay instead of as early as possible.

EV charging session scheduling◈ Members↗
FA-92851

Time-of-use cheapest slot plan: slot energy from power · case 01

A 7.4 kW charger is scheduled to deliver 7.4 kWh inside a quarter hour.

EV charging session scheduling● Open access↗
FA-92852

Time-of-use cheapest slot plan: slot energy from power · case 02

A 7.4 kW charger is scheduled to deliver 7.4 kWh inside a quarter hour.

EV charging session scheduling◈ Members↗
FA-92853

Time-of-use cheapest slot plan: slot energy from power · case 03

A 7.4 kW charger is scheduled to deliver 7.4 kWh inside a quarter hour.

EV charging session scheduling◈ Members↗
FA-92854

Time-of-use cheapest slot plan: slot energy from power · case 04

A 7.4 kW charger is scheduled to deliver 7.4 kWh inside a quarter hour.

EV charging session scheduling◈ Members↗
FA-92855

Time-of-use cheapest slot plan: slot energy from power · case 05

A 7.4 kW charger is scheduled to deliver 7.4 kWh inside a quarter hour.

EV charging session scheduling◈ Members↗
FA-92856

Time-of-use cheapest slot plan: partial final slot · case 01

The plan delivers more energy than requested and bills the overshoot.

EV charging session scheduling● Open access↗
FA-92857

Time-of-use cheapest slot plan: partial final slot · case 02

The plan delivers more energy than requested and bills the overshoot.

EV charging session scheduling◈ Members↗
FA-92858

Time-of-use cheapest slot plan: partial final slot · case 03

The plan delivers more energy than requested and bills the overshoot.

EV charging session scheduling◈ Members↗
FA-92859

Time-of-use cheapest slot plan: partial final slot · case 04

The plan delivers more energy than requested and bills the overshoot.

EV charging session scheduling◈ Members↗
FA-92860

Time-of-use cheapest slot plan: partial final slot · case 05

The plan delivers more energy than requested and bills the overshoot.

EV charging session scheduling◈ Members↗
FA-92861

Time-of-use cheapest slot plan: stop after request is met · case 01

Plans list extra slots with zero energy after the request is already satisfied.

EV charging session scheduling● Open access↗
FA-92862

Time-of-use cheapest slot plan: stop after request is met · case 02

Plans list extra slots with zero energy after the request is already satisfied.

EV charging session scheduling◈ Members↗
FA-92863

Time-of-use cheapest slot plan: stop after request is met · case 03

Plans list extra slots with zero energy after the request is already satisfied.

EV charging session scheduling◈ Members↗
FA-92864

Time-of-use cheapest slot plan: stop after request is met · case 04

Plans list extra slots with zero energy after the request is already satisfied.

EV charging session scheduling◈ Members↗
FA-92865

Time-of-use cheapest slot plan: stop after request is met · case 05

Plans list extra slots with zero energy after the request is already satisfied.

EV charging session scheduling◈ Members↗
FA-92866

Time-of-use cheapest slot plan: pre-horizon arrival clipping · case 01

A car that plugged in before the tariff horizon is planned into slots at the end of the day.

EV charging session scheduling● Open access↗
FA-92867

Time-of-use cheapest slot plan: pre-horizon arrival clipping · case 02

A car that plugged in before the tariff horizon is planned into slots at the end of the day.

EV charging session scheduling◈ Members↗
FA-92868

Time-of-use cheapest slot plan: pre-horizon arrival clipping · case 03

A car that plugged in before the tariff horizon is planned into slots at the end of the day.

EV charging session scheduling◈ Members↗
FA-92869

Time-of-use cheapest slot plan: pre-horizon arrival clipping · case 04

A car that plugged in before the tariff horizon is planned into slots at the end of the day.

EV charging session scheduling◈ Members↗
FA-92870

Time-of-use cheapest slot plan: pre-horizon arrival clipping · case 05

A car that plugged in before the tariff horizon is planned into slots at the end of the day.

EV charging session scheduling◈ Members↗
FA-92871

Time-of-use cheapest slot plan: cost uses slot tariff · case 01

The quoted cost does not match the tariff of the slots listed in the plan.

EV charging session scheduling● Open access↗
FA-92872

Time-of-use cheapest slot plan: cost uses slot tariff · case 02

The quoted cost does not match the tariff of the slots listed in the plan.

EV charging session scheduling◈ Members↗
FA-92873

Time-of-use cheapest slot plan: cost uses slot tariff · case 03

The quoted cost does not match the tariff of the slots listed in the plan.

EV charging session scheduling◈ Members↗
FA-92874

Time-of-use cheapest slot plan: cost uses slot tariff · case 04

The quoted cost does not match the tariff of the slots listed in the plan.

EV charging session scheduling◈ Members↗
FA-92875

Time-of-use cheapest slot plan: cost uses slot tariff · case 05

The quoted cost does not match the tariff of the slots listed in the plan.

EV charging session scheduling◈ Members↗
FA-92876

Post-charge idle occupancy fee: grace anchor · case 01

Drivers are billed idle time for minutes during which the car was still charging.

EV charging session scheduling● Open access↗
FA-92877

Post-charge idle occupancy fee: grace anchor · case 02

Drivers are billed idle time for minutes during which the car was still charging.

EV charging session scheduling◈ Members↗
FA-92878

Post-charge idle occupancy fee: grace anchor · case 03

Drivers are billed idle time for minutes during which the car was still charging.

EV charging session scheduling◈ Members↗
FA-92879

Post-charge idle occupancy fee: grace anchor · case 04

Drivers are billed idle time for minutes during which the car was still charging.

EV charging session scheduling◈ Members↗
FA-92880

Post-charge idle occupancy fee: grace anchor · case 05

Drivers are billed idle time for minutes during which the car was still charging.

EV charging session scheduling◈ Members↗
FA-92881

Post-charge idle occupancy fee: block rounding · case 01

Idle minutes shorter than a full block are never billed.

EV charging session scheduling● Open access↗
FA-92882

Post-charge idle occupancy fee: block rounding · case 02

Idle minutes shorter than a full block are never billed.

EV charging session scheduling◈ Members↗
FA-92883

Post-charge idle occupancy fee: block rounding · case 03

Idle minutes shorter than a full block are never billed.

EV charging session scheduling◈ Members↗
FA-92884

Post-charge idle occupancy fee: block rounding · case 04

Idle minutes shorter than a full block are never billed.

EV charging session scheduling◈ Members↗
FA-92885

Post-charge idle occupancy fee: block rounding · case 05

Idle minutes shorter than a full block are never billed.

EV charging session scheduling◈ Members↗
FA-92886

Post-charge idle occupancy fee: night waiver window edges · case 01

The first billable morning minute is waived and the first night minute is billed.

EV charging session scheduling● Open access↗
FA-92887

Post-charge idle occupancy fee: night waiver window edges · case 02

The first billable morning minute is waived and the first night minute is billed.

EV charging session scheduling◈ Members↗
FA-92888

Post-charge idle occupancy fee: night waiver window edges · case 03

The first billable morning minute is waived and the first night minute is billed.

EV charging session scheduling◈ Members↗
FA-92889

Post-charge idle occupancy fee: night waiver window edges · case 04

The first billable morning minute is waived and the first night minute is billed.

EV charging session scheduling◈ Members↗
FA-92890

Post-charge idle occupancy fee: night waiver window edges · case 05

The first billable morning minute is waived and the first night minute is billed.

EV charging session scheduling◈ Members↗
FA-92891

Post-charge idle occupancy fee: zero cap waiver · case 01

A site configured to waive idle fees (cap 0) still bills them.

EV charging session scheduling● Open access↗
FA-92892

Post-charge idle occupancy fee: zero cap waiver · case 02

A site configured to waive idle fees (cap 0) still bills them.

EV charging session scheduling◈ Members↗
FA-92893

Post-charge idle occupancy fee: zero cap waiver · case 03

A site configured to waive idle fees (cap 0) still bills them.

EV charging session scheduling◈ Members↗
FA-92894

Post-charge idle occupancy fee: zero cap waiver · case 04

A site configured to waive idle fees (cap 0) still bills them.

EV charging session scheduling◈ Members↗
FA-92895

Post-charge idle occupancy fee: zero cap waiver · case 05

A site configured to waive idle fees (cap 0) still bills them.

EV charging session scheduling◈ Members↗
FA-92896

Post-charge idle occupancy fee: unplug minute exclusivity · case 01

Every idle session is billed one extra minute.

EV charging session scheduling● Open access↗
FA-92897

Post-charge idle occupancy fee: unplug minute exclusivity · case 02

Every idle session is billed one extra minute.

EV charging session scheduling◈ Members↗
FA-92898

Post-charge idle occupancy fee: unplug minute exclusivity · case 03

Every idle session is billed one extra minute.

EV charging session scheduling◈ Members↗
FA-92899

Post-charge idle occupancy fee: unplug minute exclusivity · case 04

Every idle session is billed one extra minute.

EV charging session scheduling◈ Members↗
FA-92900

Post-charge idle occupancy fee: unplug minute exclusivity · case 05

Every idle session is billed one extra minute.

EV charging session scheduling◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗