FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-95301

Face sizing: split slot count floored · case 01

Items that need several slots are given one slot too few.

Warehouse slotting and bin packing● Open access↗
FA-95302

Face sizing: split slot count floored · case 02

Items that need several slots are given one slot too few.

Warehouse slotting and bin packing◈ Members↗
FA-95303

Face sizing: split slot count floored · case 03

Items that need several slots are given one slot too few.

Warehouse slotting and bin packing◈ Members↗
FA-95304

Face sizing: split slot count floored · case 04

Items that need several slots are given one slot too few.

Warehouse slotting and bin packing◈ Members↗
FA-95305

Face sizing: split slot count floored · case 05

Items that need several slots are given one slot too few.

Warehouse slotting and bin packing◈ Members↗
FA-95306

Face sizing: overflow split over smallest slots · case 01

High-demand items are spread across many small shelf slots.

Warehouse slotting and bin packing● Open access↗
FA-95307

Face sizing: overflow split over smallest slots · case 02

High-demand items are spread across many small shelf slots.

Warehouse slotting and bin packing◈ Members↗
FA-95308

Face sizing: overflow split over smallest slots · case 03

High-demand items are spread across many small shelf slots.

Warehouse slotting and bin packing◈ Members↗
FA-95309

Face sizing: overflow split over smallest slots · case 04

High-demand items are spread across many small shelf slots.

Warehouse slotting and bin packing◈ Members↗
FA-95310

Face sizing: overflow split over smallest slots · case 05

High-demand items are spread across many small shelf slots.

Warehouse slotting and bin packing◈ Members↗
FA-95311

Honeycombing: extra lane on exact multiples · case 01

SKUs whose pallet count fills lanes exactly are charged an extra empty lane.

Warehouse slotting and bin packing● Open access↗
FA-95312

Honeycombing: extra lane on exact multiples · case 02

SKUs whose pallet count fills lanes exactly are charged an extra empty lane.

Warehouse slotting and bin packing◈ Members↗
FA-95313

Honeycombing: extra lane on exact multiples · case 03

SKUs whose pallet count fills lanes exactly are charged an extra empty lane.

Warehouse slotting and bin packing◈ Members↗
FA-95314

Honeycombing: extra lane on exact multiples · case 04

SKUs whose pallet count fills lanes exactly are charged an extra empty lane.

Warehouse slotting and bin packing◈ Members↗
FA-95315

Honeycombing: extra lane on exact multiples · case 05

SKUs whose pallet count fills lanes exactly are charged an extra empty lane.

Warehouse slotting and bin packing◈ Members↗
FA-95316

Honeycombing: full lanes reported as a lost lane · case 01

A SKU that fills its lanes exactly shows a full lane of honeycomb loss.

Warehouse slotting and bin packing● Open access↗
FA-95317

Honeycombing: full lanes reported as a lost lane · case 02

A SKU that fills its lanes exactly shows a full lane of honeycomb loss.

Warehouse slotting and bin packing◈ Members↗
FA-95318

Honeycombing: full lanes reported as a lost lane · case 03

A SKU that fills its lanes exactly shows a full lane of honeycomb loss.

Warehouse slotting and bin packing◈ Members↗
FA-95319

Honeycombing: full lanes reported as a lost lane · case 04

A SKU that fills its lanes exactly shows a full lane of honeycomb loss.

Warehouse slotting and bin packing◈ Members↗
FA-95320

Honeycombing: full lanes reported as a lost lane · case 05

A SKU that fills its lanes exactly shows a full lane of honeycomb loss.

Warehouse slotting and bin packing◈ Members↗
FA-95321

Honeycombing: later line replaces SKU total · case 01

Adjustment lines replace the SKU quantity instead of netting against it.

Warehouse slotting and bin packing● Open access↗
FA-95322

Honeycombing: later line replaces SKU total · case 02

Adjustment lines replace the SKU quantity instead of netting against it.

Warehouse slotting and bin packing◈ Members↗
FA-95323

Honeycombing: later line replaces SKU total · case 03

Adjustment lines replace the SKU quantity instead of netting against it.

Warehouse slotting and bin packing◈ Members↗
FA-95324

Honeycombing: later line replaces SKU total · case 04

Adjustment lines replace the SKU quantity instead of netting against it.

Warehouse slotting and bin packing◈ Members↗
FA-95325

Honeycombing: later line replaces SKU total · case 05

Adjustment lines replace the SKU quantity instead of netting against it.

Warehouse slotting and bin packing◈ Members↗
FA-95326

Honeycombing: full use of lanes flagged over · case 01

Using exactly the available lanes is reported as over capacity.

Warehouse slotting and bin packing● Open access↗
FA-95327

Honeycombing: full use of lanes flagged over · case 02

Using exactly the available lanes is reported as over capacity.

Warehouse slotting and bin packing◈ Members↗
FA-95328

Honeycombing: full use of lanes flagged over · case 03

Using exactly the available lanes is reported as over capacity.

Warehouse slotting and bin packing◈ Members↗
FA-95329

Honeycombing: full use of lanes flagged over · case 04

Using exactly the available lanes is reported as over capacity.

Warehouse slotting and bin packing◈ Members↗
FA-95330

Honeycombing: full use of lanes flagged over · case 05

Using exactly the available lanes is reported as over capacity.

Warehouse slotting and bin packing◈ Members↗
FA-95331

Honeycombing: utilization rounded to nearest · case 01

Lane utilization is reported one basis point high on repeating fractions.

Warehouse slotting and bin packing● Open access↗
FA-95332

Honeycombing: utilization rounded to nearest · case 02

Lane utilization is reported one basis point high on repeating fractions.

Warehouse slotting and bin packing◈ Members↗
FA-95333

Honeycombing: utilization rounded to nearest · case 03

Lane utilization is reported one basis point high on repeating fractions.

Warehouse slotting and bin packing◈ Members↗
FA-95334

Honeycombing: utilization rounded to nearest · case 04

Lane utilization is reported one basis point high on repeating fractions.

Warehouse slotting and bin packing◈ Members↗
FA-95335

Honeycombing: utilization rounded to nearest · case 05

Lane utilization is reported one basis point high on repeating fractions.

Warehouse slotting and bin packing◈ Members↗
FA-95336

Honeycombing: negative net quantity sized · case 01

A SKU whose adjustments net below zero produces phantom loss.

Warehouse slotting and bin packing● Open access↗
FA-95337

Honeycombing: negative net quantity sized · case 02

A SKU whose adjustments net below zero produces phantom loss.

Warehouse slotting and bin packing◈ Members↗
FA-95338

Honeycombing: negative net quantity sized · case 03

A SKU whose adjustments net below zero produces phantom loss.

Warehouse slotting and bin packing◈ Members↗
FA-95339

Honeycombing: negative net quantity sized · case 04

A SKU whose adjustments net below zero produces phantom loss.

Warehouse slotting and bin packing◈ Members↗
FA-95340

Honeycombing: negative net quantity sized · case 05

A SKU whose adjustments net below zero produces phantom loss.

Warehouse slotting and bin packing◈ Members↗
FA-95341

Zone chart: ZIP+4 destinations rejected · case 01

Addresses carrying a ZIP+4 extension are rated as invalid and fall out of automated shipping.

Shipping rate zone lookup● Open access↗
FA-95342

Zone chart: ZIP+4 destinations rejected · case 02

Addresses carrying a ZIP+4 extension are rated as invalid and fall out of automated shipping.

Shipping rate zone lookup◈ Members↗
FA-95343

Zone chart: ZIP+4 destinations rejected · case 03

Addresses carrying a ZIP+4 extension are rated as invalid and fall out of automated shipping.

Shipping rate zone lookup◈ Members↗
FA-95344

Zone chart: ZIP+4 destinations rejected · case 04

Addresses carrying a ZIP+4 extension are rated as invalid and fall out of automated shipping.

Shipping rate zone lookup◈ Members↗
FA-95345

Zone chart: ZIP+4 destinations rejected · case 05

Addresses carrying a ZIP+4 extension are rated as invalid and fall out of automated shipping.

Shipping rate zone lookup◈ Members↗
FA-95346

Zone chart: four-digit New England ZIPs invalid · case 01

ZIPs that lost their leading zero in a spreadsheet export are rejected.

Shipping rate zone lookup● Open access↗
FA-95347

Zone chart: four-digit New England ZIPs invalid · case 02

ZIPs that lost their leading zero in a spreadsheet export are rejected.

Shipping rate zone lookup◈ Members↗
FA-95348

Zone chart: four-digit New England ZIPs invalid · case 03

ZIPs that lost their leading zero in a spreadsheet export are rejected.

Shipping rate zone lookup◈ Members↗
FA-95349

Zone chart: four-digit New England ZIPs invalid · case 04

ZIPs that lost their leading zero in a spreadsheet export are rejected.

Shipping rate zone lookup◈ Members↗
FA-95350

Zone chart: four-digit New England ZIPs invalid · case 05

ZIPs that lost their leading zero in a spreadsheet export are rejected.

Shipping rate zone lookup◈ Members↗
FA-95351

Zone chart: last ZIP3 of a range unmatched · case 01

Destinations on the last ZIP3 of a chart row fall to a wider row or NO_ZONE.

Shipping rate zone lookup● Open access↗
FA-95352

Zone chart: last ZIP3 of a range unmatched · case 02

Destinations on the last ZIP3 of a chart row fall to a wider row or NO_ZONE.

Shipping rate zone lookup◈ Members↗
FA-95353

Zone chart: last ZIP3 of a range unmatched · case 03

Destinations on the last ZIP3 of a chart row fall to a wider row or NO_ZONE.

Shipping rate zone lookup◈ Members↗
FA-95354

Zone chart: last ZIP3 of a range unmatched · case 04

Destinations on the last ZIP3 of a chart row fall to a wider row or NO_ZONE.

Shipping rate zone lookup◈ Members↗
FA-95355

Zone chart: last ZIP3 of a range unmatched · case 05

Destinations on the last ZIP3 of a chart row fall to a wider row or NO_ZONE.

Shipping rate zone lookup◈ Members↗
FA-95356

Zone chart: broad row shadows exception row · case 01

A ZIP3 carved out as an exception row is rated with the broad surrounding row.

Shipping rate zone lookup● Open access↗
FA-95357

Zone chart: broad row shadows exception row · case 02

A ZIP3 carved out as an exception row is rated with the broad surrounding row.

Shipping rate zone lookup◈ Members↗
FA-95358

Zone chart: broad row shadows exception row · case 03

A ZIP3 carved out as an exception row is rated with the broad surrounding row.

Shipping rate zone lookup◈ Members↗
FA-95359

Zone chart: broad row shadows exception row · case 04

A ZIP3 carved out as an exception row is rated with the broad surrounding row.

Shipping rate zone lookup◈ Members↗
FA-95360

Zone chart: broad row shadows exception row · case 05

A ZIP3 carved out as an exception row is rated with the broad surrounding row.

Shipping rate zone lookup◈ Members↗
FA-95361

Zone chart: later row wins equal-width overlap · case 01

When two equally narrow rows overlap, the later row overrides the earlier one.

Shipping rate zone lookup● Open access↗
FA-95362

Zone chart: later row wins equal-width overlap · case 02

When two equally narrow rows overlap, the later row overrides the earlier one.

Shipping rate zone lookup◈ Members↗
FA-95363

Zone chart: later row wins equal-width overlap · case 03

When two equally narrow rows overlap, the later row overrides the earlier one.

Shipping rate zone lookup◈ Members↗
FA-95364

Zone chart: later row wins equal-width overlap · case 04

When two equally narrow rows overlap, the later row overrides the earlier one.

Shipping rate zone lookup◈ Members↗
FA-95365

Zone chart: later row wins equal-width overlap · case 05

When two equally narrow rows overlap, the later row overrides the earlier one.

Shipping rate zone lookup◈ Members↗
FA-95366

Zone chart: garbage after ZIP3 accepted · case 01

Codes like "123AB" are rated as if they were valid ZIPs.

Shipping rate zone lookup● Open access↗
FA-95367

Zone chart: garbage after ZIP3 accepted · case 02

Codes like "123AB" are rated as if they were valid ZIPs.

Shipping rate zone lookup◈ Members↗
FA-95368

Zone chart: garbage after ZIP3 accepted · case 03

Codes like "123AB" are rated as if they were valid ZIPs.

Shipping rate zone lookup◈ Members↗
FA-95369

Zone chart: garbage after ZIP3 accepted · case 04

Codes like "123AB" are rated as if they were valid ZIPs.

Shipping rate zone lookup◈ Members↗
FA-95370

Zone chart: garbage after ZIP3 accepted · case 05

Codes like "123AB" are rated as if they were valid ZIPs.

Shipping rate zone lookup◈ Members↗
FA-95371

Billable weight: half inches rounded to even · case 01

A 12.5 inch side is measured as 12 inches, under-billing dimensional weight.

Shipping rate zone lookup● Open access↗
FA-95372

Billable weight: half inches rounded to even · case 02

A 12.5 inch side is measured as 12 inches, under-billing dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95373

Billable weight: half inches rounded to even · case 03

A 12.5 inch side is measured as 12 inches, under-billing dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95374

Billable weight: half inches rounded to even · case 04

A 12.5 inch side is measured as 12 inches, under-billing dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95375

Billable weight: half inches rounded to even · case 05

A 12.5 inch side is measured as 12 inches, under-billing dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95376

Billable weight: dim weight truncated · case 01

Dimensional weight is a pound short whenever cube is not an exact multiple of the divisor.

Shipping rate zone lookup● Open access↗
FA-95377

Billable weight: dim weight truncated · case 02

Dimensional weight is a pound short whenever cube is not an exact multiple of the divisor.

Shipping rate zone lookup◈ Members↗
FA-95378

Billable weight: dim weight truncated · case 03

Dimensional weight is a pound short whenever cube is not an exact multiple of the divisor.

Shipping rate zone lookup◈ Members↗
FA-95379

Billable weight: dim weight truncated · case 04

Dimensional weight is a pound short whenever cube is not an exact multiple of the divisor.

Shipping rate zone lookup◈ Members↗
FA-95380

Billable weight: dim weight truncated · case 05

Dimensional weight is a pound short whenever cube is not an exact multiple of the divisor.

Shipping rate zone lookup◈ Members↗
FA-95381

Billable weight: one cubic foot parcels dim-rated · case 01

A parcel of exactly one cubic foot is charged dimensional weight.

Shipping rate zone lookup● Open access↗
FA-95382

Billable weight: one cubic foot parcels dim-rated · case 02

A parcel of exactly one cubic foot is charged dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95383

Billable weight: one cubic foot parcels dim-rated · case 03

A parcel of exactly one cubic foot is charged dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95384

Billable weight: one cubic foot parcels dim-rated · case 04

A parcel of exactly one cubic foot is charged dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95385

Billable weight: one cubic foot parcels dim-rated · case 05

A parcel of exactly one cubic foot is charged dimensional weight.

Shipping rate zone lookup◈ Members↗
FA-95386

Billable weight: actual weight rounded to nearest · case 01

A 7.2 lb parcel is billed at 7 lb.

Shipping rate zone lookup● Open access↗
FA-95387

Billable weight: actual weight rounded to nearest · case 02

A 7.2 lb parcel is billed at 7 lb.

Shipping rate zone lookup◈ Members↗
FA-95388

Billable weight: actual weight rounded to nearest · case 03

A 7.2 lb parcel is billed at 7 lb.

Shipping rate zone lookup◈ Members↗
FA-95389

Billable weight: actual weight rounded to nearest · case 04

A 7.2 lb parcel is billed at 7 lb.

Shipping rate zone lookup◈ Members↗
FA-95390

Billable weight: actual weight rounded to nearest · case 05

A 7.2 lb parcel is billed at 7 lb.

Shipping rate zone lookup◈ Members↗
FA-95391

Billable weight: cube from raw measurements · case 01

Dimensional weight is computed from unrounded measurements and disagrees with audited invoices.

Shipping rate zone lookup● Open access↗
FA-95392

Billable weight: cube from raw measurements · case 02

Dimensional weight is computed from unrounded measurements and disagrees with audited invoices.

Shipping rate zone lookup◈ Members↗
FA-95393

Billable weight: cube from raw measurements · case 03

Dimensional weight is computed from unrounded measurements and disagrees with audited invoices.

Shipping rate zone lookup◈ Members↗
FA-95394

Billable weight: cube from raw measurements · case 04

Dimensional weight is computed from unrounded measurements and disagrees with audited invoices.

Shipping rate zone lookup◈ Members↗
FA-95395

Billable weight: cube from raw measurements · case 05

Dimensional weight is computed from unrounded measurements and disagrees with audited invoices.

Shipping rate zone lookup◈ Members↗
FA-95396

Billable weight: tie labelled dimensional · case 01

Parcels whose dim weight equals actual weight are labelled DIM, triggering dim audits.

Shipping rate zone lookup● Open access↗
FA-95397

Billable weight: tie labelled dimensional · case 02

Parcels whose dim weight equals actual weight are labelled DIM, triggering dim audits.

Shipping rate zone lookup◈ Members↗
FA-95398

Billable weight: tie labelled dimensional · case 03

Parcels whose dim weight equals actual weight are labelled DIM, triggering dim audits.

Shipping rate zone lookup◈ Members↗
FA-95399

Billable weight: tie labelled dimensional · case 04

Parcels whose dim weight equals actual weight are labelled DIM, triggering dim audits.

Shipping rate zone lookup◈ Members↗
FA-95400

Billable weight: tie labelled dimensional · case 05

Parcels whose dim weight equals actual weight are labelled DIM, triggering dim audits.

Shipping rate zone lookup◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗