FAILURE MAP

Understand the failure.
Verify the repair.

Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.

Explore the cases ↓How results are verified ↗
100840Executable case variants
20168Distinct failure mechanisms
302520Executed implementations
20168Open-access cases

WHAT THE ARCHIVE CONTAINS

100840 executable cases. 20168 are open.

Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.

The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗

A RECORD OF WHAT WENT WRONG

Browse the archive / 100840

Python · Standard library
REFERENCEFAILURE MECHANISMDOMAINACCESS
FA-57001

Performance bond: expiry call block · case 01

Expired performance guarantees accept fresh calls.

Auction allocation rules● Open access↗
FA-57002

Performance bond: expiry call block · case 02

Expired performance guarantees accept fresh calls.

Auction allocation rules◈ Members↗
FA-57003

Performance bond: expiry call block · case 03

Expired performance guarantees accept fresh calls.

Auction allocation rules◈ Members↗
FA-57004

Performance bond: expiry call block · case 04

Expired performance guarantees accept fresh calls.

Auction allocation rules◈ Members↗
FA-57005

Performance bond: expiry call block · case 05

Expired performance guarantees accept fresh calls.

Auction allocation rules◈ Members↗
FA-57006

Performance bond: retention after completion · case 01

Completion returns the defect-retention bond tranche early.

Auction allocation rules● Open access↗
FA-57007

Performance bond: retention after completion · case 02

Completion returns the defect-retention bond tranche early.

Auction allocation rules◈ Members↗
FA-57008

Performance bond: retention after completion · case 03

Completion returns the defect-retention bond tranche early.

Auction allocation rules◈ Members↗
FA-57009

Performance bond: retention after completion · case 04

Completion returns the defect-retention bond tranche early.

Auction allocation rules◈ Members↗
FA-57010

Performance bond: retention after completion · case 05

Completion returns the defect-retention bond tranche early.

Auction allocation rules◈ Members↗
FA-57011

Performance bond: milestone tranche release · case 01

One completed milestone releases every bond tranche.

Auction allocation rules● Open access↗
FA-57012

Performance bond: milestone tranche release · case 02

One completed milestone releases every bond tranche.

Auction allocation rules◈ Members↗
FA-57013

Performance bond: milestone tranche release · case 03

One completed milestone releases every bond tranche.

Auction allocation rules◈ Members↗
FA-57014

Performance bond: milestone tranche release · case 04

One completed milestone releases every bond tranche.

Auction allocation rules◈ Members↗
FA-57015

Performance bond: milestone tranche release · case 05

One completed milestone releases every bond tranche.

Auction allocation rules◈ Members↗
FA-57016

Performance bond: surety substitution approval · case 01

An unapproved substitute surety replaces the guaranteed party.

Auction allocation rules● Open access↗
FA-57017

Performance bond: surety substitution approval · case 02

An unapproved substitute surety replaces the guaranteed party.

Auction allocation rules◈ Members↗
FA-57018

Performance bond: surety substitution approval · case 03

An unapproved substitute surety replaces the guaranteed party.

Auction allocation rules◈ Members↗
FA-57019

Performance bond: surety substitution approval · case 04

An unapproved substitute surety replaces the guaranteed party.

Auction allocation rules◈ Members↗
FA-57020

Performance bond: surety substitution approval · case 05

An unapproved substitute surety replaces the guaranteed party.

Auction allocation rules◈ Members↗
FA-57021

Performance bond: old bond discharge · case 01

Old bond discharges before both substitution approval and completion.

Auction allocation rules● Open access↗
FA-57022

Performance bond: old bond discharge · case 02

Old bond discharges before both substitution approval and completion.

Auction allocation rules◈ Members↗
FA-57023

Performance bond: old bond discharge · case 03

Old bond discharges before both substitution approval and completion.

Auction allocation rules◈ Members↗
FA-57024

Performance bond: old bond discharge · case 04

Old bond discharges before both substitution approval and completion.

Auction allocation rules◈ Members↗
FA-57025

Performance bond: old bond discharge · case 05

Old bond discharges before both substitution approval and completion.

Auction allocation rules◈ Members↗
FA-57026

Performance bond: guarantee lot coverage · case 01

Bond claims include lots outside the guaranteed award schedule.

Auction allocation rules● Open access↗
FA-57027

Performance bond: guarantee lot coverage · case 02

Bond claims include lots outside the guaranteed award schedule.

Auction allocation rules◈ Members↗
FA-57028

Performance bond: guarantee lot coverage · case 03

Bond claims include lots outside the guaranteed award schedule.

Auction allocation rules◈ Members↗
FA-57029

Performance bond: guarantee lot coverage · case 04

Bond claims include lots outside the guaranteed award schedule.

Auction allocation rules◈ Members↗
FA-57030

Performance bond: guarantee lot coverage · case 05

Bond claims include lots outside the guaranteed award schedule.

Auction allocation rules◈ Members↗
FA-57031

Performance bond: beneficiary claim authority · case 01

An unauthorized claimant or expired bond initiates a call.

Auction allocation rules● Open access↗
FA-57032

Performance bond: beneficiary claim authority · case 02

An unauthorized claimant or expired bond initiates a call.

Auction allocation rules◈ Members↗
FA-57033

Performance bond: beneficiary claim authority · case 03

An unauthorized claimant or expired bond initiates a call.

Auction allocation rules◈ Members↗
FA-57034

Performance bond: beneficiary claim authority · case 04

An unauthorized claimant or expired bond initiates a call.

Auction allocation rules◈ Members↗
FA-57035

Performance bond: beneficiary claim authority · case 05

An unauthorized claimant or expired bond initiates a call.

Auction allocation rules◈ Members↗
FA-57036

Performance bond: timely claim survives expiry · case 01

Bond expiration or award completion destroys claims properly presented before the claim deadline.

Auction allocation rules● Open access↗
FA-57037

Performance bond: timely claim survives expiry · case 02

Bond expiration or award completion destroys claims properly presented before the claim deadline.

Auction allocation rules◈ Members↗
FA-57038

Performance bond: timely claim survives expiry · case 03

Bond expiration or award completion destroys claims properly presented before the claim deadline.

Auction allocation rules◈ Members↗
FA-57039

Performance bond: timely claim survives expiry · case 04

Bond expiration or award completion destroys claims properly presented before the claim deadline.

Auction allocation rules◈ Members↗
FA-57040

Performance bond: timely claim survives expiry · case 05

Bond expiration or award completion destroys claims properly presented before the claim deadline.

Auction allocation rules◈ Members↗
FA-57041

Consortium bid: representative membership · case 01

An outside representative submits a consortium offer.

Auction allocation rules● Open access↗
FA-57042

Consortium bid: representative membership · case 02

An outside representative submits a consortium offer.

Auction allocation rules◈ Members↗
FA-57043

Consortium bid: representative membership · case 03

An outside representative submits a consortium offer.

Auction allocation rules◈ Members↗
FA-57044

Consortium bid: representative membership · case 04

An outside representative submits a consortium offer.

Auction allocation rules◈ Members↗
FA-57045

Consortium bid: representative membership · case 05

An outside representative submits a consortium offer.

Auction allocation rules◈ Members↗
FA-57046

Consortium bid: unanimous bid signature · case 01

Representative signature substitutes for all required joint-bid approvals.

Auction allocation rules● Open access↗
FA-57047

Consortium bid: unanimous bid signature · case 02

Representative signature substitutes for all required joint-bid approvals.

Auction allocation rules◈ Members↗
FA-57048

Consortium bid: unanimous bid signature · case 03

Representative signature substitutes for all required joint-bid approvals.

Auction allocation rules◈ Members↗
FA-57049

Consortium bid: unanimous bid signature · case 04

Representative signature substitutes for all required joint-bid approvals.

Auction allocation rules◈ Members↗
FA-57050

Consortium bid: unanimous bid signature · case 05

Representative signature substitutes for all required joint-bid approvals.

Auction allocation rules◈ Members↗
FA-57051

Consortium bid: joint lot mandate · case 01

One member mandate authorizes lots not approved by the others.

Auction allocation rules● Open access↗
FA-57052

Consortium bid: joint lot mandate · case 02

One member mandate authorizes lots not approved by the others.

Auction allocation rules◈ Members↗
FA-57053

Consortium bid: joint lot mandate · case 03

One member mandate authorizes lots not approved by the others.

Auction allocation rules◈ Members↗
FA-57054

Consortium bid: joint lot mandate · case 04

One member mandate authorizes lots not approved by the others.

Auction allocation rules◈ Members↗
FA-57055

Consortium bid: joint lot mandate · case 05

One member mandate authorizes lots not approved by the others.

Auction allocation rules◈ Members↗
FA-57056

Consortium bid: share conservation · case 01

Consortium award shares leave units unassigned or overassigned.

Auction allocation rules● Open access↗
FA-57057

Consortium bid: share conservation · case 02

Consortium award shares leave units unassigned or overassigned.

Auction allocation rules◈ Members↗
FA-57058

Consortium bid: share conservation · case 03

Consortium award shares leave units unassigned or overassigned.

Auction allocation rules◈ Members↗
FA-57059

Consortium bid: share conservation · case 04

Consortium award shares leave units unassigned or overassigned.

Auction allocation rules◈ Members↗
FA-57060

Consortium bid: share conservation · case 05

Consortium award shares leave units unassigned or overassigned.

Auction allocation rules◈ Members↗
FA-57061

Consortium bid: exit assignment guard · case 01

A consortium member exits while still holding an award allocation.

Auction allocation rules● Open access↗
FA-57062

Consortium bid: exit assignment guard · case 02

A consortium member exits while still holding an award allocation.

Auction allocation rules◈ Members↗
FA-57063

Consortium bid: exit assignment guard · case 03

A consortium member exits while still holding an award allocation.

Auction allocation rules◈ Members↗
FA-57064

Consortium bid: exit assignment guard · case 04

A consortium member exits while still holding an award allocation.

Auction allocation rules◈ Members↗
FA-57065

Consortium bid: exit assignment guard · case 05

A consortium member exits while still holding an award allocation.

Auction allocation rules◈ Members↗
FA-57066

Consortium bid: replacement member approval · case 01

An existing or unapproved member is used as the replacement entrant.

Auction allocation rules● Open access↗
FA-57067

Consortium bid: replacement member approval · case 02

An existing or unapproved member is used as the replacement entrant.

Auction allocation rules◈ Members↗
FA-57068

Consortium bid: replacement member approval · case 03

An existing or unapproved member is used as the replacement entrant.

Auction allocation rules◈ Members↗
FA-57069

Consortium bid: replacement member approval · case 04

An existing or unapproved member is used as the replacement entrant.

Auction allocation rules◈ Members↗
FA-57070

Consortium bid: replacement member approval · case 05

An existing or unapproved member is used as the replacement entrant.

Auction allocation rules◈ Members↗
FA-57071

Consortium bid: affiliate rival exclusion · case 01

Affiliate conflicts of a nonrepresentative member escape review.

Auction allocation rules● Open access↗
FA-57072

Consortium bid: affiliate rival exclusion · case 02

Affiliate conflicts of a nonrepresentative member escape review.

Auction allocation rules◈ Members↗
FA-57073

Consortium bid: affiliate rival exclusion · case 03

Affiliate conflicts of a nonrepresentative member escape review.

Auction allocation rules◈ Members↗
FA-57074

Consortium bid: affiliate rival exclusion · case 04

Affiliate conflicts of a nonrepresentative member escape review.

Auction allocation rules◈ Members↗
FA-57075

Consortium bid: affiliate rival exclusion · case 05

Affiliate conflicts of a nonrepresentative member escape review.

Auction allocation rules◈ Members↗
FA-57076

Consortium bid: joint exposure · case 01

Joint and several award obligations are interchanged.

Auction allocation rules● Open access↗
FA-57077

Consortium bid: joint exposure · case 02

Joint and several award obligations are interchanged.

Auction allocation rules◈ Members↗
FA-57078

Consortium bid: joint exposure · case 03

Joint and several award obligations are interchanged.

Auction allocation rules◈ Members↗
FA-57079

Consortium bid: joint exposure · case 04

Joint and several award obligations are interchanged.

Auction allocation rules◈ Members↗
FA-57080

Consortium bid: joint exposure · case 05

Joint and several award obligations are interchanged.

Auction allocation rules◈ Members↗
FA-57081

Consortium bid: member cap certification · case 01

Aggregate consortium capacity hides an overloaded member.

Auction allocation rules● Open access↗
FA-57082

Consortium bid: member cap certification · case 02

Aggregate consortium capacity hides an overloaded member.

Auction allocation rules◈ Members↗
FA-57083

Consortium bid: member cap certification · case 03

Aggregate consortium capacity hides an overloaded member.

Auction allocation rules◈ Members↗
FA-57084

Consortium bid: member cap certification · case 04

Aggregate consortium capacity hides an overloaded member.

Auction allocation rules◈ Members↗
FA-57085

Consortium bid: member cap certification · case 05

Aggregate consortium capacity hides an overloaded member.

Auction allocation rules◈ Members↗
FA-57086

Consortium bid: dissolution settlement · case 01

A dissolved or underfunded consortium receives a settled award.

Auction allocation rules● Open access↗
FA-57087

Consortium bid: dissolution settlement · case 02

A dissolved or underfunded consortium receives a settled award.

Auction allocation rules◈ Members↗
FA-57088

Consortium bid: dissolution settlement · case 03

A dissolved or underfunded consortium receives a settled award.

Auction allocation rules◈ Members↗
FA-57089

Consortium bid: dissolution settlement · case 04

A dissolved or underfunded consortium receives a settled award.

Auction allocation rules◈ Members↗
FA-57090

Consortium bid: dissolution settlement · case 05

A dissolved or underfunded consortium receives a settled award.

Auction allocation rules◈ Members↗
FA-57091

Lot partition: partition quantity conservation · case 01

A lot partition destroys or invents saleable parent units.

Auction allocation rules● Open access↗
FA-57092

Lot partition: partition quantity conservation · case 02

A lot partition destroys or invents saleable parent units.

Auction allocation rules◈ Members↗
FA-57093

Lot partition: partition quantity conservation · case 03

A lot partition destroys or invents saleable parent units.

Auction allocation rules◈ Members↗
FA-57094

Lot partition: partition quantity conservation · case 04

A lot partition destroys or invents saleable parent units.

Auction allocation rules◈ Members↗
FA-57095

Lot partition: partition quantity conservation · case 05

A lot partition destroys or invents saleable parent units.

Auction allocation rules◈ Members↗
FA-57096

Lot partition: parent retirement · case 01

Parent sale identifier remains active after accepted child partition.

Auction allocation rules● Open access↗
FA-57097

Lot partition: parent retirement · case 02

Parent sale identifier remains active after accepted child partition.

Auction allocation rules◈ Members↗
FA-57098

Lot partition: parent retirement · case 03

Parent sale identifier remains active after accepted child partition.

Auction allocation rules◈ Members↗
FA-57099

Lot partition: parent retirement · case 04

Parent sale identifier remains active after accepted child partition.

Auction allocation rules◈ Members↗
FA-57100

Lot partition: parent retirement · case 05

Parent sale identifier remains active after accepted child partition.

Auction allocation rules◈ Members↗

INSPECTABLE BY DESIGN

Every result has a runnable source.

Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.

Read the methodology ↗