Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Cervical spine imaging decision rule: older age high-risk threshold · case 01
A 65-year-old is assessed for range of motion instead of being imaged.
Cervical spine imaging decision rule: older age high-risk threshold · case 02
A 65-year-old is assessed for range of motion instead of being imaged.
Cervical spine imaging decision rule: older age high-risk threshold · case 03
A 65-year-old is assessed for range of motion instead of being imaged.
Cervical spine imaging decision rule: older age high-risk threshold · case 04
A 65-year-old is assessed for range of motion instead of being imaged.
Cervical spine imaging decision rule: older age high-risk threshold · case 05
A 65-year-old is assessed for range of motion instead of being imaged.
Cervical spine imaging decision rule: low-risk factor quantifier · case 01
Patients with a single low-risk factor are imaged without a rotation test.
Cervical spine imaging decision rule: low-risk factor quantifier · case 02
Patients with a single low-risk factor are imaged without a rotation test.
Cervical spine imaging decision rule: low-risk factor quantifier · case 03
Patients with a single low-risk factor are imaged without a rotation test.
Cervical spine imaging decision rule: low-risk factor quantifier · case 04
Patients with a single low-risk factor are imaged without a rotation test.
Cervical spine imaging decision rule: low-risk factor quantifier · case 05
Patients with a single low-risk factor are imaged without a rotation test.
Cervical spine imaging decision rule: bilateral rotation requirement · case 01
A patient who can only rotate to one side is cleared.
Cervical spine imaging decision rule: bilateral rotation requirement · case 02
A patient who can only rotate to one side is cleared.
Cervical spine imaging decision rule: bilateral rotation requirement · case 03
A patient who can only rotate to one side is cleared.
Cervical spine imaging decision rule: bilateral rotation requirement · case 04
A patient who can only rotate to one side is cleared.
Cervical spine imaging decision rule: bilateral rotation requirement · case 05
A patient who can only rotate to one side is cleared.
Cervical spine imaging decision rule: paresthesia high-risk factor · case 01
Patients reporting extremity paresthesias are cleared by the rotation test.
Cervical spine imaging decision rule: paresthesia high-risk factor · case 02
Patients reporting extremity paresthesias are cleared by the rotation test.
Cervical spine imaging decision rule: paresthesia high-risk factor · case 03
Patients reporting extremity paresthesias are cleared by the rotation test.
Cervical spine imaging decision rule: paresthesia high-risk factor · case 04
Patients reporting extremity paresthesias are cleared by the rotation test.
Cervical spine imaging decision rule: paresthesia high-risk factor · case 05
Patients reporting extremity paresthesias are cleared by the rotation test.
Acute asthma severity from peak flow and signs: percentage of best · case 01
Every patient is classified as life-threatening.
Acute asthma severity from peak flow and signs: percentage of best · case 02
Every patient is classified as life-threatening.
Acute asthma severity from peak flow and signs: percentage of best · case 03
Every patient is classified as life-threatening.
Acute asthma severity from peak flow and signs: percentage of best · case 04
Every patient is classified as life-threatening.
Acute asthma severity from peak flow and signs: percentage of best · case 05
Every patient is classified as life-threatening.
Acute asthma severity from peak flow and signs: life-threatening criteria · case 01
A peak flow of exactly 33% is graded life-threatening.
Acute asthma severity from peak flow and signs: life-threatening criteria · case 02
A peak flow of exactly 33% is graded life-threatening.
Acute asthma severity from peak flow and signs: life-threatening criteria · case 03
A peak flow of exactly 33% is graded life-threatening.
Acute asthma severity from peak flow and signs: life-threatening criteria · case 04
A peak flow of exactly 33% is graded life-threatening.
Acute asthma severity from peak flow and signs: life-threatening criteria · case 05
A peak flow of exactly 33% is graded life-threatening.
Acute asthma severity from peak flow and signs: acute severe peak flow edge · case 01
A peak flow of exactly 50% is graded moderate.
Acute asthma severity from peak flow and signs: acute severe peak flow edge · case 02
A peak flow of exactly 50% is graded moderate.
Acute asthma severity from peak flow and signs: acute severe peak flow edge · case 03
A peak flow of exactly 50% is graded moderate.
Acute asthma severity from peak flow and signs: acute severe peak flow edge · case 04
A peak flow of exactly 50% is graded moderate.
Acute asthma severity from peak flow and signs: acute severe peak flow edge · case 05
A peak flow of exactly 50% is graded moderate.
Acute asthma severity from peak flow and signs: tachycardia criterion · case 01
A heart rate of exactly 110 is not treated as a severe sign.
Acute asthma severity from peak flow and signs: tachycardia criterion · case 02
A heart rate of exactly 110 is not treated as a severe sign.
Acute asthma severity from peak flow and signs: tachycardia criterion · case 03
A heart rate of exactly 110 is not treated as a severe sign.
Acute asthma severity from peak flow and signs: tachycardia criterion · case 04
A heart rate of exactly 110 is not treated as a severe sign.
Acute asthma severity from peak flow and signs: tachycardia criterion · case 05
A heart rate of exactly 110 is not treated as a severe sign.
SIR Euler integrator with daily sampling: transmission scaling · case 01
Outbreak size explodes with population size and susceptibles are exhausted within the first substep.
SIR Euler integrator with daily sampling: transmission scaling · case 02
Outbreak size explodes with population size and susceptibles are exhausted within the first substep.
SIR Euler integrator with daily sampling: transmission scaling · case 03
Outbreak size explodes with population size and susceptibles are exhausted within the first substep.
SIR Euler integrator with daily sampling: transmission scaling · case 04
Outbreak size explodes with population size and susceptibles are exhausted within the first substep.
SIR Euler integrator with daily sampling: transmission scaling · case 05
Outbreak size explodes with population size and susceptibles are exhausted within the first substep.
SIR Euler integrator with daily sampling: infection cap · case 01
With large beta*dt the susceptible pool goes negative and recovered exceeds the population.
SIR Euler integrator with daily sampling: infection cap · case 02
With large beta*dt the susceptible pool goes negative and recovered exceeds the population.
SIR Euler integrator with daily sampling: infection cap · case 03
With large beta*dt the susceptible pool goes negative and recovered exceeds the population.
SIR Euler integrator with daily sampling: infection cap · case 04
With large beta*dt the susceptible pool goes negative and recovered exceeds the population.
SIR Euler integrator with daily sampling: infection cap · case 05
With large beta*dt the susceptible pool goes negative and recovered exceeds the population.
SIR Euler integrator with daily sampling: recovery step size · case 01
Recovery runs substeps times too fast whenever the day is subdivided.
SIR Euler integrator with daily sampling: recovery step size · case 02
Recovery runs substeps times too fast whenever the day is subdivided.
SIR Euler integrator with daily sampling: recovery step size · case 03
Recovery runs substeps times too fast whenever the day is subdivided.
SIR Euler integrator with daily sampling: recovery step size · case 04
Recovery runs substeps times too fast whenever the day is subdivided.
SIR Euler integrator with daily sampling: recovery step size · case 05
Recovery runs substeps times too fast whenever the day is subdivided.
SIR Euler integrator with daily sampling: day indexing · case 01
Peak days are reported one day early and the run stops one day short in its own numbering.
SIR Euler integrator with daily sampling: day indexing · case 02
Peak days are reported one day early and the run stops one day short in its own numbering.
SIR Euler integrator with daily sampling: day indexing · case 03
Peak days are reported one day early and the run stops one day short in its own numbering.
SIR Euler integrator with daily sampling: day indexing · case 04
Peak days are reported one day early and the run stops one day short in its own numbering.
SIR Euler integrator with daily sampling: day indexing · case 05
Peak days are reported one day early and the run stops one day short in its own numbering.
SIR Euler integrator with daily sampling: initial peak baseline · case 01
A declining subcritical outbreak reports its peak on day 1 instead of at the seed on day 0.
SIR Euler integrator with daily sampling: initial peak baseline · case 02
A declining subcritical outbreak reports its peak on day 1 instead of at the seed on day 0.
SIR Euler integrator with daily sampling: initial peak baseline · case 03
A declining subcritical outbreak reports its peak on day 1 instead of at the seed on day 0.
SIR Euler integrator with daily sampling: initial peak baseline · case 04
A declining subcritical outbreak reports its peak on day 1 instead of at the seed on day 0.
SIR Euler integrator with daily sampling: initial peak baseline · case 05
A declining subcritical outbreak reports its peak on day 1 instead of at the seed on day 0.
SEIR daily symptom-onset incidence: latent rate · case 01
Onsets drain the exposed class many times over per day and turn negative.
SEIR daily symptom-onset incidence: latent rate · case 02
Onsets drain the exposed class many times over per day and turn negative.
SEIR daily symptom-onset incidence: latent rate · case 03
Onsets drain the exposed class many times over per day and turn negative.
SEIR daily symptom-onset incidence: latent rate · case 04
Onsets drain the exposed class many times over per day and turn negative.
SEIR daily symptom-onset incidence: latent rate · case 05
Onsets drain the exposed class many times over per day and turn negative.
SEIR daily symptom-onset incidence: infectious compartment in force · case 01
Transmission starts on day 0 although no seed is infectious yet.
SEIR daily symptom-onset incidence: infectious compartment in force · case 02
Transmission starts on day 0 although no seed is infectious yet.
SEIR daily symptom-onset incidence: infectious compartment in force · case 03
Transmission starts on day 0 although no seed is infectious yet.
SEIR daily symptom-onset incidence: infectious compartment in force · case 04
Transmission starts on day 0 although no seed is infectious yet.
SEIR daily symptom-onset incidence: infectious compartment in force · case 05
Transmission starts on day 0 although no seed is infectious yet.
SEIR daily symptom-onset incidence: incidence definition · case 01
The reported onset curve is shifted a latent period earlier and starts at zero.
SEIR daily symptom-onset incidence: incidence definition · case 02
The reported onset curve is shifted a latent period earlier and starts at zero.
SEIR daily symptom-onset incidence: incidence definition · case 03
The reported onset curve is shifted a latent period earlier and starts at zero.
SEIR daily symptom-onset incidence: incidence definition · case 04
The reported onset curve is shifted a latent period earlier and starts at zero.
SEIR daily symptom-onset incidence: incidence definition · case 05
The reported onset curve is shifted a latent period earlier and starts at zero.
SEIR daily symptom-onset incidence: exposed flow balance · case 01
Total population grows every day and onsets keep rising after the epidemic ends.
SEIR daily symptom-onset incidence: exposed flow balance · case 02
Total population grows every day and onsets keep rising after the epidemic ends.
SEIR daily symptom-onset incidence: exposed flow balance · case 03
Total population grows every day and onsets keep rising after the epidemic ends.
SEIR daily symptom-onset incidence: exposed flow balance · case 04
Total population grows every day and onsets keep rising after the epidemic ends.
SEIR daily symptom-onset incidence: exposed flow balance · case 05
Total population grows every day and onsets keep rising after the epidemic ends.
SEIR daily symptom-onset incidence: seed compartment · case 01
Population totals exceed the census by exactly the seed count.
SEIR daily symptom-onset incidence: seed compartment · case 02
Population totals exceed the census by exactly the seed count.
SEIR daily symptom-onset incidence: seed compartment · case 03
Population totals exceed the census by exactly the seed count.
SEIR daily symptom-onset incidence: seed compartment · case 04
Population totals exceed the census by exactly the seed count.
SEIR daily symptom-onset incidence: seed compartment · case 05
Population totals exceed the census by exactly the seed count.
SEIR daily symptom-onset incidence: removal source · case 01
Newly symptomatic people recover in the same day they become infectious.
SEIR daily symptom-onset incidence: removal source · case 02
Newly symptomatic people recover in the same day they become infectious.
SEIR daily symptom-onset incidence: removal source · case 03
Newly symptomatic people recover in the same day they become infectious.
SEIR daily symptom-onset incidence: removal source · case 04
Newly symptomatic people recover in the same day they become infectious.
SEIR daily symptom-onset incidence: removal source · case 05
Newly symptomatic people recover in the same day they become infectious.
SEIR R0 with vital dynamics and vaccine coverage: latent survival factor · case 01
R0 is overstated for pathogens with long latency in short-lived hosts.
SEIR R0 with vital dynamics and vaccine coverage: latent survival factor · case 02
R0 is overstated for pathogens with long latency in short-lived hosts.
SEIR R0 with vital dynamics and vaccine coverage: latent survival factor · case 03
R0 is overstated for pathogens with long latency in short-lived hosts.
SEIR R0 with vital dynamics and vaccine coverage: latent survival factor · case 04
R0 is overstated for pathogens with long latency in short-lived hosts.
SEIR R0 with vital dynamics and vaccine coverage: latent survival factor · case 05
R0 is overstated for pathogens with long latency in short-lived hosts.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗