Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Hospital occupancy from delayed admissions: stay window start · case 01
Each patient occupies a bed one day longer than the length of stay.
Hospital occupancy from delayed admissions: stay window start · case 02
Each patient occupies a bed one day longer than the length of stay.
Hospital occupancy from delayed admissions: stay window start · case 03
Each patient occupies a bed one day longer than the length of stay.
Hospital occupancy from delayed admissions: stay window start · case 04
Each patient occupies a bed one day longer than the length of stay.
Hospital occupancy from delayed admissions: stay window start · case 05
Each patient occupies a bed one day longer than the length of stay.
Hospital occupancy from delayed admissions: same-day admissions · case 01
Patients admitted today are not counted in today's occupancy.
Hospital occupancy from delayed admissions: same-day admissions · case 02
Patients admitted today are not counted in today's occupancy.
Hospital occupancy from delayed admissions: same-day admissions · case 03
Patients admitted today are not counted in today's occupancy.
Hospital occupancy from delayed admissions: same-day admissions · case 04
Patients admitted today are not counted in today's occupancy.
Hospital occupancy from delayed admissions: same-day admissions · case 05
Patients admitted today are not counted in today's occupancy.
Hospital occupancy from delayed admissions: rounding stage · case 01
Fractional admissions round to zero and small waves report empty wards.
Hospital occupancy from delayed admissions: rounding stage · case 02
Fractional admissions round to zero and small waves report empty wards.
Hospital occupancy from delayed admissions: rounding stage · case 03
Fractional admissions round to zero and small waves report empty wards.
Hospital occupancy from delayed admissions: rounding stage · case 04
Fractional admissions round to zero and small waves report empty wards.
Hospital occupancy from delayed admissions: rounding stage · case 05
Fractional admissions round to zero and small waves report empty wards.
Hospital occupancy from delayed admissions: peak tie-break · case 01
Plateaus report their last day as the peak instead of the first.
Hospital occupancy from delayed admissions: peak tie-break · case 02
Plateaus report their last day as the peak instead of the first.
Hospital occupancy from delayed admissions: peak tie-break · case 03
Plateaus report their last day as the peak instead of the first.
Hospital occupancy from delayed admissions: peak tie-break · case 04
Plateaus report their last day as the peak instead of the first.
Hospital occupancy from delayed admissions: peak tie-break · case 05
Plateaus report their last day as the peak instead of the first.
SIR with Erlang-distributed infectious period: stage exit rate · case 01
The mean infectious period becomes k times too long.
SIR with Erlang-distributed infectious period: stage exit rate · case 02
The mean infectious period becomes k times too long.
SIR with Erlang-distributed infectious period: stage exit rate · case 03
The mean infectious period becomes k times too long.
SIR with Erlang-distributed infectious period: stage exit rate · case 04
The mean infectious period becomes k times too long.
SIR with Erlang-distributed infectious period: stage exit rate · case 05
The mean infectious period becomes k times too long.
SIR with Erlang-distributed infectious period: interior stage chain · case 01
The last stage never fills and nobody reaches R through it.
SIR with Erlang-distributed infectious period: interior stage chain · case 02
The last stage never fills and nobody reaches R through it.
SIR with Erlang-distributed infectious period: interior stage chain · case 03
The last stage never fills and nobody reaches R through it.
SIR with Erlang-distributed infectious period: interior stage chain · case 04
The last stage never fills and nobody reaches R through it.
SIR with Erlang-distributed infectious period: interior stage chain · case 05
The last stage never fills and nobody reaches R through it.
SIR with Erlang-distributed infectious period: removal stage · case 01
Recovered counts rise immediately at stage-1 exit rates.
SIR with Erlang-distributed infectious period: removal stage · case 02
Recovered counts rise immediately at stage-1 exit rates.
SIR with Erlang-distributed infectious period: removal stage · case 03
Recovered counts rise immediately at stage-1 exit rates.
SIR with Erlang-distributed infectious period: removal stage · case 04
Recovered counts rise immediately at stage-1 exit rates.
SIR with Erlang-distributed infectious period: removal stage · case 05
Recovered counts rise immediately at stage-1 exit rates.
SIR with Erlang-distributed infectious period: seeding stage · case 01
Seeds recover almost immediately.
SIR with Erlang-distributed infectious period: seeding stage · case 02
Seeds recover almost immediately.
SIR with Erlang-distributed infectious period: seeding stage · case 03
Seeds recover almost immediately.
SIR with Erlang-distributed infectious period: seeding stage · case 04
Seeds recover almost immediately.
SIR with Erlang-distributed infectious period: seeding stage · case 05
Seeds recover almost immediately.
SIR with Erlang-distributed infectious period: infectious prevalence · case 01
Transmission falls sharply after the first stage.
SIR with Erlang-distributed infectious period: infectious prevalence · case 02
Transmission falls sharply after the first stage.
SIR with Erlang-distributed infectious period: infectious prevalence · case 03
Transmission falls sharply after the first stage.
SIR with Erlang-distributed infectious period: infectious prevalence · case 04
Transmission falls sharply after the first stage.
SIR with Erlang-distributed infectious period: infectious prevalence · case 05
Transmission falls sharply after the first stage.
Delay-adjusted case fatality ratio: delay direction · case 01
Outcome-known cases include people who fell ill after the observation window.
Delay-adjusted case fatality ratio: delay direction · case 02
Outcome-known cases include people who fell ill after the observation window.
Delay-adjusted case fatality ratio: delay direction · case 03
Outcome-known cases include people who fell ill after the observation window.
Delay-adjusted case fatality ratio: delay direction · case 04
Outcome-known cases include people who fell ill after the observation window.
Delay-adjusted case fatality ratio: delay direction · case 05
Outcome-known cases include people who fell ill after the observation window.
Delay-adjusted case fatality ratio: pmf lag origin · case 01
Every delay is shifted by one day, understating resolved cases.
Delay-adjusted case fatality ratio: pmf lag origin · case 02
Every delay is shifted by one day, understating resolved cases.
Delay-adjusted case fatality ratio: pmf lag origin · case 03
Every delay is shifted by one day, understating resolved cases.
Delay-adjusted case fatality ratio: pmf lag origin · case 04
Every delay is shifted by one day, understating resolved cases.
Delay-adjusted case fatality ratio: pmf lag origin · case 05
Every delay is shifted by one day, understating resolved cases.
Delay-adjusted case fatality ratio: fatality cap · case 01
Adjusted CFR can exceed 100% early in a surge.
Delay-adjusted case fatality ratio: fatality cap · case 02
Adjusted CFR can exceed 100% early in a surge.
Delay-adjusted case fatality ratio: fatality cap · case 03
Adjusted CFR can exceed 100% early in a surge.
Delay-adjusted case fatality ratio: fatality cap · case 04
Adjusted CFR can exceed 100% early in a surge.
Delay-adjusted case fatality ratio: fatality cap · case 05
Adjusted CFR can exceed 100% early in a surge.
Delay-adjusted case fatality ratio: unresolved outcome result · case 01
With no resolved outcomes the adjusted CFR silently equals the naive one.
Delay-adjusted case fatality ratio: unresolved outcome result · case 02
With no resolved outcomes the adjusted CFR silently equals the naive one.
Delay-adjusted case fatality ratio: unresolved outcome result · case 03
With no resolved outcomes the adjusted CFR silently equals the naive one.
Delay-adjusted case fatality ratio: unresolved outcome result · case 04
With no resolved outcomes the adjusted CFR silently equals the naive one.
Delay-adjusted case fatality ratio: unresolved outcome result · case 05
With no resolved outcomes the adjusted CFR silently equals the naive one.
Delay-adjusted case fatality ratio: naive denominator · case 01
Naive CFR is understated by treating deaths as additional cases.
Delay-adjusted case fatality ratio: naive denominator · case 02
Naive CFR is understated by treating deaths as additional cases.
Delay-adjusted case fatality ratio: naive denominator · case 03
Naive CFR is understated by treating deaths as additional cases.
Delay-adjusted case fatality ratio: naive denominator · case 04
Naive CFR is understated by treating deaths as additional cases.
Delay-adjusted case fatality ratio: naive denominator · case 05
Naive CFR is understated by treating deaths as additional cases.
Household secondary attack rate: at-risk denominator · case 01
Households with several index cases have understated attack rates.
Household secondary attack rate: at-risk denominator · case 02
Households with several index cases have understated attack rates.
Household secondary attack rate: at-risk denominator · case 03
Households with several index cases have understated attack rates.
Household secondary attack rate: at-risk denominator · case 04
Households with several index cases have understated attack rates.
Household secondary attack rate: at-risk denominator · case 05
Households with several index cases have understated attack rates.
Household secondary attack rate: index requirement · case 01
Households without any index case dilute the attack rate.
Household secondary attack rate: index requirement · case 02
Households without any index case dilute the attack rate.
Household secondary attack rate: index requirement · case 03
Households without any index case dilute the attack rate.
Household secondary attack rate: index requirement · case 04
Households without any index case dilute the attack rate.
Household secondary attack rate: index requirement · case 05
Households without any index case dilute the attack rate.
Household secondary attack rate: pooling method · case 01
The overall SAR weights each household size equally.
Household secondary attack rate: pooling method · case 02
The overall SAR weights each household size equally.
Household secondary attack rate: pooling method · case 03
The overall SAR weights each household size equally.
Household secondary attack rate: pooling method · case 04
The overall SAR weights each household size equally.
Household secondary attack rate: pooling method · case 05
The overall SAR weights each household size equally.
Household secondary attack rate: stratum key · case 01
Size strata mix households of different sizes that share an at-risk count.
Household secondary attack rate: stratum key · case 02
Size strata mix households of different sizes that share an at-risk count.
Household secondary attack rate: stratum key · case 03
Size strata mix households of different sizes that share an at-risk count.
Household secondary attack rate: stratum key · case 04
Size strata mix households of different sizes that share an at-risk count.
Household secondary attack rate: stratum key · case 05
Size strata mix households of different sizes that share an at-risk count.
Household secondary attack rate: stratum ordering · case 01
The size table follows input order.
Household secondary attack rate: stratum ordering · case 02
The size table follows input order.
Household secondary attack rate: stratum ordering · case 03
The size table follows input order.
Household secondary attack rate: stratum ordering · case 04
The size table follows input order.
Household secondary attack rate: stratum ordering · case 05
The size table follows input order.
Household secondary attack rate: secondary consistency guard · case 01
Data-entry errors produce household SARs above 100%.
Household secondary attack rate: secondary consistency guard · case 02
Data-entry errors produce household SARs above 100%.
Household secondary attack rate: secondary consistency guard · case 03
Data-entry errors produce household SARs above 100%.
Household secondary attack rate: secondary consistency guard · case 04
Data-entry errors produce household SARs above 100%.
Household secondary attack rate: secondary consistency guard · case 05
Data-entry errors produce household SARs above 100%.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗