Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Net level annual premium: Maturity benefit is discounted one year short · case 01
Endowment premiums are overstated.
Net level annual premium: Maturity benefit is discounted one year short · case 02
Endowment premiums are overstated.
Net level annual premium: Maturity benefit is discounted one year short · case 03
Endowment premiums are overstated.
Net level annual premium: Maturity benefit is discounted one year short · case 04
Endowment premiums are overstated.
Net level annual premium: Maturity benefit is discounted one year short · case 05
Endowment premiums are overstated.
Net level annual premium: Premium periods longer than the term are accepted · case 01
A 7-pay 5-year term returns a premium.
Net level annual premium: Premium periods longer than the term are accepted · case 02
A 7-pay 5-year term returns a premium.
Net level annual premium: Premium periods longer than the term are accepted · case 03
A 7-pay 5-year term returns a premium.
Net level annual premium: Premium periods longer than the term are accepted · case 04
A 7-pay 5-year term returns a premium.
Net level annual premium: Premium periods longer than the term are accepted · case 05
A 7-pay 5-year term returns a premium.
Net level annual premium: Unknown plan types are priced as term · case 01
A misspelled plan silently prices as term insurance.
Net level annual premium: Unknown plan types are priced as term · case 02
A misspelled plan silently prices as term insurance.
Net level annual premium: Unknown plan types are priced as term · case 03
A misspelled plan silently prices as term insurance.
Net level annual premium: Unknown plan types are priced as term · case 04
A misspelled plan silently prices as term insurance.
Net level annual premium: Unknown plan types are priced as term · case 05
A misspelled plan silently prices as term insurance.
Deferred annuity with guaranteed period: First payment after deferral is skipped · case 01
Deferred annuity values are one payment short.
Deferred annuity with guaranteed period: First payment after deferral is skipped · case 02
Deferred annuity values are one payment short.
Deferred annuity with guaranteed period: First payment after deferral is skipped · case 03
Deferred annuity values are one payment short.
Deferred annuity with guaranteed period: First payment after deferral is skipped · case 04
Deferred annuity values are one payment short.
Deferred annuity with guaranteed period: First payment after deferral is skipped · case 05
Deferred annuity values are one payment short.
Deferred annuity with guaranteed period: Guaranteed payments ignore deferral survival · case 01
Guaranteed payments are valued as certain from issue.
Deferred annuity with guaranteed period: Guaranteed payments ignore deferral survival · case 02
Guaranteed payments are valued as certain from issue.
Deferred annuity with guaranteed period: Guaranteed payments ignore deferral survival · case 03
Guaranteed payments are valued as certain from issue.
Deferred annuity with guaranteed period: Guaranteed payments ignore deferral survival · case 04
Guaranteed payments are valued as certain from issue.
Deferred annuity with guaranteed period: Guaranteed payments ignore deferral survival · case 05
Guaranteed payments are valued as certain from issue.
Deferred annuity with guaranteed period: Guarantee covers one payment too many · case 01
A 3-year certain period guarantees four payments.
Deferred annuity with guaranteed period: Guarantee covers one payment too many · case 02
A 3-year certain period guarantees four payments.
Deferred annuity with guaranteed period: Guarantee covers one payment too many · case 03
A 3-year certain period guarantees four payments.
Deferred annuity with guaranteed period: Guarantee covers one payment too many · case 04
A 3-year certain period guarantees four payments.
Deferred annuity with guaranteed period: Guarantee covers one payment too many · case 05
A 3-year certain period guarantees four payments.
Deferred annuity with guaranteed period: Payout term is measured from issue · case 01
Temporary deferred annuities lose payments equal to the deferral.
Deferred annuity with guaranteed period: Payout term is measured from issue · case 02
Temporary deferred annuities lose payments equal to the deferral.
Deferred annuity with guaranteed period: Payout term is measured from issue · case 03
Temporary deferred annuities lose payments equal to the deferral.
Deferred annuity with guaranteed period: Payout term is measured from issue · case 04
Temporary deferred annuities lose payments equal to the deferral.
Deferred annuity with guaranteed period: Payout term is measured from issue · case 05
Temporary deferred annuities lose payments equal to the deferral.
Deferred annuity with guaranteed period: Payments are discounted from the annuity start · case 01
The present value ignores interest during deferral.
Deferred annuity with guaranteed period: Payments are discounted from the annuity start · case 02
The present value ignores interest during deferral.
Deferred annuity with guaranteed period: Payments are discounted from the annuity start · case 03
The present value ignores interest during deferral.
Deferred annuity with guaranteed period: Payments are discounted from the annuity start · case 04
The present value ignores interest during deferral.
Deferred annuity with guaranteed period: Payments are discounted from the annuity start · case 05
The present value ignores interest during deferral.
Joint-life and last-survivor status: Last-survivor probability double counts both alive · case 01
Last-survivor probabilities exceed one.
Joint-life and last-survivor status: Last-survivor probability double counts both alive · case 02
Last-survivor probabilities exceed one.
Joint-life and last-survivor status: Last-survivor probability double counts both alive · case 03
Last-survivor probabilities exceed one.
Joint-life and last-survivor status: Last-survivor probability double counts both alive · case 04
Last-survivor probabilities exceed one.
Joint-life and last-survivor status: Last-survivor probability double counts both alive · case 05
Last-survivor probabilities exceed one.
Joint-life and last-survivor status: Joint status uses the weaker life only · case 01
Joint-life survival is overstated.
Joint-life and last-survivor status: Joint status uses the weaker life only · case 02
Joint-life survival is overstated.
Joint-life and last-survivor status: Joint status uses the weaker life only · case 03
Joint-life survival is overstated.
Joint-life and last-survivor status: Joint status uses the weaker life only · case 04
Joint-life survival is overstated.
Joint-life and last-survivor status: Joint status uses the weaker life only · case 05
Joint-life survival is overstated.
Joint-life and last-survivor status: Expectation stops at the shorter table · case 01
Last-survivor expectation ignores years when only the longer-lived table survives.
Joint-life and last-survivor status: Expectation stops at the shorter table · case 02
Last-survivor expectation ignores years when only the longer-lived table survives.
Joint-life and last-survivor status: Expectation stops at the shorter table · case 03
Last-survivor expectation ignores years when only the longer-lived table survives.
Joint-life and last-survivor status: Expectation stops at the shorter table · case 04
Last-survivor expectation ignores years when only the longer-lived table survives.
Joint-life and last-survivor status: Expectation stops at the shorter table · case 05
Last-survivor expectation ignores years when only the longer-lived table survives.
Joint-life and last-survivor status: Survival beyond a table repeats its last value · case 01
Lives from open tables never die after the last tabulated age.
Joint-life and last-survivor status: Survival beyond a table repeats its last value · case 02
Lives from open tables never die after the last tabulated age.
Joint-life and last-survivor status: Survival beyond a table repeats its last value · case 03
Lives from open tables never die after the last tabulated age.
Joint-life and last-survivor status: Survival beyond a table repeats its last value · case 04
Lives from open tables never die after the last tabulated age.
Joint-life and last-survivor status: Survival beyond a table repeats its last value · case 05
Lives from open tables never die after the last tabulated age.
Joint-life and last-survivor status: Expectation includes time zero · case 01
Curtate expectations are one year too high.
Joint-life and last-survivor status: Expectation includes time zero · case 02
Curtate expectations are one year too high.
Joint-life and last-survivor status: Expectation includes time zero · case 03
Curtate expectations are one year too high.
Joint-life and last-survivor status: Expectation includes time zero · case 04
Curtate expectations are one year too high.
Joint-life and last-survivor status: Expectation includes time zero · case 05
Curtate expectations are one year too high.
Mortality improvement projection: Generational projection freezes the calendar year · case 01
Generational tables show no improvement as the cohort ages.
Mortality improvement projection: Generational projection freezes the calendar year · case 02
Generational tables show no improvement as the cohort ages.
Mortality improvement projection: Generational projection freezes the calendar year · case 03
Generational tables show no improvement as the cohort ages.
Mortality improvement projection: Generational projection freezes the calendar year · case 04
Generational tables show no improvement as the cohort ages.
Mortality improvement projection: Generational projection freezes the calendar year · case 05
Generational tables show no improvement as the cohort ages.
Mortality improvement projection: Improvement scale is read at the starting age · case 01
Older ages are improved at the younger age's rate.
Mortality improvement projection: Improvement scale is read at the starting age · case 02
Older ages are improved at the younger age's rate.
Mortality improvement projection: Improvement scale is read at the starting age · case 03
Older ages are improved at the younger age's rate.
Mortality improvement projection: Improvement scale is read at the starting age · case 04
Older ages are improved at the younger age's rate.
Mortality improvement projection: Improvement scale is read at the starting age · case 05
Older ages are improved at the younger age's rate.
Mortality improvement projection: Years before the base year are not de-improved · case 01
Historical-year rates equal base-year rates.
Mortality improvement projection: Years before the base year are not de-improved · case 02
Historical-year rates equal base-year rates.
Mortality improvement projection: Years before the base year are not de-improved · case 03
Historical-year rates equal base-year rates.
Mortality improvement projection: Years before the base year are not de-improved · case 04
Historical-year rates equal base-year rates.
Mortality improvement projection: Years before the base year are not de-improved · case 05
Historical-year rates equal base-year rates.
Mortality improvement projection: Projected rates can exceed one · case 01
De-improved old-age rates exceed one.
Mortality improvement projection: Projected rates can exceed one · case 02
De-improved old-age rates exceed one.
Mortality improvement projection: Projected rates can exceed one · case 03
De-improved old-age rates exceed one.
Mortality improvement projection: Projected rates can exceed one · case 04
De-improved old-age rates exceed one.
Mortality improvement projection: Projected rates can exceed one · case 05
De-improved old-age rates exceed one.
Mortality improvement projection: Improvement is applied linearly · case 01
Long projections over-improve mortality.
Mortality improvement projection: Improvement is applied linearly · case 02
Long projections over-improve mortality.
Mortality improvement projection: Improvement is applied linearly · case 03
Long projections over-improve mortality.
Mortality improvement projection: Improvement is applied linearly · case 04
Long projections over-improve mortality.
Mortality improvement projection: Improvement is applied linearly · case 05
Long projections over-improve mortality.
Central death rate to mortality rate conversion: UDD conversion subtracts half the rate · case 01
Converted mortality rates are too low and turn negative for high central rates.
Central death rate to mortality rate conversion: UDD conversion subtracts half the rate · case 02
Converted mortality rates are too low and turn negative for high central rates.
Central death rate to mortality rate conversion: UDD conversion subtracts half the rate · case 03
Converted mortality rates are too low and turn negative for high central rates.
Central death rate to mortality rate conversion: UDD conversion subtracts half the rate · case 04
Converted mortality rates are too low and turn negative for high central rates.
Central death rate to mortality rate conversion: UDD conversion subtracts half the rate · case 05
Converted mortality rates are too low and turn negative for high central rates.
Central death rate to mortality rate conversion: Constant-force conversion returns survival · case 01
Low mortality groups get q close to one.
Central death rate to mortality rate conversion: Constant-force conversion returns survival · case 02
Low mortality groups get q close to one.
Central death rate to mortality rate conversion: Constant-force conversion returns survival · case 03
Low mortality groups get q close to one.
Central death rate to mortality rate conversion: Constant-force conversion returns survival · case 04
Low mortality groups get q close to one.
Central death rate to mortality rate conversion: Constant-force conversion returns survival · case 05
Low mortality groups get q close to one.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗