Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Fractional age survival assumptions: Balducci survival uses the elapsed rather than remaining fraction · case 01
Balducci survival probabilities are too high early in the year.
Fractional age survival assumptions: Balducci survival uses the elapsed rather than remaining fraction · case 02
Balducci survival probabilities are too high early in the year.
Fractional age survival assumptions: Balducci survival uses the elapsed rather than remaining fraction · case 03
Balducci survival probabilities are too high early in the year.
Fractional age survival assumptions: Balducci survival uses the elapsed rather than remaining fraction · case 04
Balducci survival probabilities are too high early in the year.
Fractional age survival assumptions: Balducci survival uses the elapsed rather than remaining fraction · case 05
Balducci survival probabilities are too high early in the year.
Fractional age survival assumptions: A full year is rejected as out of range · case 01
t=1 returns invalid.
Fractional age survival assumptions: A full year is rejected as out of range · case 02
t=1 returns invalid.
Fractional age survival assumptions: A full year is rejected as out of range · case 03
t=1 returns invalid.
Fractional age survival assumptions: A full year is rejected as out of range · case 04
t=1 returns invalid.
Fractional age survival assumptions: A full year is rejected as out of range · case 05
t=1 returns invalid.
Fractional age survival assumptions: Constant force is approximated by q · case 01
The constant force is understated.
Fractional age survival assumptions: Constant force is approximated by q · case 02
The constant force is understated.
Fractional age survival assumptions: Constant force is approximated by q · case 03
The constant force is understated.
Fractional age survival assumptions: Constant force is approximated by q · case 04
The constant force is understated.
Fractional age survival assumptions: Constant force is approximated by q · case 05
The constant force is understated.
Select and ultimate mortality lookup: The last select year uses the ultimate table · case 01
Lives in their final select year are charged ultimate mortality.
Select and ultimate mortality lookup: The last select year uses the ultimate table · case 02
Lives in their final select year are charged ultimate mortality.
Select and ultimate mortality lookup: The last select year uses the ultimate table · case 03
Lives in their final select year are charged ultimate mortality.
Select and ultimate mortality lookup: The last select year uses the ultimate table · case 04
Lives in their final select year are charged ultimate mortality.
Select and ultimate mortality lookup: The last select year uses the ultimate table · case 05
Lives in their final select year are charged ultimate mortality.
Select and ultimate mortality lookup: Ultimate rates are looked up at issue age · case 01
Ultimate mortality stops increasing with age.
Select and ultimate mortality lookup: Ultimate rates are looked up at issue age · case 02
Ultimate mortality stops increasing with age.
Select and ultimate mortality lookup: Ultimate rates are looked up at issue age · case 03
Ultimate mortality stops increasing with age.
Select and ultimate mortality lookup: Ultimate rates are looked up at issue age · case 04
Ultimate mortality stops increasing with age.
Select and ultimate mortality lookup: Ultimate rates are looked up at issue age · case 05
Ultimate mortality stops increasing with age.
Select and ultimate mortality lookup: Select durations are indexed from the projection start · case 01
Projections starting mid-select reuse early-duration rates.
Select and ultimate mortality lookup: Select durations are indexed from the projection start · case 02
Projections starting mid-select reuse early-duration rates.
Select and ultimate mortality lookup: Select durations are indexed from the projection start · case 03
Projections starting mid-select reuse early-duration rates.
Select and ultimate mortality lookup: Select durations are indexed from the projection start · case 04
Projections starting mid-select reuse early-duration rates.
Select and ultimate mortality lookup: Select durations are indexed from the projection start · case 05
Projections starting mid-select reuse early-duration rates.
Select and ultimate mortality lookup: Select row is chosen by attained age · case 01
Lives are treated as if newly selected at each age.
Select and ultimate mortality lookup: Select row is chosen by attained age · case 02
Lives are treated as if newly selected at each age.
Select and ultimate mortality lookup: Select row is chosen by attained age · case 03
Lives are treated as if newly selected at each age.
Select and ultimate mortality lookup: Select row is chosen by attained age · case 04
Lives are treated as if newly selected at each age.
Select and ultimate mortality lookup: Select row is chosen by attained age · case 05
Lives are treated as if newly selected at each age.
Select and ultimate mortality lookup: Survival subtracts rates instead of multiplying · case 01
Multi-year survival is slightly too low.
Select and ultimate mortality lookup: Survival subtracts rates instead of multiplying · case 02
Multi-year survival is slightly too low.
Select and ultimate mortality lookup: Survival subtracts rates instead of multiplying · case 03
Multi-year survival is slightly too low.
Select and ultimate mortality lookup: Survival subtracts rates instead of multiplying · case 04
Multi-year survival is slightly too low.
Select and ultimate mortality lookup: Survival subtracts rates instead of multiplying · case 05
Multi-year survival is slightly too low.
Commutation-function life annuities: The interest rate is used as a discount rate · case 01
Annuity values are slightly too low.
Commutation-function life annuities: The interest rate is used as a discount rate · case 02
Annuity values are slightly too low.
Commutation-function life annuities: The interest rate is used as a discount rate · case 03
Annuity values are slightly too low.
Commutation-function life annuities: The interest rate is used as a discount rate · case 04
Annuity values are slightly too low.
Commutation-function life annuities: The interest rate is used as a discount rate · case 05
Annuity values are slightly too low.
Commutation-function life annuities: Temporary annuities stop one payment early · case 01
An n-year annuity-due makes n-1 payments.
Commutation-function life annuities: Temporary annuities stop one payment early · case 02
An n-year annuity-due makes n-1 payments.
Commutation-function life annuities: Temporary annuities stop one payment early · case 03
An n-year annuity-due makes n-1 payments.
Commutation-function life annuities: Temporary annuities stop one payment early · case 04
An n-year annuity-due makes n-1 payments.
Commutation-function life annuities: Temporary annuities stop one payment early · case 05
An n-year annuity-due makes n-1 payments.
Commutation-function life annuities: Immediate annuity drops the final payment of the term · case 01
Temporary immediate annuities are one payment short.
Commutation-function life annuities: Immediate annuity drops the final payment of the term · case 02
Temporary immediate annuities are one payment short.
Commutation-function life annuities: Immediate annuity drops the final payment of the term · case 03
Temporary immediate annuities are one payment short.
Commutation-function life annuities: Immediate annuity drops the final payment of the term · case 04
Temporary immediate annuities are one payment short.
Commutation-function life annuities: Immediate annuity drops the final payment of the term · case 05
Temporary immediate annuities are one payment short.
Commutation-function life annuities: N_x excludes D_x · case 01
Annuity values are shifted by one payment.
Commutation-function life annuities: N_x excludes D_x · case 02
Annuity values are shifted by one payment.
Commutation-function life annuities: N_x excludes D_x · case 03
Annuity values are shifted by one payment.
Commutation-function life annuities: N_x excludes D_x · case 04
Annuity values are shifted by one payment.
Commutation-function life annuities: N_x excludes D_x · case 05
Annuity values are shifted by one payment.
Commutation-function life annuities: Whole-life annuities stop before the last age · case 01
Whole-life annuities omit payments at the oldest tabulated age.
Commutation-function life annuities: Whole-life annuities stop before the last age · case 02
Whole-life annuities omit payments at the oldest tabulated age.
Commutation-function life annuities: Whole-life annuities stop before the last age · case 03
Whole-life annuities omit payments at the oldest tabulated age.
Commutation-function life annuities: Whole-life annuities stop before the last age · case 04
Whole-life annuities omit payments at the oldest tabulated age.
Commutation-function life annuities: Whole-life annuities stop before the last age · case 05
Whole-life annuities omit payments at the oldest tabulated age.
Term insurance net single premium: Year-end claims are discounted from the start of the year · case 01
Year-end term premiums are overstated by a year of interest.
Term insurance net single premium: Year-end claims are discounted from the start of the year · case 02
Year-end term premiums are overstated by a year of interest.
Term insurance net single premium: Year-end claims are discounted from the start of the year · case 03
Year-end term premiums are overstated by a year of interest.
Term insurance net single premium: Year-end claims are discounted from the start of the year · case 04
Year-end term premiums are overstated by a year of interest.
Term insurance net single premium: Year-end claims are discounted from the start of the year · case 05
Year-end term premiums are overstated by a year of interest.
Term insurance net single premium: Survival is updated before the death term · case 01
Claims in each year are weighted by survival through that same year.
Term insurance net single premium: Survival is updated before the death term · case 02
Claims in each year are weighted by survival through that same year.
Term insurance net single premium: Survival is updated before the death term · case 03
Claims in each year are weighted by survival through that same year.
Term insurance net single premium: Survival is updated before the death term · case 04
Claims in each year are weighted by survival through that same year.
Term insurance net single premium: Survival is updated before the death term · case 05
Claims in each year are weighted by survival through that same year.
Term insurance net single premium: A term equal to the table length is rejected · case 01
A term that uses every tabulated rate returns table too short.
Term insurance net single premium: A term equal to the table length is rejected · case 02
A term that uses every tabulated rate returns table too short.
Term insurance net single premium: A term equal to the table length is rejected · case 03
A term that uses every tabulated rate returns table too short.
Term insurance net single premium: A term equal to the table length is rejected · case 04
A term that uses every tabulated rate returns table too short.
Term insurance net single premium: A term equal to the table length is rejected · case 05
A term that uses every tabulated rate returns table too short.
Term insurance net single premium: Immediate-payment adjustment is inverted · case 01
Immediate-payment premiums are lower than year-end premiums.
Term insurance net single premium: Immediate-payment adjustment is inverted · case 02
Immediate-payment premiums are lower than year-end premiums.
Term insurance net single premium: Immediate-payment adjustment is inverted · case 03
Immediate-payment premiums are lower than year-end premiums.
Term insurance net single premium: Immediate-payment adjustment is inverted · case 04
Immediate-payment premiums are lower than year-end premiums.
Term insurance net single premium: Immediate-payment adjustment is inverted · case 05
Immediate-payment premiums are lower than year-end premiums.
Term insurance net single premium: The insurance factor is rounded before applying the benefit · case 01
Large face amounts are mispriced by many cents.
Term insurance net single premium: The insurance factor is rounded before applying the benefit · case 02
Large face amounts are mispriced by many cents.
Term insurance net single premium: The insurance factor is rounded before applying the benefit · case 03
Large face amounts are mispriced by many cents.
Term insurance net single premium: The insurance factor is rounded before applying the benefit · case 04
Large face amounts are mispriced by many cents.
Term insurance net single premium: The insurance factor is rounded before applying the benefit · case 05
Large face amounts are mispriced by many cents.
Net level annual premium: Premium annuity runs one year past the paying period · case 01
Limited-pay premiums are understated.
Net level annual premium: Premium annuity runs one year past the paying period · case 02
Limited-pay premiums are understated.
Net level annual premium: Premium annuity runs one year past the paying period · case 03
Limited-pay premiums are understated.
Net level annual premium: Premium annuity runs one year past the paying period · case 04
Limited-pay premiums are understated.
Net level annual premium: Premium annuity runs one year past the paying period · case 05
Limited-pay premiums are understated.
Net level annual premium: Premiums are valued as payable in arrears · case 01
Net premiums are too high because premiums are discounted an extra year.
Net level annual premium: Premiums are valued as payable in arrears · case 02
Net premiums are too high because premiums are discounted an extra year.
Net level annual premium: Premiums are valued as payable in arrears · case 03
Net premiums are too high because premiums are discounted an extra year.
Net level annual premium: Premiums are valued as payable in arrears · case 04
Net premiums are too high because premiums are discounted an extra year.
Net level annual premium: Premiums are valued as payable in arrears · case 05
Net premiums are too high because premiums are discounted an extra year.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗