Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Premium tax, surcharge and stamping fee allocation: Stamping fee is charged on premium tax · case 01
Stamping fees are computed on a base that includes tax.
Premium tax, surcharge and stamping fee allocation: Stamping fee is charged on premium tax · case 02
Stamping fees are computed on a base that includes tax.
Premium tax, surcharge and stamping fee allocation: Stamping fee is charged on premium tax · case 03
Stamping fees are computed on a base that includes tax.
Premium tax, surcharge and stamping fee allocation: Stamping fee is charged on premium tax · case 04
Stamping fees are computed on a base that includes tax.
Premium tax, surcharge and stamping fee allocation: Stamping fee is charged on premium tax · case 05
Stamping fees are computed on a base that includes tax.
Premium tax, surcharge and stamping fee allocation: Billed total is recomputed from unrounded items · case 01
The invoice total does not equal the sum of its itemised lines.
Premium tax, surcharge and stamping fee allocation: Billed total is recomputed from unrounded items · case 02
The invoice total does not equal the sum of its itemised lines.
Premium tax, surcharge and stamping fee allocation: Billed total is recomputed from unrounded items · case 03
The invoice total does not equal the sum of its itemised lines.
Premium tax, surcharge and stamping fee allocation: Billed total is recomputed from unrounded items · case 04
The invoice total does not equal the sum of its itemised lines.
Premium tax, surcharge and stamping fee allocation: Billed total is recomputed from unrounded items · case 05
The invoice total does not equal the sum of its itemised lines.
Premium tax, surcharge and stamping fee allocation: Return-premium items round toward positive infinity · case 01
Refunded tax on a return premium is a cent short.
Premium tax, surcharge and stamping fee allocation: Return-premium items round toward positive infinity · case 02
Refunded tax on a return premium is a cent short.
Premium tax, surcharge and stamping fee allocation: Return-premium items round toward positive infinity · case 03
Refunded tax on a return premium is a cent short.
Premium tax, surcharge and stamping fee allocation: Return-premium items round toward positive infinity · case 04
Refunded tax on a return premium is a cent short.
Premium tax, surcharge and stamping fee allocation: Return-premium items round toward positive infinity · case 05
Refunded tax on a return premium is a cent short.
Retrospective rating adjustment: Loss conversion factor is applied to the basic premium · case 01
Retro premiums are inflated because expense loading is converted like losses.
Retrospective rating adjustment: Loss conversion factor is applied to the basic premium · case 02
Retro premiums are inflated because expense loading is converted like losses.
Retrospective rating adjustment: Loss conversion factor is applied to the basic premium · case 03
Retro premiums are inflated because expense loading is converted like losses.
Retrospective rating adjustment: Loss conversion factor is applied to the basic premium · case 04
Retro premiums are inflated because expense loading is converted like losses.
Retrospective rating adjustment: Loss conversion factor is applied to the basic premium · case 05
Retro premiums are inflated because expense loading is converted like losses.
Retrospective rating adjustment: Bounds are enforced before the tax multiplier · case 01
Capped or floored retro premiums exceed the plan bounds by the tax multiplier.
Retrospective rating adjustment: Bounds are enforced before the tax multiplier · case 02
Capped or floored retro premiums exceed the plan bounds by the tax multiplier.
Retrospective rating adjustment: Bounds are enforced before the tax multiplier · case 03
Capped or floored retro premiums exceed the plan bounds by the tax multiplier.
Retrospective rating adjustment: Bounds are enforced before the tax multiplier · case 04
Capped or floored retro premiums exceed the plan bounds by the tax multiplier.
Retrospective rating adjustment: Bounds are enforced before the tax multiplier · case 05
Capped or floored retro premiums exceed the plan bounds by the tax multiplier.
Retrospective rating adjustment: Minimum retro premium is not applied · case 01
Loss-free insureds pay less than the plan minimum.
Retrospective rating adjustment: Minimum retro premium is not applied · case 02
Loss-free insureds pay less than the plan minimum.
Retrospective rating adjustment: Minimum retro premium is not applied · case 03
Loss-free insureds pay less than the plan minimum.
Retrospective rating adjustment: Minimum retro premium is not applied · case 04
Loss-free insureds pay less than the plan minimum.
Retrospective rating adjustment: Minimum retro premium is not applied · case 05
Loss-free insureds pay less than the plan minimum.
Retrospective rating adjustment: Net recoveries produce negative limited losses · case 01
Salvage exceeding losses reduces the retro premium below the basic charge.
Retrospective rating adjustment: Net recoveries produce negative limited losses · case 02
Salvage exceeding losses reduces the retro premium below the basic charge.
Retrospective rating adjustment: Net recoveries produce negative limited losses · case 03
Salvage exceeding losses reduces the retro premium below the basic charge.
Retrospective rating adjustment: Net recoveries produce negative limited losses · case 04
Salvage exceeding losses reduces the retro premium below the basic charge.
Retrospective rating adjustment: Net recoveries produce negative limited losses · case 05
Salvage exceeding losses reduces the retro premium below the basic charge.
Retrospective rating adjustment: Equal minimum and maximum are rejected · case 01
A fixed-cost plan with identical bounds is refused.
Retrospective rating adjustment: Equal minimum and maximum are rejected · case 02
A fixed-cost plan with identical bounds is refused.
Retrospective rating adjustment: Equal minimum and maximum are rejected · case 03
A fixed-cost plan with identical bounds is refused.
Retrospective rating adjustment: Equal minimum and maximum are rejected · case 04
A fixed-cost plan with identical bounds is refused.
Retrospective rating adjustment: Equal minimum and maximum are rejected · case 05
A fixed-cost plan with identical bounds is refused.
Homeowners protection class and construction matrix: Exactly five miles is treated as unprotected · case 01
Homes exactly five road miles from a station are rated class 10.
Homeowners protection class and construction matrix: Exactly five miles is treated as unprotected · case 02
Homes exactly five road miles from a station are rated class 10.
Homeowners protection class and construction matrix: Exactly five miles is treated as unprotected · case 03
Homes exactly five road miles from a station are rated class 10.
Homeowners protection class and construction matrix: Exactly five miles is treated as unprotected · case 04
Homes exactly five road miles from a station are rated class 10.
Homeowners protection class and construction matrix: Exactly five miles is treated as unprotected · case 05
Homes exactly five road miles from a station are rated class 10.
Homeowners protection class and construction matrix: Split class 8B is downgraded by hydrant distance · case 01
Split-class 8B homes lose their split-class rating.
Homeowners protection class and construction matrix: Split class 8B is downgraded by hydrant distance · case 02
Split-class 8B homes lose their split-class rating.
Homeowners protection class and construction matrix: Split class 8B is downgraded by hydrant distance · case 03
Split-class 8B homes lose their split-class rating.
Homeowners protection class and construction matrix: Split class 8B is downgraded by hydrant distance · case 04
Split-class 8B homes lose their split-class rating.
Homeowners protection class and construction matrix: Split class 8B is downgraded by hydrant distance · case 05
Split-class 8B homes lose their split-class rating.
Homeowners protection class and construction matrix: Masonry fallback omits the 5% credit · case 01
Masonry homes in classes without masonry factors pay frame rates.
Homeowners protection class and construction matrix: Masonry fallback omits the 5% credit · case 02
Masonry homes in classes without masonry factors pay frame rates.
Homeowners protection class and construction matrix: Masonry fallback omits the 5% credit · case 03
Masonry homes in classes without masonry factors pay frame rates.
Homeowners protection class and construction matrix: Masonry fallback omits the 5% credit · case 04
Masonry homes in classes without masonry factors pay frame rates.
Homeowners protection class and construction matrix: Masonry fallback omits the 5% credit · case 05
Masonry homes in classes without masonry factors pay frame rates.
Homeowners protection class and construction matrix: Hydrant distance is compared after a unit conversion · case 01
Homes exactly 1000 feet from a hydrant are downgraded.
Homeowners protection class and construction matrix: Hydrant distance is compared after a unit conversion · case 02
Homes exactly 1000 feet from a hydrant are downgraded.
Homeowners protection class and construction matrix: Hydrant distance is compared after a unit conversion · case 03
Homes exactly 1000 feet from a hydrant are downgraded.
Homeowners protection class and construction matrix: Hydrant distance is compared after a unit conversion · case 04
Homes exactly 1000 feet from a hydrant are downgraded.
Homeowners protection class and construction matrix: Hydrant distance is compared after a unit conversion · case 05
Homes exactly 1000 feet from a hydrant are downgraded.
Homeowners protection class and construction matrix: Matrix lookup uses the reported class · case 01
Downgraded homes are still rated at their reported class.
Homeowners protection class and construction matrix: Matrix lookup uses the reported class · case 02
Downgraded homes are still rated at their reported class.
Homeowners protection class and construction matrix: Matrix lookup uses the reported class · case 03
Downgraded homes are still rated at their reported class.
Homeowners protection class and construction matrix: Matrix lookup uses the reported class · case 04
Downgraded homes are still rated at their reported class.
Homeowners protection class and construction matrix: Matrix lookup uses the reported class · case 05
Downgraded homes are still rated at their reported class.
Mid-term endorsement pro-rata premium: Each endorsement is priced against the original premium · case 01
A second endorsement double-charges the first change.
Mid-term endorsement pro-rata premium: Each endorsement is priced against the original premium · case 02
A second endorsement double-charges the first change.
Mid-term endorsement pro-rata premium: Each endorsement is priced against the original premium · case 03
A second endorsement double-charges the first change.
Mid-term endorsement pro-rata premium: Each endorsement is priced against the original premium · case 04
A second endorsement double-charges the first change.
Mid-term endorsement pro-rata premium: Each endorsement is priced against the original premium · case 05
A second endorsement double-charges the first change.
Mid-term endorsement pro-rata premium: Remaining days include the effective day twice · case 01
Additional premiums are one day too large.
Mid-term endorsement pro-rata premium: Remaining days include the effective day twice · case 02
Additional premiums are one day too large.
Mid-term endorsement pro-rata premium: Remaining days include the effective day twice · case 03
Additional premiums are one day too large.
Mid-term endorsement pro-rata premium: Remaining days include the effective day twice · case 04
Additional premiums are one day too large.
Mid-term endorsement pro-rata premium: Remaining days include the effective day twice · case 05
Additional premiums are one day too large.
Mid-term endorsement pro-rata premium: Endorsements effective on expiry are accepted · case 01
An endorsement dated on the expiration date returns zero instead of an error.
Mid-term endorsement pro-rata premium: Endorsements effective on expiry are accepted · case 02
An endorsement dated on the expiration date returns zero instead of an error.
Mid-term endorsement pro-rata premium: Endorsements effective on expiry are accepted · case 03
An endorsement dated on the expiration date returns zero instead of an error.
Mid-term endorsement pro-rata premium: Endorsements effective on expiry are accepted · case 04
An endorsement dated on the expiration date returns zero instead of an error.
Mid-term endorsement pro-rata premium: Endorsements effective on expiry are accepted · case 05
An endorsement dated on the expiration date returns zero instead of an error.
Mid-term endorsement pro-rata premium: Proration always uses 365 days · case 01
Short-term and leap-year policies are prorated on the wrong base.
Mid-term endorsement pro-rata premium: Proration always uses 365 days · case 02
Short-term and leap-year policies are prorated on the wrong base.
Mid-term endorsement pro-rata premium: Proration always uses 365 days · case 03
Short-term and leap-year policies are prorated on the wrong base.
Mid-term endorsement pro-rata premium: Proration always uses 365 days · case 04
Short-term and leap-year policies are prorated on the wrong base.
Mid-term endorsement pro-rata premium: Proration always uses 365 days · case 05
Short-term and leap-year policies are prorated on the wrong base.
Mid-term endorsement pro-rata premium: Out-of-order endorsements are accepted · case 01
Backdated endorsements are processed in the wrong order.
Mid-term endorsement pro-rata premium: Out-of-order endorsements are accepted · case 02
Backdated endorsements are processed in the wrong order.
Mid-term endorsement pro-rata premium: Out-of-order endorsements are accepted · case 03
Backdated endorsements are processed in the wrong order.
Mid-term endorsement pro-rata premium: Out-of-order endorsements are accepted · case 04
Backdated endorsements are processed in the wrong order.
Mid-term endorsement pro-rata premium: Out-of-order endorsements are accepted · case 05
Backdated endorsements are processed in the wrong order.
Renewal rate capping transition: Caps chain from the uncapped indication · case 01
Phase-in steps jump because the next cap is measured from the indicated premium.
Renewal rate capping transition: Caps chain from the uncapped indication · case 02
Phase-in steps jump because the next cap is measured from the indicated premium.
Renewal rate capping transition: Caps chain from the uncapped indication · case 03
Phase-in steps jump because the next cap is measured from the indicated premium.
Renewal rate capping transition: Caps chain from the uncapped indication · case 04
Phase-in steps jump because the next cap is measured from the indicated premium.
Renewal rate capping transition: Caps chain from the uncapped indication · case 05
Phase-in steps jump because the next cap is measured from the indicated premium.
Renewal rate capping transition: New business is capped against a zero prior · case 01
New business is charged zero premium.
Renewal rate capping transition: New business is capped against a zero prior · case 02
New business is charged zero premium.
Renewal rate capping transition: New business is capped against a zero prior · case 03
New business is charged zero premium.
Renewal rate capping transition: New business is capped against a zero prior · case 04
New business is charged zero premium.
Renewal rate capping transition: New business is capped against a zero prior · case 05
New business is charged zero premium.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗