Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Subscription schedule phases within a period: phase end from next start · case 01
Periods with a phase change are charged for both phases on the overlapping days.
Subscription schedule phases within a period: phase end from next start · case 02
Periods with a phase change are charged for both phases on the overlapping days.
Subscription schedule phases within a period: phase end from next start · case 03
Periods with a phase change are charged for both phases on the overlapping days.
Subscription schedule phases within a period: phase end from next start · case 04
Periods with a phase change are charged for both phases on the overlapping days.
Subscription schedule phases within a period: phase end from next start · case 05
Periods with a phase change are charged for both phases on the overlapping days.
Subscription schedule phases within a period: overlap start clip · case 01
Phases that started before the period charge for days in the previous period.
Subscription schedule phases within a period: overlap start clip · case 02
Phases that started before the period charge for days in the previous period.
Subscription schedule phases within a period: overlap start clip · case 03
Phases that started before the period charge for days in the previous period.
Subscription schedule phases within a period: overlap start clip · case 04
Phases that started before the period charge for days in the previous period.
Subscription schedule phases within a period: overlap start clip · case 05
Phases that started before the period charge for days in the previous period.
Subscription schedule phases within a period: phase ordering · case 01
Schedules entered out of order produce wrong phase boundaries.
Subscription schedule phases within a period: phase ordering · case 02
Schedules entered out of order produce wrong phase boundaries.
Subscription schedule phases within a period: phase ordering · case 03
Schedules entered out of order produce wrong phase boundaries.
Subscription schedule phases within a period: phase ordering · case 04
Schedules entered out of order produce wrong phase boundaries.
Subscription schedule phases within a period: phase ordering · case 05
Schedules entered out of order produce wrong phase boundaries.
Subscription schedule phases within a period: single final rounding · case 01
Multi-phase periods are a cent off the exact prorated total.
Subscription schedule phases within a period: single final rounding · case 02
Multi-phase periods are a cent off the exact prorated total.
Subscription schedule phases within a period: single final rounding · case 03
Multi-phase periods are a cent off the exact prorated total.
Subscription schedule phases within a period: single final rounding · case 04
Multi-phase periods are a cent off the exact prorated total.
Subscription schedule phases within a period: single final rounding · case 05
Multi-phase periods are a cent off the exact prorated total.
Current billing period containing a date: boundary date ownership · case 01
A change on a renewal date is prorated against the period that just ended.
Current billing period containing a date: boundary date ownership · case 02
A change on a renewal date is prorated against the period that just ended.
Current billing period containing a date: boundary date ownership · case 03
A change on a renewal date is prorated against the period that just ended.
Current billing period containing a date: boundary date ownership · case 04
A change on a renewal date is prorated against the period that just ended.
Current billing period containing a date: boundary date ownership · case 05
A change on a renewal date is prorated against the period that just ended.
Current billing period containing a date: yearly interval scaling · case 01
Yearly plans roll over monthly and monthly plans yearly.
Current billing period containing a date: yearly interval scaling · case 02
Yearly plans roll over monthly and monthly plans yearly.
Current billing period containing a date: yearly interval scaling · case 03
Yearly plans roll over monthly and monthly plans yearly.
Current billing period containing a date: yearly interval scaling · case 04
Yearly plans roll over monthly and monthly plans yearly.
Current billing period containing a date: yearly interval scaling · case 05
Yearly plans roll over monthly and monthly plans yearly.
Current billing period containing a date: weekly count multiplier · case 01
Biweekly plans are treated as weekly.
Current billing period containing a date: weekly count multiplier · case 02
Biweekly plans are treated as weekly.
Current billing period containing a date: weekly count multiplier · case 03
Biweekly plans are treated as weekly.
Current billing period containing a date: weekly count multiplier · case 04
Biweekly plans are treated as weekly.
Current billing period containing a date: weekly count multiplier · case 05
Biweekly plans are treated as weekly.
Metered usage split at a mid-period price change: change day ownership · case 01
Usage recorded on the change day is billed at both prices.
Metered usage split at a mid-period price change: change day ownership · case 02
Usage recorded on the change day is billed at both prices.
Metered usage split at a mid-period price change: change day ownership · case 03
Usage recorded on the change day is billed at both prices.
Metered usage split at a mid-period price change: change day ownership · case 04
Usage recorded on the change day is billed at both prices.
Metered usage split at a mid-period price change: change day ownership · case 05
Usage recorded on the change day is billed at both prices.
Metered usage split at a mid-period price change: chronological order for last · case 01
Last-value meters report whichever event arrived last rather than the latest reading.
Metered usage split at a mid-period price change: chronological order for last · case 02
Last-value meters report whichever event arrived last rather than the latest reading.
Metered usage split at a mid-period price change: chronological order for last · case 03
Last-value meters report whichever event arrived last rather than the latest reading.
Metered usage split at a mid-period price change: chronological order for last · case 04
Last-value meters report whichever event arrived last rather than the latest reading.
Metered usage split at a mid-period price change: chronological order for last · case 05
Last-value meters report whichever event arrived last rather than the latest reading.
Metered usage split at a mid-period price change: segment max scope · case 01
Peak meters bill the whole-period peak in both segments.
Metered usage split at a mid-period price change: segment max scope · case 02
Peak meters bill the whole-period peak in both segments.
Metered usage split at a mid-period price change: segment max scope · case 03
Peak meters bill the whole-period peak in both segments.
Metered usage split at a mid-period price change: segment max scope · case 04
Peak meters bill the whole-period peak in both segments.
Metered usage split at a mid-period price change: segment max scope · case 05
Peak meters bill the whole-period peak in both segments.
Metered usage split at a mid-period price change: segment pricing · case 01
Usage before an upgrade is billed at the new price.
Metered usage split at a mid-period price change: segment pricing · case 02
Usage before an upgrade is billed at the new price.
Metered usage split at a mid-period price change: segment pricing · case 03
Usage before an upgrade is billed at the new price.
Metered usage split at a mid-period price change: segment pricing · case 04
Usage before an upgrade is billed at the new price.
Metered usage split at a mid-period price change: segment pricing · case 05
Usage before an upgrade is billed at the new price.
Expiring credit grants applied to invoices: expiry boundary · case 01
Credits are consumed on their expiry day.
Expiring credit grants applied to invoices: expiry boundary · case 02
Credits are consumed on their expiry day.
Expiring credit grants applied to invoices: expiry boundary · case 03
Credits are consumed on their expiry day.
Expiring credit grants applied to invoices: expiry boundary · case 04
Credits are consumed on their expiry day.
Expiring credit grants applied to invoices: expiry boundary · case 05
Credits are consumed on their expiry day.
Expiring credit grants applied to invoices: consumption order · case 01
Long-lived credits are consumed while short-lived ones expire unused.
Expiring credit grants applied to invoices: consumption order · case 02
Long-lived credits are consumed while short-lived ones expire unused.
Expiring credit grants applied to invoices: consumption order · case 03
Long-lived credits are consumed while short-lived ones expire unused.
Expiring credit grants applied to invoices: consumption order · case 04
Long-lived credits are consumed while short-lived ones expire unused.
Expiring credit grants applied to invoices: consumption order · case 05
Long-lived credits are consumed while short-lived ones expire unused.
Expiring credit grants applied to invoices: partial grant remainder · case 01
Partially used credits reappear at full value.
Expiring credit grants applied to invoices: partial grant remainder · case 02
Partially used credits reappear at full value.
Expiring credit grants applied to invoices: partial grant remainder · case 03
Partially used credits reappear at full value.
Expiring credit grants applied to invoices: partial grant remainder · case 04
Partially used credits reappear at full value.
Expiring credit grants applied to invoices: partial grant remainder · case 05
Partially used credits reappear at full value.
Expiring credit grants applied to invoices: future grants excluded · case 01
Credits scheduled for next month pay this month's invoice.
Expiring credit grants applied to invoices: future grants excluded · case 02
Credits scheduled for next month pay this month's invoice.
Expiring credit grants applied to invoices: future grants excluded · case 03
Credits scheduled for next month pay this month's invoice.
Expiring credit grants applied to invoices: future grants excluded · case 04
Credits scheduled for next month pay this month's invoice.
Expiring credit grants applied to invoices: future grants excluded · case 05
Credits scheduled for next month pay this month's invoice.
Ratable monthly schedule of a prepaid term: cumulative remainder allocation · case 01
Monthly schedule parts do not add up to the invoiced amount.
Ratable monthly schedule of a prepaid term: cumulative remainder allocation · case 02
Monthly schedule parts do not add up to the invoiced amount.
Ratable monthly schedule of a prepaid term: cumulative remainder allocation · case 03
Monthly schedule parts do not add up to the invoiced amount.
Ratable monthly schedule of a prepaid term: cumulative remainder allocation · case 04
Monthly schedule parts do not add up to the invoiced amount.
Ratable monthly schedule of a prepaid term: cumulative remainder allocation · case 05
Monthly schedule parts do not add up to the invoiced amount.
Proration behavior modes and pending items: pending sweep on immediate invoice · case 01
Pending proration items vanish when a later change is invoiced immediately.
Proration behavior modes and pending items: pending sweep on immediate invoice · case 02
Pending proration items vanish when a later change is invoiced immediately.
Proration behavior modes and pending items: pending sweep on immediate invoice · case 03
Pending proration items vanish when a later change is invoiced immediately.
Proration behavior modes and pending items: pending sweep on immediate invoice · case 04
Pending proration items vanish when a later change is invoiced immediately.
Proration behavior modes and pending items: pending sweep on immediate invoice · case 05
Pending proration items vanish when a later change is invoiced immediately.
Proration behavior modes and pending items: none keeps pending · case 01
Changes made without prorations erase previously pending items.
Proration behavior modes and pending items: none keeps pending · case 02
Changes made without prorations erase previously pending items.
Proration behavior modes and pending items: none keeps pending · case 03
Changes made without prorations erase previously pending items.
Proration behavior modes and pending items: none keeps pending · case 04
Changes made without prorations erase previously pending items.
Proration behavior modes and pending items: none keeps pending · case 05
Changes made without prorations erase previously pending items.
Proration behavior modes and pending items: create defers to renewal · case 01
Default prorations are charged immediately instead of on the next renewal invoice.
Proration behavior modes and pending items: create defers to renewal · case 02
Default prorations are charged immediately instead of on the next renewal invoice.
Proration behavior modes and pending items: create defers to renewal · case 03
Default prorations are charged immediately instead of on the next renewal invoice.
Proration behavior modes and pending items: create defers to renewal · case 04
Default prorations are charged immediately instead of on the next renewal invoice.
Proration behavior modes and pending items: create defers to renewal · case 05
Default prorations are charged immediately instead of on the next renewal invoice.
Renewal price with lock and increase cap: lock expiry day · case 01
Renewals on the lock expiry day lose the locked price.
Renewal price with lock and increase cap: lock expiry day · case 02
Renewals on the lock expiry day lose the locked price.
Renewal price with lock and increase cap: lock expiry day · case 03
Renewals on the lock expiry day lose the locked price.
Renewal price with lock and increase cap: lock expiry day · case 04
Renewals on the lock expiry day lose the locked price.
Renewal price with lock and increase cap: lock expiry day · case 05
Renewals on the lock expiry day lose the locked price.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗