Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Pending points hold period: redeemable balance · case 01
Members can redeem points that are still in the return window.
Pending points hold period: redeemable balance · case 02
Members can redeem points that are still in the return window.
Pending points hold period: redeemable balance · case 03
Members can redeem points that are still in the return window.
Pending points hold period: redeemable balance · case 04
Members can redeem points that are still in the return window.
Pending points hold period: redeemable balance · case 05
Members can redeem points that are still in the return window.
Pending points hold period: cancel versus clawback decision · case 01
Refunds late in the hold period are treated as clawbacks of posted points.
Pending points hold period: cancel versus clawback decision · case 02
Refunds late in the hold period are treated as clawbacks of posted points.
Pending points hold period: cancel versus clawback decision · case 03
Refunds late in the hold period are treated as clawbacks of posted points.
Pending points hold period: cancel versus clawback decision · case 04
Refunds late in the hold period are treated as clawbacks of posted points.
Pending points hold period: cancel versus clawback decision · case 05
Refunds late in the hold period are treated as clawbacks of posted points.
Member-to-member point transfers: fee rounding direction · case 01
Transfer fees come out a point short on amounts that do not divide evenly.
Member-to-member point transfers: fee rounding direction · case 02
Transfer fees come out a point short on amounts that do not divide evenly.
Member-to-member point transfers: fee rounding direction · case 03
Transfer fees come out a point short on amounts that do not divide evenly.
Member-to-member point transfers: fee rounding direction · case 04
Transfer fees come out a point short on amounts that do not divide evenly.
Member-to-member point transfers: fee rounding direction · case 05
Transfer fees come out a point short on amounts that do not divide evenly.
Member-to-member point transfers: fee payer · case 01
The recipient receives fewer points than were sent while the sender pays only the principal.
Member-to-member point transfers: fee payer · case 02
The recipient receives fewer points than were sent while the sender pays only the principal.
Member-to-member point transfers: fee payer · case 03
The recipient receives fewer points than were sent while the sender pays only the principal.
Member-to-member point transfers: fee payer · case 04
The recipient receives fewer points than were sent while the sender pays only the principal.
Member-to-member point transfers: fee payer · case 05
The recipient receives fewer points than were sent while the sender pays only the principal.
Member-to-member point transfers: sufficiency includes fee · case 01
Senders end with negative balances after transferring their whole balance.
Member-to-member point transfers: sufficiency includes fee · case 02
Senders end with negative balances after transferring their whole balance.
Member-to-member point transfers: sufficiency includes fee · case 03
Senders end with negative balances after transferring their whole balance.
Member-to-member point transfers: sufficiency includes fee · case 04
Senders end with negative balances after transferring their whole balance.
Member-to-member point transfers: sufficiency includes fee · case 05
Senders end with negative balances after transferring their whole balance.
Member-to-member point transfers: cap accounting of fees · case 01
Members hit the annual transfer cap early because fees are counted as transferred points.
Member-to-member point transfers: cap accounting of fees · case 02
Members hit the annual transfer cap early because fees are counted as transferred points.
Member-to-member point transfers: cap accounting of fees · case 03
Members hit the annual transfer cap early because fees are counted as transferred points.
Member-to-member point transfers: cap accounting of fees · case 04
Members hit the annual transfer cap early because fees are counted as transferred points.
Member-to-member point transfers: cap accounting of fees · case 05
Members hit the annual transfer cap early because fees are counted as transferred points.
Member-to-member point transfers: annual cap boundary · case 01
A transfer that brings the year total exactly to the cap is refused.
Member-to-member point transfers: annual cap boundary · case 02
A transfer that brings the year total exactly to the cap is refused.
Member-to-member point transfers: annual cap boundary · case 03
A transfer that brings the year total exactly to the cap is refused.
Member-to-member point transfers: annual cap boundary · case 04
A transfer that brings the year total exactly to the cap is refused.
Member-to-member point transfers: annual cap boundary · case 05
A transfer that brings the year total exactly to the cap is refused.
Promotion stacking rules: multiplier increment · case 01
A double-points promo awards triple points in total.
Promotion stacking rules: multiplier increment · case 02
A double-points promo awards triple points in total.
Promotion stacking rules: multiplier increment · case 03
A double-points promo awards triple points in total.
Promotion stacking rules: multiplier increment · case 04
A double-points promo awards triple points in total.
Promotion stacking rules: multiplier increment · case 05
A double-points promo awards triple points in total.
Promotion stacking rules: uncapped sentinel · case 01
Promotions with no cap award zero bonus points.
Promotion stacking rules: uncapped sentinel · case 02
Promotions with no cap award zero bonus points.
Promotion stacking rules: uncapped sentinel · case 03
Promotions with no cap award zero bonus points.
Promotion stacking rules: uncapped sentinel · case 04
Promotions with no cap award zero bonus points.
Promotion stacking rules: uncapped sentinel · case 05
Promotions with no cap award zero bonus points.
Promotion stacking rules: best non-stackable choice · case 01
The first listed non-stackable promo applies even when a richer one exists.
Promotion stacking rules: best non-stackable choice · case 02
The first listed non-stackable promo applies even when a richer one exists.
Promotion stacking rules: best non-stackable choice · case 03
The first listed non-stackable promo applies even when a richer one exists.
Promotion stacking rules: best non-stackable choice · case 04
The first listed non-stackable promo applies even when a richer one exists.
Promotion stacking rules: best non-stackable choice · case 05
The first listed non-stackable promo applies even when a richer one exists.
Promotion stacking rules: non-stackable tie-break · case 01
When two exclusive promos tie, the promo with the higher id is recorded as applied.
Promotion stacking rules: non-stackable tie-break · case 02
When two exclusive promos tie, the promo with the higher id is recorded as applied.
Promotion stacking rules: non-stackable tie-break · case 03
When two exclusive promos tie, the promo with the higher id is recorded as applied.
Promotion stacking rules: non-stackable tie-break · case 04
When two exclusive promos tie, the promo with the higher id is recorded as applied.
Promotion stacking rules: non-stackable tie-break · case 05
When two exclusive promos tie, the promo with the higher id is recorded as applied.
Promotion stacking rules: exclusive promo combination · case 01
Exclusive promotions are all applied together.
Promotion stacking rules: exclusive promo combination · case 02
Exclusive promotions are all applied together.
Promotion stacking rules: exclusive promo combination · case 03
Exclusive promotions are all applied together.
Promotion stacking rules: exclusive promo combination · case 04
Exclusive promotions are all applied together.
Promotion stacking rules: exclusive promo combination · case 05
Exclusive promotions are all applied together.
Account inactivity expiry: qualifying activity kinds · case 01
Goodwill bonus credits keep dormant accounts alive indefinitely.
Account inactivity expiry: qualifying activity kinds · case 02
Goodwill bonus credits keep dormant accounts alive indefinitely.
Account inactivity expiry: qualifying activity kinds · case 03
Goodwill bonus credits keep dormant accounts alive indefinitely.
Account inactivity expiry: qualifying activity kinds · case 04
Goodwill bonus credits keep dormant accounts alive indefinitely.
Account inactivity expiry: qualifying activity kinds · case 05
Goodwill bonus credits keep dormant accounts alive indefinitely.
Account inactivity expiry: latest qualifying day · case 01
Accounts with recent activity are expired because the clock runs from their first earn.
Account inactivity expiry: latest qualifying day · case 02
Accounts with recent activity are expired because the clock runs from their first earn.
Account inactivity expiry: latest qualifying day · case 03
Accounts with recent activity are expired because the clock runs from their first earn.
Account inactivity expiry: latest qualifying day · case 04
Accounts with recent activity are expired because the clock runs from their first earn.
Account inactivity expiry: latest qualifying day · case 05
Accounts with recent activity are expired because the clock runs from their first earn.
Account inactivity expiry: inactivity boundary · case 01
Points expire on the last day of the allowed inactivity window.
Account inactivity expiry: inactivity boundary · case 02
Points expire on the last day of the allowed inactivity window.
Account inactivity expiry: inactivity boundary · case 03
Points expire on the last day of the allowed inactivity window.
Account inactivity expiry: inactivity boundary · case 04
Points expire on the last day of the allowed inactivity window.
Account inactivity expiry: inactivity boundary · case 05
Points expire on the last day of the allowed inactivity window.
Account inactivity expiry: never-qualified reference · case 01
Accounts that never earned or redeemed keep their adjustment points forever.
Account inactivity expiry: never-qualified reference · case 02
Accounts that never earned or redeemed keep their adjustment points forever.
Account inactivity expiry: never-qualified reference · case 03
Accounts that never earned or redeemed keep their adjustment points forever.
Account inactivity expiry: never-qualified reference · case 04
Accounts that never earned or redeemed keep their adjustment points forever.
Account inactivity expiry: never-qualified reference · case 05
Accounts that never earned or redeemed keep their adjustment points forever.
Account inactivity expiry: negative balance expiry · case 01
Inactive accounts in debt report a negative expiry and have their debt wiped.
Account inactivity expiry: negative balance expiry · case 02
Inactive accounts in debt report a negative expiry and have their debt wiped.
Account inactivity expiry: negative balance expiry · case 03
Inactive accounts in debt report a negative expiry and have their debt wiped.
Account inactivity expiry: negative balance expiry · case 04
Inactive accounts in debt report a negative expiry and have their debt wiped.
Account inactivity expiry: negative balance expiry · case 05
Inactive accounts in debt report a negative expiry and have their debt wiped.
Account inactivity expiry: future-dated activity · case 01
A pre-scheduled future earn keeps an inactive account from expiring.
Account inactivity expiry: future-dated activity · case 02
A pre-scheduled future earn keeps an inactive account from expiring.
Account inactivity expiry: future-dated activity · case 03
A pre-scheduled future earn keeps an inactive account from expiring.
Account inactivity expiry: future-dated activity · case 04
A pre-scheduled future earn keeps an inactive account from expiring.
Account inactivity expiry: future-dated activity · case 05
A pre-scheduled future earn keeps an inactive account from expiring.
Breakage-based revenue recognition: expected redemption rate · case 01
Revenue is recognized far too fast because expected redemptions are computed from the breakage rate itself.
Breakage-based revenue recognition: expected redemption rate · case 02
Revenue is recognized far too fast because expected redemptions are computed from the breakage rate itself.
Breakage-based revenue recognition: expected redemption rate · case 03
Revenue is recognized far too fast because expected redemptions are computed from the breakage rate itself.
Breakage-based revenue recognition: expected redemption rate · case 04
Revenue is recognized far too fast because expected redemptions are computed from the breakage rate itself.
Breakage-based revenue recognition: expected redemption rate · case 05
Revenue is recognized far too fast because expected redemptions are computed from the breakage rate itself.
Breakage-based revenue recognition: recognition ceiling · case 01
Redemptions beyond the expected level recognize more revenue than was deferred and the liability turns negative.
Breakage-based revenue recognition: recognition ceiling · case 02
Redemptions beyond the expected level recognize more revenue than was deferred and the liability turns negative.
Breakage-based revenue recognition: recognition ceiling · case 03
Redemptions beyond the expected level recognize more revenue than was deferred and the liability turns negative.
Breakage-based revenue recognition: recognition ceiling · case 04
Redemptions beyond the expected level recognize more revenue than was deferred and the liability turns negative.
Breakage-based revenue recognition: recognition ceiling · case 05
Redemptions beyond the expected level recognize more revenue than was deferred and the liability turns negative.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗