Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Birthday bonus window: neighbouring birthday years · case 01
Purchases in late December miss an early-January birthday window.
Birthday bonus window: neighbouring birthday years · case 02
Purchases in late December miss an early-January birthday window.
Birthday bonus window: neighbouring birthday years · case 03
Purchases in late December miss an early-January birthday window.
Birthday bonus window: neighbouring birthday years · case 04
Purchases in late December miss an early-January birthday window.
Birthday bonus window: neighbouring birthday years · case 05
Purchases in late December miss an early-January birthday window.
Birthday bonus window: once-per-year key · case 01
A member receives two bonuses for one birthday when purchases straddle New Year.
Birthday bonus window: once-per-year key · case 02
A member receives two bonuses for one birthday when purchases straddle New Year.
Birthday bonus window: once-per-year key · case 03
A member receives two bonuses for one birthday when purchases straddle New Year.
Birthday bonus window: once-per-year key · case 04
A member receives two bonuses for one birthday when purchases straddle New Year.
Birthday bonus window: once-per-year key · case 05
A member receives two bonuses for one birthday when purchases straddle New Year.
Birthday bonus window: distance symmetry · case 01
Purchases weeks before a birthday qualify for the bonus.
Birthday bonus window: distance symmetry · case 02
Purchases weeks before a birthday qualify for the bonus.
Birthday bonus window: distance symmetry · case 03
Purchases weeks before a birthday qualify for the bonus.
Birthday bonus window: distance symmetry · case 04
Purchases weeks before a birthday qualify for the bonus.
Birthday bonus window: distance symmetry · case 05
Purchases weeks before a birthday qualify for the bonus.
Monthly promotional bonus cap: cap period key · case 01
The monthly cap behaves like an annual cap and later months award no bonus.
Monthly promotional bonus cap: cap period key · case 02
The monthly cap behaves like an annual cap and later months award no bonus.
Monthly promotional bonus cap: cap period key · case 03
The monthly cap behaves like an annual cap and later months award no bonus.
Monthly promotional bonus cap: cap period key · case 04
The monthly cap behaves like an annual cap and later months award no bonus.
Monthly promotional bonus cap: cap period key · case 05
The monthly cap behaves like an annual cap and later months award no bonus.
Monthly promotional bonus cap: partial bonus near cap · case 01
A transaction that would exceed the cap gets no bonus at all instead of the remaining allowance.
Monthly promotional bonus cap: partial bonus near cap · case 02
A transaction that would exceed the cap gets no bonus at all instead of the remaining allowance.
Monthly promotional bonus cap: partial bonus near cap · case 03
A transaction that would exceed the cap gets no bonus at all instead of the remaining allowance.
Monthly promotional bonus cap: partial bonus near cap · case 04
A transaction that would exceed the cap gets no bonus at all instead of the remaining allowance.
Monthly promotional bonus cap: partial bonus near cap · case 05
A transaction that would exceed the cap gets no bonus at all instead of the remaining allowance.
Monthly promotional bonus cap: base points consume cap · case 01
Large purchases exhaust the bonus cap with base points.
Monthly promotional bonus cap: base points consume cap · case 02
Large purchases exhaust the bonus cap with base points.
Monthly promotional bonus cap: base points consume cap · case 03
Large purchases exhaust the bonus cap with base points.
Monthly promotional bonus cap: base points consume cap · case 04
Large purchases exhaust the bonus cap with base points.
Monthly promotional bonus cap: base points consume cap · case 05
Large purchases exhaust the bonus cap with base points.
Monthly promotional bonus cap: exempt bonus and cap · case 01
Exempt promotional bonus uses up the monthly cap.
Monthly promotional bonus cap: exempt bonus and cap · case 02
Exempt promotional bonus uses up the monthly cap.
Monthly promotional bonus cap: exempt bonus and cap · case 03
Exempt promotional bonus uses up the monthly cap.
Monthly promotional bonus cap: exempt bonus and cap · case 04
Exempt promotional bonus uses up the monthly cap.
Monthly promotional bonus cap: exempt bonus and cap · case 05
Exempt promotional bonus uses up the monthly cap.
Monthly promotional bonus cap: exempt bonus award · case 01
Exempt promotional bonus never reaches the member.
Monthly promotional bonus cap: exempt bonus award · case 02
Exempt promotional bonus never reaches the member.
Monthly promotional bonus cap: exempt bonus award · case 03
Exempt promotional bonus never reaches the member.
Monthly promotional bonus cap: exempt bonus award · case 04
Exempt promotional bonus never reaches the member.
Monthly promotional bonus cap: exempt bonus award · case 05
Exempt promotional bonus never reaches the member.
Tier multiplier in force at transaction time: historical tier lookup · case 01
Transactions made before an upgrade are re-earned at the new, higher multiplier.
Tier multiplier in force at transaction time: historical tier lookup · case 02
Transactions made before an upgrade are re-earned at the new, higher multiplier.
Tier multiplier in force at transaction time: historical tier lookup · case 03
Transactions made before an upgrade are re-earned at the new, higher multiplier.
Tier multiplier in force at transaction time: historical tier lookup · case 04
Transactions made before an upgrade are re-earned at the new, higher multiplier.
Tier multiplier in force at transaction time: historical tier lookup · case 05
Transactions made before an upgrade are re-earned at the new, higher multiplier.
Tier multiplier in force at transaction time: effective day boundary · case 01
Transactions on the day a tier takes effect earn at the old tier.
Tier multiplier in force at transaction time: effective day boundary · case 02
Transactions on the day a tier takes effect earn at the old tier.
Tier multiplier in force at transaction time: effective day boundary · case 03
Transactions on the day a tier takes effect earn at the old tier.
Tier multiplier in force at transaction time: effective day boundary · case 04
Transactions on the day a tier takes effect earn at the old tier.
Tier multiplier in force at transaction time: effective day boundary · case 05
Transactions on the day a tier takes effect earn at the old tier.
Tier multiplier in force at transaction time: history ordering · case 01
An out-of-order tier history makes later transactions use an older tier.
Tier multiplier in force at transaction time: history ordering · case 02
An out-of-order tier history makes later transactions use an older tier.
Tier multiplier in force at transaction time: history ordering · case 03
An out-of-order tier history makes later transactions use an older tier.
Tier multiplier in force at transaction time: history ordering · case 04
An out-of-order tier history makes later transactions use an older tier.
Tier multiplier in force at transaction time: history ordering · case 05
An out-of-order tier history makes later transactions use an older tier.
Tier multiplier in force at transaction time: unknown tier multiplier · case 01
Members on a retired tier name earn zero points.
Tier multiplier in force at transaction time: unknown tier multiplier · case 02
Members on a retired tier name earn zero points.
Tier multiplier in force at transaction time: unknown tier multiplier · case 03
Members on a retired tier name earn zero points.
Tier multiplier in force at transaction time: unknown tier multiplier · case 04
Members on a retired tier name earn zero points.
Tier multiplier in force at transaction time: unknown tier multiplier · case 05
Members on a retired tier name earn zero points.
Points plus cash split: maximum points rounding · case 01
Cash due falls below the minimum cash component by a fraction of a point.
Points plus cash split: maximum points rounding · case 02
Cash due falls below the minimum cash component by a fraction of a point.
Points plus cash split: maximum points rounding · case 03
Cash due falls below the minimum cash component by a fraction of a point.
Points plus cash split: maximum points rounding · case 04
Cash due falls below the minimum cash component by a fraction of a point.
Points plus cash split: maximum points rounding · case 05
Cash due falls below the minimum cash component by a fraction of a point.
Points plus cash split: minimum cash reservation · case 01
Awards are fully paid with points although a cash co-pay is required.
Points plus cash split: minimum cash reservation · case 02
Awards are fully paid with points although a cash co-pay is required.
Points plus cash split: minimum cash reservation · case 03
Awards are fully paid with points although a cash co-pay is required.
Points plus cash split: minimum cash reservation · case 04
Awards are fully paid with points although a cash co-pay is required.
Points plus cash split: minimum cash reservation · case 05
Awards are fully paid with points although a cash co-pay is required.
Points plus cash split: tenths-of-cent scaling · case 01
Only a tenth of the allowed points are applied.
Points plus cash split: tenths-of-cent scaling · case 02
Only a tenth of the allowed points are applied.
Points plus cash split: tenths-of-cent scaling · case 03
Only a tenth of the allowed points are applied.
Points plus cash split: tenths-of-cent scaling · case 04
Only a tenth of the allowed points are applied.
Points plus cash split: tenths-of-cent scaling · case 05
Only a tenth of the allowed points are applied.
Points plus cash split: balance limit · case 01
Members are charged more points than they hold.
Points plus cash split: balance limit · case 02
Members are charged more points than they hold.
Points plus cash split: balance limit · case 03
Members are charged more points than they hold.
Points plus cash split: balance limit · case 04
Members are charged more points than they hold.
Points plus cash split: balance limit · case 05
Members are charged more points than they hold.
Points plus cash split: negative room guard · case 01
When the price is below the minimum cash the member is credited points and charged more than the price.
Points plus cash split: negative room guard · case 02
When the price is below the minimum cash the member is credited points and charged more than the price.
Points plus cash split: negative room guard · case 03
When the price is below the minimum cash the member is credited points and charged more than the price.
Points plus cash split: negative room guard · case 04
When the price is below the minimum cash the member is credited points and charged more than the price.
Points plus cash split: negative room guard · case 05
When the price is below the minimum cash the member is credited points and charged more than the price.
Purchased points with volume bonus: purchase unit flooring · case 01
Members are sold fractional thousands of points at a pro-rated price.
Purchased points with volume bonus: purchase unit flooring · case 02
Members are sold fractional thousands of points at a pro-rated price.
Purchased points with volume bonus: purchase unit flooring · case 03
Members are sold fractional thousands of points at a pro-rated price.
Purchased points with volume bonus: purchase unit flooring · case 04
Members are sold fractional thousands of points at a pro-rated price.
Purchased points with volume bonus: purchase unit flooring · case 05
Members are sold fractional thousands of points at a pro-rated price.
Purchased points with volume bonus: tier basis per request · case 01
Members who bought earlier in the year get the top bonus tier on a small purchase.
Purchased points with volume bonus: tier basis per request · case 02
Members who bought earlier in the year get the top bonus tier on a small purchase.
Purchased points with volume bonus: tier basis per request · case 03
Members who bought earlier in the year get the top bonus tier on a small purchase.
Purchased points with volume bonus: tier basis per request · case 04
Members who bought earlier in the year get the top bonus tier on a small purchase.
Purchased points with volume bonus: tier basis per request · case 05
Members who bought earlier in the year get the top bonus tier on a small purchase.
Purchased points with volume bonus: tier minimum boundary · case 01
Buying exactly the tier minimum does not earn that tier bonus.
Purchased points with volume bonus: tier minimum boundary · case 02
Buying exactly the tier minimum does not earn that tier bonus.
Purchased points with volume bonus: tier minimum boundary · case 03
Buying exactly the tier minimum does not earn that tier bonus.
Purchased points with volume bonus: tier minimum boundary · case 04
Buying exactly the tier minimum does not earn that tier bonus.
Purchased points with volume bonus: tier minimum boundary · case 05
Buying exactly the tier minimum does not earn that tier bonus.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗