Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Foreign currency period-end revaluation: bid and ask selection · case 01
Foreign payables are understated at period end.
Foreign currency period-end revaluation: bid and ask selection · case 02
Foreign payables are understated at period end.
Foreign currency period-end revaluation: bid and ask selection · case 03
Foreign payables are understated at period end.
Foreign currency period-end revaluation: bid and ask selection · case 04
Foreign payables are understated at period end.
Foreign currency period-end revaluation: bid and ask selection · case 05
Foreign payables are understated at period end.
Auto-reversing accruals: reversal date · case 01
Accruals cancel themselves inside the period they were meant to accrue.
Auto-reversing accruals: reversal date · case 02
Accruals cancel themselves inside the period they were meant to accrue.
Auto-reversing accruals: reversal date · case 03
Accruals cancel themselves inside the period they were meant to accrue.
Auto-reversing accruals: reversal date · case 04
Accruals cancel themselves inside the period they were meant to accrue.
Auto-reversing accruals: reversal date · case 05
Accruals cancel themselves inside the period they were meant to accrue.
Auto-reversing accruals: reversal sign · case 01
Reversal entries double the accrual instead of cancelling it.
Auto-reversing accruals: reversal sign · case 02
Reversal entries double the accrual instead of cancelling it.
Auto-reversing accruals: reversal sign · case 03
Reversal entries double the accrual instead of cancelling it.
Auto-reversing accruals: reversal sign · case 04
Reversal entries double the accrual instead of cancelling it.
Auto-reversing accruals: reversal sign · case 05
Reversal entries double the accrual instead of cancelling it.
Auto-reversing accruals: reversible kind filter · case 01
Ordinary cash postings are reversed at period start.
Auto-reversing accruals: reversible kind filter · case 02
Ordinary cash postings are reversed at period start.
Auto-reversing accruals: reversible kind filter · case 03
Ordinary cash postings are reversed at period start.
Auto-reversing accruals: reversible kind filter · case 04
Ordinary cash postings are reversed at period start.
Auto-reversing accruals: reversible kind filter · case 05
Ordinary cash postings are reversed at period start.
Auto-reversing accruals: accrual period cutoff · case 01
Accruals booked on the last day of the period are never reversed.
Auto-reversing accruals: accrual period cutoff · case 02
Accruals booked on the last day of the period are never reversed.
Auto-reversing accruals: accrual period cutoff · case 03
Accruals booked on the last day of the period are never reversed.
Auto-reversing accruals: accrual period cutoff · case 04
Accruals booked on the last day of the period are never reversed.
Auto-reversing accruals: accrual period cutoff · case 05
Accruals booked on the last day of the period are never reversed.
Auto-reversing accruals: as-of inclusivity · case 01
Balances as of a date omit entries dated that day.
Auto-reversing accruals: as-of inclusivity · case 02
Balances as of a date omit entries dated that day.
Auto-reversing accruals: as-of inclusivity · case 03
Balances as of a date omit entries dated that day.
Auto-reversing accruals: as-of inclusivity · case 04
Balances as of a date omit entries dated that day.
Auto-reversing accruals: as-of inclusivity · case 05
Balances as of a date omit entries dated that day.
Auto-reversing accruals: zero balance accounts · case 01
Accounts whose accrual was reversed vanish from the balance list.
Auto-reversing accruals: zero balance accounts · case 02
Accounts whose accrual was reversed vanish from the balance list.
Auto-reversing accruals: zero balance accounts · case 03
Accounts whose accrual was reversed vanish from the balance list.
Auto-reversing accruals: zero balance accounts · case 04
Accounts whose accrual was reversed vanish from the balance list.
Auto-reversing accruals: zero balance accounts · case 05
Accounts whose accrual was reversed vanish from the balance list.
Posting period lock: period end inclusivity · case 01
Entries dated on the last day of a period are reported as outside any period.
Posting period lock: period end inclusivity · case 02
Entries dated on the last day of a period are reported as outside any period.
Posting period lock: period end inclusivity · case 03
Entries dated on the last day of a period are reported as outside any period.
Posting period lock: period end inclusivity · case 04
Entries dated on the last day of a period are reported as outside any period.
Posting period lock: period end inclusivity · case 05
Entries dated on the last day of a period are reported as outside any period.
Posting period lock: soft close adjusting gate · case 01
Routine entries post into a soft-closed period.
Posting period lock: soft close adjusting gate · case 02
Routine entries post into a soft-closed period.
Posting period lock: soft close adjusting gate · case 03
Routine entries post into a soft-closed period.
Posting period lock: soft close adjusting gate · case 04
Routine entries post into a soft-closed period.
Posting period lock: soft close adjusting gate · case 05
Routine entries post into a soft-closed period.
Posting period lock: roll target status · case 01
Rolled entries land in a soft-closed period.
Posting period lock: roll target status · case 02
Rolled entries land in a soft-closed period.
Posting period lock: roll target status · case 03
Rolled entries land in a soft-closed period.
Posting period lock: roll target status · case 04
Rolled entries land in a soft-closed period.
Posting period lock: roll target status · case 05
Rolled entries land in a soft-closed period.
Posting period lock: roll target choice · case 01
Rolled entries skip ahead to the last open period of the year.
Posting period lock: roll target choice · case 02
Rolled entries skip ahead to the last open period of the year.
Posting period lock: roll target choice · case 03
Rolled entries skip ahead to the last open period of the year.
Posting period lock: roll target choice · case 04
Rolled entries skip ahead to the last open period of the year.
Posting period lock: roll target choice · case 05
Rolled entries skip ahead to the last open period of the year.
Posting period lock: period ordering · case 01
Roll-forward destinations depend on the order periods were configured.
Posting period lock: period ordering · case 02
Roll-forward destinations depend on the order periods were configured.
Posting period lock: period ordering · case 03
Roll-forward destinations depend on the order periods were configured.
Posting period lock: period ordering · case 04
Roll-forward destinations depend on the order periods were configured.
Posting period lock: period ordering · case 05
Roll-forward destinations depend on the order periods were configured.
Account running balance report: credit-normal sign map · case 01
A liability ledger shows credits as decreases in the running balance.
Account running balance report: credit-normal sign map · case 02
A liability ledger shows credits as decreases in the running balance.
Account running balance report: credit-normal sign map · case 03
A liability ledger shows credits as decreases in the running balance.
Account running balance report: credit-normal sign map · case 04
A liability ledger shows credits as decreases in the running balance.
Account running balance report: credit-normal sign map · case 05
A liability ledger shows credits as decreases in the running balance.
Account running balance report: line ordering key · case 01
Back-dated entries appear at the end of the ledger with wrong running balances.
Account running balance report: line ordering key · case 02
Back-dated entries appear at the end of the ledger with wrong running balances.
Account running balance report: line ordering key · case 03
Back-dated entries appear at the end of the ledger with wrong running balances.
Account running balance report: line ordering key · case 04
Back-dated entries appear at the end of the ledger with wrong running balances.
Account running balance report: line ordering key · case 05
Back-dated entries appear at the end of the ledger with wrong running balances.
Account running balance report: report opening cutoff · case 01
Lines dated on the first report day are counted in the opening and again in the rows.
Account running balance report: report opening cutoff · case 02
Lines dated on the first report day are counted in the opening and again in the rows.
Account running balance report: report opening cutoff · case 03
Lines dated on the first report day are counted in the opening and again in the rows.
Account running balance report: report opening cutoff · case 04
Lines dated on the first report day are counted in the opening and again in the rows.
Account running balance report: report opening cutoff · case 05
Lines dated on the first report day are counted in the opening and again in the rows.
Account running balance report: report end inclusivity · case 01
Entries dated on the report end day are missing from the report.
Account running balance report: report end inclusivity · case 02
Entries dated on the report end day are missing from the report.
Account running balance report: report end inclusivity · case 03
Entries dated on the report end day are missing from the report.
Account running balance report: report end inclusivity · case 04
Entries dated on the report end day are missing from the report.
Account running balance report: report end inclusivity · case 05
Entries dated on the report end day are missing from the report.
Account running balance report: running balance seed · case 01
Running balances in the report start from zero.
Account running balance report: running balance seed · case 02
Running balances in the report start from zero.
Account running balance report: running balance seed · case 03
Running balances in the report start from zero.
Account running balance report: running balance seed · case 04
Running balances in the report start from zero.
Account running balance report: running balance seed · case 05
Running balances in the report start from zero.
FIFO perpetual inventory journal: consumption order · case 01
Cost of goods sold uses the newest purchase prices.
FIFO perpetual inventory journal: consumption order · case 02
Cost of goods sold uses the newest purchase prices.
FIFO perpetual inventory journal: consumption order · case 03
Cost of goods sold uses the newest purchase prices.
FIFO perpetual inventory journal: consumption order · case 04
Cost of goods sold uses the newest purchase prices.
FIFO perpetual inventory journal: consumption order · case 05
Cost of goods sold uses the newest purchase prices.
FIFO perpetual inventory journal: layer merge target · case 01
New purchases jump the FIFO queue when their cost matches the oldest layer.
FIFO perpetual inventory journal: layer merge target · case 02
New purchases jump the FIFO queue when their cost matches the oldest layer.
FIFO perpetual inventory journal: layer merge target · case 03
New purchases jump the FIFO queue when their cost matches the oldest layer.
FIFO perpetual inventory journal: layer merge target · case 04
New purchases jump the FIFO queue when their cost matches the oldest layer.
FIFO perpetual inventory journal: layer merge target · case 05
New purchases jump the FIFO queue when their cost matches the oldest layer.
FIFO perpetual inventory journal: oversell check · case 01
Sales that span two cost layers are rejected as stock-outs.
FIFO perpetual inventory journal: oversell check · case 02
Sales that span two cost layers are rejected as stock-outs.
FIFO perpetual inventory journal: oversell check · case 03
Sales that span two cost layers are rejected as stock-outs.
FIFO perpetual inventory journal: oversell check · case 04
Sales that span two cost layers are rejected as stock-outs.
FIFO perpetual inventory journal: oversell check · case 05
Sales that span two cost layers are rejected as stock-outs.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗