Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
W-4 step adjustment withholding: extra withholding after floor · case 01
Employees whose credits exceed tentative withholding lose some or all of their requested extra withholding.
W-4 step adjustment withholding: extra withholding after floor · case 02
Employees whose credits exceed tentative withholding lose some or all of their requested extra withholding.
W-4 step adjustment withholding: extra withholding after floor · case 03
Employees whose credits exceed tentative withholding lose some or all of their requested extra withholding.
W-4 step adjustment withholding: extra withholding after floor · case 04
Employees whose credits exceed tentative withholding lose some or all of their requested extra withholding.
W-4 step adjustment withholding: extra withholding after floor · case 05
Employees whose credits exceed tentative withholding lose some or all of their requested extra withholding.
W-4 step adjustment withholding: credit de-annualization · case 01
Any employee claiming dependents has withholding wiped out entirely each paycheck.
W-4 step adjustment withholding: credit de-annualization · case 02
Any employee claiming dependents has withholding wiped out entirely each paycheck.
W-4 step adjustment withholding: credit de-annualization · case 03
Any employee claiming dependents has withholding wiped out entirely each paycheck.
W-4 step adjustment withholding: credit de-annualization · case 04
Any employee claiming dependents has withholding wiped out entirely each paycheck.
W-4 step adjustment withholding: credit de-annualization · case 05
Any employee claiming dependents has withholding wiped out entirely each paycheck.
W-4 step adjustment withholding: other income annualization · case 01
Employees reporting other income are withheld as if that income recurred every paycheck.
W-4 step adjustment withholding: other income annualization · case 02
Employees reporting other income are withheld as if that income recurred every paycheck.
W-4 step adjustment withholding: other income annualization · case 03
Employees reporting other income are withheld as if that income recurred every paycheck.
W-4 step adjustment withholding: other income annualization · case 04
Employees reporting other income are withheld as if that income recurred every paycheck.
W-4 step adjustment withholding: other income annualization · case 05
Employees reporting other income are withheld as if that income recurred every paycheck.
W-4 step adjustment withholding: step 2 deduction scope · case 01
Multiple-job employees who also itemize are over-withheld because half their itemized deductions vanish.
W-4 step adjustment withholding: step 2 deduction scope · case 02
Multiple-job employees who also itemize are over-withheld because half their itemized deductions vanish.
W-4 step adjustment withholding: step 2 deduction scope · case 03
Multiple-job employees who also itemize are over-withheld because half their itemized deductions vanish.
W-4 step adjustment withholding: step 2 deduction scope · case 04
Multiple-job employees who also itemize are over-withheld because half their itemized deductions vanish.
W-4 step adjustment withholding: step 2 deduction scope · case 05
Multiple-job employees who also itemize are over-withheld because half their itemized deductions vanish.
W-4 step adjustment withholding: step 2 bracket scaling · case 01
Married and head-of-household employees who check step 2 are under-withheld.
W-4 step adjustment withholding: step 2 bracket scaling · case 02
Married and head-of-household employees who check step 2 are under-withheld.
W-4 step adjustment withholding: step 2 bracket scaling · case 03
Married and head-of-household employees who check step 2 are under-withheld.
W-4 step adjustment withholding: step 2 bracket scaling · case 04
Married and head-of-household employees who check step 2 are under-withheld.
W-4 step adjustment withholding: step 2 bracket scaling · case 05
Married and head-of-household employees who check step 2 are under-withheld.
Supplemental flat-rate withholding tiers: mandatory tier split · case 01
A bonus that crosses the 1M mark is counted twice, once in each tier, over-withholding heavily.
Supplemental flat-rate withholding tiers: mandatory tier split · case 02
A bonus that crosses the 1M mark is counted twice, once in each tier, over-withholding heavily.
Supplemental flat-rate withholding tiers: mandatory tier split · case 03
A bonus that crosses the 1M mark is counted twice, once in each tier, over-withholding heavily.
Supplemental flat-rate withholding tiers: mandatory tier split · case 04
A bonus that crosses the 1M mark is counted twice, once in each tier, over-withholding heavily.
Supplemental flat-rate withholding tiers: mandatory tier split · case 05
A bonus that crosses the 1M mark is counted twice, once in each tier, over-withholding heavily.
Supplemental flat-rate withholding tiers: tier rounding stage · case 01
Crossing bonuses are withheld one cent more than the contract amount.
Supplemental flat-rate withholding tiers: tier rounding stage · case 02
Crossing bonuses are withheld one cent more than the contract amount.
Supplemental flat-rate withholding tiers: tier rounding stage · case 03
Crossing bonuses are withheld one cent more than the contract amount.
Supplemental flat-rate withholding tiers: tier rounding stage · case 04
Crossing bonuses are withheld one cent more than the contract amount.
Supplemental flat-rate withholding tiers: tier rounding stage · case 05
Crossing bonuses are withheld one cent more than the contract amount.
Supplemental flat-rate withholding tiers: year-to-date inclusion · case 01
Bonuses approaching the million-dollar mark move to the 37% tier too early.
Supplemental flat-rate withholding tiers: year-to-date inclusion · case 02
Bonuses approaching the million-dollar mark move to the 37% tier too early.
Supplemental flat-rate withholding tiers: year-to-date inclusion · case 03
Bonuses approaching the million-dollar mark move to the 37% tier too early.
Supplemental flat-rate withholding tiers: year-to-date inclusion · case 04
Bonuses approaching the million-dollar mark move to the 37% tier too early.
Supplemental flat-rate withholding tiers: year-to-date inclusion · case 05
Bonuses approaching the million-dollar mark move to the 37% tier too early.
Wage garnishment limits with support priority: disposable earnings basis · case 01
Employees with voluntary benefit deductions have smaller garnishments than the orders permit.
Wage garnishment limits with support priority: disposable earnings basis · case 02
Employees with voluntary benefit deductions have smaller garnishments than the orders permit.
Wage garnishment limits with support priority: disposable earnings basis · case 03
Employees with voluntary benefit deductions have smaller garnishments than the orders permit.
Wage garnishment limits with support priority: disposable earnings basis · case 04
Employees with voluntary benefit deductions have smaller garnishments than the orders permit.
Wage garnishment limits with support priority: disposable earnings basis · case 05
Employees with voluntary benefit deductions have smaller garnishments than the orders permit.
Wage garnishment limits with support priority: other-family support percentage · case 01
Obligors supporting a second family have more withheld for support than the lower limit allows.
Wage garnishment limits with support priority: other-family support percentage · case 02
Obligors supporting a second family have more withheld for support than the lower limit allows.
Wage garnishment limits with support priority: other-family support percentage · case 03
Obligors supporting a second family have more withheld for support than the lower limit allows.
Wage garnishment limits with support priority: other-family support percentage · case 04
Obligors supporting a second family have more withheld for support than the lower limit allows.
Wage garnishment limits with support priority: other-family support percentage · case 05
Obligors supporting a second family have more withheld for support than the lower limit allows.
Wage garnishment limits with support priority: arrears threshold · case 01
An obligor exactly 12 weeks in arrears receives the 5-point increase early.
Wage garnishment limits with support priority: arrears threshold · case 02
An obligor exactly 12 weeks in arrears receives the 5-point increase early.
Wage garnishment limits with support priority: arrears threshold · case 03
An obligor exactly 12 weeks in arrears receives the 5-point increase early.
Wage garnishment limits with support priority: arrears threshold · case 04
An obligor exactly 12 weeks in arrears receives the 5-point increase early.
Wage garnishment limits with support priority: arrears threshold · case 05
An obligor exactly 12 weeks in arrears receives the 5-point increase early.
Wage garnishment limits with support priority: minimum wage floor basis · case 01
Low-wage employees are garnished below the protected thirty-times-minimum-wage floor.
Wage garnishment limits with support priority: minimum wage floor basis · case 02
Low-wage employees are garnished below the protected thirty-times-minimum-wage floor.
Wage garnishment limits with support priority: minimum wage floor basis · case 03
Low-wage employees are garnished below the protected thirty-times-minimum-wage floor.
Wage garnishment limits with support priority: minimum wage floor basis · case 04
Low-wage employees are garnished below the protected thirty-times-minimum-wage floor.
Wage garnishment limits with support priority: minimum wage floor basis · case 05
Low-wage employees are garnished below the protected thirty-times-minimum-wage floor.
Wage garnishment limits with support priority: creditor room after support · case 01
Creditor garnishments are taken in full even when child support already used the 25% limit.
Wage garnishment limits with support priority: creditor room after support · case 02
Creditor garnishments are taken in full even when child support already used the 25% limit.
Wage garnishment limits with support priority: creditor room after support · case 03
Creditor garnishments are taken in full even when child support already used the 25% limit.
Wage garnishment limits with support priority: creditor room after support · case 04
Creditor garnishments are taken in full even when child support already used the 25% limit.
Wage garnishment limits with support priority: creditor room after support · case 05
Creditor garnishments are taken in full even when child support already used the 25% limit.
Tip credit and minimum-wage makeup: overtime tip credit · case 01
Tipped employees working overtime receive less cash than the overtime minimum requires.
Tip credit and minimum-wage makeup: overtime tip credit · case 02
Tipped employees working overtime receive less cash than the overtime minimum requires.
Tip credit and minimum-wage makeup: overtime tip credit · case 03
Tipped employees working overtime receive less cash than the overtime minimum requires.
Tip credit and minimum-wage makeup: overtime tip credit · case 04
Tipped employees working overtime receive less cash than the overtime minimum requires.
Tip credit and minimum-wage makeup: overtime tip credit · case 05
Tipped employees working overtime receive less cash than the overtime minimum requires.
Tip credit and minimum-wage makeup: tip shortfall makeup · case 01
Slow weeks with few tips leave the employee below minimum wage with no makeup pay.
Tip credit and minimum-wage makeup: tip shortfall makeup · case 02
Slow weeks with few tips leave the employee below minimum wage with no makeup pay.
Tip credit and minimum-wage makeup: tip shortfall makeup · case 03
Slow weeks with few tips leave the employee below minimum wage with no makeup pay.
Tip credit and minimum-wage makeup: tip shortfall makeup · case 04
Slow weeks with few tips leave the employee below minimum wage with no makeup pay.
Tip credit and minimum-wage makeup: tip shortfall makeup · case 05
Slow weeks with few tips leave the employee below minimum wage with no makeup pay.
Tip credit and minimum-wage makeup: tip credit cap · case 01
Employees with a very low cash rate have more tip credit claimed than the jurisdiction maximum.
Tip credit and minimum-wage makeup: tip credit cap · case 02
Employees with a very low cash rate have more tip credit claimed than the jurisdiction maximum.
Tip credit and minimum-wage makeup: tip credit cap · case 03
Employees with a very low cash rate have more tip credit claimed than the jurisdiction maximum.
Tip credit and minimum-wage makeup: tip credit cap · case 04
Employees with a very low cash rate have more tip credit claimed than the jurisdiction maximum.
Tip credit and minimum-wage makeup: tip credit cap · case 05
Employees with a very low cash rate have more tip credit claimed than the jurisdiction maximum.
Tip credit and minimum-wage makeup: negative credit floor · case 01
Employees paid a cash rate above minimum wage get negative makeup and inflated wages.
Tip credit and minimum-wage makeup: negative credit floor · case 02
Employees paid a cash rate above minimum wage get negative makeup and inflated wages.
Tip credit and minimum-wage makeup: negative credit floor · case 03
Employees paid a cash rate above minimum wage get negative makeup and inflated wages.
Tip credit and minimum-wage makeup: negative credit floor · case 04
Employees paid a cash rate above minimum wage get negative makeup and inflated wages.
Tip credit and minimum-wage makeup: negative credit floor · case 05
Employees paid a cash rate above minimum wage get negative makeup and inflated wages.
Overtime regular rate with bonuses and differentials: discretionary bonus exclusion · case 01
Overtime premiums rise when a discretionary spot bonus is paid.
Overtime regular rate with bonuses and differentials: discretionary bonus exclusion · case 02
Overtime premiums rise when a discretionary spot bonus is paid.
Overtime regular rate with bonuses and differentials: discretionary bonus exclusion · case 03
Overtime premiums rise when a discretionary spot bonus is paid.
Overtime regular rate with bonuses and differentials: discretionary bonus exclusion · case 04
Overtime premiums rise when a discretionary spot bonus is paid.
Overtime regular rate with bonuses and differentials: discretionary bonus exclusion · case 05
Overtime premiums rise when a discretionary spot bonus is paid.
Overtime regular rate with bonuses and differentials: half-time premium · case 01
Overtime hours are paid at two and a half times the rate in total.
Overtime regular rate with bonuses and differentials: half-time premium · case 02
Overtime hours are paid at two and a half times the rate in total.
Overtime regular rate with bonuses and differentials: half-time premium · case 03
Overtime hours are paid at two and a half times the rate in total.
Overtime regular rate with bonuses and differentials: half-time premium · case 04
Overtime hours are paid at two and a half times the rate in total.
Overtime regular rate with bonuses and differentials: half-time premium · case 05
Overtime hours are paid at two and a half times the rate in total.
Overtime regular rate with bonuses and differentials: regular rate divisor · case 01
Employees working long weeks receive an inflated overtime premium.
Overtime regular rate with bonuses and differentials: regular rate divisor · case 02
Employees working long weeks receive an inflated overtime premium.
Overtime regular rate with bonuses and differentials: regular rate divisor · case 03
Employees working long weeks receive an inflated overtime premium.
Overtime regular rate with bonuses and differentials: regular rate divisor · case 04
Employees working long weeks receive an inflated overtime premium.
Overtime regular rate with bonuses and differentials: regular rate divisor · case 05
Employees working long weeks receive an inflated overtime premium.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗