Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
High-altitude baking adjuster: liquid increase per level · case 01
Liquid at 8000 ft increases no more than at 3000 ft, and sea level also gets extra liquid.
High-altitude baking adjuster: liquid increase per level · case 02
Liquid at 8000 ft increases no more than at 3000 ft, and sea level also gets extra liquid.
High-altitude baking adjuster: liquid increase per level · case 03
Liquid at 8000 ft increases no more than at 3000 ft, and sea level also gets extra liquid.
High-altitude baking adjuster: liquid increase per level · case 04
Liquid at 8000 ft increases no more than at 3000 ft, and sea level also gets extra liquid.
High-altitude baking adjuster: liquid increase per level · case 05
Liquid at 8000 ft increases no more than at 3000 ft, and sea level also gets extra liquid.
High-altitude baking adjuster: oven temperature bump · case 01
At 8000 ft the oven is raised 45 F.
High-altitude baking adjuster: oven temperature bump · case 02
At 8000 ft the oven is raised 45 F.
High-altitude baking adjuster: oven temperature bump · case 03
At 8000 ft the oven is raised 45 F.
High-altitude baking adjuster: oven temperature bump · case 04
At 8000 ft the oven is raised 45 F.
High-altitude baking adjuster: oven temperature bump · case 05
At 8000 ft the oven is raised 45 F.
Home canning altitude table: dial gauge ceiling · case 01
A dial gauge at 9000 ft is told 14 psi instead of being refused.
Home canning altitude table: dial gauge ceiling · case 02
A dial gauge at 9000 ft is told 14 psi instead of being refused.
Home canning altitude table: dial gauge ceiling · case 03
A dial gauge at 9000 ft is told 14 psi instead of being refused.
Home canning altitude table: dial gauge ceiling · case 04
A dial gauge at 9000 ft is told 14 psi instead of being refused.
Home canning altitude table: dial gauge ceiling · case 05
A dial gauge at 9000 ft is told 14 psi instead of being refused.
Home canning altitude table: weighted gauge band · case 01
A weighted gauge at 1500 ft is set to 10 psi.
Home canning altitude table: weighted gauge band · case 02
A weighted gauge at 1500 ft is set to 10 psi.
Home canning altitude table: weighted gauge band · case 03
A weighted gauge at 1500 ft is set to 10 psi.
Home canning altitude table: weighted gauge band · case 04
A weighted gauge at 1500 ft is set to 10 psi.
Home canning altitude table: weighted gauge band · case 05
A weighted gauge at 1500 ft is set to 10 psi.
Home canning altitude table: pressure time adjustment · case 01
Dial gauge processing times grow with altitude although pressure already compensates.
Home canning altitude table: pressure time adjustment · case 02
Dial gauge processing times grow with altitude although pressure already compensates.
Home canning altitude table: pressure time adjustment · case 03
Dial gauge processing times grow with altitude although pressure already compensates.
Home canning altitude table: pressure time adjustment · case 04
Dial gauge processing times grow with altitude although pressure already compensates.
Home canning altitude table: pressure time adjustment · case 05
Dial gauge processing times grow with altitude although pressure already compensates.
Shopping list aggregator: -oes plural rule · case 01
Tomatoes and tomato appear as separate lines "tomatoe" and "tomato".
Shopping list aggregator: -oes plural rule · case 02
Tomatoes and tomato appear as separate lines "tomatoe" and "tomato".
Shopping list aggregator: -oes plural rule · case 03
Tomatoes and tomato appear as separate lines "tomatoe" and "tomato".
Shopping list aggregator: -oes plural rule · case 04
Tomatoes and tomato appear as separate lines "tomatoe" and "tomato".
Shopping list aggregator: -oes plural rule · case 05
Tomatoes and tomato appear as separate lines "tomatoe" and "tomato".
Shopping list aggregator: double-s guard · case 01
Watercress is listed as "watercres".
Shopping list aggregator: double-s guard · case 02
Watercress is listed as "watercres".
Shopping list aggregator: double-s guard · case 03
Watercress is listed as "watercres".
Shopping list aggregator: double-s guard · case 04
Watercress is listed as "watercres".
Shopping list aggregator: double-s guard · case 05
Watercress is listed as "watercres".
Shopping list aggregator: pantry subtraction floor · case 01
Having six eggs for a two-egg recipe lists "-4" eggs to buy.
Shopping list aggregator: pantry subtraction floor · case 02
Having six eggs for a two-egg recipe lists "-4" eggs to buy.
Shopping list aggregator: pantry subtraction floor · case 03
Having six eggs for a two-egg recipe lists "-4" eggs to buy.
Shopping list aggregator: pantry subtraction floor · case 04
Having six eggs for a two-egg recipe lists "-4" eggs to buy.
Shopping list aggregator: pantry subtraction floor · case 05
Having six eggs for a two-egg recipe lists "-4" eggs to buy.
Shopping list aggregator: pantry name normalization · case 01
A pantry entry "egg" does not cancel recipe rows "eggs".
Shopping list aggregator: pantry name normalization · case 02
A pantry entry "egg" does not cancel recipe rows "eggs".
Shopping list aggregator: pantry name normalization · case 03
A pantry entry "egg" does not cancel recipe rows "eggs".
Shopping list aggregator: pantry name normalization · case 04
A pantry entry "egg" does not cancel recipe rows "eggs".
Shopping list aggregator: pantry name normalization · case 05
A pantry entry "egg" does not cancel recipe rows "eggs".
Shopping list aggregator: cup display threshold · case 01
A quarter cup prints as "4 tbsp".
Shopping list aggregator: cup display threshold · case 02
A quarter cup prints as "4 tbsp".
Shopping list aggregator: cup display threshold · case 03
A quarter cup prints as "4 tbsp".
Shopping list aggregator: cup display threshold · case 04
A quarter cup prints as "4 tbsp".
Shopping list aggregator: cup display threshold · case 05
A quarter cup prints as "4 tbsp".
Shopping list aggregator: zero line suppression · case 01
Items fully covered by the pantry still appear with quantity 0.
Shopping list aggregator: zero line suppression · case 02
Items fully covered by the pantry still appear with quantity 0.
Shopping list aggregator: zero line suppression · case 03
Items fully covered by the pantry still appear with quantity 0.
Shopping list aggregator: zero line suppression · case 04
Items fully covered by the pantry still appear with quantity 0.
Shopping list aggregator: zero line suppression · case 05
Items fully covered by the pantry still appear with quantity 0.
Nutrient content claim screener: small reference amount test · case 01
Foods with a 30 g reference amount skip the per-50 g check.
Nutrient content claim screener: small reference amount test · case 02
Foods with a 30 g reference amount skip the per-50 g check.
Nutrient content claim screener: small reference amount test · case 03
Foods with a 30 g reference amount skip the per-50 g check.
Nutrient content claim screener: small reference amount test · case 04
Foods with a 30 g reference amount skip the per-50 g check.
Nutrient content claim screener: small reference amount test · case 05
Foods with a 30 g reference amount skip the per-50 g check.
Nutrient content claim screener: per-50 g scaling · case 01
A 15 g cracker serving with 30 mg sodium is judged at 9 mg per 50 g.
Nutrient content claim screener: per-50 g scaling · case 02
A 15 g cracker serving with 30 mg sodium is judged at 9 mg per 50 g.
Nutrient content claim screener: per-50 g scaling · case 03
A 15 g cracker serving with 30 mg sodium is judged at 9 mg per 50 g.
Nutrient content claim screener: per-50 g scaling · case 04
A 15 g cracker serving with 30 mg sodium is judged at 9 mg per 50 g.
Nutrient content claim screener: per-50 g scaling · case 05
A 15 g cracker serving with 30 mg sodium is judged at 9 mg per 50 g.
Nutrient content claim screener: stricter of two bases · case 01
A 40 g serving of a small-RACC food qualifies for low fat on its diluted per-50 g figure alone.
Nutrient content claim screener: stricter of two bases · case 02
A 40 g serving of a small-RACC food qualifies for low fat on its diluted per-50 g figure alone.
Nutrient content claim screener: stricter of two bases · case 03
A 40 g serving of a small-RACC food qualifies for low fat on its diluted per-50 g figure alone.
Nutrient content claim screener: stricter of two bases · case 04
A 40 g serving of a small-RACC food qualifies for low fat on its diluted per-50 g figure alone.
Nutrient content claim screener: stricter of two bases · case 05
A 40 g serving of a small-RACC food qualifies for low fat on its diluted per-50 g figure alone.
Nutrient content claim screener: exclusive sodium tiers · case 01
A sodium-free product also claims very low sodium.
Nutrient content claim screener: exclusive sodium tiers · case 02
A sodium-free product also claims very low sodium.
Nutrient content claim screener: exclusive sodium tiers · case 03
A sodium-free product also claims very low sodium.
Nutrient content claim screener: exclusive sodium tiers · case 04
A sodium-free product also claims very low sodium.
Nutrient content claim screener: exclusive sodium tiers · case 05
A sodium-free product also claims very low sodium.
Nutrient content claim screener: fiber basis · case 01
Small crackers claim high fiber from an inflated per-50 g figure.
Nutrient content claim screener: fiber basis · case 02
Small crackers claim high fiber from an inflated per-50 g figure.
Nutrient content claim screener: fiber basis · case 03
Small crackers claim high fiber from an inflated per-50 g figure.
Nutrient content claim screener: fiber basis · case 04
Small crackers claim high fiber from an inflated per-50 g figure.
Nutrient content claim screener: fiber basis · case 05
Small crackers claim high fiber from an inflated per-50 g figure.
Roast timing and carryover planner: carryover by weight · case 01
A 4 kg medium-rare roast is pulled 2C too late because carryover follows doneness.
Roast timing and carryover planner: carryover by weight · case 02
A 4 kg medium-rare roast is pulled 2C too late because carryover follows doneness.
Roast timing and carryover planner: carryover by weight · case 03
A 4 kg medium-rare roast is pulled 2C too late because carryover follows doneness.
Roast timing and carryover planner: carryover by weight · case 04
A 4 kg medium-rare roast is pulled 2C too late because carryover follows doneness.
Roast timing and carryover planner: carryover by weight · case 05
A 4 kg medium-rare roast is pulled 2C too late because carryover follows doneness.
Roast timing and carryover planner: poultry pull temperature · case 01
Chicken is pulled below the 74C safety minimum.
Roast timing and carryover planner: poultry pull temperature · case 02
Chicken is pulled below the 74C safety minimum.
Roast timing and carryover planner: poultry pull temperature · case 03
Chicken is pulled below the 74C safety minimum.
Roast timing and carryover planner: poultry pull temperature · case 04
Chicken is pulled below the 74C safety minimum.
Roast timing and carryover planner: poultry pull temperature · case 05
Chicken is pulled below the 74C safety minimum.
Roast timing and carryover planner: poultry cooking rate · case 01
A chicken marked "rare" gets the rare-beef cooking time.
Roast timing and carryover planner: poultry cooking rate · case 02
A chicken marked "rare" gets the rare-beef cooking time.
Roast timing and carryover planner: poultry cooking rate · case 03
A chicken marked "rare" gets the rare-beef cooking time.
Roast timing and carryover planner: poultry cooking rate · case 04
A chicken marked "rare" gets the rare-beef cooking time.
Roast timing and carryover planner: poultry cooking rate · case 05
A chicken marked "rare" gets the rare-beef cooking time.
Roast timing and carryover planner: cook time rounding · case 01
A 1.2 kg medium-rare roast (42 min) is scheduled for 40 minutes instead of 45.
Roast timing and carryover planner: cook time rounding · case 02
A 1.2 kg medium-rare roast (42 min) is scheduled for 40 minutes instead of 45.
Roast timing and carryover planner: cook time rounding · case 03
A 1.2 kg medium-rare roast (42 min) is scheduled for 40 minutes instead of 45.
Roast timing and carryover planner: cook time rounding · case 04
A 1.2 kg medium-rare roast (42 min) is scheduled for 40 minutes instead of 45.
Roast timing and carryover planner: cook time rounding · case 05
A 1.2 kg medium-rare roast (42 min) is scheduled for 40 minutes instead of 45.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗