Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Numbering prefix pattern classifier: the closing bracket is read as a literal · case 01
Every pattern containing a class fails to match.
Numbering prefix pattern classifier: the closing bracket is read as a literal · case 02
Every pattern containing a class fails to match.
Numbering prefix pattern classifier: the closing bracket is read as a literal · case 03
Every pattern containing a class fails to match.
Numbering prefix pattern classifier: the closing bracket is read as a literal · case 04
Every pattern containing a class fails to match.
Numbering prefix pattern classifier: the closing bracket is read as a literal · case 05
Every pattern containing a class fails to match.
Caller ID display and callback string: home-country numbers are called back internationally · case 01
A caller with +42 is called back via "00..." instead of the trunk form.
Caller ID display and callback string: home-country numbers are called back internationally · case 02
A caller with +42 is called back via "00..." instead of the trunk form.
Caller ID display and callback string: home-country numbers are called back internationally · case 03
A caller with +42 is called back via "00..." instead of the trunk form.
Caller ID display and callback string: home-country numbers are called back internationally · case 04
A caller with +42 is called back via "00..." instead of the trunk form.
Caller ID display and callback string: home-country numbers are called back internationally · case 05
A caller with +42 is called back via "00..." instead of the trunk form.
Caller ID display and callback string: international numbers are detected by their leading digits · case 01
"+83 ..." becomes a subscriber number and "42..." an international one.
Caller ID display and callback string: international numbers are detected by their leading digits · case 02
"+83 ..." becomes a subscriber number and "42..." an international one.
Caller ID display and callback string: international numbers are detected by their leading digits · case 03
"+83 ..." becomes a subscriber number and "42..." an international one.
Caller ID display and callback string: international numbers are detected by their leading digits · case 04
"+83 ..." becomes a subscriber number and "42..." an international one.
Caller ID display and callback string: international numbers are detected by their leading digits · case 05
"+83 ..." becomes a subscriber number and "42..." an international one.
Caller ID display and callback string: the exit prefix is read as a trunk · case 01
"0083 ..." is displayed as the national number "0083...".
Caller ID display and callback string: the exit prefix is read as a trunk · case 02
"0083 ..." is displayed as the national number "0083...".
Caller ID display and callback string: the exit prefix is read as a trunk · case 03
"0083 ..." is displayed as the national number "0083...".
Caller ID display and callback string: the exit prefix is read as a trunk · case 04
"0083 ..." is displayed as the national number "0083...".
Caller ID display and callback string: the exit prefix is read as a trunk · case 05
"0083 ..." is displayed as the national number "0083...".
Caller ID display and callback string: unavailable numbers are shown as private · case 01
An unavailable caller is labeled "Private".
Caller ID display and callback string: unavailable numbers are shown as private · case 02
An unavailable caller is labeled "Private".
Caller ID display and callback string: unavailable numbers are shown as private · case 03
An unavailable caller is labeled "Private".
Caller ID display and callback string: unavailable numbers are shown as private · case 04
An unavailable caller is labeled "Private".
Caller ID display and callback string: unavailable numbers are shown as private · case 05
An unavailable caller is labeled "Private".
Caller ID display and callback string: subscriber numbers are called back without the area · case 01
A seven-digit caller is called back as trunk + number.
Caller ID display and callback string: subscriber numbers are called back without the area · case 02
A seven-digit caller is called back as trunk + number.
Caller ID display and callback string: subscriber numbers are called back without the area · case 03
A seven-digit caller is called back as trunk + number.
Caller ID display and callback string: subscriber numbers are called back without the area · case 04
A seven-digit caller is called back as trunk + number.
Caller ID display and callback string: subscriber numbers are called back without the area · case 05
A seven-digit caller is called back as trunk + number.
Caller ID display and callback string: national numbers are displayed without the trunk · case 01
A national caller is shown as "55..." which looks like a subscriber number.
Caller ID display and callback string: national numbers are displayed without the trunk · case 02
A national caller is shown as "55..." which looks like a subscriber number.
Caller ID display and callback string: national numbers are displayed without the trunk · case 03
A national caller is shown as "55..." which looks like a subscriber number.
Caller ID display and callback string: national numbers are displayed without the trunk · case 04
A national caller is shown as "55..." which looks like a subscriber number.
Caller ID display and callback string: national numbers are displayed without the trunk · case 05
A national caller is shown as "55..." which looks like a subscriber number.
Caller ID display and callback string: punctuation-only numbers are treated as subscribers · case 01
"---" is displayed as an empty subscriber with a callback of "055".
Caller ID display and callback string: punctuation-only numbers are treated as subscribers · case 02
"---" is displayed as an empty subscriber with a callback of "055".
Caller ID display and callback string: punctuation-only numbers are treated as subscribers · case 03
"---" is displayed as an empty subscriber with a callback of "055".
Caller ID display and callback string: punctuation-only numbers are treated as subscribers · case 04
"---" is displayed as an empty subscriber with a callback of "055".
Caller ID display and callback string: punctuation-only numbers are treated as subscribers · case 05
"---" is displayed as an empty subscriber with a callback of "055".
Servings scaler: scale factor direction · case 01
Scaling a recipe from 4 to 8 servings halves every ingredient instead of doubling it.
Servings scaler: scale factor direction · case 02
Scaling a recipe from 4 to 8 servings halves every ingredient instead of doubling it.
Servings scaler: scale factor direction · case 03
Scaling a recipe from 4 to 8 servings halves every ingredient instead of doubling it.
Servings scaler: scale factor direction · case 04
Scaling a recipe from 4 to 8 servings halves every ingredient instead of doubling it.
Servings scaler: scale factor direction · case 05
Scaling a recipe from 4 to 8 servings halves every ingredient instead of doubling it.
Servings scaler: seasoning damping · case 01
Salt and spices come out at three quarters of even the unscaled amount.
Servings scaler: seasoning damping · case 02
Salt and spices come out at three quarters of even the unscaled amount.
Servings scaler: seasoning damping · case 03
Salt and spices come out at three quarters of even the unscaled amount.
Servings scaler: seasoning damping · case 04
Salt and spices come out at three quarters of even the unscaled amount.
Servings scaler: seasoning damping · case 05
Salt and spices come out at three quarters of even the unscaled amount.
Servings scaler: count half-up rounding · case 01
4.5 eggs becomes 4 eggs and 2.75 limes becomes 2 limes.
Servings scaler: count half-up rounding · case 02
4.5 eggs becomes 4 eggs and 2.75 limes becomes 2 limes.
Servings scaler: count half-up rounding · case 03
4.5 eggs becomes 4 eggs and 2.75 limes becomes 2 limes.
Servings scaler: count half-up rounding · case 04
4.5 eggs becomes 4 eggs and 2.75 limes becomes 2 limes.
Servings scaler: count half-up rounding · case 05
4.5 eggs becomes 4 eggs and 2.75 limes becomes 2 limes.
Servings scaler: countable floor of one · case 01
Scaling one egg for eight down to one serving lists 0 eggs.
Servings scaler: countable floor of one · case 02
Scaling one egg for eight down to one serving lists 0 eggs.
Servings scaler: countable floor of one · case 03
Scaling one egg for eight down to one serving lists 0 eggs.
Servings scaler: countable floor of one · case 04
Scaling one egg for eight down to one serving lists 0 eggs.
Servings scaler: countable floor of one · case 05
Scaling one egg for eight down to one serving lists 0 eggs.
Servings scaler: eighth-cup rounding · case 01
0.19 cup prints as 1/8 instead of 1/4 and small amounts collapse to pinch too early.
Servings scaler: eighth-cup rounding · case 02
0.19 cup prints as 1/8 instead of 1/4 and small amounts collapse to pinch too early.
Servings scaler: eighth-cup rounding · case 03
0.19 cup prints as 1/8 instead of 1/4 and small amounts collapse to pinch too early.
Servings scaler: eighth-cup rounding · case 04
0.19 cup prints as 1/8 instead of 1/4 and small amounts collapse to pinch too early.
Servings scaler: eighth-cup rounding · case 05
0.19 cup prints as 1/8 instead of 1/4 and small amounts collapse to pinch too early.
Servings scaler: kitchen fraction reduction · case 01
Half a cup prints as "4/8" and one and a quarter as "1 2/8".
Servings scaler: kitchen fraction reduction · case 02
Half a cup prints as "4/8" and one and a quarter as "1 2/8".
Servings scaler: kitchen fraction reduction · case 03
Half a cup prints as "4/8" and one and a quarter as "1 2/8".
Servings scaler: kitchen fraction reduction · case 04
Half a cup prints as "4/8" and one and a quarter as "1 2/8".
Servings scaler: kitchen fraction reduction · case 05
Half a cup prints as "4/8" and one and a quarter as "1 2/8".
Nutrition label rounding: calorie insignificance test · case 01
A 4.6 kcal serving is labelled 5 calories instead of 0.
Nutrition label rounding: calorie insignificance test · case 02
A 4.6 kcal serving is labelled 5 calories instead of 0.
Nutrition label rounding: calorie insignificance test · case 03
A 4.6 kcal serving is labelled 5 calories instead of 0.
Nutrition label rounding: calorie insignificance test · case 04
A 4.6 kcal serving is labelled 5 calories instead of 0.
Nutrition label rounding: calorie insignificance test · case 05
A 4.6 kcal serving is labelled 5 calories instead of 0.
Nutrition label rounding: calorie coarse band step · case 01
65 kcal prints as 65 instead of 70.
Nutrition label rounding: calorie coarse band step · case 02
65 kcal prints as 65 instead of 70.
Nutrition label rounding: calorie coarse band step · case 03
65 kcal prints as 65 instead of 70.
Nutrition label rounding: calorie coarse band step · case 04
65 kcal prints as 65 instead of 70.
Nutrition label rounding: calorie coarse band step · case 05
65 kcal prints as 65 instead of 70.
Nutrition label rounding: fat half-gram band · case 01
2.25 g of fat prints as 2 g instead of 2.5 g.
Nutrition label rounding: fat half-gram band · case 02
2.25 g of fat prints as 2 g instead of 2.5 g.
Nutrition label rounding: fat half-gram band · case 03
2.25 g of fat prints as 2 g instead of 2.5 g.
Nutrition label rounding: fat half-gram band · case 04
2.25 g of fat prints as 2 g instead of 2.5 g.
Nutrition label rounding: fat half-gram band · case 05
2.25 g of fat prints as 2 g instead of 2.5 g.
Nutrition label rounding: sodium band steps · case 01
142.5 mg sodium prints 145 mg and 12.5 mg prints 10 mg.
Nutrition label rounding: sodium band steps · case 02
142.5 mg sodium prints 145 mg and 12.5 mg prints 10 mg.
Nutrition label rounding: sodium band steps · case 03
142.5 mg sodium prints 145 mg and 12.5 mg prints 10 mg.
Nutrition label rounding: sodium band steps · case 04
142.5 mg sodium prints 145 mg and 12.5 mg prints 10 mg.
Nutrition label rounding: sodium band steps · case 05
142.5 mg sodium prints 145 mg and 12.5 mg prints 10 mg.
Nutrition label rounding: cholesterol less-than band · case 01
3 mg cholesterol prints "5 mg" instead of "less than 5 mg".
Nutrition label rounding: cholesterol less-than band · case 02
3 mg cholesterol prints "5 mg" instead of "less than 5 mg".
Nutrition label rounding: cholesterol less-than band · case 03
3 mg cholesterol prints "5 mg" instead of "less than 5 mg".
Nutrition label rounding: cholesterol less-than band · case 04
3 mg cholesterol prints "5 mg" instead of "less than 5 mg".
Nutrition label rounding: cholesterol less-than band · case 05
3 mg cholesterol prints "5 mg" instead of "less than 5 mg".
Nutrition label rounding: half-up tie rounding · case 01
A 47.5 kcal serving prints 50 but 42.5 kcal prints 40, and 142.5 mg sodium flips between bands.
Nutrition label rounding: half-up tie rounding · case 02
A 47.5 kcal serving prints 50 but 42.5 kcal prints 40, and 142.5 mg sodium flips between bands.
Nutrition label rounding: half-up tie rounding · case 03
A 47.5 kcal serving prints 50 but 42.5 kcal prints 40, and 142.5 mg sodium flips between bands.
Nutrition label rounding: half-up tie rounding · case 04
A 47.5 kcal serving prints 50 but 42.5 kcal prints 40, and 142.5 mg sodium flips between bands.
Nutrition label rounding: half-up tie rounding · case 05
A 47.5 kcal serving prints 50 but 42.5 kcal prints 40, and 142.5 mg sodium flips between bands.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗