Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Block range side assignment: descending ranges never match · case 01
House 296 is not found on a block whose left range runs 298 down to 200.
Block range side assignment: descending ranges never match · case 02
House 296 is not found on a block whose left range runs 298 down to 200.
Block range side assignment: descending ranges never match · case 03
House 296 is not found on a block whose left range runs 298 down to 200.
Block range side assignment: descending ranges never match · case 04
House 296 is not found on a block whose left range runs 298 down to 200.
Block range side assignment: descending ranges never match · case 05
House 296 is not found on a block whose left range runs 298 down to 200.
Block range side assignment: parity is not used to pick the side · case 01
Even house 152 is placed on the odd left side.
Block range side assignment: parity is not used to pick the side · case 02
Even house 152 is placed on the odd left side.
Block range side assignment: parity is not used to pick the side · case 03
Even house 152 is placed on the odd left side.
Block range side assignment: parity is not used to pick the side · case 04
Even house 152 is placed on the odd left side.
Block range side assignment: parity is not used to pick the side · case 05
Even house 152 is placed on the odd left side.
Block range side assignment: position measured from the lower bound · case 01
On a descending range the position is mirrored (near the start reads as near the end).
Block range side assignment: position measured from the lower bound · case 02
On a descending range the position is mirrored (near the start reads as near the end).
Block range side assignment: position measured from the lower bound · case 03
On a descending range the position is mirrored (near the start reads as near the end).
Block range side assignment: position measured from the lower bound · case 04
On a descending range the position is mirrored (near the start reads as near the end).
Block range side assignment: position measured from the lower bound · case 05
On a descending range the position is mirrored (near the start reads as near the end).
Block range side assignment: position rendered as a float · case 01
Positions read "0.02040816326530612" instead of "1/49".
Block range side assignment: position rendered as a float · case 02
Positions read "0.02040816326530612" instead of "1/49".
Block range side assignment: position rendered as a float · case 03
Positions read "0.02040816326530612" instead of "1/49".
Block range side assignment: position rendered as a float · case 04
Positions read "0.02040816326530612" instead of "1/49".
Block range side assignment: position rendered as a float · case 05
Positions read "0.02040816326530612" instead of "1/49".
Block range side assignment: right side wins a conflicting segment · case 01
A house present on both sides of bad data is assigned to the right.
Block range side assignment: right side wins a conflicting segment · case 02
A house present on both sides of bad data is assigned to the right.
Block range side assignment: right side wins a conflicting segment · case 03
A house present on both sides of bad data is assigned to the right.
Block range side assignment: right side wins a conflicting segment · case 04
A house present on both sides of bad data is assigned to the right.
Block range side assignment: right side wins a conflicting segment · case 05
A house present on both sides of bad data is assigned to the right.
Country address template renderer: unknown destinations render no address · case 01
A parcel to code DD gets only a country line.
Country address template renderer: unknown destinations render no address · case 02
A parcel to code DD gets only a country line.
Country address template renderer: unknown destinations render no address · case 03
A parcel to code DD gets only a country line.
Country address template renderer: unknown destinations render no address · case 04
A parcel to code DD gets only a country line.
Country address template renderer: unknown destinations render no address · case 05
A parcel to code DD gets only a country line.
Country address template renderer: empty components leave doubled spaces · case 01
A missing region renders "Faketown 11345".
Country address template renderer: empty components leave doubled spaces · case 02
A missing region renders "Faketown 11345".
Country address template renderer: empty components leave doubled spaces · case 03
A missing region renders "Faketown 11345".
Country address template renderer: empty components leave doubled spaces · case 04
A missing region renders "Faketown 11345".
Country address template renderer: empty components leave doubled spaces · case 05
A missing region renders "Faketown 11345".
Country address template renderer: empty lines are printed · case 01
A label without a name starts with a blank line.
Country address template renderer: empty lines are printed · case 02
A label without a name starts with a blank line.
Country address template renderer: empty lines are printed · case 03
A label without a name starts with a blank line.
Country address template renderer: empty lines are printed · case 04
A label without a name starts with a blank line.
Country address template renderer: empty lines are printed · case 05
A label without a name starts with a blank line.
Country address template renderer: the country line is printed on domestic mail · case 01
Domestic AA labels end with "AALANDIA".
Country address template renderer: the country line is printed on domestic mail · case 02
Domestic AA labels end with "AALANDIA".
Country address template renderer: the country line is printed on domestic mail · case 03
Domestic AA labels end with "AALANDIA".
Country address template renderer: the country line is printed on domestic mail · case 04
Domestic AA labels end with "AALANDIA".
Country address template renderer: the country line is printed on domestic mail · case 05
Domestic AA labels end with "AALANDIA".
Country address template renderer: city uppercasing applies to the wrong destinations · case 01
BB labels print the city in capitals.
Country address template renderer: city uppercasing applies to the wrong destinations · case 02
BB labels print the city in capitals.
Country address template renderer: city uppercasing applies to the wrong destinations · case 03
BB labels print the city in capitals.
Country address template renderer: city uppercasing applies to the wrong destinations · case 04
BB labels print the city in capitals.
Country address template renderer: city uppercasing applies to the wrong destinations · case 05
BB labels print the city in capitals.
Country address template renderer: unknown destinations get an empty country line · case 01
A DD label ends with an empty line.
Country address template renderer: unknown destinations get an empty country line · case 02
A DD label ends with an empty line.
Country address template renderer: unknown destinations get an empty country line · case 03
A DD label ends with an empty line.
Country address template renderer: unknown destinations get an empty country line · case 04
A DD label ends with an empty line.
Country address template renderer: unknown destinations get an empty country line · case 05
A DD label ends with an empty line.
Rural route and highway token normalizer: single tokens are matched before two-token phrases · case 01
"HIGHWAY CONTRACT 3" becomes "HWY CONTRACT 3".
Rural route and highway token normalizer: single tokens are matched before two-token phrases · case 02
"HIGHWAY CONTRACT 3" becomes "HWY CONTRACT 3".
Rural route and highway token normalizer: single tokens are matched before two-token phrases · case 03
"HIGHWAY CONTRACT 3" becomes "HWY CONTRACT 3".
Rural route and highway token normalizer: single tokens are matched before two-token phrases · case 04
"HIGHWAY CONTRACT 3" becomes "HWY CONTRACT 3".
Rural route and highway token normalizer: single tokens are matched before two-token phrases · case 05
"HIGHWAY CONTRACT 3" becomes "HWY CONTRACT 3".
Rural route and highway token normalizer: dotted route abbreviations are not recognized · case 01
"R.R. 2" is left as typed.
Rural route and highway token normalizer: dotted route abbreviations are not recognized · case 02
"R.R. 2" is left as typed.
Rural route and highway token normalizer: dotted route abbreviations are not recognized · case 03
"R.R. 2" is left as typed.
Rural route and highway token normalizer: dotted route abbreviations are not recognized · case 04
"R.R. 2" is left as typed.
Rural route and highway token normalizer: dotted route abbreviations are not recognized · case 05
"R.R. 2" is left as typed.
Rural route and highway token normalizer: fused route numbers are left fused · case 01
"RR21" stays one token.
Rural route and highway token normalizer: fused route numbers are left fused · case 02
"RR21" stays one token.
Rural route and highway token normalizer: fused route numbers are left fused · case 03
"RR21" stays one token.
Rural route and highway token normalizer: fused route numbers are left fused · case 04
"RR21" stays one token.
Rural route and highway token normalizer: fused route numbers are left fused · case 05
"RR21" stays one token.
Rural route and highway token normalizer: the RURAL RTE variant is missing · case 01
"RURAL RTE 2" is left unnormalized.
Rural route and highway token normalizer: the RURAL RTE variant is missing · case 02
"RURAL RTE 2" is left unnormalized.
Rural route and highway token normalizer: the RURAL RTE variant is missing · case 03
"RURAL RTE 2" is left unnormalized.
Rural route and highway token normalizer: the RURAL RTE variant is missing · case 04
"RURAL RTE 2" is left unnormalized.
Rural route and highway token normalizer: the RURAL RTE variant is missing · case 05
"RURAL RTE 2" is left unnormalized.
Rural route and highway token normalizer: the short box token is not normalized · case 01
"BX 11" stays "BX 11".
Rural route and highway token normalizer: the short box token is not normalized · case 02
"BX 11" stays "BX 11".
Rural route and highway token normalizer: the short box token is not normalized · case 03
"BX 11" stays "BX 11".
Rural route and highway token normalizer: the short box token is not normalized · case 04
"BX 11" stays "BX 11".
Rural route and highway token normalizer: the short box token is not normalized · case 05
"BX 11" stays "BX 11".
Address display casing: unit letters are lowercased with ordinals · case 01
"APT 1B" prints as "Apt 1b".
Address display casing: unit letters are lowercased with ordinals · case 02
"APT 1B" prints as "Apt 1b".
Address display casing: unit letters are lowercased with ordinals · case 03
"APT 1B" prints as "Apt 1b".
Address display casing: unit letters are lowercased with ordinals · case 04
"APT 1B" prints as "Apt 1b".
Address display casing: unit letters are lowercased with ordinals · case 05
"APT 1B" prints as "Apt 1b".
Address display casing: Mc names lose their inner capital · case 01
"MCFAKE" prints as "Mcfake".
Address display casing: Mc names lose their inner capital · case 02
"MCFAKE" prints as "Mcfake".
Address display casing: Mc names lose their inner capital · case 03
"MCFAKE" prints as "Mcfake".
Address display casing: Mc names lose their inner capital · case 04
"MCFAKE" prints as "Mcfake".
Address display casing: Mc names lose their inner capital · case 05
"MCFAKE" prints as "Mcfake".
Address display casing: second hyphen part stays lowercase · case 01
"FAKE-SIDE" prints as "Fake-side".
Address display casing: second hyphen part stays lowercase · case 02
"FAKE-SIDE" prints as "Fake-side".
Address display casing: second hyphen part stays lowercase · case 03
"FAKE-SIDE" prints as "Fake-side".
Address display casing: second hyphen part stays lowercase · case 04
"FAKE-SIDE" prints as "Fake-side".
Address display casing: second hyphen part stays lowercase · case 05
"FAKE-SIDE" prints as "Fake-side".
Address display casing: the letter after an apostrophe is lowercased · case 01
"O'FAKE" prints as "O'fake".
Address display casing: the letter after an apostrophe is lowercased · case 02
"O'FAKE" prints as "O'fake".
Address display casing: the letter after an apostrophe is lowercased · case 03
"O'FAKE" prints as "O'fake".
Address display casing: the letter after an apostrophe is lowercased · case 04
"O'FAKE" prints as "O'fake".
Address display casing: the letter after an apostrophe is lowercased · case 05
"O'FAKE" prints as "O'fake".
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗