Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Only the first two components checked for tariff compatibility · case 01
A third component from a negotiated tariff is combined with public fares.
Only the first two components checked for tariff compatibility · case 02
A third component from a negotiated tariff is combined with public fares.
Only the first two components checked for tariff compatibility · case 03
A third component from a negotiated tariff is combined with public fares.
Only the first two components checked for tariff compatibility · case 04
A third component from a negotiated tariff is combined with public fares.
Only the first two components checked for tariff compatibility · case 05
A third component from a negotiated tariff is combined with public fares.
Interline permission read backwards · case 01
Journeys marked interline-permitted are rejected and forbidden ones pass.
Interline permission read backwards · case 02
Journeys marked interline-permitted are rejected and forbidden ones pass.
Interline permission read backwards · case 03
Journeys marked interline-permitted are rejected and forbidden ones pass.
Interline permission read backwards · case 04
Journeys marked interline-permitted are rejected and forbidden ones pass.
Interline permission read backwards · case 05
Journeys marked interline-permitted are rejected and forbidden ones pass.
Carrier error masks a tariff mismatch · case 01
A combination that is both cross-tariff and cross-carrier reports only ERR_CARRIER.
Carrier error masks a tariff mismatch · case 02
A combination that is both cross-tariff and cross-carrier reports only ERR_CARRIER.
Carrier error masks a tariff mismatch · case 03
A combination that is both cross-tariff and cross-carrier reports only ERR_CARRIER.
Carrier error masks a tariff mismatch · case 04
A combination that is both cross-tariff and cross-carrier reports only ERR_CARRIER.
Carrier error masks a tariff mismatch · case 05
A combination that is both cross-tariff and cross-carrier reports only ERR_CARRIER.
Only the first advance purchase digit consumed · case 01
QLX14NR decodes as a 1-day advance purchase followed by an invalid token.
Only the first advance purchase digit consumed · case 02
QLX14NR decodes as a 1-day advance purchase followed by an invalid token.
Only the first advance purchase digit consumed · case 03
QLX14NR decodes as a 1-day advance purchase followed by an invalid token.
Only the first advance purchase digit consumed · case 04
QLX14NR decodes as a 1-day advance purchase followed by an invalid token.
Only the first advance purchase digit consumed · case 05
QLX14NR decodes as a 1-day advance purchase followed by an invalid token.
W and X day codes decoded backwards · case 01
Weekend fares are reported as weekday-only.
W and X day codes decoded backwards · case 02
Weekend fares are reported as weekday-only.
W and X day codes decoded backwards · case 03
Weekend fares are reported as weekday-only.
W and X day codes decoded backwards · case 04
Weekend fares are reported as weekday-only.
W and X day codes decoded backwards · case 05
Weekend fares are reported as weekday-only.
Unrecognised suffix tokens silently dropped · case 01
A corrupted basis such as MH14ZZ decodes as valid with no flags.
Unrecognised suffix tokens silently dropped · case 02
A corrupted basis such as MH14ZZ decodes as valid with no flags.
Unrecognised suffix tokens silently dropped · case 03
A corrupted basis such as MH14ZZ decodes as valid with no flags.
Unrecognised suffix tokens silently dropped · case 04
A corrupted basis such as MH14ZZ decodes as valid with no flags.
Unrecognised suffix tokens silently dropped · case 05
A corrupted basis such as MH14ZZ decodes as valid with no flags.
Any letter after the RBD taken as a season · case 01
KW3NR decodes season W and loses the weekend day code.
Any letter after the RBD taken as a season · case 02
KW3NR decodes season W and loses the weekend day code.
Any letter after the RBD taken as a season · case 03
KW3NR decodes season W and loses the weekend day code.
Any letter after the RBD taken as a season · case 04
KW3NR decodes season W and loses the weekend day code.
Any letter after the RBD taken as a season · case 05
KW3NR decodes season W and loses the weekend day code.
Lowercase and accented letters accepted as booking classes · case 01
A basis beginning with a lowercase or accented letter decodes with an invalid RBD.
Lowercase and accented letters accepted as booking classes · case 02
A basis beginning with a lowercase or accented letter decodes with an invalid RBD.
Lowercase and accented letters accepted as booking classes · case 03
A basis beginning with a lowercase or accented letter decodes with an invalid RBD.
Lowercase and accented letters accepted as booking classes · case 04
A basis beginning with a lowercase or accented letter decodes with an invalid RBD.
Lowercase and accented letters accepted as booking classes · case 05
A basis beginning with a lowercase or accented letter decodes with an invalid RBD.
Prorated coupon values do not add up to the fare · case 01
Interline settlement is short by a few cents on most tickets.
Prorated coupon values do not add up to the fare · case 02
Interline settlement is short by a few cents on most tickets.
Prorated coupon values do not add up to the fare · case 03
Interline settlement is short by a few cents on most tickets.
Prorated coupon values do not add up to the fare · case 04
Interline settlement is short by a few cents on most tickets.
Prorated coupon values do not add up to the fare · case 05
Interline settlement is short by a few cents on most tickets.
Rounding remainder assigned to the first coupon · case 01
The first coupon carries the remainder, even when it is a surface sector with no miles.
Rounding remainder assigned to the first coupon · case 02
The first coupon carries the remainder, even when it is a surface sector with no miles.
Rounding remainder assigned to the first coupon · case 03
The first coupon carries the remainder, even when it is a surface sector with no miles.
Rounding remainder assigned to the first coupon · case 04
The first coupon carries the remainder, even when it is a surface sector with no miles.
Rounding remainder assigned to the first coupon · case 05
The first coupon carries the remainder, even when it is a surface sector with no miles.
Fare split equally between coupons · case 01
A short hop receives the same value as a long-haul sector.
Fare split equally between coupons · case 02
A short hop receives the same value as a long-haul sector.
Fare split equally between coupons · case 03
A short hop receives the same value as a long-haul sector.
Fare split equally between coupons · case 04
A short hop receives the same value as a long-haul sector.
Fare split equally between coupons · case 05
A short hop receives the same value as a long-haul sector.
Coupon shares rounded to nearest cent before remainder · case 01
Earlier coupons gain or lose a cent compared with the settlement contract.
Coupon shares rounded to nearest cent before remainder · case 02
Earlier coupons gain or lose a cent compared with the settlement contract.
Coupon shares rounded to nearest cent before remainder · case 03
Earlier coupons gain or lose a cent compared with the settlement contract.
Coupon shares rounded to nearest cent before remainder · case 04
Earlier coupons gain or lose a cent compared with the settlement contract.
Coupon shares rounded to nearest cent before remainder · case 05
Earlier coupons gain or lose a cent compared with the settlement contract.
Coupons before the no-show also cancelled · case 01
An open coupon earlier in the itinerary is voided because a later sector was missed.
Coupons before the no-show also cancelled · case 02
An open coupon earlier in the itinerary is voided because a later sector was missed.
Coupons before the no-show also cancelled · case 03
An open coupon earlier in the itinerary is voided because a later sector was missed.
Coupons before the no-show also cancelled · case 04
An open coupon earlier in the itinerary is voided because a later sector was missed.
Coupons before the no-show also cancelled · case 05
An open coupon earlier in the itinerary is voided because a later sector was missed.
Only the coupon right after a no-show is cancelled · case 01
The third sector of an itinerary remains open after the passenger missed the first.
Only the coupon right after a no-show is cancelled · case 02
The third sector of an itinerary remains open after the passenger missed the first.
Only the coupon right after a no-show is cancelled · case 03
The third sector of an itinerary remains open after the passenger missed the first.
Only the coupon right after a no-show is cancelled · case 04
The third sector of an itinerary remains open after the passenger missed the first.
Only the coupon right after a no-show is cancelled · case 05
The third sector of an itinerary remains open after the passenger missed the first.
No-show fee charged for every missed coupon · case 01
A ticket with two no-show coupons is charged two penalties.
No-show fee charged for every missed coupon · case 02
A ticket with two no-show coupons is charged two penalties.
No-show fee charged for every missed coupon · case 03
A ticket with two no-show coupons is charged two penalties.
No-show fee charged for every missed coupon · case 04
A ticket with two no-show coupons is charged two penalties.
No-show fee charged for every missed coupon · case 05
A ticket with two no-show coupons is charged two penalties.
Flight number ranges compared as strings · case 01
Flight AA99 qualifies for a 100-999 range, and zero-padded numbers fall outside ranges they belong to.
Flight number ranges compared as strings · case 02
Flight AA99 qualifies for a 100-999 range, and zero-padded numbers fall outside ranges they belong to.
Flight number ranges compared as strings · case 03
Flight AA99 qualifies for a 100-999 range, and zero-padded numbers fall outside ranges they belong to.
Flight number ranges compared as strings · case 04
Flight AA99 qualifies for a 100-999 range, and zero-padded numbers fall outside ranges they belong to.
Flight number ranges compared as strings · case 05
Flight AA99 qualifies for a 100-999 range, and zero-padded numbers fall outside ranges they belong to.
Excepted flights inside a range still qualify · case 01
Flight AA500 is sold on a fare that explicitly excludes it.
Excepted flights inside a range still qualify · case 02
Flight AA500 is sold on a fare that explicitly excludes it.
Excepted flights inside a range still qualify · case 03
Flight AA500 is sold on a fare that explicitly excludes it.
Excepted flights inside a range still qualify · case 04
Flight AA500 is sold on a fare that explicitly excludes it.
Excepted flights inside a range still qualify · case 05
Flight AA500 is sold on a fare that explicitly excludes it.
Lowercase carrier codes never match · case 01
Segments entered as "ba" are rejected although BA flights are in range.
Lowercase carrier codes never match · case 02
Segments entered as "ba" are rejected although BA flights are in range.
Lowercase carrier codes never match · case 03
Segments entered as "ba" are rejected although BA flights are in range.
Lowercase carrier codes never match · case 04
Segments entered as "ba" are rejected although BA flights are in range.
Lowercase carrier codes never match · case 05
Segments entered as "ba" are rejected although BA flights are in range.
Last flight number of a range excluded · case 01
Flight LH2999 is not covered by a 2000-2999 range.
Last flight number of a range excluded · case 02
Flight LH2999 is not covered by a 2000-2999 range.
Last flight number of a range excluded · case 03
Flight LH2999 is not covered by a 2000-2999 range.
Last flight number of a range excluded · case 04
Flight LH2999 is not covered by a 2000-2999 range.
Last flight number of a range excluded · case 05
Flight LH2999 is not covered by a 2000-2999 range.
Piece charges restart after the free allowance · case 01
With one free bag the second bag is charged 30 instead of 40.
Piece charges restart after the free allowance · case 02
With one free bag the second bag is charged 30 instead of 40.
Piece charges restart after the free allowance · case 03
With one free bag the second bag is charged 30 instead of 40.
Piece charges restart after the free allowance · case 04
With one free bag the second bag is charged 30 instead of 40.
Piece charges restart after the free allowance · case 05
With one free bag the second bag is charged 30 instead of 40.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗