Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Maximum number of stops rejected · case 01
Riders adding the third allowed stop get an error.
Maximum number of stops rejected · case 02
Riders adding the third allowed stop get an error.
Maximum number of stops rejected · case 03
Riders adding the third allowed stop get an error.
Maximum number of stops rejected · case 04
Riders adding the third allowed stop get an error.
Maximum number of stops rejected · case 05
Riders adding the third allowed stop get an error.
Free waiting pooled across all stops · case 01
Two 2-minute stops are billed although each is within its allowance.
Free waiting pooled across all stops · case 02
Two 2-minute stops are billed although each is within its allowance.
Free waiting pooled across all stops · case 03
Two 2-minute stops are billed although each is within its allowance.
Free waiting pooled across all stops · case 04
Two 2-minute stops are billed although each is within its allowance.
Free waiting pooled across all stops · case 05
Two 2-minute stops are billed although each is within its allowance.
Card payments rounded to the cash step · case 01
Swiss card payments are rounded to 5 centimes.
Card payments rounded to the cash step · case 02
Swiss card payments are rounded to 5 centimes.
Card payments rounded to the cash step · case 03
Swiss card payments are rounded to 5 centimes.
Card payments rounded to the cash step · case 04
Swiss card payments are rounded to 5 centimes.
Card payments rounded to the cash step · case 05
Swiss card payments are rounded to 5 centimes.
Cash step applied before currency conversion · case 01
Francs paid in cash come out at odd centimes after conversion.
Cash step applied before currency conversion · case 02
Francs paid in cash come out at odd centimes after conversion.
Cash step applied before currency conversion · case 03
Francs paid in cash come out at odd centimes after conversion.
Cash step applied before currency conversion · case 04
Francs paid in cash come out at odd centimes after conversion.
Cash step applied before currency conversion · case 05
Francs paid in cash come out at odd centimes after conversion.
Cash step taken from the fare currency · case 01
A CHF fare paid in euro cash is rounded to 5 cents.
Cash step taken from the fare currency · case 02
A CHF fare paid in euro cash is rounded to 5 cents.
Cash step taken from the fare currency · case 03
A CHF fare paid in euro cash is rounded to 5 cents.
Cash step taken from the fare currency · case 04
A CHF fare paid in euro cash is rounded to 5 cents.
Cash step taken from the fare currency · case 05
A CHF fare paid in euro cash is rounded to 5 cents.
Conversion uses the inverted reverse rate · case 01
Converted fares are off by the bid/ask spread.
Conversion uses the inverted reverse rate · case 02
Converted fares are off by the bid/ask spread.
Conversion uses the inverted reverse rate · case 03
Converted fares are off by the bid/ask spread.
Conversion uses the inverted reverse rate · case 04
Converted fares are off by the bid/ask spread.
Conversion uses the inverted reverse rate · case 05
Converted fares are off by the bid/ask spread.
Smoothing reads already-smoothed neighbors · case 01
Surge spreads several hops from a hotspot depending on zone name order.
Smoothing reads already-smoothed neighbors · case 02
Surge spreads several hops from a hotspot depending on zone name order.
Smoothing reads already-smoothed neighbors · case 03
Surge spreads several hops from a hotspot depending on zone name order.
Smoothing reads already-smoothed neighbors · case 04
Surge spreads several hops from a hotspot depending on zone name order.
Smoothing reads already-smoothed neighbors · case 05
Surge spreads several hops from a hotspot depending on zone name order.
Neighbor surge spills over without decay · case 01
Calm zones next to a hotspot publish the full hotspot multiplier.
Neighbor surge spills over without decay · case 02
Calm zones next to a hotspot publish the full hotspot multiplier.
Neighbor surge spills over without decay · case 03
Calm zones next to a hotspot publish the full hotspot multiplier.
Neighbor surge spills over without decay · case 04
Calm zones next to a hotspot publish the full hotspot multiplier.
Neighbor surge spills over without decay · case 05
Calm zones next to a hotspot publish the full hotspot multiplier.
Published multiplier exceeds the 3.0x cap · case 01
A raw 3.5x zone publishes 3.5x.
Published multiplier exceeds the 3.0x cap · case 02
A raw 3.5x zone publishes 3.5x.
Published multiplier exceeds the 3.0x cap · case 03
A raw 3.5x zone publishes 3.5x.
Published multiplier exceeds the 3.0x cap · case 04
A raw 3.5x zone publishes 3.5x.
Published multiplier exceeds the 3.0x cap · case 05
A raw 3.5x zone publishes 3.5x.
One-way adjacency entries ignored · case 01
Zone B smooths from A but A never smooths from B.
One-way adjacency entries ignored · case 02
Zone B smooths from A but A never smooths from B.
One-way adjacency entries ignored · case 03
Zone B smooths from A but A never smooths from B.
One-way adjacency entries ignored · case 04
Zone B smooths from A but A never smooths from B.
One-way adjacency entries ignored · case 05
Zone B smooths from A but A never smooths from B.
Any detour triggers a refund · case 01
Riders get refunds for routes only slightly longer than optimal.
Any detour triggers a refund · case 02
Riders get refunds for routes only slightly longer than optimal.
Any detour triggers a refund · case 03
Riders get refunds for routes only slightly longer than optimal.
Any detour triggers a refund · case 04
Riders get refunds for routes only slightly longer than optimal.
Any detour triggers a refund · case 05
Riders get refunds for routes only slightly longer than optimal.
Refund of exactly two dollars suppressed · case 01
A computed 2.00 refund is never issued.
Refund of exactly two dollars suppressed · case 02
A computed 2.00 refund is never issued.
Refund of exactly two dollars suppressed · case 03
A computed 2.00 refund is never issued.
Refund of exactly two dollars suppressed · case 04
A computed 2.00 refund is never issued.
Refund of exactly two dollars suppressed · case 05
A computed 2.00 refund is never issued.
Refund reduces the charge below the minimum fare · case 01
A short inefficient trip is refunded to almost nothing.
Refund reduces the charge below the minimum fare · case 02
A short inefficient trip is refunded to almost nothing.
Refund reduces the charge below the minimum fare · case 03
A short inefficient trip is refunded to almost nothing.
Refund reduces the charge below the minimum fare · case 04
A short inefficient trip is refunded to almost nothing.
Refund reduces the charge below the minimum fare · case 05
A short inefficient trip is refunded to almost nothing.
Fast segments billed for distance and time · case 01
Highway segments are charged twice.
Fast segments billed for distance and time · case 02
Highway segments are charged twice.
Fast segments billed for distance and time · case 03
Highway segments are charged twice.
Fast segments billed for distance and time · case 04
Highway segments are charged twice.
Fast segments billed for distance and time · case 05
Highway segments are charged twice.
Segments exactly at the switch speed billed by time · case 01
Traffic moving at exactly 5 m/s is billed on the clock.
Segments exactly at the switch speed billed by time · case 02
Traffic moving at exactly 5 m/s is billed on the clock.
Segments exactly at the switch speed billed by time · case 03
Traffic moving at exactly 5 m/s is billed on the clock.
Segments exactly at the switch speed billed by time · case 04
Traffic moving at exactly 5 m/s is billed on the clock.
Segments exactly at the switch speed billed by time · case 05
Traffic moving at exactly 5 m/s is billed on the clock.
Meter rounds every segment to a cent · case 01
Trips with many short segments drift from the exact tariff.
Meter rounds every segment to a cent · case 02
Trips with many short segments drift from the exact tariff.
Meter rounds every segment to a cent · case 03
Trips with many short segments drift from the exact tariff.
Meter rounds every segment to a cent · case 04
Trips with many short segments drift from the exact tariff.
Meter rounds every segment to a cent · case 05
Trips with many short segments drift from the exact tariff.
Meter total truncated · case 01
The meter drops fractional cents instead of rounding.
Meter total truncated · case 02
The meter drops fractional cents instead of rounding.
Meter total truncated · case 03
The meter drops fractional cents instead of rounding.
Meter total truncated · case 04
The meter drops fractional cents instead of rounding.
Meter total truncated · case 05
The meter drops fractional cents instead of rounding.
Hourly waiting rate applied per minute · case 01
Waiting in traffic costs sixty times the tariff.
Hourly waiting rate applied per minute · case 02
Waiting in traffic costs sixty times the tariff.
Hourly waiting rate applied per minute · case 03
Waiting in traffic costs sixty times the tariff.
Hourly waiting rate applied per minute · case 04
Waiting in traffic costs sixty times the tariff.
Hourly waiting rate applied per minute · case 05
Waiting in traffic costs sixty times the tariff.
Surge cap applied to non-members · case 01
Non-members pay 2.0x during a 2.5x surge.
Surge cap applied to non-members · case 02
Non-members pay 2.0x during a 2.5x surge.
Surge cap applied to non-members · case 03
Non-members pay 2.0x during a 2.5x surge.
Surge cap applied to non-members · case 04
Non-members pay 2.0x during a 2.5x surge.
Surge cap applied to non-members · case 05
Non-members pay 2.0x during a 2.5x surge.
No member discount at exactly 1.5x · case 01
Members lose the 10% discount at 1.5x surge.
No member discount at exactly 1.5x · case 02
Members lose the 10% discount at 1.5x surge.
No member discount at exactly 1.5x · case 03
Members lose the 10% discount at 1.5x surge.
No member discount at exactly 1.5x · case 04
Members lose the 10% discount at 1.5x surge.
No member discount at exactly 1.5x · case 05
Members lose the 10% discount at 1.5x surge.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗