Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Yellow and all-red intervals: approach speed in mph is used as ft/s · case 01
Yellow and all-red intervals returns a wrong result when approach speed in mph is used as ft/s.
Yellow and all-red intervals: approach speed in mph is used as ft/s · case 02
Yellow and all-red intervals returns a wrong result when approach speed in mph is used as ft/s.
Yellow and all-red intervals: approach speed in mph is used as ft/s · case 03
Yellow and all-red intervals returns a wrong result when approach speed in mph is used as ft/s.
Yellow and all-red intervals: approach speed in mph is used as ft/s · case 04
Yellow and all-red intervals returns a wrong result when approach speed in mph is used as ft/s.
Yellow and all-red intervals: approach speed in mph is used as ft/s · case 05
Yellow and all-red intervals returns a wrong result when approach speed in mph is used as ft/s.
Yellow and all-red intervals: grade percent is used as a decimal fraction · case 01
Yellow and all-red intervals returns a wrong result when grade percent is used as a decimal fraction.
Yellow and all-red intervals: grade percent is used as a decimal fraction · case 02
Yellow and all-red intervals returns a wrong result when grade percent is used as a decimal fraction.
Yellow and all-red intervals: grade percent is used as a decimal fraction · case 03
Yellow and all-red intervals returns a wrong result when grade percent is used as a decimal fraction.
Yellow and all-red intervals: grade percent is used as a decimal fraction · case 04
Yellow and all-red intervals returns a wrong result when grade percent is used as a decimal fraction.
Yellow and all-red intervals: grade percent is used as a decimal fraction · case 05
Yellow and all-red intervals returns a wrong result when grade percent is used as a decimal fraction.
Yellow and all-red intervals: the grade term omits the factor of two · case 01
Yellow and all-red intervals returns a wrong result when the grade term omits the factor of two.
Yellow and all-red intervals: the grade term omits the factor of two · case 02
Yellow and all-red intervals returns a wrong result when the grade term omits the factor of two.
Yellow and all-red intervals: the grade term omits the factor of two · case 03
Yellow and all-red intervals returns a wrong result when the grade term omits the factor of two.
Yellow and all-red intervals: the grade term omits the factor of two · case 04
Yellow and all-red intervals returns a wrong result when the grade term omits the factor of two.
Yellow and all-red intervals: the grade term omits the factor of two · case 05
Yellow and all-red intervals returns a wrong result when the grade term omits the factor of two.
Yellow and all-red intervals: the yellow interval is truncated to tenths · case 01
Yellow and all-red intervals returns a wrong result when the yellow interval is truncated to tenths.
Yellow and all-red intervals: the yellow interval is truncated to tenths · case 02
Yellow and all-red intervals returns a wrong result when the yellow interval is truncated to tenths.
Yellow and all-red intervals: the yellow interval is truncated to tenths · case 03
Yellow and all-red intervals returns a wrong result when the yellow interval is truncated to tenths.
Yellow and all-red intervals: the yellow interval is truncated to tenths · case 04
Yellow and all-red intervals returns a wrong result when the yellow interval is truncated to tenths.
Yellow and all-red intervals: the yellow interval is truncated to tenths · case 05
Yellow and all-red intervals returns a wrong result when the yellow interval is truncated to tenths.
Yellow and all-red intervals: reaction time in tenths is read as hundredths · case 01
Yellow and all-red intervals returns a wrong result when reaction time in tenths is read as hundredths.
Yellow and all-red intervals: reaction time in tenths is read as hundredths · case 02
Yellow and all-red intervals returns a wrong result when reaction time in tenths is read as hundredths.
Yellow and all-red intervals: reaction time in tenths is read as hundredths · case 03
Yellow and all-red intervals returns a wrong result when reaction time in tenths is read as hundredths.
Yellow and all-red intervals: reaction time in tenths is read as hundredths · case 04
Yellow and all-red intervals returns a wrong result when reaction time in tenths is read as hundredths.
Yellow and all-red intervals: reaction time in tenths is read as hundredths · case 05
Yellow and all-red intervals returns a wrong result when reaction time in tenths is read as hundredths.
Yellow and all-red intervals: the far crosswalk is added when no pedestrians are present · case 01
Yellow and all-red intervals returns a wrong result when the far crosswalk is added when no pedestrians are present.
Yellow and all-red intervals: the far crosswalk is added when no pedestrians are present · case 02
Yellow and all-red intervals returns a wrong result when the far crosswalk is added when no pedestrians are present.
Yellow and all-red intervals: the far crosswalk is added when no pedestrians are present · case 03
Yellow and all-red intervals returns a wrong result when the far crosswalk is added when no pedestrians are present.
Yellow and all-red intervals: the far crosswalk is added when no pedestrians are present · case 04
Yellow and all-red intervals returns a wrong result when the far crosswalk is added when no pedestrians are present.
Yellow and all-red intervals: the far crosswalk is added when no pedestrians are present · case 05
Yellow and all-red intervals returns a wrong result when the far crosswalk is added when no pedestrians are present.
Yellow and all-red intervals: all-red ignores the vehicle length · case 01
Yellow and all-red intervals returns a wrong result when all-red ignores the vehicle length.
Yellow and all-red intervals: all-red ignores the vehicle length · case 02
Yellow and all-red intervals returns a wrong result when all-red ignores the vehicle length.
Yellow and all-red intervals: all-red ignores the vehicle length · case 03
Yellow and all-red intervals returns a wrong result when all-red ignores the vehicle length.
Yellow and all-red intervals: all-red ignores the vehicle length · case 04
Yellow and all-red intervals returns a wrong result when all-red ignores the vehicle length.
Yellow and all-red intervals: all-red ignores the vehicle length · case 05
Yellow and all-red intervals returns a wrong result when all-red ignores the vehicle length.
Pedestrian walk and clearance timing: the flashing dont walk interval is truncated · case 01
Pedestrian walk and clearance timing returns a wrong result when the flashing dont walk interval is truncated.
Pedestrian walk and clearance timing: the flashing dont walk interval is truncated · case 02
Pedestrian walk and clearance timing returns a wrong result when the flashing dont walk interval is truncated.
Pedestrian walk and clearance timing: the flashing dont walk interval is truncated · case 03
Pedestrian walk and clearance timing returns a wrong result when the flashing dont walk interval is truncated.
Pedestrian walk and clearance timing: the flashing dont walk interval is truncated · case 04
Pedestrian walk and clearance timing returns a wrong result when the flashing dont walk interval is truncated.
Pedestrian walk and clearance timing: the flashing dont walk interval is truncated · case 05
Pedestrian walk and clearance timing returns a wrong result when the flashing dont walk interval is truncated.
Pedestrian walk and clearance timing: the total-crossing check omits the pushbutton setback · case 01
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check omits the pushbutton setback.
Pedestrian walk and clearance timing: the total-crossing check omits the pushbutton setback · case 02
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check omits the pushbutton setback.
Pedestrian walk and clearance timing: the total-crossing check omits the pushbutton setback · case 03
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check omits the pushbutton setback.
Pedestrian walk and clearance timing: the total-crossing check omits the pushbutton setback · case 04
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check omits the pushbutton setback.
Pedestrian walk and clearance timing: the total-crossing check omits the pushbutton setback · case 05
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check omits the pushbutton setback.
Pedestrian walk and clearance timing: the total-crossing check reuses the clearance walking speed · case 01
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check reuses the clearance walking speed.
Pedestrian walk and clearance timing: the total-crossing check reuses the clearance walking speed · case 02
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check reuses the clearance walking speed.
Pedestrian walk and clearance timing: the total-crossing check reuses the clearance walking speed · case 03
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check reuses the clearance walking speed.
Pedestrian walk and clearance timing: the total-crossing check reuses the clearance walking speed · case 04
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check reuses the clearance walking speed.
Pedestrian walk and clearance timing: the total-crossing check reuses the clearance walking speed · case 05
Pedestrian walk and clearance timing returns a wrong result when the total-crossing check reuses the clearance walking speed.
Pedestrian walk and clearance timing: walk is extended by comparing walk alone to total crossing time · case 01
Pedestrian walk and clearance timing returns a wrong result when walk is extended by comparing walk alone to total crossing time.
Pedestrian walk and clearance timing: walk is extended by comparing walk alone to total crossing time · case 02
Pedestrian walk and clearance timing returns a wrong result when walk is extended by comparing walk alone to total crossing time.
Pedestrian walk and clearance timing: walk is extended by comparing walk alone to total crossing time · case 03
Pedestrian walk and clearance timing returns a wrong result when walk is extended by comparing walk alone to total crossing time.
Pedestrian walk and clearance timing: walk is extended by comparing walk alone to total crossing time · case 04
Pedestrian walk and clearance timing returns a wrong result when walk is extended by comparing walk alone to total crossing time.
Pedestrian walk and clearance timing: walk is extended by comparing walk alone to total crossing time · case 05
Pedestrian walk and clearance timing returns a wrong result when walk is extended by comparing walk alone to total crossing time.
Pedestrian walk and clearance timing: no credit is taken for FDW overlapping the yellow and all-red · case 01
Pedestrian walk and clearance timing returns a wrong result when no credit is taken for FDW overlapping the yellow and all-red.
Pedestrian walk and clearance timing: no credit is taken for FDW overlapping the yellow and all-red · case 02
Pedestrian walk and clearance timing returns a wrong result when no credit is taken for FDW overlapping the yellow and all-red.
Pedestrian walk and clearance timing: no credit is taken for FDW overlapping the yellow and all-red · case 03
Pedestrian walk and clearance timing returns a wrong result when no credit is taken for FDW overlapping the yellow and all-red.
Pedestrian walk and clearance timing: no credit is taken for FDW overlapping the yellow and all-red · case 04
Pedestrian walk and clearance timing returns a wrong result when no credit is taken for FDW overlapping the yellow and all-red.
Pedestrian walk and clearance timing: no credit is taken for FDW overlapping the yellow and all-red · case 05
Pedestrian walk and clearance timing returns a wrong result when no credit is taken for FDW overlapping the yellow and all-red.
Pedestrian walk and clearance timing: a plan that exactly fills its split is reported as not fitting · case 01
Pedestrian walk and clearance timing returns a wrong result when a plan that exactly fills its split is reported as not fitting.
Pedestrian walk and clearance timing: a plan that exactly fills its split is reported as not fitting · case 02
Pedestrian walk and clearance timing returns a wrong result when a plan that exactly fills its split is reported as not fitting.
Pedestrian walk and clearance timing: a plan that exactly fills its split is reported as not fitting · case 03
Pedestrian walk and clearance timing returns a wrong result when a plan that exactly fills its split is reported as not fitting.
Pedestrian walk and clearance timing: a plan that exactly fills its split is reported as not fitting · case 04
Pedestrian walk and clearance timing returns a wrong result when a plan that exactly fills its split is reported as not fitting.
Pedestrian walk and clearance timing: a plan that exactly fills its split is reported as not fitting · case 05
Pedestrian walk and clearance timing returns a wrong result when a plan that exactly fills its split is reported as not fitting.
Actuated phase gap-out and max-out: an actuation exactly at gap expiry is treated as a gap · case 01
Actuated phase gap-out and max-out returns a wrong result when an actuation exactly at gap expiry is treated as a gap.
Actuated phase gap-out and max-out: an actuation exactly at gap expiry is treated as a gap · case 02
Actuated phase gap-out and max-out returns a wrong result when an actuation exactly at gap expiry is treated as a gap.
Actuated phase gap-out and max-out: an actuation exactly at gap expiry is treated as a gap · case 03
Actuated phase gap-out and max-out returns a wrong result when an actuation exactly at gap expiry is treated as a gap.
Actuated phase gap-out and max-out: an actuation exactly at gap expiry is treated as a gap · case 04
Actuated phase gap-out and max-out returns a wrong result when an actuation exactly at gap expiry is treated as a gap.
Actuated phase gap-out and max-out: an actuation exactly at gap expiry is treated as a gap · case 05
Actuated phase gap-out and max-out returns a wrong result when an actuation exactly at gap expiry is treated as a gap.
Actuated phase gap-out and max-out: the max timer runs from the start of green · case 01
Actuated phase gap-out and max-out returns a wrong result when the max timer runs from the start of green.
Actuated phase gap-out and max-out: the max timer runs from the start of green · case 02
Actuated phase gap-out and max-out returns a wrong result when the max timer runs from the start of green.
Actuated phase gap-out and max-out: the max timer runs from the start of green · case 03
Actuated phase gap-out and max-out returns a wrong result when the max timer runs from the start of green.
Actuated phase gap-out and max-out: the max timer runs from the start of green · case 04
Actuated phase gap-out and max-out returns a wrong result when the max timer runs from the start of green.
Actuated phase gap-out and max-out: the max timer runs from the start of green · case 05
Actuated phase gap-out and max-out returns a wrong result when the max timer runs from the start of green.
Actuated phase gap-out and max-out: the raw passage expiry is compared with max-out · case 01
Actuated phase gap-out and max-out returns a wrong result when the raw passage expiry is compared with max-out.
Actuated phase gap-out and max-out: the raw passage expiry is compared with max-out · case 02
Actuated phase gap-out and max-out returns a wrong result when the raw passage expiry is compared with max-out.
Actuated phase gap-out and max-out: the raw passage expiry is compared with max-out · case 03
Actuated phase gap-out and max-out returns a wrong result when the raw passage expiry is compared with max-out.
Actuated phase gap-out and max-out: the raw passage expiry is compared with max-out · case 04
Actuated phase gap-out and max-out returns a wrong result when the raw passage expiry is compared with max-out.
Actuated phase gap-out and max-out: the raw passage expiry is compared with max-out · case 05
Actuated phase gap-out and max-out returns a wrong result when the raw passage expiry is compared with max-out.
Actuated phase gap-out and max-out: a phase that gapped out before the call ends before the call arrives · case 01
Actuated phase gap-out and max-out returns a wrong result when a phase that gapped out before the call ends before the call arrives.
Actuated phase gap-out and max-out: a phase that gapped out before the call ends before the call arrives · case 02
Actuated phase gap-out and max-out returns a wrong result when a phase that gapped out before the call ends before the call arrives.
Actuated phase gap-out and max-out: a phase that gapped out before the call ends before the call arrives · case 03
Actuated phase gap-out and max-out returns a wrong result when a phase that gapped out before the call ends before the call arrives.
Actuated phase gap-out and max-out: a phase that gapped out before the call ends before the call arrives · case 04
Actuated phase gap-out and max-out returns a wrong result when a phase that gapped out before the call ends before the call arrives.
Actuated phase gap-out and max-out: a phase that gapped out before the call ends before the call arrives · case 05
Actuated phase gap-out and max-out returns a wrong result when a phase that gapped out before the call ends before the call arrives.
Actuated phase gap-out and max-out: the passage timer is started only after min green · case 01
Actuated phase gap-out and max-out returns a wrong result when the passage timer is started only after min green.
Actuated phase gap-out and max-out: the passage timer is started only after min green · case 02
Actuated phase gap-out and max-out returns a wrong result when the passage timer is started only after min green.
Actuated phase gap-out and max-out: the passage timer is started only after min green · case 03
Actuated phase gap-out and max-out returns a wrong result when the passage timer is started only after min green.
Actuated phase gap-out and max-out: the passage timer is started only after min green · case 04
Actuated phase gap-out and max-out returns a wrong result when the passage timer is started only after min green.
Actuated phase gap-out and max-out: the passage timer is started only after min green · case 05
Actuated phase gap-out and max-out returns a wrong result when the passage timer is started only after min green.
Actuated phase gap-out and max-out: the max timer is started at the end of min green · case 01
Actuated phase gap-out and max-out returns a wrong result when the max timer is started at the end of min green.
Actuated phase gap-out and max-out: the max timer is started at the end of min green · case 02
Actuated phase gap-out and max-out returns a wrong result when the max timer is started at the end of min green.
Actuated phase gap-out and max-out: the max timer is started at the end of min green · case 03
Actuated phase gap-out and max-out returns a wrong result when the max timer is started at the end of min green.
Actuated phase gap-out and max-out: the max timer is started at the end of min green · case 04
Actuated phase gap-out and max-out returns a wrong result when the max timer is started at the end of min green.
Actuated phase gap-out and max-out: the max timer is started at the end of min green · case 05
Actuated phase gap-out and max-out returns a wrong result when the max timer is started at the end of min green.
Actuated phase gap-out and max-out: a phase without a conflicting call reports a gap-out · case 01
Actuated phase gap-out and max-out returns a wrong result when a phase without a conflicting call reports a gap-out.
Actuated phase gap-out and max-out: a phase without a conflicting call reports a gap-out · case 02
Actuated phase gap-out and max-out returns a wrong result when a phase without a conflicting call reports a gap-out.
Actuated phase gap-out and max-out: a phase without a conflicting call reports a gap-out · case 03
Actuated phase gap-out and max-out returns a wrong result when a phase without a conflicting call reports a gap-out.
Actuated phase gap-out and max-out: a phase without a conflicting call reports a gap-out · case 04
Actuated phase gap-out and max-out returns a wrong result when a phase without a conflicting call reports a gap-out.
Actuated phase gap-out and max-out: a phase without a conflicting call reports a gap-out · case 05
Actuated phase gap-out and max-out returns a wrong result when a phase without a conflicting call reports a gap-out.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗