Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Time-of-day plan schedule: carryover takes the earliest event of the previous day · case 01
Time-of-day plan schedule returns a wrong result when carryover takes the earliest event of the previous day.
Time-of-day plan schedule: carryover takes the earliest event of the previous day · case 02
Time-of-day plan schedule returns a wrong result when carryover takes the earliest event of the previous day.
Time-of-day plan schedule: carryover takes the earliest event of the previous day · case 03
Time-of-day plan schedule returns a wrong result when carryover takes the earliest event of the previous day.
Time-of-day plan schedule: carryover takes the earliest event of the previous day · case 04
Time-of-day plan schedule returns a wrong result when carryover takes the earliest event of the previous day.
Time-of-day plan schedule: carryover takes the earliest event of the previous day · case 05
Time-of-day plan schedule returns a wrong result when carryover takes the earliest event of the previous day.
Time-of-day plan schedule: the carryover search looks back only one day · case 01
Time-of-day plan schedule returns a wrong result when the carryover search looks back only one day.
Time-of-day plan schedule: the carryover search looks back only one day · case 02
Time-of-day plan schedule returns a wrong result when the carryover search looks back only one day.
Time-of-day plan schedule: the carryover search looks back only one day · case 03
Time-of-day plan schedule returns a wrong result when the carryover search looks back only one day.
Time-of-day plan schedule: the carryover search looks back only one day · case 04
Time-of-day plan schedule returns a wrong result when the carryover search looks back only one day.
Time-of-day plan schedule: the carryover search looks back only one day · case 05
Time-of-day plan schedule returns a wrong result when the carryover search looks back only one day.
Dual-ring barrier sequencing: ring 1 alone decides when the barrier is crossed · case 01
Dual-ring barrier sequencing returns a wrong result when ring 1 alone decides when the barrier is crossed.
Dual-ring barrier sequencing: ring 1 alone decides when the barrier is crossed · case 02
Dual-ring barrier sequencing returns a wrong result when ring 1 alone decides when the barrier is crossed.
Dual-ring barrier sequencing: ring 1 alone decides when the barrier is crossed · case 03
Dual-ring barrier sequencing returns a wrong result when ring 1 alone decides when the barrier is crossed.
Dual-ring barrier sequencing: ring 1 alone decides when the barrier is crossed · case 04
Dual-ring barrier sequencing returns a wrong result when ring 1 alone decides when the barrier is crossed.
Dual-ring barrier sequencing: ring 1 alone decides when the barrier is crossed · case 05
Dual-ring barrier sequencing returns a wrong result when ring 1 alone decides when the barrier is crossed.
Dual-ring barrier sequencing: skipped phases still consume their duration · case 01
Dual-ring barrier sequencing returns a wrong result when skipped phases still consume their duration.
Dual-ring barrier sequencing: skipped phases still consume their duration · case 02
Dual-ring barrier sequencing returns a wrong result when skipped phases still consume their duration.
Dual-ring barrier sequencing: skipped phases still consume their duration · case 03
Dual-ring barrier sequencing returns a wrong result when skipped phases still consume their duration.
Dual-ring barrier sequencing: skipped phases still consume their duration · case 04
Dual-ring barrier sequencing returns a wrong result when skipped phases still consume their duration.
Dual-ring barrier sequencing: skipped phases still consume their duration · case 05
Dual-ring barrier sequencing returns a wrong result when skipped phases still consume their duration.
Dual-ring barrier sequencing: lead-lag is keyed on the second phase of the pair · case 01
Dual-ring barrier sequencing returns a wrong result when lead-lag is keyed on the second phase of the pair.
Dual-ring barrier sequencing: lead-lag is keyed on the second phase of the pair · case 02
Dual-ring barrier sequencing returns a wrong result when lead-lag is keyed on the second phase of the pair.
Dual-ring barrier sequencing: lead-lag is keyed on the second phase of the pair · case 03
Dual-ring barrier sequencing returns a wrong result when lead-lag is keyed on the second phase of the pair.
Dual-ring barrier sequencing: lead-lag is keyed on the second phase of the pair · case 04
Dual-ring barrier sequencing returns a wrong result when lead-lag is keyed on the second phase of the pair.
Dual-ring barrier sequencing: lead-lag is keyed on the second phase of the pair · case 05
Dual-ring barrier sequencing returns a wrong result when lead-lag is keyed on the second phase of the pair.
Dual-ring barrier sequencing: ring 2 starts when ring 1 ends · case 01
Dual-ring barrier sequencing returns a wrong result when ring 2 starts when ring 1 ends.
Dual-ring barrier sequencing: ring 2 starts when ring 1 ends · case 02
Dual-ring barrier sequencing returns a wrong result when ring 2 starts when ring 1 ends.
Dual-ring barrier sequencing: ring 2 starts when ring 1 ends · case 03
Dual-ring barrier sequencing returns a wrong result when ring 2 starts when ring 1 ends.
Dual-ring barrier sequencing: ring 2 starts when ring 1 ends · case 04
Dual-ring barrier sequencing returns a wrong result when ring 2 starts when ring 1 ends.
Dual-ring barrier sequencing: ring 2 starts when ring 1 ends · case 05
Dual-ring barrier sequencing returns a wrong result when ring 2 starts when ring 1 ends.
Uniform delay level of service: capacity ignores the number of lanes · case 01
Uniform delay level of service returns a wrong result when capacity ignores the number of lanes.
Uniform delay level of service: capacity ignores the number of lanes · case 02
Uniform delay level of service returns a wrong result when capacity ignores the number of lanes.
Uniform delay level of service: capacity ignores the number of lanes · case 03
Uniform delay level of service returns a wrong result when capacity ignores the number of lanes.
Uniform delay level of service: capacity ignores the number of lanes · case 04
Uniform delay level of service returns a wrong result when capacity ignores the number of lanes.
Uniform delay level of service: capacity ignores the number of lanes · case 05
Uniform delay level of service returns a wrong result when capacity ignores the number of lanes.
Uniform delay level of service: the delay denominator uses uncapped X · case 01
Uniform delay level of service returns a wrong result when the delay denominator uses uncapped X.
Uniform delay level of service: the delay denominator uses uncapped X · case 02
Uniform delay level of service returns a wrong result when the delay denominator uses uncapped X.
Uniform delay level of service: the delay denominator uses uncapped X · case 03
Uniform delay level of service returns a wrong result when the delay denominator uses uncapped X.
Uniform delay level of service: the delay denominator uses uncapped X · case 04
Uniform delay level of service returns a wrong result when the delay denominator uses uncapped X.
Uniform delay level of service: the delay denominator uses uncapped X · case 05
Uniform delay level of service returns a wrong result when the delay denominator uses uncapped X.
Uniform delay level of service: the delay is truncated to tenths · case 01
Uniform delay level of service returns a wrong result when the delay is truncated to tenths.
Uniform delay level of service: the delay is truncated to tenths · case 02
Uniform delay level of service returns a wrong result when the delay is truncated to tenths.
Uniform delay level of service: the delay is truncated to tenths · case 03
Uniform delay level of service returns a wrong result when the delay is truncated to tenths.
Uniform delay level of service: the delay is truncated to tenths · case 04
Uniform delay level of service returns a wrong result when the delay is truncated to tenths.
Uniform delay level of service: the delay is truncated to tenths · case 05
Uniform delay level of service returns a wrong result when the delay is truncated to tenths.
Uniform delay level of service: LOS thresholds are exclusive · case 01
Uniform delay level of service returns a wrong result when lOS thresholds are exclusive.
Uniform delay level of service: LOS thresholds are exclusive · case 02
Uniform delay level of service returns a wrong result when lOS thresholds are exclusive.
Uniform delay level of service: LOS thresholds are exclusive · case 03
Uniform delay level of service returns a wrong result when lOS thresholds are exclusive.
Uniform delay level of service: LOS thresholds are exclusive · case 04
Uniform delay level of service returns a wrong result when lOS thresholds are exclusive.
Uniform delay level of service: LOS thresholds are exclusive · case 05
Uniform delay level of service returns a wrong result when lOS thresholds are exclusive.
Uniform delay level of service: oversaturation is only flagged above X = 1.1 · case 01
Uniform delay level of service returns a wrong result when oversaturation is only flagged above X = 1.1.
Uniform delay level of service: oversaturation is only flagged above X = 1.1 · case 02
Uniform delay level of service returns a wrong result when oversaturation is only flagged above X = 1.1.
Uniform delay level of service: oversaturation is only flagged above X = 1.1 · case 03
Uniform delay level of service returns a wrong result when oversaturation is only flagged above X = 1.1.
Uniform delay level of service: oversaturation is only flagged above X = 1.1 · case 04
Uniform delay level of service returns a wrong result when oversaturation is only flagged above X = 1.1.
Uniform delay level of service: oversaturation is only flagged above X = 1.1 · case 05
Uniform delay level of service returns a wrong result when oversaturation is only flagged above X = 1.1.
Uniform delay level of service: the uniform delay uses green instead of cycle · case 01
Uniform delay level of service returns a wrong result when the uniform delay uses green instead of cycle.
Uniform delay level of service: the uniform delay uses green instead of cycle · case 02
Uniform delay level of service returns a wrong result when the uniform delay uses green instead of cycle.
Uniform delay level of service: the uniform delay uses green instead of cycle · case 03
Uniform delay level of service returns a wrong result when the uniform delay uses green instead of cycle.
Uniform delay level of service: the uniform delay uses green instead of cycle · case 04
Uniform delay level of service returns a wrong result when the uniform delay uses green instead of cycle.
Uniform delay level of service: the uniform delay uses green instead of cycle · case 05
Uniform delay level of service returns a wrong result when the uniform delay uses green instead of cycle.
Railroad preemption entry timing: the normal minimum green is honoured during preemption entry · case 01
Railroad preemption entry timing returns a wrong result when the normal minimum green is honoured during preemption entry.
Railroad preemption entry timing: the normal minimum green is honoured during preemption entry · case 02
Railroad preemption entry timing returns a wrong result when the normal minimum green is honoured during preemption entry.
Railroad preemption entry timing: the normal minimum green is honoured during preemption entry · case 03
Railroad preemption entry timing returns a wrong result when the normal minimum green is honoured during preemption entry.
Railroad preemption entry timing: the normal minimum green is honoured during preemption entry · case 04
Railroad preemption entry timing returns a wrong result when the normal minimum green is honoured during preemption entry.
Railroad preemption entry timing: the normal minimum green is honoured during preemption entry · case 05
Railroad preemption entry timing returns a wrong result when the normal minimum green is honoured during preemption entry.
Railroad preemption entry timing: an active yellow is truncated on preemption · case 01
Railroad preemption entry timing returns a wrong result when an active yellow is truncated on preemption.
Railroad preemption entry timing: an active yellow is truncated on preemption · case 02
Railroad preemption entry timing returns a wrong result when an active yellow is truncated on preemption.
Railroad preemption entry timing: an active yellow is truncated on preemption · case 03
Railroad preemption entry timing returns a wrong result when an active yellow is truncated on preemption.
Railroad preemption entry timing: an active yellow is truncated on preemption · case 04
Railroad preemption entry timing returns a wrong result when an active yellow is truncated on preemption.
Railroad preemption entry timing: an active yellow is truncated on preemption · case 05
Railroad preemption entry timing returns a wrong result when an active yellow is truncated on preemption.
Railroad preemption entry timing: FDW is timed even when pedestrian truncation is enabled · case 01
Railroad preemption entry timing returns a wrong result when fDW is timed even when pedestrian truncation is enabled.
Railroad preemption entry timing: FDW is timed even when pedestrian truncation is enabled · case 02
Railroad preemption entry timing returns a wrong result when fDW is timed even when pedestrian truncation is enabled.
Railroad preemption entry timing: FDW is timed even when pedestrian truncation is enabled · case 03
Railroad preemption entry timing returns a wrong result when fDW is timed even when pedestrian truncation is enabled.
Railroad preemption entry timing: FDW is timed even when pedestrian truncation is enabled · case 04
Railroad preemption entry timing returns a wrong result when fDW is timed even when pedestrian truncation is enabled.
Railroad preemption entry timing: FDW is timed even when pedestrian truncation is enabled · case 05
Railroad preemption entry timing returns a wrong result when fDW is timed even when pedestrian truncation is enabled.
Railroad preemption entry timing: the FDW remainder is measured from vehicle green · case 01
Railroad preemption entry timing returns a wrong result when the FDW remainder is measured from vehicle green.
Railroad preemption entry timing: the FDW remainder is measured from vehicle green · case 02
Railroad preemption entry timing returns a wrong result when the FDW remainder is measured from vehicle green.
Railroad preemption entry timing: the FDW remainder is measured from vehicle green · case 03
Railroad preemption entry timing returns a wrong result when the FDW remainder is measured from vehicle green.
Railroad preemption entry timing: the FDW remainder is measured from vehicle green · case 04
Railroad preemption entry timing returns a wrong result when the FDW remainder is measured from vehicle green.
Railroad preemption entry timing: the FDW remainder is measured from vehicle green · case 05
Railroad preemption entry timing returns a wrong result when the FDW remainder is measured from vehicle green.
Railroad preemption entry timing: pedestrian time and minimum green are added · case 01
Railroad preemption entry timing returns a wrong result when pedestrian time and minimum green are added.
Railroad preemption entry timing: pedestrian time and minimum green are added · case 02
Railroad preemption entry timing returns a wrong result when pedestrian time and minimum green are added.
Railroad preemption entry timing: pedestrian time and minimum green are added · case 03
Railroad preemption entry timing returns a wrong result when pedestrian time and minimum green are added.
Railroad preemption entry timing: pedestrian time and minimum green are added · case 04
Railroad preemption entry timing returns a wrong result when pedestrian time and minimum green are added.
Railroad preemption entry timing: pedestrian time and minimum green are added · case 05
Railroad preemption entry timing returns a wrong result when pedestrian time and minimum green are added.
Railroad preemption entry timing: an all-red in progress is timed again in full · case 01
Railroad preemption entry timing returns a wrong result when an all-red in progress is timed again in full.
Railroad preemption entry timing: an all-red in progress is timed again in full · case 02
Railroad preemption entry timing returns a wrong result when an all-red in progress is timed again in full.
Railroad preemption entry timing: an all-red in progress is timed again in full · case 03
Railroad preemption entry timing returns a wrong result when an all-red in progress is timed again in full.
Railroad preemption entry timing: an all-red in progress is timed again in full · case 04
Railroad preemption entry timing returns a wrong result when an all-red in progress is timed again in full.
Railroad preemption entry timing: an all-red in progress is timed again in full · case 05
Railroad preemption entry timing returns a wrong result when an all-red in progress is timed again in full.
Railroad preemption entry timing: track phase in yellow is treated as already serving · case 01
Railroad preemption entry timing returns a wrong result when track phase in yellow is treated as already serving.
Railroad preemption entry timing: track phase in yellow is treated as already serving · case 02
Railroad preemption entry timing returns a wrong result when track phase in yellow is treated as already serving.
Railroad preemption entry timing: track phase in yellow is treated as already serving · case 03
Railroad preemption entry timing returns a wrong result when track phase in yellow is treated as already serving.
Railroad preemption entry timing: track phase in yellow is treated as already serving · case 04
Railroad preemption entry timing returns a wrong result when track phase in yellow is treated as already serving.
Railroad preemption entry timing: track phase in yellow is treated as already serving · case 05
Railroad preemption entry timing returns a wrong result when track phase in yellow is treated as already serving.
Transit signal priority decision: arrival times beyond one cycle are clamped instead of wrapped · case 01
Transit signal priority decision returns a wrong result when arrival times beyond one cycle are clamped instead of wrapped.
Transit signal priority decision: arrival times beyond one cycle are clamped instead of wrapped · case 02
Transit signal priority decision returns a wrong result when arrival times beyond one cycle are clamped instead of wrapped.
Transit signal priority decision: arrival times beyond one cycle are clamped instead of wrapped · case 03
Transit signal priority decision returns a wrong result when arrival times beyond one cycle are clamped instead of wrapped.
Transit signal priority decision: arrival times beyond one cycle are clamped instead of wrapped · case 04
Transit signal priority decision returns a wrong result when arrival times beyond one cycle are clamped instead of wrapped.
Transit signal priority decision: arrival times beyond one cycle are clamped instead of wrapped · case 05
Transit signal priority decision returns a wrong result when arrival times beyond one cycle are clamped instead of wrapped.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗