Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Transit signal priority decision: the lockout window lets the boundary cycle through · case 01
Transit signal priority decision returns a wrong result when the lockout window lets the boundary cycle through.
Transit signal priority decision: the lockout window lets the boundary cycle through · case 02
Transit signal priority decision returns a wrong result when the lockout window lets the boundary cycle through.
Transit signal priority decision: the lockout window lets the boundary cycle through · case 03
Transit signal priority decision returns a wrong result when the lockout window lets the boundary cycle through.
Transit signal priority decision: the lockout window lets the boundary cycle through · case 04
Transit signal priority decision returns a wrong result when the lockout window lets the boundary cycle through.
Transit signal priority decision: the lockout window lets the boundary cycle through · case 05
Transit signal priority decision returns a wrong result when the lockout window lets the boundary cycle through.
Transit signal priority decision: a bus arriving at green end is treated as in green · case 01
Transit signal priority decision returns a wrong result when a bus arriving at green end is treated as in green.
Transit signal priority decision: a bus arriving at green end is treated as in green · case 02
Transit signal priority decision returns a wrong result when a bus arriving at green end is treated as in green.
Transit signal priority decision: a bus arriving at green end is treated as in green · case 03
Transit signal priority decision returns a wrong result when a bus arriving at green end is treated as in green.
Transit signal priority decision: a bus arriving at green end is treated as in green · case 04
Transit signal priority decision returns a wrong result when a bus arriving at green end is treated as in green.
Transit signal priority decision: a bus arriving at green end is treated as in green · case 05
Transit signal priority decision returns a wrong result when a bus arriving at green end is treated as in green.
Transit signal priority decision: the extension distance is not wrapped around the cycle · case 01
Transit signal priority decision returns a wrong result when the extension distance is not wrapped around the cycle.
Transit signal priority decision: the extension distance is not wrapped around the cycle · case 02
Transit signal priority decision returns a wrong result when the extension distance is not wrapped around the cycle.
Transit signal priority decision: the extension distance is not wrapped around the cycle · case 03
Transit signal priority decision returns a wrong result when the extension distance is not wrapped around the cycle.
Transit signal priority decision: the extension distance is not wrapped around the cycle · case 04
Transit signal priority decision returns a wrong result when the extension distance is not wrapped around the cycle.
Transit signal priority decision: the extension distance is not wrapped around the cycle · case 05
Transit signal priority decision returns a wrong result when the extension distance is not wrapped around the cycle.
Transit signal priority decision: green is extended only up to the arrival second · case 01
Transit signal priority decision returns a wrong result when green is extended only up to the arrival second.
Transit signal priority decision: green is extended only up to the arrival second · case 02
Transit signal priority decision returns a wrong result when green is extended only up to the arrival second.
Transit signal priority decision: green is extended only up to the arrival second · case 03
Transit signal priority decision returns a wrong result when green is extended only up to the arrival second.
Transit signal priority decision: green is extended only up to the arrival second · case 04
Transit signal priority decision returns a wrong result when green is extended only up to the arrival second.
Transit signal priority decision: green is extended only up to the arrival second · case 05
Transit signal priority decision returns a wrong result when green is extended only up to the arrival second.
Transit signal priority decision: early green always uses the maximum advance · case 01
Transit signal priority decision returns a wrong result when early green always uses the maximum advance.
Transit signal priority decision: early green always uses the maximum advance · case 02
Transit signal priority decision returns a wrong result when early green always uses the maximum advance.
Transit signal priority decision: early green always uses the maximum advance · case 03
Transit signal priority decision returns a wrong result when early green always uses the maximum advance.
Transit signal priority decision: early green always uses the maximum advance · case 04
Transit signal priority decision returns a wrong result when early green always uses the maximum advance.
Transit signal priority decision: early green always uses the maximum advance · case 05
Transit signal priority decision returns a wrong result when early green always uses the maximum advance.
Transit signal priority decision: time to next green is measured backwards · case 01
Transit signal priority decision returns a wrong result when time to next green is measured backwards.
Transit signal priority decision: time to next green is measured backwards · case 02
Transit signal priority decision returns a wrong result when time to next green is measured backwards.
Transit signal priority decision: time to next green is measured backwards · case 03
Transit signal priority decision returns a wrong result when time to next green is measured backwards.
Transit signal priority decision: time to next green is measured backwards · case 04
Transit signal priority decision returns a wrong result when time to next green is measured backwards.
Transit signal priority decision: time to next green is measured backwards · case 05
Transit signal priority decision returns a wrong result when time to next green is measured backwards.
Loop detector count and occupancy binning: vehicles are counted in the bin where they leave · case 01
Loop detector count and occupancy binning returns a wrong result when vehicles are counted in the bin where they leave.
Loop detector count and occupancy binning: vehicles are counted in the bin where they leave · case 02
Loop detector count and occupancy binning returns a wrong result when vehicles are counted in the bin where they leave.
Loop detector count and occupancy binning: vehicles are counted in the bin where they leave · case 03
Loop detector count and occupancy binning returns a wrong result when vehicles are counted in the bin where they leave.
Loop detector count and occupancy binning: vehicles are counted in the bin where they leave · case 04
Loop detector count and occupancy binning returns a wrong result when vehicles are counted in the bin where they leave.
Loop detector count and occupancy binning: vehicles are counted in the bin where they leave · case 05
Loop detector count and occupancy binning returns a wrong result when vehicles are counted in the bin where they leave.
Loop detector count and occupancy binning: occupied time is measured from vehicle arrival rather than bin start · case 01
Loop detector count and occupancy binning returns a wrong result when occupied time is measured from vehicle arrival rather than bin start.
Loop detector count and occupancy binning: occupied time is measured from vehicle arrival rather than bin start · case 02
Loop detector count and occupancy binning returns a wrong result when occupied time is measured from vehicle arrival rather than bin start.
Loop detector count and occupancy binning: occupied time is measured from vehicle arrival rather than bin start · case 03
Loop detector count and occupancy binning returns a wrong result when occupied time is measured from vehicle arrival rather than bin start.
Loop detector count and occupancy binning: occupied time is measured from vehicle arrival rather than bin start · case 04
Loop detector count and occupancy binning returns a wrong result when occupied time is measured from vehicle arrival rather than bin start.
Loop detector count and occupancy binning: occupied time is measured from vehicle arrival rather than bin start · case 05
Loop detector count and occupancy binning returns a wrong result when occupied time is measured from vehicle arrival rather than bin start.
Loop detector count and occupancy binning: a presence exactly at the threshold is not stuck · case 01
Loop detector count and occupancy binning returns a wrong result when a presence exactly at the threshold is not stuck.
Loop detector count and occupancy binning: a presence exactly at the threshold is not stuck · case 02
Loop detector count and occupancy binning returns a wrong result when a presence exactly at the threshold is not stuck.
Loop detector count and occupancy binning: a presence exactly at the threshold is not stuck · case 03
Loop detector count and occupancy binning returns a wrong result when a presence exactly at the threshold is not stuck.
Loop detector count and occupancy binning: a presence exactly at the threshold is not stuck · case 04
Loop detector count and occupancy binning returns a wrong result when a presence exactly at the threshold is not stuck.
Loop detector count and occupancy binning: a presence exactly at the threshold is not stuck · case 05
Loop detector count and occupancy binning returns a wrong result when a presence exactly at the threshold is not stuck.
Loop detector count and occupancy binning: occupancy percent is scaled after integer division · case 01
Loop detector count and occupancy binning returns a wrong result when occupancy percent is scaled after integer division.
Loop detector count and occupancy binning: occupancy percent is scaled after integer division · case 02
Loop detector count and occupancy binning returns a wrong result when occupancy percent is scaled after integer division.
Loop detector count and occupancy binning: occupancy percent is scaled after integer division · case 03
Loop detector count and occupancy binning returns a wrong result when occupancy percent is scaled after integer division.
Loop detector count and occupancy binning: occupancy percent is scaled after integer division · case 04
Loop detector count and occupancy binning returns a wrong result when occupancy percent is scaled after integer division.
Loop detector count and occupancy binning: occupancy percent is scaled after integer division · case 05
Loop detector count and occupancy binning returns a wrong result when occupancy percent is scaled after integer division.
Loop detector count and occupancy binning: the no-activity limit is compared with the bin count · case 01
Loop detector count and occupancy binning returns a wrong result when the no-activity limit is compared with the bin count.
Loop detector count and occupancy binning: the no-activity limit is compared with the bin count · case 02
Loop detector count and occupancy binning returns a wrong result when the no-activity limit is compared with the bin count.
Loop detector count and occupancy binning: the no-activity limit is compared with the bin count · case 03
Loop detector count and occupancy binning returns a wrong result when the no-activity limit is compared with the bin count.
Loop detector count and occupancy binning: the no-activity limit is compared with the bin count · case 04
Loop detector count and occupancy binning returns a wrong result when the no-activity limit is compared with the bin count.
Loop detector count and occupancy binning: the no-activity limit is compared with the bin count · case 05
Loop detector count and occupancy binning returns a wrong result when the no-activity limit is compared with the bin count.
Loop detector count and occupancy binning: vehicles present before period start are counted in the last bin · case 01
Loop detector count and occupancy binning returns a wrong result when vehicles present before period start are counted in the last bin.
Loop detector count and occupancy binning: vehicles present before period start are counted in the last bin · case 02
Loop detector count and occupancy binning returns a wrong result when vehicles present before period start are counted in the last bin.
Loop detector count and occupancy binning: vehicles present before period start are counted in the last bin · case 03
Loop detector count and occupancy binning returns a wrong result when vehicles present before period start are counted in the last bin.
Loop detector count and occupancy binning: vehicles present before period start are counted in the last bin · case 04
Loop detector count and occupancy binning returns a wrong result when vehicles present before period start are counted in the last bin.
Loop detector count and occupancy binning: vehicles present before period start are counted in the last bin · case 05
Loop detector count and occupancy binning returns a wrong result when vehicles present before period start are counted in the last bin.
Split failure detection: the red occupancy window starts at yellow onset · case 01
Split failure detection returns a wrong result when the red occupancy window starts at yellow onset.
Split failure detection: the red occupancy window starts at yellow onset · case 02
Split failure detection returns a wrong result when the red occupancy window starts at yellow onset.
Split failure detection: the red occupancy window starts at yellow onset · case 03
Split failure detection returns a wrong result when the red occupancy window starts at yellow onset.
Split failure detection: the red occupancy window starts at yellow onset · case 04
Split failure detection returns a wrong result when the red occupancy window starts at yellow onset.
Split failure detection: the red occupancy window starts at yellow onset · case 05
Split failure detection returns a wrong result when the red occupancy window starts at yellow onset.
Split failure detection: split failure requires strictly more than 80 percent · case 01
Split failure detection returns a wrong result when split failure requires strictly more than 80 percent.
Split failure detection: split failure requires strictly more than 80 percent · case 02
Split failure detection returns a wrong result when split failure requires strictly more than 80 percent.
Split failure detection: split failure requires strictly more than 80 percent · case 03
Split failure detection returns a wrong result when split failure requires strictly more than 80 percent.
Split failure detection: split failure requires strictly more than 80 percent · case 04
Split failure detection returns a wrong result when split failure requires strictly more than 80 percent.
Split failure detection: split failure requires strictly more than 80 percent · case 05
Split failure detection returns a wrong result when split failure requires strictly more than 80 percent.
Split failure detection: occupancy before the window start is credited · case 01
Split failure detection returns a wrong result when occupancy before the window start is credited.
Split failure detection: occupancy before the window start is credited · case 02
Split failure detection returns a wrong result when occupancy before the window start is credited.
Split failure detection: occupancy before the window start is credited · case 03
Split failure detection returns a wrong result when occupancy before the window start is credited.
Split failure detection: occupancy before the window start is credited · case 04
Split failure detection returns a wrong result when occupancy before the window start is credited.
Split failure detection: occupancy before the window start is credited · case 05
Split failure detection returns a wrong result when occupancy before the window start is credited.
Split failure detection: green occupancy includes the yellow interval · case 01
Split failure detection returns a wrong result when green occupancy includes the yellow interval.
Split failure detection: green occupancy includes the yellow interval · case 02
Split failure detection returns a wrong result when green occupancy includes the yellow interval.
Split failure detection: green occupancy includes the yellow interval · case 03
Split failure detection returns a wrong result when green occupancy includes the yellow interval.
Split failure detection: green occupancy includes the yellow interval · case 04
Split failure detection returns a wrong result when green occupancy includes the yellow interval.
Split failure detection: green occupancy includes the yellow interval · case 05
Split failure detection returns a wrong result when green occupancy includes the yellow interval.
Split failure detection: the failure percentage divides before scaling · case 01
Split failure detection returns a wrong result when the failure percentage divides before scaling.
Split failure detection: the failure percentage divides before scaling · case 02
Split failure detection returns a wrong result when the failure percentage divides before scaling.
Split failure detection: the failure percentage divides before scaling · case 03
Split failure detection returns a wrong result when the failure percentage divides before scaling.
Split failure detection: the failure percentage divides before scaling · case 04
Split failure detection returns a wrong result when the failure percentage divides before scaling.
Split failure detection: the failure percentage divides before scaling · case 05
Split failure detection returns a wrong result when the failure percentage divides before scaling.
Conflict monitor fault scan: compatible pairs are stored in the order given · case 01
Conflict monitor fault scan returns a wrong result when compatible pairs are stored in the order given.
Conflict monitor fault scan: compatible pairs are stored in the order given · case 02
Conflict monitor fault scan returns a wrong result when compatible pairs are stored in the order given.
Conflict monitor fault scan: compatible pairs are stored in the order given · case 03
Conflict monitor fault scan returns a wrong result when compatible pairs are stored in the order given.
Conflict monitor fault scan: compatible pairs are stored in the order given · case 04
Conflict monitor fault scan returns a wrong result when compatible pairs are stored in the order given.
Conflict monitor fault scan: compatible pairs are stored in the order given · case 05
Conflict monitor fault scan returns a wrong result when compatible pairs are stored in the order given.
Conflict monitor fault scan: yellow indications are left out of the conflict check · case 01
Conflict monitor fault scan returns a wrong result when yellow indications are left out of the conflict check.
Conflict monitor fault scan: yellow indications are left out of the conflict check · case 02
Conflict monitor fault scan returns a wrong result when yellow indications are left out of the conflict check.
Conflict monitor fault scan: yellow indications are left out of the conflict check · case 03
Conflict monitor fault scan returns a wrong result when yellow indications are left out of the conflict check.
Conflict monitor fault scan: yellow indications are left out of the conflict check · case 04
Conflict monitor fault scan returns a wrong result when yellow indications are left out of the conflict check.
Conflict monitor fault scan: yellow indications are left out of the conflict check · case 05
Conflict monitor fault scan returns a wrong result when yellow indications are left out of the conflict check.
Conflict monitor fault scan: disabled channels showing green still enter the conflict check · case 01
Conflict monitor fault scan returns a wrong result when disabled channels showing green still enter the conflict check.
Conflict monitor fault scan: disabled channels showing green still enter the conflict check · case 02
Conflict monitor fault scan returns a wrong result when disabled channels showing green still enter the conflict check.
Conflict monitor fault scan: disabled channels showing green still enter the conflict check · case 03
Conflict monitor fault scan returns a wrong result when disabled channels showing green still enter the conflict check.
Conflict monitor fault scan: disabled channels showing green still enter the conflict check · case 04
Conflict monitor fault scan returns a wrong result when disabled channels showing green still enter the conflict check.
Conflict monitor fault scan: disabled channels showing green still enter the conflict check · case 05
Conflict monitor fault scan returns a wrong result when disabled channels showing green still enter the conflict check.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗