Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Gap displacement uses offset sum or reversed offset change · case 01
The decoded time state disagrees with the explicit regression oracle for width.
Gap displacement uses offset sum or reversed offset change · case 02
The decoded time state disagrees with the explicit regression oracle for width.
Gap displacement uses offset sum or reversed offset change · case 03
The decoded time state disagrees with the explicit regression oracle for width.
Gap displacement uses offset sum or reversed offset change · case 04
The decoded time state disagrees with the explicit regression oracle for width.
Gap displacement uses offset sum or reversed offset change · case 05
The decoded time state disagrees with the explicit regression oracle for width.
Forward transition assigns gap boundaries incorrectly · case 01
The decoded time state disagrees with the explicit regression oracle for in_gap.
Forward transition assigns gap boundaries incorrectly · case 02
The decoded time state disagrees with the explicit regression oracle for in_gap.
Forward transition assigns gap boundaries incorrectly · case 03
The decoded time state disagrees with the explicit regression oracle for in_gap.
Forward transition assigns gap boundaries incorrectly · case 04
The decoded time state disagrees with the explicit regression oracle for in_gap.
Forward transition assigns gap boundaries incorrectly · case 05
The decoded time state disagrees with the explicit regression oracle for in_gap.
Gap shift ignores directional and reject policy · case 01
The decoded time state disagrees with the explicit regression oracle for shift.
Gap shift ignores directional and reject policy · case 02
The decoded time state disagrees with the explicit regression oracle for shift.
Gap shift ignores directional and reject policy · case 03
The decoded time state disagrees with the explicit regression oracle for shift.
Gap shift ignores directional and reject policy · case 04
The decoded time state disagrees with the explicit regression oracle for shift.
Gap shift ignores directional and reject policy · case 05
The decoded time state disagrees with the explicit regression oracle for shift.
Gap resolution rejects repairable times or accepts reject policy · case 01
The decoded time state disagrees with the explicit regression oracle for resolved.
Gap resolution rejects repairable times or accepts reject policy · case 02
The decoded time state disagrees with the explicit regression oracle for resolved.
Gap resolution rejects repairable times or accepts reject policy · case 03
The decoded time state disagrees with the explicit regression oracle for resolved.
Gap resolution rejects repairable times or accepts reject policy · case 04
The decoded time state disagrees with the explicit regression oracle for resolved.
Gap resolution rejects repairable times or accepts reject policy · case 05
The decoded time state disagrees with the explicit regression oracle for resolved.
Gap repair keeps an offset from the discarded side · case 01
The decoded time state disagrees with the explicit regression oracle for offset.
Gap repair keeps an offset from the discarded side · case 02
The decoded time state disagrees with the explicit regression oracle for offset.
Gap repair keeps an offset from the discarded side · case 03
The decoded time state disagrees with the explicit regression oracle for offset.
Gap repair keeps an offset from the discarded side · case 04
The decoded time state disagrees with the explicit regression oracle for offset.
Gap repair keeps an offset from the discarded side · case 05
The decoded time state disagrees with the explicit regression oracle for offset.
Gap repair exposes local coordinate as UTC · case 01
The decoded time state disagrees with the explicit regression oracle for utc.
Gap repair exposes local coordinate as UTC · case 02
The decoded time state disagrees with the explicit regression oracle for utc.
Gap repair exposes local coordinate as UTC · case 03
The decoded time state disagrees with the explicit regression oracle for utc.
Gap repair exposes local coordinate as UTC · case 04
The decoded time state disagrees with the explicit regression oracle for utc.
Gap repair exposes local coordinate as UTC · case 05
The decoded time state disagrees with the explicit regression oracle for utc.
Backward or zero civil adjustment gets a positive direction marker · case 01
The decoded time state disagrees with the explicit regression oracle for direction.
Backward or zero civil adjustment gets a positive direction marker · case 02
The decoded time state disagrees with the explicit regression oracle for direction.
Backward or zero civil adjustment gets a positive direction marker · case 03
The decoded time state disagrees with the explicit regression oracle for direction.
Backward or zero civil adjustment gets a positive direction marker · case 04
The decoded time state disagrees with the explicit regression oracle for direction.
Backward or zero civil adjustment gets a positive direction marker · case 05
The decoded time state disagrees with the explicit regression oracle for direction.
Rejected local time is reported as a successful shift · case 01
The decoded time state disagrees with the explicit regression oracle for changed.
Rejected local time is reported as a successful shift · case 02
The decoded time state disagrees with the explicit regression oracle for changed.
Rejected local time is reported as a successful shift · case 03
The decoded time state disagrees with the explicit regression oracle for changed.
Rejected local time is reported as a successful shift · case 04
The decoded time state disagrees with the explicit regression oracle for changed.
Rejected local time is reported as a successful shift · case 05
The decoded time state disagrees with the explicit regression oracle for changed.
Day encoding erases leap metadata or adds a leap to every day · case 01
The decoded time state disagrees with the explicit regression oracle for length.
Day encoding erases leap metadata or adds a leap to every day · case 02
The decoded time state disagrees with the explicit regression oracle for length.
Day encoding erases leap metadata or adds a leap to every day · case 03
The decoded time state disagrees with the explicit regression oracle for length.
Day encoding erases leap metadata or adds a leap to every day · case 04
The decoded time state disagrees with the explicit regression oracle for length.
Day encoding erases leap metadata or adds a leap to every day · case 05
The decoded time state disagrees with the explicit regression oracle for length.
Leap label validator admits next midnight or rejects extra second · case 01
The decoded time state disagrees with the explicit regression oracle for valid.
Leap label validator admits next midnight or rejects extra second · case 02
The decoded time state disagrees with the explicit regression oracle for valid.
Leap label validator admits next midnight or rejects extra second · case 03
The decoded time state disagrees with the explicit regression oracle for valid.
Leap label validator admits next midnight or rejects extra second · case 04
The decoded time state disagrees with the explicit regression oracle for valid.
Leap label validator admits next midnight or rejects extra second · case 05
The decoded time state disagrees with the explicit regression oracle for valid.
Atomic label collapses leap second or applies leap at day start · case 01
The decoded time state disagrees with the explicit regression oracle for atomic.
Atomic label collapses leap second or applies leap at day start · case 02
The decoded time state disagrees with the explicit regression oracle for atomic.
Atomic label collapses leap second or applies leap at day start · case 03
The decoded time state disagrees with the explicit regression oracle for atomic.
Atomic label collapses leap second or applies leap at day start · case 04
The decoded time state disagrees with the explicit regression oracle for atomic.
Atomic label collapses leap second or applies leap at day start · case 05
The decoded time state disagrees with the explicit regression oracle for atomic.
Leap metadata is confused with the extra-second label · case 01
The decoded time state disagrees with the explicit regression oracle for extra.
Leap metadata is confused with the extra-second label · case 02
The decoded time state disagrees with the explicit regression oracle for extra.
Leap metadata is confused with the extra-second label · case 03
The decoded time state disagrees with the explicit regression oracle for extra.
Leap metadata is confused with the extra-second label · case 04
The decoded time state disagrees with the explicit regression oracle for extra.
Leap metadata is confused with the extra-second label · case 05
The decoded time state disagrees with the explicit regression oracle for extra.
Leap-second display becomes hour twenty-four or midnight · case 01
The decoded time state disagrees with the explicit regression oracle for hour.
Leap-second display becomes hour twenty-four or midnight · case 02
The decoded time state disagrees with the explicit regression oracle for hour.
Leap-second display becomes hour twenty-four or midnight · case 03
The decoded time state disagrees with the explicit regression oracle for hour.
Leap-second display becomes hour twenty-four or midnight · case 04
The decoded time state disagrees with the explicit regression oracle for hour.
Leap-second display becomes hour twenty-four or midnight · case 05
The decoded time state disagrees with the explicit regression oracle for hour.
Leap display loses the repeated final minute · case 01
The decoded time state disagrees with the explicit regression oracle for minute.
Leap display loses the repeated final minute · case 02
The decoded time state disagrees with the explicit regression oracle for minute.
Leap display loses the repeated final minute · case 03
The decoded time state disagrees with the explicit regression oracle for minute.
Leap display loses the repeated final minute · case 04
The decoded time state disagrees with the explicit regression oracle for minute.
Leap display loses the repeated final minute · case 05
The decoded time state disagrees with the explicit regression oracle for minute.
Extra-second label is reduced modulo sixty · case 01
The decoded time state disagrees with the explicit regression oracle for second.
Extra-second label is reduced modulo sixty · case 02
The decoded time state disagrees with the explicit regression oracle for second.
Extra-second label is reduced modulo sixty · case 03
The decoded time state disagrees with the explicit regression oracle for second.
Extra-second label is reduced modulo sixty · case 04
The decoded time state disagrees with the explicit regression oracle for second.
Extra-second label is reduced modulo sixty · case 05
The decoded time state disagrees with the explicit regression oracle for second.
End-of-day marker ignores inserted leap label · case 01
The decoded time state disagrees with the explicit regression oracle for last.
End-of-day marker ignores inserted leap label · case 02
The decoded time state disagrees with the explicit regression oracle for last.
End-of-day marker ignores inserted leap label · case 03
The decoded time state disagrees with the explicit regression oracle for last.
End-of-day marker ignores inserted leap label · case 04
The decoded time state disagrees with the explicit regression oracle for last.
End-of-day marker ignores inserted leap label · case 05
The decoded time state disagrees with the explicit regression oracle for last.
Midnight countdown counts labels instead of remaining tick intervals · case 01
The decoded time state disagrees with the explicit regression oracle for remaining.
Midnight countdown counts labels instead of remaining tick intervals · case 02
The decoded time state disagrees with the explicit regression oracle for remaining.
Midnight countdown counts labels instead of remaining tick intervals · case 03
The decoded time state disagrees with the explicit regression oracle for remaining.
Midnight countdown counts labels instead of remaining tick intervals · case 04
The decoded time state disagrees with the explicit regression oracle for remaining.
Midnight countdown counts labels instead of remaining tick intervals · case 05
The decoded time state disagrees with the explicit regression oracle for remaining.
Following midnight discards leap adjustment or absolute origin · case 01
The decoded time state disagrees with the explicit regression oracle for midnight.
Following midnight discards leap adjustment or absolute origin · case 02
The decoded time state disagrees with the explicit regression oracle for midnight.
Following midnight discards leap adjustment or absolute origin · case 03
The decoded time state disagrees with the explicit regression oracle for midnight.
Following midnight discards leap adjustment or absolute origin · case 04
The decoded time state disagrees with the explicit regression oracle for midnight.
Following midnight discards leap adjustment or absolute origin · case 05
The decoded time state disagrees with the explicit regression oracle for midnight.
Smear span counts endpoint labels instead of elapsed ticks · case 01
The decoded time state disagrees with the explicit regression oracle for width.
Smear span counts endpoint labels instead of elapsed ticks · case 02
The decoded time state disagrees with the explicit regression oracle for width.
Smear span counts endpoint labels instead of elapsed ticks · case 03
The decoded time state disagrees with the explicit regression oracle for width.
Smear span counts endpoint labels instead of elapsed ticks · case 04
The decoded time state disagrees with the explicit regression oracle for width.
Smear span counts endpoint labels instead of elapsed ticks · case 05
The decoded time state disagrees with the explicit regression oracle for width.
Smear progress extrapolates outside its window or forgets window origin · case 01
The decoded time state disagrees with the explicit regression oracle for progress.
Smear progress extrapolates outside its window or forgets window origin · case 02
The decoded time state disagrees with the explicit regression oracle for progress.
Smear progress extrapolates outside its window or forgets window origin · case 03
The decoded time state disagrees with the explicit regression oracle for progress.
Smear progress extrapolates outside its window or forgets window origin · case 04
The decoded time state disagrees with the explicit regression oracle for progress.
Smear progress extrapolates outside its window or forgets window origin · case 05
The decoded time state disagrees with the explicit regression oracle for progress.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗