Understand the failure.
Verify the repair.
Small, reproducible software failures. The broken implementation, the fix that didn’t work, and the one that passed—preserved together.
Explore the cases ↓How results are verified ↗WHAT THE ARCHIVE CONTAINS
100840 executable cases. 20168 are open.
Every case records the implementation that fails, the fix that did not work, and the repair that passed its checks—with recorded outputs and source hashes. This release adds 100840 cases across 20168 failure mechanisms and 254 domains.
The open tier gives you the failure and the unsuccessful fix for one case in every mechanism. The remaining 80672 cases, 5 variants per mechanism, are member-only: the verified repair, its recorded checks, and the full fixture suite are held in the member archive. Read the methodology ↗
A RECORD OF WHAT WENT WRONG
Browse the archive / 100840
Access-arrangement candidates counted as one seat · case 01
Spaced seating for access candidates overflows the hall.
Access-arrangement candidates counted as one seat · case 02
Spaced seating for access candidates overflows the hall.
Access-arrangement candidates counted as one seat · case 03
Spaced seating for access candidates overflows the hall.
Access-arrangement candidates counted as one seat · case 04
Spaced seating for access candidates overflows the hall.
Access-arrangement candidates counted as one seat · case 05
Spaced seating for access candidates overflows the hall.
Repeated sitting rows consume extra seats · case 01
Duplicate registrations push a period over capacity.
Repeated sitting rows consume extra seats · case 02
Duplicate registrations push a period over capacity.
Repeated sitting rows consume extra seats · case 03
Duplicate registrations push a period over capacity.
Repeated sitting rows consume extra seats · case 04
Duplicate registrations push a period over capacity.
Repeated sitting rows consume extra seats · case 05
Duplicate registrations push a period over capacity.
Period without configured capacity treated as unlimited · case 01
Exams placed in periods with no rooms booked pass the capacity check.
Period without configured capacity treated as unlimited · case 02
Exams placed in periods with no rooms booked pass the capacity check.
Period without configured capacity treated as unlimited · case 03
Exams placed in periods with no rooms booked pass the capacity check.
Period without configured capacity treated as unlimited · case 04
Exams placed in periods with no rooms booked pass the capacity check.
Period without configured capacity treated as unlimited · case 05
Exams placed in periods with no rooms booked pass the capacity check.
Weekday names mapped with a Sunday-first table · case 01
A Friday-evening restriction is enforced on Saturday.
Weekday names mapped with a Sunday-first table · case 02
A Friday-evening restriction is enforced on Saturday.
Weekday names mapped with a Sunday-first table · case 03
A Friday-evening restriction is enforced on Saturday.
Weekday names mapped with a Sunday-first table · case 04
A Friday-evening restriction is enforced on Saturday.
Weekday names mapped with a Sunday-first table · case 05
A Friday-evening restriction is enforced on Saturday.
Day-slot restriction applies only to the named slot · case 01
A Friday-afternoon restriction still allows a Friday-evening exam.
Day-slot restriction applies only to the named slot · case 02
A Friday-afternoon restriction still allows a Friday-evening exam.
Day-slot restriction applies only to the named slot · case 03
A Friday-afternoon restriction still allows a Friday-evening exam.
Day-slot restriction applies only to the named slot · case 04
A Friday-afternoon restriction still allows a Friday-evening exam.
Day-slot restriction applies only to the named slot · case 05
A Friday-afternoon restriction still allows a Friday-evening exam.
Sitting reported once per matching rule · case 01
Overlapping rules (sat and fri-pm style) produce duplicate findings.
Sitting reported once per matching rule · case 02
Overlapping rules (sat and fri-pm style) produce duplicate findings.
Sitting reported once per matching rule · case 03
Overlapping rules (sat and fri-pm style) produce duplicate findings.
Sitting reported once per matching rule · case 04
Overlapping rules (sat and fri-pm style) produce duplicate findings.
Sitting reported once per matching rule · case 05
Overlapping rules (sat and fri-pm style) produce duplicate findings.
Room swap inside the same venue notifies candidates · case 01
Candidates receive change notices for internal room reshuffles.
Room swap inside the same venue notifies candidates · case 02
Candidates receive change notices for internal room reshuffles.
Room swap inside the same venue notifies candidates · case 03
Candidates receive change notices for internal room reshuffles.
Room swap inside the same venue notifies candidates · case 04
Candidates receive change notices for internal room reshuffles.
Room swap inside the same venue notifies candidates · case 05
Candidates receive change notices for internal room reshuffles.
Venue change reported instead of a period move · case 01
Candidates whose exam moved day and venue are told only about the venue.
Venue change reported instead of a period move · case 02
Candidates whose exam moved day and venue are told only about the venue.
Venue change reported instead of a period move · case 03
Candidates whose exam moved day and venue are told only about the venue.
Venue change reported instead of a period move · case 04
Candidates whose exam moved day and venue are told only about the venue.
Venue change reported instead of a period move · case 05
Candidates whose exam moved day and venue are told only about the venue.
Withdrawn exams produce no notification · case 01
Candidates are not told an exam was removed from the timetable.
Withdrawn exams produce no notification · case 02
Candidates are not told an exam was removed from the timetable.
Withdrawn exams produce no notification · case 03
Candidates are not told an exam was removed from the timetable.
Withdrawn exams produce no notification · case 04
Candidates are not told an exam was removed from the timetable.
Withdrawn exams produce no notification · case 05
Candidates are not told an exam was removed from the timetable.
Duplicate enrolment rows send duplicate notices · case 01
Students receive the same change notice twice.
Duplicate enrolment rows send duplicate notices · case 02
Students receive the same change notice twice.
Duplicate enrolment rows send duplicate notices · case 03
Students receive the same change notice twice.
Duplicate enrolment rows send duplicate notices · case 04
Students receive the same change notice twice.
Duplicate enrolment rows send duplicate notices · case 05
Students receive the same change notice twice.
Fair-share target truncated instead of rounded · case 01
Staff with fractional shares are assigned targets one lower.
Fair-share target truncated instead of rounded · case 02
Staff with fractional shares are assigned targets one lower.
Fair-share target truncated instead of rounded · case 03
Staff with fractional shares are assigned targets one lower.
Fair-share target truncated instead of rounded · case 04
Staff with fractional shares are assigned targets one lower.
Fair-share target truncated instead of rounded · case 05
Staff with fractional shares are assigned targets one lower.
Fair share computed against full-time headcount · case 01
Targets sum to less than the duties when staff are part-time.
Fair share computed against full-time headcount · case 02
Targets sum to less than the duties when staff are part-time.
Fair share computed against full-time headcount · case 03
Targets sum to less than the duties when staff are part-time.
Fair share computed against full-time headcount · case 04
Targets sum to less than the duties when staff are part-time.
Fair share computed against full-time headcount · case 05
Targets sum to less than the duties when staff are part-time.
Under-assigned staff never flagged · case 01
Staff carrying far fewer duties than their share pass the report.
Under-assigned staff never flagged · case 02
Staff carrying far fewer duties than their share pass the report.
Under-assigned staff never flagged · case 03
Staff carrying far fewer duties than their share pass the report.
Under-assigned staff never flagged · case 04
Staff carrying far fewer duties than their share pass the report.
Under-assigned staff never flagged · case 05
Staff carrying far fewer duties than their share pass the report.
Room features compared in the wrong subset direction · case 01
Well-equipped rooms are rejected and bare rooms accepted.
Room features compared in the wrong subset direction · case 02
Well-equipped rooms are rejected and bare rooms accepted.
Room features compared in the wrong subset direction · case 03
Well-equipped rooms are rejected and bare rooms accepted.
Room features compared in the wrong subset direction · case 04
Well-equipped rooms are rejected and bare rooms accepted.
Room features compared in the wrong subset direction · case 05
Well-equipped rooms are rejected and bare rooms accepted.
Required features compared case-sensitively · case 01
A requirement for "Lab" is never satisfied by a room tagged "lab".
Required features compared case-sensitively · case 02
A requirement for "Lab" is never satisfied by a room tagged "lab".
Required features compared case-sensitively · case 03
A requirement for "Lab" is never satisfied by a room tagged "lab".
Required features compared case-sensitively · case 04
A requirement for "Lab" is never satisfied by a room tagged "lab".
Required features compared case-sensitively · case 05
A requirement for "Lab" is never satisfied by a room tagged "lab".
Room capacity checked against the last placement only · case 01
Several exams sharing a room overfill it without a finding.
Room capacity checked against the last placement only · case 02
Several exams sharing a room overfill it without a finding.
Room capacity checked against the last placement only · case 03
Several exams sharing a room overfill it without a finding.
Room capacity checked against the last placement only · case 04
Several exams sharing a room overfill it without a finding.
Room capacity checked against the last placement only · case 05
Several exams sharing a room overfill it without a finding.
Room filled exactly to capacity reported as overfull · case 01
Rooms at capacity are flagged.
Room filled exactly to capacity reported as overfull · case 02
Rooms at capacity are flagged.
Room filled exactly to capacity reported as overfull · case 03
Rooms at capacity are flagged.
Room filled exactly to capacity reported as overfull · case 04
Rooms at capacity are flagged.
Room filled exactly to capacity reported as overfull · case 05
Rooms at capacity are flagged.
Evening slot detected from the day number · case 01
Evening-morning sequences are only found on one particular day.
Evening slot detected from the day number · case 02
Evening-morning sequences are only found on one particular day.
Evening slot detected from the day number · case 03
Evening-morning sequences are only found on one particular day.
Evening slot detected from the day number · case 04
Evening-morning sequences are only found on one particular day.
Evening slot detected from the day number · case 05
Evening-morning sequences are only found on one particular day.
Next-morning check looks at the same slot next day · case 01
An evening exam followed by the next day's first exam is not reported.
Next-morning check looks at the same slot next day · case 02
An evening exam followed by the next day's first exam is not reported.
Next-morning check looks at the same slot next day · case 03
An evening exam followed by the next day's first exam is not reported.
Next-morning check looks at the same slot next day · case 04
An evening exam followed by the next day's first exam is not reported.
Next-morning check looks at the same slot next day · case 05
An evening exam followed by the next day's first exam is not reported.
Student at the daily limit reported · case 01
Students with exactly the allowed exams in a day are flagged.
Student at the daily limit reported · case 02
Students with exactly the allowed exams in a day are flagged.
Student at the daily limit reported · case 03
Students with exactly the allowed exams in a day are flagged.
Student at the daily limit reported · case 04
Students with exactly the allowed exams in a day are flagged.
Student at the daily limit reported · case 05
Students with exactly the allowed exams in a day are flagged.
INSPECTABLE BY DESIGN
Every result has a runnable source.
Runnable implementations with recorded outputs, source hashes, and explicit contracts. Related variants share a failure mechanism and belong together in evaluation splits.
Read the methodology ↗