{"abstract":"Candidates are not told an exam was removed from the timetable.","category":"Exam timetabling constraints","checks":8,"contract":"old/new timetables map exam -> [period, room]; rooms room -> venue; enrol [student, exam] rows (may repeat). Reasons: added, removed, moved (period changed; takes precedence), venue (same period, different venue). A room change within the same venue needs no notice. Return distinct [student, exam, reason] rows sorted by student, exam.","contract_signature":"old, new, rooms, enrol","evaluation_group":"w2-exam-timetabling-constraints-republish-change-notifications","failed_approach":"Examining only old exams misses newly added exams.","family":"w2-exam-timetabling-constraints-republish-change-notifications-removed-exams","id":"FA-94741","implementations":{"attempt":{"sha256":"3b594d5410d2f4853db7b52e303bf640126a8585ec336bba9a99e918068b674c","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(old, new, rooms, enrol):\n    reasons = {}\n    for ex in set(old):\n        if ex not in old:\n            reasons[ex] = 'added'\n        elif ex not in new:\n            reasons[ex] = 'removed'\n        elif old[ex][0] != new[ex][0]:\n            reasons[ex] = 'moved'\n        elif rooms[old[ex][1]] != rooms[new[ex][1]]:\n            reasons[ex] = 'venue'\n    out = sorted(set((st, ex, reasons[ex]) for st, ex in enrol if ex in reasons))\n    return [list(t) for t in out]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: removed exams 1',\n   [{'A': [0, 'H1']}, {}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   [['s1', 'A', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [0, 'G1'], 'PHYS110': [1, 'L1'], 'BIO130': [0, 'H1']},\n    {'MATH101H': [2, 'L1'], 'PHYS110': [1, 'L1'], 'CHEM120': [3, 'L2'], 'BIO130': [0, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'HIST140'], ['s2', 'MATH101'], ['s2', 'MATH101H']]],\n   [['s2', 'MATH101', 'removed'], ['s2', 'MATH101H', 'moved']]),\n  ('partial repair guard 3',\n   [{'MATH101H': [0, 'L1'], 'CHEM120': [2, 'H2'], 'BIO130': [3, 'G1']},\n    {'MATH101': [2, 'L2'], 'MATH101H': [3, 'H1'], 'CHEM120': [2, 'H2'], 'BIO130': [3, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'HIST140'], ['s2', 'MATH101H'], ['s1', 'ECON150'], ['s4', 'BIO130'], ['s1', 'BIO130'],\n     ['s5', 'MATH101'], ['s2', 'BIO130'], ['s5', 'HIST140'], ['s4', 'ECON150'], ['s3', 'BIO130'],\n     ['s4', 'CHEM120'], ['s2', 'PHYS110'], ['s5', 'CHEM120'], ['s1', 'MATH101H']]],\n   [['s1', 'MATH101H', 'moved'], ['s2', 'MATH101H', 'moved'], ['s5', 'MATH101', 'added']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {'A': [0, 'G1']}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A'], ['s1', 'A']]],\n   []),\n  ('normal control 5',\n   [{'MATH101': [2, 'L1'], 'MATH101H': [2, 'L2'], 'PHYS110': [1, 'G1']},\n    {'MATH101': [2, 'L1'], 'MATH101H': [2, 'G1'], 'CHEM120': [1, 'H1'], 'BIO130': [0, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'HIST140'], ['s5', 'PHYS110'], ['s2', 'BIO130'], ['s3', 'ECON150'], ['s1', 'MATH101H'],\n     ['s1', 'CHEM120'], ['s3', 'CHEM120'], ['s5', 'BIO130'], ['s2', 'CHEM120'], ['s1', 'ECON150'],\n     ['s5', 'MATH101'], ['s2', 'HIST140']]],\n   [['s1', 'CHEM120', 'added'], ['s1', 'MATH101H', 'venue'], ['s2', 'BIO130', 'added'],\n    ['s2', 'CHEM120', 'added'], ['s3', 'CHEM120', 'added'], ['s5', 'BIO130', 'added'],\n    ['s5', 'PHYS110', 'removed']]),\n  ('normal control 6',\n   [{'MATH101H': [0, 'L2'], 'PHYS110': [1, 'G1'], 'CHEM120': [2, 'H1'], 'BIO130': [1, 'L2']},\n    {'MATH101': [0, 'H2'],\n     'MATH101H': [0, 'L2'],\n     'PHYS110': [1, 'G1'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [1, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'CHEM120'], ['s2', 'BIO130'], ['s3', 'ECON150'], ['s2', 'ECON150'], ['s5', 'BIO130'],\n     ['s3', 'HIST140'], ['s4', 'ECON150'], ['s2', 'HIST140']]],\n   []),\n  ('normal control 7',\n   [{'MATH101': [2, 'L2'], 'MATH101H': [2, 'L2'], 'CHEM120': [3, 'H2'], 'BIO130': [3, 'H1']},\n    {'MATH101': [0, 'H1'], 'MATH101H': [2, 'L2'], 'CHEM120': [3, 'H2'], 'BIO130': [3, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'HIST140'], ['s3', 'CHEM120'], ['s3', 'MATH101H']]],\n   []),\n  ('normal control 8',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [0, 'L2'], 'CHEM120': [3, 'L1'], 'BIO130': [1, 'H1']},\n    {'MATH101': [2, 'H2'], 'MATH101H': [0, 'L2'], 'CHEM120': [0, 'L1'], 'BIO130': [2, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'MATH101'], ['s2', 'HIST140'], ['s1', 'MATH101H'], ['s1', 'MATH101'], ['s3', 'MATH101H'],\n     ['s5', 'PHYS110'], ['s3', 'BIO130'], ['s1', 'BIO130']]],\n   [['s1', 'BIO130', 'moved'], ['s3', 'BIO130', 'moved']])],\n [('regression: removed exams 1',\n   [{'MATH101': [2, 'G1'],\n     'MATH101H': [0, 'G1'],\n     'PHYS110': [3, 'L1'],\n     'CHEM120': [1, 'L1'],\n     'BIO130': [3, 'H1']},\n    {'MATH101': [2, 'G1'], 'MATH101H': [0, 'G1'], 'PHYS110': [3, 'L1'], 'BIO130': [3, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'CHEM120'], ['s4', 'BIO130'], ['s2', 'PHYS110'], ['s3', 'BIO130'], ['s4', 'ECON150'],\n     ['s3', 'CHEM120'], ['s4', 'MATH101H'], ['s3', 'ECON150'], ['s4', 'CHEM120'], ['s2', 'CHEM120']]],\n   [['s2', 'CHEM120', 'removed'], ['s3', 'CHEM120', 'removed'], ['s4', 'CHEM120', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [0, 'L2'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [0, 'H2'],\n     'CHEM120': [0, 'G1'],\n     'BIO130': [3, 'L1']},\n    {'MATH101': [3, 'L1'], 'PHYS110': [3, 'H2'], 'BIO130': [3, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'MATH101'], ['s1', 'PHYS110'], ['s2', 'CHEM120'], ['s5', 'MATH101'], ['s4', 'PHYS110'],\n     ['s3', 'MATH101'], ['s5', 'HIST140'], ['s3', 'PHYS110'], ['s4', 'CHEM120'], ['s3', 'ECON150'],\n     ['s5', 'CHEM120'], ['s5', 'BIO130'], ['s4', 'MATH101'], ['s3', 'MATH101H'], ['s4', 'HIST140']]],\n   [['s1', 'PHYS110', 'moved'], ['s2', 'CHEM120', 'removed'], ['s2', 'MATH101', 'moved'],\n    ['s3', 'MATH101', 'moved'], ['s3', 'MATH101H', 'removed'], ['s3', 'PHYS110', 'moved'],\n    ['s4', 'CHEM120', 'removed'], ['s4', 'MATH101', 'moved'], ['s4', 'PHYS110', 'moved'],\n    ['s5', 'CHEM120', 'removed'], ['s5', 'MATH101', 'moved']]),\n  ('partial repair guard 3',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [2, 'H2'], 'CHEM120': [2, 'L1'], 'BIO130': [1, 'G1']},\n    {'MATH101': [1, 'L2'],\n     'MATH101H': [2, 'G1'],\n     'PHYS110': [3, 'G1'],\n     'CHEM120': [2, 'L1'],\n     'BIO130': [1, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'HIST140'], ['s2', 'ECON150'], ['s2', 'CHEM120'], ['s1', 'PHYS110'], ['s2', 'PHYS110'],\n     ['s1', 'CHEM120'], ['s2', 'MATH101'], ['s4', 'PHYS110'], ['s4', 'MATH101']]],\n   [['s1', 'PHYS110', 'added'], ['s2', 'MATH101', 'moved'], ['s2', 'PHYS110', 'added'],\n    ['s4', 'MATH101', 'moved'], ['s4', 'PHYS110', 'added']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {'A': [1, 'L1']}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   [['s1', 'A', 'moved']]),\n  ('normal control 5',\n   [{'MATH101': [1, 'H2'], 'MATH101H': [3, 'G1'], 'PHYS110': [3, 'L2']},\n    {'MATH101': [3, 'L2'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [1, 'L2'],\n     'CHEM120': [1, 'H1'],\n     'BIO130': [3, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'CHEM120'], ['s5', 'ECON150'], ['s5', 'MATH101'], ['s5', 'MATH101H']]],\n   [['s5', 'CHEM120', 'added'], ['s5', 'MATH101', 'moved']]),\n  ('normal control 6',\n   [{'MATH101': [0, 'G1'], 'PHYS110': [0, 'L1'], 'BIO130': [0, 'L1']},\n    {'MATH101': [0, 'L2'],\n     'MATH101H': [1, 'H2'],\n     'PHYS110': [0, 'L1'],\n     'CHEM120': [1, 'L1'],\n     'BIO130': [0, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s3', 'BIO130'], ['s4', 'ECON150'], ['s1', 'MATH101H'], ['s1', 'BIO130'],\n     ['s1', 'HIST140'], ['s1', 'PHYS110'], ['s5', 'BIO130'], ['s5', 'CHEM120'], ['s4', 'PHYS110']]],\n   [['s1', 'BIO130', 'venue'], ['s1', 'MATH101H', 'added'], ['s3', 'BIO130', 'venue'],\n    ['s4', 'CHEM120', 'added'], ['s5', 'BIO130', 'venue'], ['s5', 'CHEM120', 'added']]),\n  ('normal control 7',\n   [{'MATH101H': [2, 'G1'], 'CHEM120': [1, 'H2'], 'BIO130': [0, 'L2']},\n    {'MATH101': [3, 'L2'],\n     'MATH101H': [2, 'G1'],\n     'PHYS110': [3, 'H1'],\n     'CHEM120': [1, 'H2'],\n     'BIO130': [2, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'PHYS110'], ['s4', 'CHEM120'], ['s3', 'MATH101H'], ['s2', 'BIO130'], ['s3', 'BIO130'],\n     ['s2', 'MATH101H'], ['s2', 'HIST140'], ['s5', 'CHEM120'], ['s3', 'CHEM120'], ['s2', 'ECON150']]],\n   [['s2', 'BIO130', 'moved'], ['s3', 'BIO130', 'moved'], ['s3', 'PHYS110', 'added']]),\n  ('normal control 8',\n   [{'MATH101': [0, 'H2'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [2, 'H1'],\n     'CHEM120': [2, 'L2'],\n     'BIO130': [1, 'L1']},\n    {'MATH101': [0, 'L1'], 'PHYS110': [2, 'H1'], 'CHEM120': [3, 'G1'], 'BIO130': [1, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'PHYS110'], ['s1', 'MATH101'], ['s5', 'BIO130'], ['s4', 'MATH101'], ['s5', 'CHEM120'],\n     ['s1', 'BIO130'], ['s5', 'HIST140']]],\n   [['s1', 'MATH101', 'venue'], ['s4', 'MATH101', 'venue'], ['s5', 'CHEM120', 'moved']])],\n [('regression: removed exams 1',\n   [{'MATH101': [1, 'L2'], 'CHEM120': [1, 'G1'], 'BIO130': [2, 'H2']},\n    {'MATH101': [1, 'L2'], 'MATH101H': [3, 'G1'], 'PHYS110': [2, 'L2'], 'CHEM120': [1, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'CHEM120'], ['s4', 'BIO130'], ['s3', 'PHYS110'], ['s4', 'HIST140'], ['s1', 'BIO130'],\n     ['s2', 'HIST140'], ['s4', 'PHYS110'], ['s4', 'MATH101H']]],\n   [['s1', 'BIO130', 'removed'], ['s3', 'PHYS110', 'added'], ['s4', 'BIO130', 'removed'],\n    ['s4', 'MATH101H', 'added'], ['s4', 'PHYS110', 'added']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [2, 'L1'],\n     'MATH101H': [2, 'L2'],\n     'PHYS110': [2, 'L1'],\n     'CHEM120': [0, 'H2'],\n     'BIO130': [0, 'L1']},\n    {'MATH101H': [2, 'L2'], 'PHYS110': [3, 'L1'], 'CHEM120': [0, 'H2'], 'BIO130': [0, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'ECON150'], ['s2', 'MATH101'], ['s3', 'MATH101H'], ['s1', 'BIO130'], ['s5', 'MATH101'],\n     ['s5', 'BIO130'], ['s1', 'PHYS110'], ['s5', 'PHYS110'], ['s3', 'ECON150'], ['s1', 'MATH101'],\n     ['s3', 'CHEM120'], ['s1', 'HIST140'], ['s3', 'BIO130'], ['s2', 'MATH101H']]],\n   [['s1', 'MATH101', 'removed'], ['s1', 'PHYS110', 'moved'], ['s2', 'MATH101', 'removed'],\n    ['s5', 'MATH101', 'removed'], ['s5', 'PHYS110', 'moved']]),\n  ('partial repair guard 3',\n   [{'MATH101H': [3, 'G1'], 'PHYS110': [0, 'L1'], 'CHEM120': [2, 'L2'], 'BIO130': [1, 'H1']},\n    {'MATH101': [0, 'L1'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [3, 'H1'],\n     'CHEM120': [2, 'L2'],\n     'BIO130': [1, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s3', 'CHEM120'], ['s3', 'MATH101'], ['s4', 'ECON150'], ['s3', 'ECON150'],\n     ['s4', 'MATH101'], ['s3', 'MATH101']]],\n   [['s3', 'MATH101', 'added'], ['s4', 'MATH101', 'added']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1'], 'B': [1, 'L1']}, {'A': [2, 'H1'], 'B': [1, 'H2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'A'], ['s1', 'B'], ['s1', 'A']]],\n   [['s1', 'A', 'moved'], ['s1', 'B', 'venue'], ['s2', 'A', 'moved']]),\n  ('normal control 5',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [0, 'L2'], 'PHYS110': [1, 'L2'], 'CHEM120': [0, 'G1']},\n    {'MATH101': [2, 'H2'],\n     'MATH101H': [0, 'L2'],\n     'PHYS110': [3, 'L1'],\n     'CHEM120': [0, 'G1'],\n     'BIO130': [3, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'HIST140'], ['s4', 'HIST140'], ['s1', 'MATH101H'], ['s5', 'MATH101'], ['s1', 'PHYS110'],\n     ['s2', 'ECON150'], ['s2', 'BIO130'], ['s1', 'HIST140'], ['s2', 'BIO130'], ['s5', 'MATH101H'],\n     ['s1', 'MATH101'], ['s2', 'MATH101H'], ['s4', 'MATH101H']]],\n   [['s1', 'PHYS110', 'moved'], ['s2', 'BIO130', 'added']]),\n  ('normal control 6',\n   [{'MATH101': [1, 'H1'], 'PHYS110': [0, 'H1'], 'CHEM120': [2, 'H2'], 'BIO130': [2, 'G1']},\n    {'MATH101': [1, 'H1'], 'MATH101H': [3, 'H1'], 'PHYS110': [0, 'H1'], 'BIO130': [2, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'MATH101H'], ['s5', 'CHEM120'], ['s2', 'ECON150'], ['s5', 'MATH101'], ['s4', 'CHEM120'],\n     ['s4', 'BIO130'], ['s3', 'HIST140'], ['s1', 'MATH101'], ['s2', 'PHYS110'], ['s5', 'PHYS110'],\n     ['s2', 'HIST140'], ['s5', 'BIO130'], ['s2', 'MATH101H'], ['s1', 'ECON150'], ['s1', 'HIST140']]],\n   [['s1', 'MATH101H', 'added'], ['s2', 'MATH101H', 'added'], ['s4', 'CHEM120', 'removed'],\n    ['s5', 'CHEM120', 'removed']]),\n  ('normal control 7',\n   [{'MATH101': [3, 'H1'],\n     'MATH101H': [1, 'L2'],\n     'PHYS110': [3, 'H2'],\n     'CHEM120': [3, 'H1'],\n     'BIO130': [3, 'G1']},\n    {'MATH101': [3, 'H1'], 'MATH101H': [1, 'L2'], 'PHYS110': [1, 'G1'], 'CHEM120': [3, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'BIO130'], ['s3', 'HIST140'], ['s3', 'MATH101H'], ['s5', 'PHYS110']]],\n   [['s2', 'BIO130', 'removed'], ['s5', 'PHYS110', 'moved']]),\n  ('normal control 8',\n   [{'MATH101': [3, 'L1'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [1, 'L2'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [1, 'L1']},\n    {'MATH101': [3, 'L1'],\n     'MATH101H': [0, 'L2'],\n     'PHYS110': [1, 'L2'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [1, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'}, [['s3', 'HIST140']]],\n   [])],\n [('regression: removed exams 1',\n   [{'MATH101': [0, 'L1'],\n     'MATH101H': [3, 'H2'],\n     'PHYS110': [1, 'H2'],\n     'CHEM120': [1, 'H1'],\n     'BIO130': [0, 'H1']},\n    {'MATH101': [2, 'L1'], 'MATH101H': [3, 'H2'], 'CHEM120': [1, 'H1'], 'BIO130': [3, 'H2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s1', 'HIST140'], ['s2', 'HIST140'], ['s1', 'BIO130'], ['s5', 'ECON150'],\n     ['s1', 'PHYS110'], ['s3', 'ECON150'], ['s4', 'MATH101H'], ['s3', 'PHYS110'], ['s3', 'MATH101'],\n     ['s4', 'MATH101'], ['s3', 'CHEM120'], ['s5', 'MATH101'], ['s5', 'CHEM120'], ['s5', 'PHYS110']]],\n   [['s1', 'BIO130', 'moved'], ['s1', 'PHYS110', 'removed'], ['s3', 'MATH101', 'moved'],\n    ['s3', 'PHYS110', 'removed'], ['s4', 'MATH101', 'moved'], ['s5', 'MATH101', 'moved'],\n    ['s5', 'PHYS110', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [1, 'H2'],\n     'MATH101H': [3, 'H2'],\n     'PHYS110': [3, 'H2'],\n     'CHEM120': [2, 'L1'],\n     'BIO130': [2, 'G1']},\n    {'PHYS110': [0, 'H2'], 'CHEM120': [2, 'L1'], 'BIO130': [2, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s1', 'ECON150'], ['s2', 'MATH101'], ['s4', 'HIST140'], ['s4', 'BIO130'],\n     ['s4', 'MATH101H'], ['s3', 'BIO130'], ['s5', 'BIO130'], ['s2', 'MATH101']]],\n   [['s2', 'MATH101', 'removed'], ['s4', 'MATH101H', 'removed']]),\n  ('partial repair guard 3',\n   [{'MATH101': [0, 'H2'], 'MATH101H': [2, 'G1'], 'CHEM120': [0, 'G1']},\n    {'MATH101H': [3, 'L2'], 'PHYS110': [3, 'L1'], 'CHEM120': [0, 'G1'], 'BIO130': [3, 'H2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'CHEM120'], ['s5', 'HIST140'], ['s1', 'PHYS110'], ['s4', 'MATH101'], ['s1', 'CHEM120'],\n     ['s3', 'MATH101'], ['s1', 'BIO130'], ['s2', 'MATH101H']]],\n   [['s1', 'BIO130', 'added'], ['s1', 'PHYS110', 'added'], ['s2', 'MATH101H', 'moved'],\n    ['s3', 'MATH101', 'removed'], ['s4', 'MATH101', 'removed']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   [['s1', 'A', 'removed']]),\n  ('normal control 5',\n   [{'MATH101': [3, 'G1'],\n     'MATH101H': [1, 'L2'],\n     'PHYS110': [3, 'L2'],\n     'CHEM120': [0, 'L2'],\n     'BIO130': [0, 'L1']},\n    {'MATH101': [3, 'G1'],\n     'MATH101H': [2, 'L1'],\n     'PHYS110': [3, 'L2'],\n     'CHEM120': [3, 'H1'],\n     'BIO130': [0, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'MATH101H'], ['s3', 'MATH101H'], ['s2', 'BIO130'], ['s3', 'HIST140'], ['s4', 'CHEM120'],\n     ['s3', 'MATH101'], ['s2', 'MATH101'], ['s2', 'CHEM120'], ['s1', 'MATH101'], ['s2', 'PHYS110']]],\n   [['s2', 'CHEM120', 'moved'], ['s3', 'MATH101H', 'moved'], ['s4', 'CHEM120', 'moved'],\n    ['s4', 'MATH101H', 'moved']]),\n  ('normal control 6',\n   [{'MATH101': [2, 'G1'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [3, 'G1'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [0, 'H2']},\n    {'MATH101': [1, 'H2'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [3, 'G1'],\n     'CHEM120': [1, 'L2'],\n     'BIO130': [3, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'BIO130'], ['s5', 'BIO130'], ['s2', 'ECON150'], ['s2', 'HIST140'], ['s1', 'MATH101H'],\n     ['s4', 'MATH101H'], ['s4', 'ECON150'], ['s1', 'BIO130'], ['s4', 'BIO130'], ['s1', 'ECON150'],\n     ['s4', 'CHEM120'], ['s2', 'MATH101H'], ['s2', 'CHEM120'], ['s1', 'PHYS110']]],\n   [['s1', 'BIO130', 'moved'], ['s2', 'CHEM120', 'moved'], ['s4', 'BIO130', 'moved'],\n    ['s4', 'CHEM120', 'moved'], ['s5', 'BIO130', 'moved']]),\n  ('normal control 7',\n   [{'BIO130': [0, 'H1']},\n    {'MATH101': [2, 'G1'], 'MATH101H': [1, 'H1'], 'CHEM120': [2, 'L1'], 'BIO130': [1, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'ECON150'], ['s1', 'BIO130'], ['s1', 'HIST140'], ['s3', 'MATH101H'], ['s4', 'CHEM120'],\n     ['s3', 'CHEM120'], ['s1', 'CHEM120'], ['s2', 'MATH101'], ['s1', 'PHYS110'], ['s4', 'HIST140'],\n     ['s3', 'BIO130'], ['s1', 'CHEM120']]],\n   [['s1', 'BIO130', 'moved'], ['s1', 'CHEM120', 'added'], ['s2', 'MATH101', 'added'],\n    ['s3', 'BIO130', 'moved'], ['s3', 'CHEM120', 'added'], ['s3', 'MATH101H', 'added'],\n    ['s4', 'CHEM120', 'added']]),\n  ('normal control 8',\n   [{'MATH101H': [1, 'G1'], 'PHYS110': [0, 'L1'], 'CHEM120': [3, 'G1'], 'BIO130': [0, 'H2']},\n    {'MATH101': [3, 'L2'],\n     'MATH101H': [1, 'G1'],\n     'PHYS110': [3, 'H2'],\n     'CHEM120': [3, 'G1'],\n     'BIO130': [1, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'MATH101H'], ['s5', 'HIST140'], ['s4', 'ECON150'], ['s3', 'MATH101'], ['s5', 'MATH101H'],\n     ['s2', 'PHYS110'], ['s4', 'MATH101H'], ['s2', 'CHEM120'], ['s2', 'MATH101'], ['s5', 'BIO130'],\n     ['s5', 'CHEM120'], ['s2', 'HIST140']]],\n   [['s2', 'MATH101', 'added'], ['s2', 'PHYS110', 'moved'], ['s3', 'MATH101', 'added'],\n    ['s5', 'BIO130', 'moved']])],\n [('regression: removed exams 1',\n   [{'MATH101': [1, 'L1'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [2, 'H2'],\n     'CHEM120': [3, 'H2'],\n     'BIO130': [0, 'H1']},\n    {'MATH101': [2, 'G1'], 'CHEM120': [3, 'H1'], 'BIO130': [0, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'ECON150'], ['s4', 'PHYS110'], ['s1', 'HIST140'], ['s4', 'PHYS110'], ['s5', 'BIO130'],\n     ['s2', 'ECON150'], ['s2', 'HIST140'], ['s5', 'MATH101H']]],\n   [['s4', 'PHYS110', 'removed'], ['s5', 'MATH101H', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101H': [1, 'H1'], 'PHYS110': [0, 'H2'], 'BIO130': [0, 'L2']},\n    {'MATH101': [3, 'H2'], 'PHYS110': [0, 'H2'], 'CHEM120': [0, 'L1'], 'BIO130': [0, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'CHEM120'], ['s2', 'HIST140'], ['s4', 'BIO130'], ['s4', 'HIST140'], ['s5', 'HIST140'],\n     ['s2', 'ECON150'], ['s4', 'PHYS110'], ['s4', 'CHEM120'], ['s3', 'CHEM120'], ['s1', 'BIO130'],\n     ['s2', 'MATH101H']]],\n   [['s1', 'CHEM120', 'added'], ['s2', 'MATH101H', 'removed'], ['s3', 'CHEM120', 'added'],\n    ['s4', 'CHEM120', 'added']]),\n  ('partial repair guard 3',\n   [{'MATH101': [3, 'H1'], 'MATH101H': [1, 'G1'], 'PHYS110': [1, 'H1'], 'CHEM120': [1, 'H1']},\n    {'MATH101': [2, 'G1'],\n     'MATH101H': [1, 'G1'],\n     'PHYS110': [1, 'H1'],\n     'CHEM120': [0, 'H2'],\n     'BIO130': [2, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'ECON150'], ['s5', 'PHYS110'], ['s2', 'MATH101'], ['s2', 'PHYS110'], ['s1', 'BIO130'],\n     ['s2', 'HIST140'], ['s3', 'HIST140'], ['s5', 'HIST140'], ['s1', 'HIST140'], ['s1', 'MATH101H'],\n     ['s4', 'PHYS110'], ['s3', 'MATH101']]],\n   [['s1', 'BIO130', 'added'], ['s2', 'MATH101', 'moved'], ['s3', 'MATH101', 'moved']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {'A': [0, 'H2']}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   []),\n  ('normal control 5',\n   [{'MATH101H': [2, 'H2'], 'PHYS110': [3, 'L2'], 'CHEM120': [2, 'L2'], 'BIO130': [3, 'H1']},\n    {'MATH101': [2, 'H2'], 'MATH101H': [2, 'H2'], 'PHYS110': [3, 'L2'], 'CHEM120': [2, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'PHYS110'], ['s5', 'ECON150'], ['s2', 'BIO130'], ['s2', 'CHEM120'], ['s1', 'CHEM120'],\n     ['s5', 'MATH101'], ['s5', 'ECON150'], ['s1', 'HIST140']]],\n   [['s2', 'BIO130', 'removed'], ['s5', 'MATH101', 'added']]),\n  ('normal control 6',\n   [{'MATH101': [3, 'G1'],\n     'MATH101H': [0, 'L1'],\n     'PHYS110': [1, 'H2'],\n     'CHEM120': [1, 'L2'],\n     'BIO130': [3, 'G1']},\n    {'MATH101': [3, 'G1'],\n     'MATH101H': [0, 'L1'],\n     'PHYS110': [1, 'H2'],\n     'CHEM120': [1, 'L2'],\n     'BIO130': [3, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'}, [['s4', 'CHEM120']]],\n   []),\n  ('normal control 7',\n   [{'MATH101': [1, 'L1'], 'MATH101H': [0, 'L2'], 'PHYS110': [3, 'H2'], 'BIO130': [0, 'L1']},\n    {'MATH101': [1, 'L1'],\n     'MATH101H': [2, 'H1'],\n     'PHYS110': [0, 'H2'],\n     'CHEM120': [0, 'H1'],\n     'BIO130': [0, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'PHYS110'], ['s1', 'HIST140'], ['s1', 'MATH101H'], ['s3', 'HIST140'], ['s1', 'MATH101'],\n     ['s3', 'ECON150']]],\n   [['s1', 'MATH101H', 'moved'], ['s1', 'PHYS110', 'moved']]),\n  ('normal control 8',\n   [{'MATH101H': [1, 'L2'], 'PHYS110': [2, 'L1'], 'CHEM120': [0, 'L1'], 'BIO130': [2, 'H1']},\n    {'MATH101': [2, 'L1'],\n     'MATH101H': [0, 'H2'],\n     'PHYS110': [2, 'L1'],\n     'CHEM120': [0, 'L1'],\n     'BIO130': [2, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'BIO130'], ['s4', 'PHYS110'], ['s4', 'MATH101H'], ['s3', 'MATH101H'], ['s3', 'HIST140'],\n     ['s4', 'PHYS110']]],\n   [['s3', 'MATH101H', 'moved'], ['s4', 'MATH101H', 'moved']])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"f550b534b48d872f4970a88462d0851b4588c60b31fe5714a8f2c1316d74eaa3","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(old, new, rooms, enrol):\n    reasons = {}\n    for ex in set(new):\n        if ex not in old:\n            reasons[ex] = 'added'\n        elif ex not in new:\n            reasons[ex] = 'removed'\n        elif old[ex][0] != new[ex][0]:\n            reasons[ex] = 'moved'\n        elif rooms[old[ex][1]] != rooms[new[ex][1]]:\n            reasons[ex] = 'venue'\n    out = sorted(set((st, ex, reasons[ex]) for st, ex in enrol if ex in reasons))\n    return [list(t) for t in out]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: removed exams 1',\n   [{'A': [0, 'H1']}, {}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   [['s1', 'A', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [0, 'G1'], 'PHYS110': [1, 'L1'], 'BIO130': [0, 'H1']},\n    {'MATH101H': [2, 'L1'], 'PHYS110': [1, 'L1'], 'CHEM120': [3, 'L2'], 'BIO130': [0, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'HIST140'], ['s2', 'MATH101'], ['s2', 'MATH101H']]],\n   [['s2', 'MATH101', 'removed'], ['s2', 'MATH101H', 'moved']]),\n  ('partial repair guard 3',\n   [{'MATH101H': [0, 'L1'], 'CHEM120': [2, 'H2'], 'BIO130': [3, 'G1']},\n    {'MATH101': [2, 'L2'], 'MATH101H': [3, 'H1'], 'CHEM120': [2, 'H2'], 'BIO130': [3, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'HIST140'], ['s2', 'MATH101H'], ['s1', 'ECON150'], ['s4', 'BIO130'], ['s1', 'BIO130'],\n     ['s5', 'MATH101'], ['s2', 'BIO130'], ['s5', 'HIST140'], ['s4', 'ECON150'], ['s3', 'BIO130'],\n     ['s4', 'CHEM120'], ['s2', 'PHYS110'], ['s5', 'CHEM120'], ['s1', 'MATH101H']]],\n   [['s1', 'MATH101H', 'moved'], ['s2', 'MATH101H', 'moved'], ['s5', 'MATH101', 'added']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {'A': [0, 'G1']}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A'], ['s1', 'A']]],\n   []),\n  ('normal control 5',\n   [{'MATH101': [2, 'L1'], 'MATH101H': [2, 'L2'], 'PHYS110': [1, 'G1']},\n    {'MATH101': [2, 'L1'], 'MATH101H': [2, 'G1'], 'CHEM120': [1, 'H1'], 'BIO130': [0, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'HIST140'], ['s5', 'PHYS110'], ['s2', 'BIO130'], ['s3', 'ECON150'], ['s1', 'MATH101H'],\n     ['s1', 'CHEM120'], ['s3', 'CHEM120'], ['s5', 'BIO130'], ['s2', 'CHEM120'], ['s1', 'ECON150'],\n     ['s5', 'MATH101'], ['s2', 'HIST140']]],\n   [['s1', 'CHEM120', 'added'], ['s1', 'MATH101H', 'venue'], ['s2', 'BIO130', 'added'],\n    ['s2', 'CHEM120', 'added'], ['s3', 'CHEM120', 'added'], ['s5', 'BIO130', 'added'],\n    ['s5', 'PHYS110', 'removed']]),\n  ('normal control 6',\n   [{'MATH101H': [0, 'L2'], 'PHYS110': [1, 'G1'], 'CHEM120': [2, 'H1'], 'BIO130': [1, 'L2']},\n    {'MATH101': [0, 'H2'],\n     'MATH101H': [0, 'L2'],\n     'PHYS110': [1, 'G1'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [1, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'CHEM120'], ['s2', 'BIO130'], ['s3', 'ECON150'], ['s2', 'ECON150'], ['s5', 'BIO130'],\n     ['s3', 'HIST140'], ['s4', 'ECON150'], ['s2', 'HIST140']]],\n   []),\n  ('normal control 7',\n   [{'MATH101': [2, 'L2'], 'MATH101H': [2, 'L2'], 'CHEM120': [3, 'H2'], 'BIO130': [3, 'H1']},\n    {'MATH101': [0, 'H1'], 'MATH101H': [2, 'L2'], 'CHEM120': [3, 'H2'], 'BIO130': [3, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'HIST140'], ['s3', 'CHEM120'], ['s3', 'MATH101H']]],\n   []),\n  ('normal control 8',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [0, 'L2'], 'CHEM120': [3, 'L1'], 'BIO130': [1, 'H1']},\n    {'MATH101': [2, 'H2'], 'MATH101H': [0, 'L2'], 'CHEM120': [0, 'L1'], 'BIO130': [2, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'MATH101'], ['s2', 'HIST140'], ['s1', 'MATH101H'], ['s1', 'MATH101'], ['s3', 'MATH101H'],\n     ['s5', 'PHYS110'], ['s3', 'BIO130'], ['s1', 'BIO130']]],\n   [['s1', 'BIO130', 'moved'], ['s3', 'BIO130', 'moved']])],\n [('regression: removed exams 1',\n   [{'MATH101': [2, 'G1'],\n     'MATH101H': [0, 'G1'],\n     'PHYS110': [3, 'L1'],\n     'CHEM120': [1, 'L1'],\n     'BIO130': [3, 'H1']},\n    {'MATH101': [2, 'G1'], 'MATH101H': [0, 'G1'], 'PHYS110': [3, 'L1'], 'BIO130': [3, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'CHEM120'], ['s4', 'BIO130'], ['s2', 'PHYS110'], ['s3', 'BIO130'], ['s4', 'ECON150'],\n     ['s3', 'CHEM120'], ['s4', 'MATH101H'], ['s3', 'ECON150'], ['s4', 'CHEM120'], ['s2', 'CHEM120']]],\n   [['s2', 'CHEM120', 'removed'], ['s3', 'CHEM120', 'removed'], ['s4', 'CHEM120', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [0, 'L2'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [0, 'H2'],\n     'CHEM120': [0, 'G1'],\n     'BIO130': [3, 'L1']},\n    {'MATH101': [3, 'L1'], 'PHYS110': [3, 'H2'], 'BIO130': [3, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'MATH101'], ['s1', 'PHYS110'], ['s2', 'CHEM120'], ['s5', 'MATH101'], ['s4', 'PHYS110'],\n     ['s3', 'MATH101'], ['s5', 'HIST140'], ['s3', 'PHYS110'], ['s4', 'CHEM120'], ['s3', 'ECON150'],\n     ['s5', 'CHEM120'], ['s5', 'BIO130'], ['s4', 'MATH101'], ['s3', 'MATH101H'], ['s4', 'HIST140']]],\n   [['s1', 'PHYS110', 'moved'], ['s2', 'CHEM120', 'removed'], ['s2', 'MATH101', 'moved'],\n    ['s3', 'MATH101', 'moved'], ['s3', 'MATH101H', 'removed'], ['s3', 'PHYS110', 'moved'],\n    ['s4', 'CHEM120', 'removed'], ['s4', 'MATH101', 'moved'], ['s4', 'PHYS110', 'moved'],\n    ['s5', 'CHEM120', 'removed'], ['s5', 'MATH101', 'moved']]),\n  ('partial repair guard 3',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [2, 'H2'], 'CHEM120': [2, 'L1'], 'BIO130': [1, 'G1']},\n    {'MATH101': [1, 'L2'],\n     'MATH101H': [2, 'G1'],\n     'PHYS110': [3, 'G1'],\n     'CHEM120': [2, 'L1'],\n     'BIO130': [1, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'HIST140'], ['s2', 'ECON150'], ['s2', 'CHEM120'], ['s1', 'PHYS110'], ['s2', 'PHYS110'],\n     ['s1', 'CHEM120'], ['s2', 'MATH101'], ['s4', 'PHYS110'], ['s4', 'MATH101']]],\n   [['s1', 'PHYS110', 'added'], ['s2', 'MATH101', 'moved'], ['s2', 'PHYS110', 'added'],\n    ['s4', 'MATH101', 'moved'], ['s4', 'PHYS110', 'added']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {'A': [1, 'L1']}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   [['s1', 'A', 'moved']]),\n  ('normal control 5',\n   [{'MATH101': [1, 'H2'], 'MATH101H': [3, 'G1'], 'PHYS110': [3, 'L2']},\n    {'MATH101': [3, 'L2'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [1, 'L2'],\n     'CHEM120': [1, 'H1'],\n     'BIO130': [3, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'CHEM120'], ['s5', 'ECON150'], ['s5', 'MATH101'], ['s5', 'MATH101H']]],\n   [['s5', 'CHEM120', 'added'], ['s5', 'MATH101', 'moved']]),\n  ('normal control 6',\n   [{'MATH101': [0, 'G1'], 'PHYS110': [0, 'L1'], 'BIO130': [0, 'L1']},\n    {'MATH101': [0, 'L2'],\n     'MATH101H': [1, 'H2'],\n     'PHYS110': [0, 'L1'],\n     'CHEM120': [1, 'L1'],\n     'BIO130': [0, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s3', 'BIO130'], ['s4', 'ECON150'], ['s1', 'MATH101H'], ['s1', 'BIO130'],\n     ['s1', 'HIST140'], ['s1', 'PHYS110'], ['s5', 'BIO130'], ['s5', 'CHEM120'], ['s4', 'PHYS110']]],\n   [['s1', 'BIO130', 'venue'], ['s1', 'MATH101H', 'added'], ['s3', 'BIO130', 'venue'],\n    ['s4', 'CHEM120', 'added'], ['s5', 'BIO130', 'venue'], ['s5', 'CHEM120', 'added']]),\n  ('normal control 7',\n   [{'MATH101H': [2, 'G1'], 'CHEM120': [1, 'H2'], 'BIO130': [0, 'L2']},\n    {'MATH101': [3, 'L2'],\n     'MATH101H': [2, 'G1'],\n     'PHYS110': [3, 'H1'],\n     'CHEM120': [1, 'H2'],\n     'BIO130': [2, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'PHYS110'], ['s4', 'CHEM120'], ['s3', 'MATH101H'], ['s2', 'BIO130'], ['s3', 'BIO130'],\n     ['s2', 'MATH101H'], ['s2', 'HIST140'], ['s5', 'CHEM120'], ['s3', 'CHEM120'], ['s2', 'ECON150']]],\n   [['s2', 'BIO130', 'moved'], ['s3', 'BIO130', 'moved'], ['s3', 'PHYS110', 'added']]),\n  ('normal control 8',\n   [{'MATH101': [0, 'H2'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [2, 'H1'],\n     'CHEM120': [2, 'L2'],\n     'BIO130': [1, 'L1']},\n    {'MATH101': [0, 'L1'], 'PHYS110': [2, 'H1'], 'CHEM120': [3, 'G1'], 'BIO130': [1, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'PHYS110'], ['s1', 'MATH101'], ['s5', 'BIO130'], ['s4', 'MATH101'], ['s5', 'CHEM120'],\n     ['s1', 'BIO130'], ['s5', 'HIST140']]],\n   [['s1', 'MATH101', 'venue'], ['s4', 'MATH101', 'venue'], ['s5', 'CHEM120', 'moved']])],\n [('regression: removed exams 1',\n   [{'MATH101': [1, 'L2'], 'CHEM120': [1, 'G1'], 'BIO130': [2, 'H2']},\n    {'MATH101': [1, 'L2'], 'MATH101H': [3, 'G1'], 'PHYS110': [2, 'L2'], 'CHEM120': [1, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'CHEM120'], ['s4', 'BIO130'], ['s3', 'PHYS110'], ['s4', 'HIST140'], ['s1', 'BIO130'],\n     ['s2', 'HIST140'], ['s4', 'PHYS110'], ['s4', 'MATH101H']]],\n   [['s1', 'BIO130', 'removed'], ['s3', 'PHYS110', 'added'], ['s4', 'BIO130', 'removed'],\n    ['s4', 'MATH101H', 'added'], ['s4', 'PHYS110', 'added']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [2, 'L1'],\n     'MATH101H': [2, 'L2'],\n     'PHYS110': [2, 'L1'],\n     'CHEM120': [0, 'H2'],\n     'BIO130': [0, 'L1']},\n    {'MATH101H': [2, 'L2'], 'PHYS110': [3, 'L1'], 'CHEM120': [0, 'H2'], 'BIO130': [0, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'ECON150'], ['s2', 'MATH101'], ['s3', 'MATH101H'], ['s1', 'BIO130'], ['s5', 'MATH101'],\n     ['s5', 'BIO130'], ['s1', 'PHYS110'], ['s5', 'PHYS110'], ['s3', 'ECON150'], ['s1', 'MATH101'],\n     ['s3', 'CHEM120'], ['s1', 'HIST140'], ['s3', 'BIO130'], ['s2', 'MATH101H']]],\n   [['s1', 'MATH101', 'removed'], ['s1', 'PHYS110', 'moved'], ['s2', 'MATH101', 'removed'],\n    ['s5', 'MATH101', 'removed'], ['s5', 'PHYS110', 'moved']]),\n  ('partial repair guard 3',\n   [{'MATH101H': [3, 'G1'], 'PHYS110': [0, 'L1'], 'CHEM120': [2, 'L2'], 'BIO130': [1, 'H1']},\n    {'MATH101': [0, 'L1'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [3, 'H1'],\n     'CHEM120': [2, 'L2'],\n     'BIO130': [1, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s3', 'CHEM120'], ['s3', 'MATH101'], ['s4', 'ECON150'], ['s3', 'ECON150'],\n     ['s4', 'MATH101'], ['s3', 'MATH101']]],\n   [['s3', 'MATH101', 'added'], ['s4', 'MATH101', 'added']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1'], 'B': [1, 'L1']}, {'A': [2, 'H1'], 'B': [1, 'H2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'A'], ['s1', 'B'], ['s1', 'A']]],\n   [['s1', 'A', 'moved'], ['s1', 'B', 'venue'], ['s2', 'A', 'moved']]),\n  ('normal control 5',\n   [{'MATH101': [2, 'H2'], 'MATH101H': [0, 'L2'], 'PHYS110': [1, 'L2'], 'CHEM120': [0, 'G1']},\n    {'MATH101': [2, 'H2'],\n     'MATH101H': [0, 'L2'],\n     'PHYS110': [3, 'L1'],\n     'CHEM120': [0, 'G1'],\n     'BIO130': [3, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'HIST140'], ['s4', 'HIST140'], ['s1', 'MATH101H'], ['s5', 'MATH101'], ['s1', 'PHYS110'],\n     ['s2', 'ECON150'], ['s2', 'BIO130'], ['s1', 'HIST140'], ['s2', 'BIO130'], ['s5', 'MATH101H'],\n     ['s1', 'MATH101'], ['s2', 'MATH101H'], ['s4', 'MATH101H']]],\n   [['s1', 'PHYS110', 'moved'], ['s2', 'BIO130', 'added']]),\n  ('normal control 6',\n   [{'MATH101': [1, 'H1'], 'PHYS110': [0, 'H1'], 'CHEM120': [2, 'H2'], 'BIO130': [2, 'G1']},\n    {'MATH101': [1, 'H1'], 'MATH101H': [3, 'H1'], 'PHYS110': [0, 'H1'], 'BIO130': [2, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'MATH101H'], ['s5', 'CHEM120'], ['s2', 'ECON150'], ['s5', 'MATH101'], ['s4', 'CHEM120'],\n     ['s4', 'BIO130'], ['s3', 'HIST140'], ['s1', 'MATH101'], ['s2', 'PHYS110'], ['s5', 'PHYS110'],\n     ['s2', 'HIST140'], ['s5', 'BIO130'], ['s2', 'MATH101H'], ['s1', 'ECON150'], ['s1', 'HIST140']]],\n   [['s1', 'MATH101H', 'added'], ['s2', 'MATH101H', 'added'], ['s4', 'CHEM120', 'removed'],\n    ['s5', 'CHEM120', 'removed']]),\n  ('normal control 7',\n   [{'MATH101': [3, 'H1'],\n     'MATH101H': [1, 'L2'],\n     'PHYS110': [3, 'H2'],\n     'CHEM120': [3, 'H1'],\n     'BIO130': [3, 'G1']},\n    {'MATH101': [3, 'H1'], 'MATH101H': [1, 'L2'], 'PHYS110': [1, 'G1'], 'CHEM120': [3, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'BIO130'], ['s3', 'HIST140'], ['s3', 'MATH101H'], ['s5', 'PHYS110']]],\n   [['s2', 'BIO130', 'removed'], ['s5', 'PHYS110', 'moved']]),\n  ('normal control 8',\n   [{'MATH101': [3, 'L1'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [1, 'L2'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [1, 'L1']},\n    {'MATH101': [3, 'L1'],\n     'MATH101H': [0, 'L2'],\n     'PHYS110': [1, 'L2'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [1, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'}, [['s3', 'HIST140']]],\n   [])],\n [('regression: removed exams 1',\n   [{'MATH101': [0, 'L1'],\n     'MATH101H': [3, 'H2'],\n     'PHYS110': [1, 'H2'],\n     'CHEM120': [1, 'H1'],\n     'BIO130': [0, 'H1']},\n    {'MATH101': [2, 'L1'], 'MATH101H': [3, 'H2'], 'CHEM120': [1, 'H1'], 'BIO130': [3, 'H2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s1', 'HIST140'], ['s2', 'HIST140'], ['s1', 'BIO130'], ['s5', 'ECON150'],\n     ['s1', 'PHYS110'], ['s3', 'ECON150'], ['s4', 'MATH101H'], ['s3', 'PHYS110'], ['s3', 'MATH101'],\n     ['s4', 'MATH101'], ['s3', 'CHEM120'], ['s5', 'MATH101'], ['s5', 'CHEM120'], ['s5', 'PHYS110']]],\n   [['s1', 'BIO130', 'moved'], ['s1', 'PHYS110', 'removed'], ['s3', 'MATH101', 'moved'],\n    ['s3', 'PHYS110', 'removed'], ['s4', 'MATH101', 'moved'], ['s5', 'MATH101', 'moved'],\n    ['s5', 'PHYS110', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101': [1, 'H2'],\n     'MATH101H': [3, 'H2'],\n     'PHYS110': [3, 'H2'],\n     'CHEM120': [2, 'L1'],\n     'BIO130': [2, 'G1']},\n    {'PHYS110': [0, 'H2'], 'CHEM120': [2, 'L1'], 'BIO130': [2, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'CHEM120'], ['s1', 'ECON150'], ['s2', 'MATH101'], ['s4', 'HIST140'], ['s4', 'BIO130'],\n     ['s4', 'MATH101H'], ['s3', 'BIO130'], ['s5', 'BIO130'], ['s2', 'MATH101']]],\n   [['s2', 'MATH101', 'removed'], ['s4', 'MATH101H', 'removed']]),\n  ('partial repair guard 3',\n   [{'MATH101': [0, 'H2'], 'MATH101H': [2, 'G1'], 'CHEM120': [0, 'G1']},\n    {'MATH101H': [3, 'L2'], 'PHYS110': [3, 'L1'], 'CHEM120': [0, 'G1'], 'BIO130': [3, 'H2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'CHEM120'], ['s5', 'HIST140'], ['s1', 'PHYS110'], ['s4', 'MATH101'], ['s1', 'CHEM120'],\n     ['s3', 'MATH101'], ['s1', 'BIO130'], ['s2', 'MATH101H']]],\n   [['s1', 'BIO130', 'added'], ['s1', 'PHYS110', 'added'], ['s2', 'MATH101H', 'moved'],\n    ['s3', 'MATH101', 'removed'], ['s4', 'MATH101', 'removed']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   [['s1', 'A', 'removed']]),\n  ('normal control 5',\n   [{'MATH101': [3, 'G1'],\n     'MATH101H': [1, 'L2'],\n     'PHYS110': [3, 'L2'],\n     'CHEM120': [0, 'L2'],\n     'BIO130': [0, 'L1']},\n    {'MATH101': [3, 'G1'],\n     'MATH101H': [2, 'L1'],\n     'PHYS110': [3, 'L2'],\n     'CHEM120': [3, 'H1'],\n     'BIO130': [0, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'MATH101H'], ['s3', 'MATH101H'], ['s2', 'BIO130'], ['s3', 'HIST140'], ['s4', 'CHEM120'],\n     ['s3', 'MATH101'], ['s2', 'MATH101'], ['s2', 'CHEM120'], ['s1', 'MATH101'], ['s2', 'PHYS110']]],\n   [['s2', 'CHEM120', 'moved'], ['s3', 'MATH101H', 'moved'], ['s4', 'CHEM120', 'moved'],\n    ['s4', 'MATH101H', 'moved']]),\n  ('normal control 6',\n   [{'MATH101': [2, 'G1'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [3, 'G1'],\n     'CHEM120': [2, 'H1'],\n     'BIO130': [0, 'H2']},\n    {'MATH101': [1, 'H2'],\n     'MATH101H': [1, 'L1'],\n     'PHYS110': [3, 'G1'],\n     'CHEM120': [1, 'L2'],\n     'BIO130': [3, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s5', 'BIO130'], ['s5', 'BIO130'], ['s2', 'ECON150'], ['s2', 'HIST140'], ['s1', 'MATH101H'],\n     ['s4', 'MATH101H'], ['s4', 'ECON150'], ['s1', 'BIO130'], ['s4', 'BIO130'], ['s1', 'ECON150'],\n     ['s4', 'CHEM120'], ['s2', 'MATH101H'], ['s2', 'CHEM120'], ['s1', 'PHYS110']]],\n   [['s1', 'BIO130', 'moved'], ['s2', 'CHEM120', 'moved'], ['s4', 'BIO130', 'moved'],\n    ['s4', 'CHEM120', 'moved'], ['s5', 'BIO130', 'moved']]),\n  ('normal control 7',\n   [{'BIO130': [0, 'H1']},\n    {'MATH101': [2, 'G1'], 'MATH101H': [1, 'H1'], 'CHEM120': [2, 'L1'], 'BIO130': [1, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'ECON150'], ['s1', 'BIO130'], ['s1', 'HIST140'], ['s3', 'MATH101H'], ['s4', 'CHEM120'],\n     ['s3', 'CHEM120'], ['s1', 'CHEM120'], ['s2', 'MATH101'], ['s1', 'PHYS110'], ['s4', 'HIST140'],\n     ['s3', 'BIO130'], ['s1', 'CHEM120']]],\n   [['s1', 'BIO130', 'moved'], ['s1', 'CHEM120', 'added'], ['s2', 'MATH101', 'added'],\n    ['s3', 'BIO130', 'moved'], ['s3', 'CHEM120', 'added'], ['s3', 'MATH101H', 'added'],\n    ['s4', 'CHEM120', 'added']]),\n  ('normal control 8',\n   [{'MATH101H': [1, 'G1'], 'PHYS110': [0, 'L1'], 'CHEM120': [3, 'G1'], 'BIO130': [0, 'H2']},\n    {'MATH101': [3, 'L2'],\n     'MATH101H': [1, 'G1'],\n     'PHYS110': [3, 'H2'],\n     'CHEM120': [3, 'G1'],\n     'BIO130': [1, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'MATH101H'], ['s5', 'HIST140'], ['s4', 'ECON150'], ['s3', 'MATH101'], ['s5', 'MATH101H'],\n     ['s2', 'PHYS110'], ['s4', 'MATH101H'], ['s2', 'CHEM120'], ['s2', 'MATH101'], ['s5', 'BIO130'],\n     ['s5', 'CHEM120'], ['s2', 'HIST140']]],\n   [['s2', 'MATH101', 'added'], ['s2', 'PHYS110', 'moved'], ['s3', 'MATH101', 'added'],\n    ['s5', 'BIO130', 'moved']])],\n [('regression: removed exams 1',\n   [{'MATH101': [1, 'L1'],\n     'MATH101H': [3, 'G1'],\n     'PHYS110': [2, 'H2'],\n     'CHEM120': [3, 'H2'],\n     'BIO130': [0, 'H1']},\n    {'MATH101': [2, 'G1'], 'CHEM120': [3, 'H1'], 'BIO130': [0, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'ECON150'], ['s4', 'PHYS110'], ['s1', 'HIST140'], ['s4', 'PHYS110'], ['s5', 'BIO130'],\n     ['s2', 'ECON150'], ['s2', 'HIST140'], ['s5', 'MATH101H']]],\n   [['s4', 'PHYS110', 'removed'], ['s5', 'MATH101H', 'removed']]),\n  ('regression variant: removed exams 2',\n   [{'MATH101H': [1, 'H1'], 'PHYS110': [0, 'H2'], 'BIO130': [0, 'L2']},\n    {'MATH101': [3, 'H2'], 'PHYS110': [0, 'H2'], 'CHEM120': [0, 'L1'], 'BIO130': [0, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'CHEM120'], ['s2', 'HIST140'], ['s4', 'BIO130'], ['s4', 'HIST140'], ['s5', 'HIST140'],\n     ['s2', 'ECON150'], ['s4', 'PHYS110'], ['s4', 'CHEM120'], ['s3', 'CHEM120'], ['s1', 'BIO130'],\n     ['s2', 'MATH101H']]],\n   [['s1', 'CHEM120', 'added'], ['s2', 'MATH101H', 'removed'], ['s3', 'CHEM120', 'added'],\n    ['s4', 'CHEM120', 'added']]),\n  ('partial repair guard 3',\n   [{'MATH101': [3, 'H1'], 'MATH101H': [1, 'G1'], 'PHYS110': [1, 'H1'], 'CHEM120': [1, 'H1']},\n    {'MATH101': [2, 'G1'],\n     'MATH101H': [1, 'G1'],\n     'PHYS110': [1, 'H1'],\n     'CHEM120': [0, 'H2'],\n     'BIO130': [2, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s3', 'ECON150'], ['s5', 'PHYS110'], ['s2', 'MATH101'], ['s2', 'PHYS110'], ['s1', 'BIO130'],\n     ['s2', 'HIST140'], ['s3', 'HIST140'], ['s5', 'HIST140'], ['s1', 'HIST140'], ['s1', 'MATH101H'],\n     ['s4', 'PHYS110'], ['s3', 'MATH101']]],\n   [['s1', 'BIO130', 'added'], ['s2', 'MATH101', 'moved'], ['s3', 'MATH101', 'moved']]),\n  ('boundary control 4',\n   [{'A': [0, 'H1']}, {'A': [0, 'H2']}, {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'A']]],\n   []),\n  ('normal control 5',\n   [{'MATH101H': [2, 'H2'], 'PHYS110': [3, 'L2'], 'CHEM120': [2, 'L2'], 'BIO130': [3, 'H1']},\n    {'MATH101': [2, 'H2'], 'MATH101H': [2, 'H2'], 'PHYS110': [3, 'L2'], 'CHEM120': [2, 'L2']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s2', 'PHYS110'], ['s5', 'ECON150'], ['s2', 'BIO130'], ['s2', 'CHEM120'], ['s1', 'CHEM120'],\n     ['s5', 'MATH101'], ['s5', 'ECON150'], ['s1', 'HIST140']]],\n   [['s2', 'BIO130', 'removed'], ['s5', 'MATH101', 'added']]),\n  ('normal control 6',\n   [{'MATH101': [3, 'G1'],\n     'MATH101H': [0, 'L1'],\n     'PHYS110': [1, 'H2'],\n     'CHEM120': [1, 'L2'],\n     'BIO130': [3, 'G1']},\n    {'MATH101': [3, 'G1'],\n     'MATH101H': [0, 'L1'],\n     'PHYS110': [1, 'H2'],\n     'CHEM120': [1, 'L2'],\n     'BIO130': [3, 'G1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'}, [['s4', 'CHEM120']]],\n   []),\n  ('normal control 7',\n   [{'MATH101': [1, 'L1'], 'MATH101H': [0, 'L2'], 'PHYS110': [3, 'H2'], 'BIO130': [0, 'L1']},\n    {'MATH101': [1, 'L1'],\n     'MATH101H': [2, 'H1'],\n     'PHYS110': [0, 'H2'],\n     'CHEM120': [0, 'H1'],\n     'BIO130': [0, 'L1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s1', 'PHYS110'], ['s1', 'HIST140'], ['s1', 'MATH101H'], ['s3', 'HIST140'], ['s1', 'MATH101'],\n     ['s3', 'ECON150']]],\n   [['s1', 'MATH101H', 'moved'], ['s1', 'PHYS110', 'moved']]),\n  ('normal control 8',\n   [{'MATH101H': [1, 'L2'], 'PHYS110': [2, 'L1'], 'CHEM120': [0, 'L1'], 'BIO130': [2, 'H1']},\n    {'MATH101': [2, 'L1'],\n     'MATH101H': [0, 'H2'],\n     'PHYS110': [2, 'L1'],\n     'CHEM120': [0, 'L1'],\n     'BIO130': [2, 'H1']},\n    {'H1': 'hall', 'H2': 'hall', 'G1': 'hall', 'L1': 'lib', 'L2': 'lib'},\n    [['s4', 'BIO130'], ['s4', 'PHYS110'], ['s4', 'MATH101H'], ['s3', 'MATH101H'], ['s3', 'HIST140'],\n     ['s4', 'PHYS110']]],\n   [['s3', 'MATH101H', 'moved'], ['s4', 'MATH101H', 'moved']])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Stipulated toy exam-timetabling rule set for a bounded model; it does not claim conformance with any institution's regulations or a benchmark specification, and it performs no search or optimisation. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-exam-timetabling-constraints-republish-change-notifications-removed-exams","generated_at":"2026-09-29T14:52:07.213987+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Republishing a timetable must notify exactly the affected candidates.","root_cause":"Only exams present in the new timetable are examined.","sha256":"e833f3d20c1e033a948dcb0c24688e9d6c8d20dc9d97697a104ba63c2b21fe40","title":"Withdrawn exams produce no notification · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":43.079,"exit_code":1,"observations":[{"actual":[["s1","A","removed"]],"check":"regression: removed exams 1","expected":[["s1","A","removed"]],"passed":true},{"actual":[["s2","MATH101","removed"],["s2","MATH101H","moved"]],"check":"regression variant: removed exams 2","expected":[["s2","MATH101","removed"],["s2","MATH101H","moved"]],"passed":true},{"actual":[["s1","MATH101H","moved"],["s2","MATH101H","moved"]],"check":"partial repair guard 3","expected":[["s1","MATH101H","moved"],["s2","MATH101H","moved"],["s5","MATH101","added"]],"passed":false},{"actual":[],"check":"boundary control 4","expected":[],"passed":true},{"actual":[["s1","MATH101H","venue"],["s5","PHYS110","removed"]],"check":"normal control 5","expected":[["s1","CHEM120","added"],["s1","MATH101H","venue"],["s2","BIO130","added"],["s2","CHEM120","added"],["s3","CHEM120","added"],["s5","BIO130","added"],["s5","PHYS110","removed"]],"passed":false},{"actual":[],"check":"normal control 6","expected":[],"passed":true},{"actual":[],"check":"normal control 7","expected":[],"passed":true},{"actual":[["s1","BIO130","moved"],["s3","BIO130","moved"]],"check":"normal control 8","expected":[["s1","BIO130","moved"],["s3","BIO130","moved"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: removed exams 1\", \"actual\": [[\"s1\", \"A\", \"removed\"]], \"expected\": [[\"s1\", \"A\", \"removed\"]], \"passed\": true}, {\"check\": \"regression variant: removed exams 2\", \"actual\": [[\"s2\", \"MATH101\", \"removed\"], [\"s2\", \"MATH101H\", \"moved\"]], \"expected\": [[\"s2\", \"MATH101\", \"removed\"], [\"s2\", \"MATH101H\", \"moved\"]], \"passed\": true}, {\"check\": \"partial repair guard 3\", \"actual\": [[\"s1\", \"MATH101H\", \"moved\"], [\"s2\", \"MATH101H\", \"moved\"]], \"expected\": [[\"s1\", \"MATH101H\", \"moved\"], [\"s2\", \"MATH101H\", \"moved\"], [\"s5\", \"MATH101\", \"added\"]], \"passed\": false}, {\"check\": \"boundary control 4\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 5\", \"actual\": [[\"s1\", \"MATH101H\", \"venue\"], [\"s5\", \"PHYS110\", \"removed\"]], \"expected\": [[\"s1\", \"CHEM120\", \"added\"], [\"s1\", \"MATH101H\", \"venue\"], [\"s2\", \"BIO130\", \"added\"], [\"s2\", \"CHEM120\", \"added\"], [\"s3\", \"CHEM120\", \"added\"], [\"s5\", \"BIO130\", \"added\"], [\"s5\", \"PHYS110\", \"removed\"]], \"passed\": false}, {\"check\": \"normal control 6\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 7\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 8\", \"actual\": [[\"s1\", \"BIO130\", \"moved\"], [\"s3\", \"BIO130\", \"moved\"]], \"expected\": [[\"s1\", \"BIO130\", \"moved\"], [\"s3\", \"BIO130\", \"moved\"]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":44.937,"exit_code":1,"observations":[{"actual":[],"check":"regression: removed exams 1","expected":[["s1","A","removed"]],"passed":false},{"actual":[["s2","MATH101H","moved"]],"check":"regression variant: removed exams 2","expected":[["s2","MATH101","removed"],["s2","MATH101H","moved"]],"passed":false},{"actual":[["s1","MATH101H","moved"],["s2","MATH101H","moved"],["s5","MATH101","added"]],"check":"partial repair guard 3","expected":[["s1","MATH101H","moved"],["s2","MATH101H","moved"],["s5","MATH101","added"]],"passed":true},{"actual":[],"check":"boundary control 4","expected":[],"passed":true},{"actual":[["s1","CHEM120","added"],["s1","MATH101H","venue"],["s2","BIO130","added"],["s2","CHEM120","added"],["s3","CHEM120","added"],["s5","BIO130","added"]],"check":"normal control 5","expected":[["s1","CHEM120","added"],["s1","MATH101H","venue"],["s2","BIO130","added"],["s2","CHEM120","added"],["s3","CHEM120","added"],["s5","BIO130","added"],["s5","PHYS110","removed"]],"passed":false},{"actual":[],"check":"normal control 6","expected":[],"passed":true},{"actual":[],"check":"normal control 7","expected":[],"passed":true},{"actual":[["s1","BIO130","moved"],["s3","BIO130","moved"]],"check":"normal control 8","expected":[["s1","BIO130","moved"],["s3","BIO130","moved"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: removed exams 1\", \"actual\": [], \"expected\": [[\"s1\", \"A\", \"removed\"]], \"passed\": false}, {\"check\": \"regression variant: removed exams 2\", \"actual\": [[\"s2\", \"MATH101H\", \"moved\"]], \"expected\": [[\"s2\", \"MATH101\", \"removed\"], [\"s2\", \"MATH101H\", \"moved\"]], \"passed\": false}, {\"check\": \"partial repair guard 3\", \"actual\": [[\"s1\", \"MATH101H\", \"moved\"], [\"s2\", \"MATH101H\", \"moved\"], [\"s5\", \"MATH101\", \"added\"]], \"expected\": [[\"s1\", \"MATH101H\", \"moved\"], [\"s2\", \"MATH101H\", \"moved\"], [\"s5\", \"MATH101\", \"added\"]], \"passed\": true}, {\"check\": \"boundary control 4\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 5\", \"actual\": [[\"s1\", \"CHEM120\", \"added\"], [\"s1\", \"MATH101H\", \"venue\"], [\"s2\", \"BIO130\", \"added\"], [\"s2\", \"CHEM120\", \"added\"], [\"s3\", \"CHEM120\", \"added\"], [\"s5\", \"BIO130\", \"added\"]], \"expected\": [[\"s1\", \"CHEM120\", \"added\"], [\"s1\", \"MATH101H\", \"venue\"], [\"s2\", \"BIO130\", \"added\"], [\"s2\", \"CHEM120\", \"added\"], [\"s3\", \"CHEM120\", \"added\"], [\"s5\", \"BIO130\", \"added\"], [\"s5\", \"PHYS110\", \"removed\"]], \"passed\": false}, {\"check\": \"normal control 6\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 7\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 8\", \"actual\": [[\"s1\", \"BIO130\", \"moved\"], [\"s3\", \"BIO130\", \"moved\"]], \"expected\": [[\"s1\", \"BIO130\", \"moved\"], [\"s3\", \"BIO130\", \"moved\"]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}