{"abstract":"Two different invigilators in the same period are reported as double-booked.","category":"Exam timetabling constraints","checks":8,"contract":"duties [invigilator, exam, period]; teach invigilator -> busy periods; subj invigilator -> subject code; exam subject is the part of the exam id before \"-\". Findings: busy (duty in a busy period), own_subject, double (same invigilator already on duty that period), daily_max (reported once, on the first duty that exceeds maxday on a day = period // spd). Return sorted [invigilator, exam, finding] rows.","contract_signature":"duties, teach, subj, maxday, spd","evaluation_group":"w2-exam-timetabling-constraints-invigilation-duty-validation","failed_approach":"Keying by invigilator and exam misses two different exams in one period.","family":"w2-exam-timetabling-constraints-invigilation-duty-validation-double-duty-key","id":"FA-94596","implementations":{"attempt":{"sha256":"04b77351b7cbbd52f6ec5661fd14da11151fb69464784fe811594eb9e0e31e2f","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(duties, teach, subj, maxday, spd):\n    out = []\n    seen = {}\n    per_day = {}\n    for inv, ex, p in duties:\n        if p in teach.get(inv, []):\n            out.append([inv, ex, 'busy'])\n        if ex.split('-')[0] == subj.get(inv):\n            out.append([inv, ex, 'own_subject'])\n        if (inv, ex) in seen:\n            out.append([inv, ex, 'double'])\n        seen[(inv, ex)] = ex\n        d = (inv, p // spd)\n        per_day[d] = per_day.get(d, 0) + 1\n        if per_day[d] == maxday + 1:\n            out.append([inv, ex, 'daily_max'])\n    return sorted(out)\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: double duty key 1', [[['ann', 'MATH-101', 0], ['bob', 'CHEM-110', 0]], {}, {}, 2, 3], []),\n  ('regression variant: double duty key 2',\n   [[['ann', 'BIO-201', 2], ['bob', 'BIOL-300', 3], ['bob', 'BIOL-300', 4], ['ann', 'BIOL-300', 4],\n     ['bob', 'CHEM-110', 1], ['ann', 'BIO-201', 1], ['cy', 'BIO-201', 2]],\n    {'ann': [0], 'bob': [4, 5]}, {'ann': 'BIOL', 'bob': 'CHEM', 'cy': 'CHEM'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIOL-300', 'own_subject'], ['bob', 'BIOL-300', 'busy'],\n    ['bob', 'BIOL-300', 'daily_max'], ['bob', 'CHEM-110', 'own_subject']]),\n  ('partial repair guard 3',\n   [[['ann', 'BIOL-300', 0], ['ann', 'BIO-201', 5], ['ann', 'MATH-101', 5], ['ann', 'BIO-201', 5]],\n    {'ann': [], 'bob': [2, 3], 'cy': [0, 4]}, {'ann': 'CHEM', 'bob': 'BIO', 'cy': 'CHEM'}, 2, 2],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIO-201', 'double'], ['ann', 'MATH-101', 'double']]),\n  ('boundary control 4', [[['ann', 'MATH-101', 2], ['ann', 'CHEM-110', 3]], {}, {}, 1, 3], []),\n  ('normal control 5',\n   [[['bob', 'MATH-101', 3], ['ann', 'BIOL-300', 2], ['cy', 'MATH-101', 1], ['cy', 'MATH-101', 5]],\n    {'ann': [3, 5], 'cy': [0, 3]}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'BIOL'}, 2, 2],\n   [['ann', 'BIOL-300', 'own_subject']]),\n  ('normal control 6',\n   [[['bob', 'CHEM-110', 5], ['ann', 'CHEM-110', 0]], {'ann': [], 'bob': [], 'cy': [1, 4]},\n    {'ann': 'BIO', 'bob': 'CHEM', 'cy': 'BIOL'}, 1, 2],\n   [['bob', 'CHEM-110', 'own_subject']]),\n  ('normal control 7',\n   [[['cy', 'BIOL-300', 1], ['ann', 'BIOL-300', 1], ['cy', 'CHEM-110', 1], ['bob', 'MATH-101', 5]],\n    {'ann': [], 'cy': [0]}, {'ann': 'BIOL', 'bob': 'MATH', 'cy': 'MATH'}, 1, 2],\n   [['ann', 'BIOL-300', 'own_subject'], ['bob', 'MATH-101', 'own_subject'], ['cy', 'CHEM-110', 'daily_max'],\n    ['cy', 'CHEM-110', 'double']]),\n  ('normal control 8',\n   [[['ann', 'CHEM-110', 4], ['ann', 'BIO-201', 2]], {'ann': [3, 5], 'cy': []},\n    {'ann': 'BIO', 'bob': 'MATH', 'cy': 'CHEM'}, 1, 2],\n   [['ann', 'BIO-201', 'own_subject']])],\n [('regression: double duty key 1',\n   [[['bob', 'BIOL-300', 3], ['bob', 'CHEM-110', 0], ['ann', 'CHEM-110', 0], ['cy', 'BIO-201', 4]],\n    {'bob': [], 'cy': []}, {'ann': 'MATH', 'bob': 'BIOL', 'cy': 'BIOL'}, 2, 3],\n   [['bob', 'BIOL-300', 'own_subject']]),\n  ('regression variant: double duty key 2',\n   [[['bob', 'BIO-201', 4], ['ann', 'BIOL-300', 5], ['cy', 'BIO-201', 5], ['ann', 'CHEM-110', 2]],\n    {'ann': []}, {'ann': 'MATH', 'bob': 'CHEM', 'cy': 'CHEM'}, 1, 3],\n   []),\n  ('partial repair guard 3',\n   [[['bob', 'BIOL-300', 3], ['cy', 'CHEM-110', 3], ['cy', 'CHEM-110', 3], ['ann', 'MATH-101', 0],\n     ['bob', 'BIOL-300', 1], ['cy', 'MATH-101', 3]],\n    {'bob': [], 'cy': [0, 2]}, {'ann': 'MATH', 'bob': 'CHEM', 'cy': 'BIO'}, 2, 3],\n   [['ann', 'MATH-101', 'own_subject'], ['cy', 'CHEM-110', 'double'], ['cy', 'MATH-101', 'daily_max'],\n    ['cy', 'MATH-101', 'double']]),\n  ('boundary control 4', [[['ann', 'BIOL-300', 0]], {}, {'ann': 'BIO'}, 2, 3], []),\n  ('normal control 5',\n   [[['ann', 'BIOL-300', 0], ['bob', 'BIOL-300', 0], ['cy', 'CHEM-110', 2]], {'cy': [3, 4]},\n    {'ann': 'CHEM', 'bob': 'BIO', 'cy': 'CHEM'}, 2, 3],\n   [['cy', 'CHEM-110', 'own_subject']]),\n  ('normal control 6',\n   [[['cy', 'CHEM-110', 4], ['ann', 'BIO-201', 0], ['cy', 'BIO-201', 4], ['ann', 'MATH-101', 4],\n     ['ann', 'BIO-201', 3]],\n    {'ann': [1, 2], 'cy': []}, {'ann': 'BIO', 'bob': 'MATH', 'cy': 'BIOL'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIO-201', 'own_subject'], ['ann', 'BIO-201', 'own_subject'],\n    ['cy', 'BIO-201', 'daily_max'], ['cy', 'BIO-201', 'double']]),\n  ('normal control 7',\n   [[['cy', 'BIOL-300', 3], ['ann', 'BIO-201', 4], ['ann', 'CHEM-110', 3], ['bob', 'BIO-201', 3],\n     ['cy', 'BIOL-300', 1], ['bob', 'MATH-101', 4], ['cy', 'BIO-201', 0]],\n    {'bob': [], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'BIOL'}, 2, 3],\n   [['cy', 'BIOL-300', 'own_subject'], ['cy', 'BIOL-300', 'own_subject']]),\n  ('normal control 8',\n   [[['bob', 'BIOL-300', 0], ['bob', 'BIOL-300', 3], ['cy', 'MATH-101', 2]],\n    {'ann': [], 'bob': [2], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIO', 'cy': 'MATH'}, 2, 2],\n   [['cy', 'MATH-101', 'own_subject']])],\n [('regression: double duty key 1',\n   [[['cy', 'MATH-101', 0], ['cy', 'BIOL-300', 0], ['ann', 'BIOL-300', 0], ['ann', 'BIO-201', 1],\n     ['bob', 'BIO-201', 1]],\n    {'bob': [1, 4], 'cy': []}, {'ann': 'BIO', 'bob': 'CHEM', 'cy': 'CHEM'}, 2, 2],\n   [['ann', 'BIO-201', 'own_subject'], ['bob', 'BIO-201', 'busy'], ['cy', 'BIOL-300', 'double']]),\n  ('regression variant: double duty key 2',\n   [[['ann', 'MATH-101', 5], ['bob', 'MATH-101', 5], ['ann', 'BIO-201', 1], ['cy', 'CHEM-110', 3],\n     ['bob', 'MATH-101', 2], ['cy', 'BIOL-300', 5], ['ann', 'BIO-201', 1]],\n    {'ann': [], 'cy': [1, 2]}, {'ann': 'MATH', 'bob': 'CHEM', 'cy': 'BIO'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIO-201', 'double'], ['ann', 'MATH-101', 'own_subject'],\n    ['cy', 'BIOL-300', 'daily_max']]),\n  ('partial repair guard 3',\n   [[['bob', 'BIOL-300', 0], ['ann', 'MATH-101', 5], ['bob', 'BIOL-300', 1]], {'ann': [], 'cy': [4]},\n    {'ann': 'MATH', 'bob': 'MATH', 'cy': 'MATH'}, 1, 3],\n   [['ann', 'MATH-101', 'own_subject'], ['bob', 'BIOL-300', 'daily_max']]),\n  ('boundary control 4', [[['ann', 'MATH-101', 0], ['bob', 'CHEM-110', 0]], {}, {}, 2, 3], []),\n  ('normal control 5',\n   [[['ann', 'MATH-101', 1], ['ann', 'BIO-201', 2], ['bob', 'MATH-101', 4], ['cy', 'CHEM-110', 1],\n     ['ann', 'MATH-101', 4], ['cy', 'MATH-101', 0], ['cy', 'CHEM-110', 4]],\n    {'ann': [3], 'bob': [4]}, {'ann': 'CHEM', 'bob': 'MATH', 'cy': 'BIOL'}, 1, 2],\n   [['bob', 'MATH-101', 'busy'], ['bob', 'MATH-101', 'own_subject'], ['cy', 'MATH-101', 'daily_max']]),\n  ('normal control 6',\n   [[['bob', 'BIO-201', 3], ['ann', 'BIOL-300', 4], ['ann', 'BIOL-300', 4], ['ann', 'BIO-201', 2],\n     ['ann', 'MATH-101', 1], ['ann', 'BIOL-300', 0]],\n    {'ann': [0], 'bob': [5], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIO', 'cy': 'BIOL'}, 1, 3],\n   [['ann', 'BIOL-300', 'busy'], ['ann', 'BIOL-300', 'daily_max'], ['ann', 'BIOL-300', 'double'],\n    ['ann', 'BIOL-300', 'own_subject'], ['ann', 'BIOL-300', 'own_subject'],\n    ['ann', 'BIOL-300', 'own_subject'], ['ann', 'MATH-101', 'daily_max'],\n    ['bob', 'BIO-201', 'own_subject']]),\n  ('normal control 7',\n   [[['cy', 'BIO-201', 1], ['bob', 'BIO-201', 1], ['ann', 'BIO-201', 5]],\n    {'ann': [3], 'bob': [0], 'cy': [3, 4]}, {'ann': 'CHEM', 'bob': 'MATH', 'cy': 'MATH'}, 2, 2],\n   []),\n  ('normal control 8',\n   [[['ann', 'MATH-101', 0], ['bob', 'CHEM-110', 1]], {'ann': [], 'bob': [2], 'cy': []},\n    {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'CHEM'}, 2, 2],\n   [])],\n [('regression: double duty key 1',\n   [[['bob', 'BIOL-300', 4], ['cy', 'CHEM-110', 5], ['cy', 'BIOL-300', 4], ['ann', 'CHEM-110', 4],\n     ['ann', 'BIOL-300', 0], ['cy', 'CHEM-110', 5], ['cy', 'CHEM-110', 2]],\n    {'ann': [], 'cy': [2]}, {'ann': 'MATH', 'bob': 'BIOL', 'cy': 'MATH'}, 2, 3],\n   [['bob', 'BIOL-300', 'own_subject'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'daily_max'],\n    ['cy', 'CHEM-110', 'double']]),\n  ('regression variant: double duty key 2',\n   [[['bob', 'CHEM-110', 4], ['cy', 'CHEM-110', 1], ['ann', 'CHEM-110', 2], ['ann', 'BIOL-300', 5],\n     ['bob', 'BIOL-300', 1]],\n    {'ann': [], 'bob': [0], 'cy': [4, 5]}, {'ann': 'BIOL', 'bob': 'MATH', 'cy': 'MATH'}, 2, 3],\n   [['ann', 'BIOL-300', 'own_subject']]),\n  ('partial repair guard 3',\n   [[['cy', 'BIO-201', 2], ['bob', 'BIOL-300', 3], ['ann', 'MATH-101', 3], ['ann', 'CHEM-110', 5],\n     ['cy', 'MATH-101', 3], ['bob', 'BIOL-300', 0], ['cy', 'MATH-101', 0]],\n    {'ann': [3], 'bob': [1, 2], 'cy': [5]}, {'ann': 'BIO', 'bob': 'MATH', 'cy': 'BIOL'}, 2, 2],\n   [['ann', 'MATH-101', 'busy']]),\n  ('boundary control 4',\n   [[['ann', 'MATH-101', 0], ['ann', 'CHEM-110', 1], ['ann', 'BIO-201', 2]], {}, {}, 2, 3],\n   [['ann', 'BIO-201', 'daily_max']]),\n  ('normal control 5',\n   [[['ann', 'BIO-201', 0], ['cy', 'BIOL-300', 0], ['cy', 'BIOL-300', 3], ['bob', 'BIO-201', 2],\n     ['cy', 'BIO-201', 1], ['bob', 'BIO-201', 4], ['ann', 'CHEM-110', 0]],\n    {'ann': [2], 'cy': []}, {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'MATH'}, 1, 2],\n   [['ann', 'CHEM-110', 'daily_max'], ['ann', 'CHEM-110', 'double'], ['ann', 'CHEM-110', 'own_subject'],\n    ['cy', 'BIO-201', 'daily_max']]),\n  ('normal control 6',\n   [[['bob', 'MATH-101', 1], ['cy', 'BIOL-300', 0], ['cy', 'MATH-101', 5], ['cy', 'CHEM-110', 1],\n     ['cy', 'MATH-101', 4], ['bob', 'MATH-101', 0], ['bob', 'BIO-201', 3]],\n    {'ann': [5], 'bob': [0, 2], 'cy': [2, 4]}, {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'BIO'}, 2, 2],\n   [['bob', 'MATH-101', 'busy'], ['cy', 'MATH-101', 'busy']]),\n  ('normal control 7',\n   [[['bob', 'MATH-101', 2], ['bob', 'CHEM-110', 0], ['bob', 'BIOL-300', 0]],\n    {'ann': [], 'bob': [1, 3], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'BIOL'}, 1, 2],\n   [['bob', 'BIOL-300', 'daily_max'], ['bob', 'BIOL-300', 'double'], ['bob', 'BIOL-300', 'own_subject']]),\n  ('normal control 8',\n   [[['ann', 'CHEM-110', 2], ['bob', 'BIOL-300', 3], ['cy', 'MATH-101', 2]], {'bob': [], 'cy': [0]},\n    {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'MATH'}, 1, 2],\n   [['ann', 'CHEM-110', 'own_subject'], ['cy', 'MATH-101', 'own_subject']])],\n [('regression: double duty key 1',\n   [[['bob', 'BIO-201', 3], ['cy', 'CHEM-110', 5], ['ann', 'BIOL-300', 1], ['ann', 'BIO-201', 2],\n     ['cy', 'CHEM-110', 3], ['bob', 'CHEM-110', 4], ['cy', 'CHEM-110', 0]],\n    {'ann': [1, 5], 'bob': [3], 'cy': [3]}, {'ann': 'CHEM', 'bob': 'MATH', 'cy': 'MATH'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIOL-300', 'busy'], ['bob', 'BIO-201', 'busy'],\n    ['bob', 'CHEM-110', 'daily_max'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'daily_max']]),\n  ('regression variant: double duty key 2',\n   [[['ann', 'BIOL-300', 1], ['ann', 'MATH-101', 1], ['bob', 'CHEM-110', 0], ['ann', 'MATH-101', 5],\n     ['ann', 'BIOL-300', 3], ['bob', 'BIO-201', 1]],\n    {'ann': [1], 'bob': [0], 'cy': [0, 2]}, {'ann': 'CHEM', 'bob': 'BIOL', 'cy': 'CHEM'}, 2, 3],\n   [['ann', 'BIOL-300', 'busy'], ['ann', 'MATH-101', 'busy'], ['ann', 'MATH-101', 'double'],\n    ['bob', 'CHEM-110', 'busy']]),\n  ('partial repair guard 3',\n   [[['bob', 'BIOL-300', 2], ['bob', 'BIOL-300', 5], ['ann', 'BIOL-300', 4], ['ann', 'BIOL-300', 0]],\n    {'ann': [], 'cy': []}, {'ann': 'BIOL', 'bob': 'CHEM', 'cy': 'BIOL'}, 1, 3],\n   [['ann', 'BIOL-300', 'own_subject'], ['ann', 'BIOL-300', 'own_subject']]),\n  ('boundary control 4', [[['ann', 'BIO-201', 0]], {}, {'ann': 'BIOL'}, 2, 3], []),\n  ('normal control 5',\n   [[['bob', 'MATH-101', 2], ['cy', 'CHEM-110', 1], ['cy', 'MATH-101', 2], ['cy', 'BIO-201', 5],\n     ['cy', 'CHEM-110', 2], ['bob', 'BIO-201', 2], ['cy', 'BIOL-300', 3]],\n    {'ann': [1, 5], 'bob': [2, 3], 'cy': [1, 2]}, {'ann': 'CHEM', 'bob': 'BIOL', 'cy': 'BIO'}, 2, 3],\n   [['bob', 'BIO-201', 'busy'], ['bob', 'BIO-201', 'double'], ['bob', 'MATH-101', 'busy'],\n    ['cy', 'BIO-201', 'own_subject'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'busy'],\n    ['cy', 'CHEM-110', 'daily_max'], ['cy', 'CHEM-110', 'double'], ['cy', 'MATH-101', 'busy']]),\n  ('normal control 6',\n   [[['ann', 'MATH-101', 1], ['bob', 'BIOL-300', 0], ['ann', 'MATH-101', 2], ['ann', 'MATH-101', 3],\n     ['bob', 'BIOL-300', 4], ['bob', 'MATH-101', 4], ['ann', 'CHEM-110', 0]],\n    {'ann': [], 'bob': [2, 5], 'cy': [1, 5]}, {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'BIOL'}, 2, 3],\n   [['ann', 'CHEM-110', 'daily_max'], ['ann', 'CHEM-110', 'own_subject'], ['bob', 'MATH-101', 'double']]),\n  ('normal control 7',\n   [[['ann', 'BIO-201', 1], ['bob', 'BIOL-300', 0], ['cy', 'MATH-101', 2], ['bob', 'CHEM-110', 5]],\n    {'ann': [0], 'bob': [1]}, {'ann': 'MATH', 'bob': 'MATH', 'cy': 'MATH'}, 1, 3],\n   [['cy', 'MATH-101', 'own_subject']]),\n  ('normal control 8',\n   [[['ann', 'CHEM-110', 2], ['cy', 'MATH-101', 5], ['bob', 'BIOL-300', 2], ['cy', 'CHEM-110', 0],\n     ['cy', 'CHEM-110', 4], ['ann', 'BIOL-300', 0], ['ann', 'CHEM-110', 4]],\n    {'bob': [1, 2], 'cy': [0, 5]}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'CHEM'}, 1, 3],\n   [['ann', 'BIOL-300', 'daily_max'], ['ann', 'BIOL-300', 'own_subject'], ['bob', 'BIOL-300', 'busy'],\n    ['bob', 'BIOL-300', 'own_subject'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'daily_max'],\n    ['cy', 'CHEM-110', 'own_subject'], ['cy', 'CHEM-110', 'own_subject'], ['cy', 'MATH-101', 'busy']])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"240fb15f8c6efca7d07ba2a7d6e18f521205074c410104ac820d138588e0ea93","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(duties, teach, subj, maxday, spd):\n    out = []\n    seen = {}\n    per_day = {}\n    for inv, ex, p in duties:\n        if p in teach.get(inv, []):\n            out.append([inv, ex, 'busy'])\n        if ex.split('-')[0] == subj.get(inv):\n            out.append([inv, ex, 'own_subject'])\n        if p in seen:\n            out.append([inv, ex, 'double'])\n        seen[p] = ex\n        d = (inv, p // spd)\n        per_day[d] = per_day.get(d, 0) + 1\n        if per_day[d] == maxday + 1:\n            out.append([inv, ex, 'daily_max'])\n    return sorted(out)\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: double duty key 1', [[['ann', 'MATH-101', 0], ['bob', 'CHEM-110', 0]], {}, {}, 2, 3], []),\n  ('regression variant: double duty key 2',\n   [[['ann', 'BIO-201', 2], ['bob', 'BIOL-300', 3], ['bob', 'BIOL-300', 4], ['ann', 'BIOL-300', 4],\n     ['bob', 'CHEM-110', 1], ['ann', 'BIO-201', 1], ['cy', 'BIO-201', 2]],\n    {'ann': [0], 'bob': [4, 5]}, {'ann': 'BIOL', 'bob': 'CHEM', 'cy': 'CHEM'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIOL-300', 'own_subject'], ['bob', 'BIOL-300', 'busy'],\n    ['bob', 'BIOL-300', 'daily_max'], ['bob', 'CHEM-110', 'own_subject']]),\n  ('partial repair guard 3',\n   [[['ann', 'BIOL-300', 0], ['ann', 'BIO-201', 5], ['ann', 'MATH-101', 5], ['ann', 'BIO-201', 5]],\n    {'ann': [], 'bob': [2, 3], 'cy': [0, 4]}, {'ann': 'CHEM', 'bob': 'BIO', 'cy': 'CHEM'}, 2, 2],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIO-201', 'double'], ['ann', 'MATH-101', 'double']]),\n  ('boundary control 4', [[['ann', 'MATH-101', 2], ['ann', 'CHEM-110', 3]], {}, {}, 1, 3], []),\n  ('normal control 5',\n   [[['bob', 'MATH-101', 3], ['ann', 'BIOL-300', 2], ['cy', 'MATH-101', 1], ['cy', 'MATH-101', 5]],\n    {'ann': [3, 5], 'cy': [0, 3]}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'BIOL'}, 2, 2],\n   [['ann', 'BIOL-300', 'own_subject']]),\n  ('normal control 6',\n   [[['bob', 'CHEM-110', 5], ['ann', 'CHEM-110', 0]], {'ann': [], 'bob': [], 'cy': [1, 4]},\n    {'ann': 'BIO', 'bob': 'CHEM', 'cy': 'BIOL'}, 1, 2],\n   [['bob', 'CHEM-110', 'own_subject']]),\n  ('normal control 7',\n   [[['cy', 'BIOL-300', 1], ['ann', 'BIOL-300', 1], ['cy', 'CHEM-110', 1], ['bob', 'MATH-101', 5]],\n    {'ann': [], 'cy': [0]}, {'ann': 'BIOL', 'bob': 'MATH', 'cy': 'MATH'}, 1, 2],\n   [['ann', 'BIOL-300', 'own_subject'], ['bob', 'MATH-101', 'own_subject'], ['cy', 'CHEM-110', 'daily_max'],\n    ['cy', 'CHEM-110', 'double']]),\n  ('normal control 8',\n   [[['ann', 'CHEM-110', 4], ['ann', 'BIO-201', 2]], {'ann': [3, 5], 'cy': []},\n    {'ann': 'BIO', 'bob': 'MATH', 'cy': 'CHEM'}, 1, 2],\n   [['ann', 'BIO-201', 'own_subject']])],\n [('regression: double duty key 1',\n   [[['bob', 'BIOL-300', 3], ['bob', 'CHEM-110', 0], ['ann', 'CHEM-110', 0], ['cy', 'BIO-201', 4]],\n    {'bob': [], 'cy': []}, {'ann': 'MATH', 'bob': 'BIOL', 'cy': 'BIOL'}, 2, 3],\n   [['bob', 'BIOL-300', 'own_subject']]),\n  ('regression variant: double duty key 2',\n   [[['bob', 'BIO-201', 4], ['ann', 'BIOL-300', 5], ['cy', 'BIO-201', 5], ['ann', 'CHEM-110', 2]],\n    {'ann': []}, {'ann': 'MATH', 'bob': 'CHEM', 'cy': 'CHEM'}, 1, 3],\n   []),\n  ('partial repair guard 3',\n   [[['bob', 'BIOL-300', 3], ['cy', 'CHEM-110', 3], ['cy', 'CHEM-110', 3], ['ann', 'MATH-101', 0],\n     ['bob', 'BIOL-300', 1], ['cy', 'MATH-101', 3]],\n    {'bob': [], 'cy': [0, 2]}, {'ann': 'MATH', 'bob': 'CHEM', 'cy': 'BIO'}, 2, 3],\n   [['ann', 'MATH-101', 'own_subject'], ['cy', 'CHEM-110', 'double'], ['cy', 'MATH-101', 'daily_max'],\n    ['cy', 'MATH-101', 'double']]),\n  ('boundary control 4', [[['ann', 'BIOL-300', 0]], {}, {'ann': 'BIO'}, 2, 3], []),\n  ('normal control 5',\n   [[['ann', 'BIOL-300', 0], ['bob', 'BIOL-300', 0], ['cy', 'CHEM-110', 2]], {'cy': [3, 4]},\n    {'ann': 'CHEM', 'bob': 'BIO', 'cy': 'CHEM'}, 2, 3],\n   [['cy', 'CHEM-110', 'own_subject']]),\n  ('normal control 6',\n   [[['cy', 'CHEM-110', 4], ['ann', 'BIO-201', 0], ['cy', 'BIO-201', 4], ['ann', 'MATH-101', 4],\n     ['ann', 'BIO-201', 3]],\n    {'ann': [1, 2], 'cy': []}, {'ann': 'BIO', 'bob': 'MATH', 'cy': 'BIOL'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIO-201', 'own_subject'], ['ann', 'BIO-201', 'own_subject'],\n    ['cy', 'BIO-201', 'daily_max'], ['cy', 'BIO-201', 'double']]),\n  ('normal control 7',\n   [[['cy', 'BIOL-300', 3], ['ann', 'BIO-201', 4], ['ann', 'CHEM-110', 3], ['bob', 'BIO-201', 3],\n     ['cy', 'BIOL-300', 1], ['bob', 'MATH-101', 4], ['cy', 'BIO-201', 0]],\n    {'bob': [], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'BIOL'}, 2, 3],\n   [['cy', 'BIOL-300', 'own_subject'], ['cy', 'BIOL-300', 'own_subject']]),\n  ('normal control 8',\n   [[['bob', 'BIOL-300', 0], ['bob', 'BIOL-300', 3], ['cy', 'MATH-101', 2]],\n    {'ann': [], 'bob': [2], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIO', 'cy': 'MATH'}, 2, 2],\n   [['cy', 'MATH-101', 'own_subject']])],\n [('regression: double duty key 1',\n   [[['cy', 'MATH-101', 0], ['cy', 'BIOL-300', 0], ['ann', 'BIOL-300', 0], ['ann', 'BIO-201', 1],\n     ['bob', 'BIO-201', 1]],\n    {'bob': [1, 4], 'cy': []}, {'ann': 'BIO', 'bob': 'CHEM', 'cy': 'CHEM'}, 2, 2],\n   [['ann', 'BIO-201', 'own_subject'], ['bob', 'BIO-201', 'busy'], ['cy', 'BIOL-300', 'double']]),\n  ('regression variant: double duty key 2',\n   [[['ann', 'MATH-101', 5], ['bob', 'MATH-101', 5], ['ann', 'BIO-201', 1], ['cy', 'CHEM-110', 3],\n     ['bob', 'MATH-101', 2], ['cy', 'BIOL-300', 5], ['ann', 'BIO-201', 1]],\n    {'ann': [], 'cy': [1, 2]}, {'ann': 'MATH', 'bob': 'CHEM', 'cy': 'BIO'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIO-201', 'double'], ['ann', 'MATH-101', 'own_subject'],\n    ['cy', 'BIOL-300', 'daily_max']]),\n  ('partial repair guard 3',\n   [[['bob', 'BIOL-300', 0], ['ann', 'MATH-101', 5], ['bob', 'BIOL-300', 1]], {'ann': [], 'cy': [4]},\n    {'ann': 'MATH', 'bob': 'MATH', 'cy': 'MATH'}, 1, 3],\n   [['ann', 'MATH-101', 'own_subject'], ['bob', 'BIOL-300', 'daily_max']]),\n  ('boundary control 4', [[['ann', 'MATH-101', 0], ['bob', 'CHEM-110', 0]], {}, {}, 2, 3], []),\n  ('normal control 5',\n   [[['ann', 'MATH-101', 1], ['ann', 'BIO-201', 2], ['bob', 'MATH-101', 4], ['cy', 'CHEM-110', 1],\n     ['ann', 'MATH-101', 4], ['cy', 'MATH-101', 0], ['cy', 'CHEM-110', 4]],\n    {'ann': [3], 'bob': [4]}, {'ann': 'CHEM', 'bob': 'MATH', 'cy': 'BIOL'}, 1, 2],\n   [['bob', 'MATH-101', 'busy'], ['bob', 'MATH-101', 'own_subject'], ['cy', 'MATH-101', 'daily_max']]),\n  ('normal control 6',\n   [[['bob', 'BIO-201', 3], ['ann', 'BIOL-300', 4], ['ann', 'BIOL-300', 4], ['ann', 'BIO-201', 2],\n     ['ann', 'MATH-101', 1], ['ann', 'BIOL-300', 0]],\n    {'ann': [0], 'bob': [5], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIO', 'cy': 'BIOL'}, 1, 3],\n   [['ann', 'BIOL-300', 'busy'], ['ann', 'BIOL-300', 'daily_max'], ['ann', 'BIOL-300', 'double'],\n    ['ann', 'BIOL-300', 'own_subject'], ['ann', 'BIOL-300', 'own_subject'],\n    ['ann', 'BIOL-300', 'own_subject'], ['ann', 'MATH-101', 'daily_max'],\n    ['bob', 'BIO-201', 'own_subject']]),\n  ('normal control 7',\n   [[['cy', 'BIO-201', 1], ['bob', 'BIO-201', 1], ['ann', 'BIO-201', 5]],\n    {'ann': [3], 'bob': [0], 'cy': [3, 4]}, {'ann': 'CHEM', 'bob': 'MATH', 'cy': 'MATH'}, 2, 2],\n   []),\n  ('normal control 8',\n   [[['ann', 'MATH-101', 0], ['bob', 'CHEM-110', 1]], {'ann': [], 'bob': [2], 'cy': []},\n    {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'CHEM'}, 2, 2],\n   [])],\n [('regression: double duty key 1',\n   [[['bob', 'BIOL-300', 4], ['cy', 'CHEM-110', 5], ['cy', 'BIOL-300', 4], ['ann', 'CHEM-110', 4],\n     ['ann', 'BIOL-300', 0], ['cy', 'CHEM-110', 5], ['cy', 'CHEM-110', 2]],\n    {'ann': [], 'cy': [2]}, {'ann': 'MATH', 'bob': 'BIOL', 'cy': 'MATH'}, 2, 3],\n   [['bob', 'BIOL-300', 'own_subject'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'daily_max'],\n    ['cy', 'CHEM-110', 'double']]),\n  ('regression variant: double duty key 2',\n   [[['bob', 'CHEM-110', 4], ['cy', 'CHEM-110', 1], ['ann', 'CHEM-110', 2], ['ann', 'BIOL-300', 5],\n     ['bob', 'BIOL-300', 1]],\n    {'ann': [], 'bob': [0], 'cy': [4, 5]}, {'ann': 'BIOL', 'bob': 'MATH', 'cy': 'MATH'}, 2, 3],\n   [['ann', 'BIOL-300', 'own_subject']]),\n  ('partial repair guard 3',\n   [[['cy', 'BIO-201', 2], ['bob', 'BIOL-300', 3], ['ann', 'MATH-101', 3], ['ann', 'CHEM-110', 5],\n     ['cy', 'MATH-101', 3], ['bob', 'BIOL-300', 0], ['cy', 'MATH-101', 0]],\n    {'ann': [3], 'bob': [1, 2], 'cy': [5]}, {'ann': 'BIO', 'bob': 'MATH', 'cy': 'BIOL'}, 2, 2],\n   [['ann', 'MATH-101', 'busy']]),\n  ('boundary control 4',\n   [[['ann', 'MATH-101', 0], ['ann', 'CHEM-110', 1], ['ann', 'BIO-201', 2]], {}, {}, 2, 3],\n   [['ann', 'BIO-201', 'daily_max']]),\n  ('normal control 5',\n   [[['ann', 'BIO-201', 0], ['cy', 'BIOL-300', 0], ['cy', 'BIOL-300', 3], ['bob', 'BIO-201', 2],\n     ['cy', 'BIO-201', 1], ['bob', 'BIO-201', 4], ['ann', 'CHEM-110', 0]],\n    {'ann': [2], 'cy': []}, {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'MATH'}, 1, 2],\n   [['ann', 'CHEM-110', 'daily_max'], ['ann', 'CHEM-110', 'double'], ['ann', 'CHEM-110', 'own_subject'],\n    ['cy', 'BIO-201', 'daily_max']]),\n  ('normal control 6',\n   [[['bob', 'MATH-101', 1], ['cy', 'BIOL-300', 0], ['cy', 'MATH-101', 5], ['cy', 'CHEM-110', 1],\n     ['cy', 'MATH-101', 4], ['bob', 'MATH-101', 0], ['bob', 'BIO-201', 3]],\n    {'ann': [5], 'bob': [0, 2], 'cy': [2, 4]}, {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'BIO'}, 2, 2],\n   [['bob', 'MATH-101', 'busy'], ['cy', 'MATH-101', 'busy']]),\n  ('normal control 7',\n   [[['bob', 'MATH-101', 2], ['bob', 'CHEM-110', 0], ['bob', 'BIOL-300', 0]],\n    {'ann': [], 'bob': [1, 3], 'cy': []}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'BIOL'}, 1, 2],\n   [['bob', 'BIOL-300', 'daily_max'], ['bob', 'BIOL-300', 'double'], ['bob', 'BIOL-300', 'own_subject']]),\n  ('normal control 8',\n   [[['ann', 'CHEM-110', 2], ['bob', 'BIOL-300', 3], ['cy', 'MATH-101', 2]], {'bob': [], 'cy': [0]},\n    {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'MATH'}, 1, 2],\n   [['ann', 'CHEM-110', 'own_subject'], ['cy', 'MATH-101', 'own_subject']])],\n [('regression: double duty key 1',\n   [[['bob', 'BIO-201', 3], ['cy', 'CHEM-110', 5], ['ann', 'BIOL-300', 1], ['ann', 'BIO-201', 2],\n     ['cy', 'CHEM-110', 3], ['bob', 'CHEM-110', 4], ['cy', 'CHEM-110', 0]],\n    {'ann': [1, 5], 'bob': [3], 'cy': [3]}, {'ann': 'CHEM', 'bob': 'MATH', 'cy': 'MATH'}, 1, 3],\n   [['ann', 'BIO-201', 'daily_max'], ['ann', 'BIOL-300', 'busy'], ['bob', 'BIO-201', 'busy'],\n    ['bob', 'CHEM-110', 'daily_max'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'daily_max']]),\n  ('regression variant: double duty key 2',\n   [[['ann', 'BIOL-300', 1], ['ann', 'MATH-101', 1], ['bob', 'CHEM-110', 0], ['ann', 'MATH-101', 5],\n     ['ann', 'BIOL-300', 3], ['bob', 'BIO-201', 1]],\n    {'ann': [1], 'bob': [0], 'cy': [0, 2]}, {'ann': 'CHEM', 'bob': 'BIOL', 'cy': 'CHEM'}, 2, 3],\n   [['ann', 'BIOL-300', 'busy'], ['ann', 'MATH-101', 'busy'], ['ann', 'MATH-101', 'double'],\n    ['bob', 'CHEM-110', 'busy']]),\n  ('partial repair guard 3',\n   [[['bob', 'BIOL-300', 2], ['bob', 'BIOL-300', 5], ['ann', 'BIOL-300', 4], ['ann', 'BIOL-300', 0]],\n    {'ann': [], 'cy': []}, {'ann': 'BIOL', 'bob': 'CHEM', 'cy': 'BIOL'}, 1, 3],\n   [['ann', 'BIOL-300', 'own_subject'], ['ann', 'BIOL-300', 'own_subject']]),\n  ('boundary control 4', [[['ann', 'BIO-201', 0]], {}, {'ann': 'BIOL'}, 2, 3], []),\n  ('normal control 5',\n   [[['bob', 'MATH-101', 2], ['cy', 'CHEM-110', 1], ['cy', 'MATH-101', 2], ['cy', 'BIO-201', 5],\n     ['cy', 'CHEM-110', 2], ['bob', 'BIO-201', 2], ['cy', 'BIOL-300', 3]],\n    {'ann': [1, 5], 'bob': [2, 3], 'cy': [1, 2]}, {'ann': 'CHEM', 'bob': 'BIOL', 'cy': 'BIO'}, 2, 3],\n   [['bob', 'BIO-201', 'busy'], ['bob', 'BIO-201', 'double'], ['bob', 'MATH-101', 'busy'],\n    ['cy', 'BIO-201', 'own_subject'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'busy'],\n    ['cy', 'CHEM-110', 'daily_max'], ['cy', 'CHEM-110', 'double'], ['cy', 'MATH-101', 'busy']]),\n  ('normal control 6',\n   [[['ann', 'MATH-101', 1], ['bob', 'BIOL-300', 0], ['ann', 'MATH-101', 2], ['ann', 'MATH-101', 3],\n     ['bob', 'BIOL-300', 4], ['bob', 'MATH-101', 4], ['ann', 'CHEM-110', 0]],\n    {'ann': [], 'bob': [2, 5], 'cy': [1, 5]}, {'ann': 'CHEM', 'bob': 'CHEM', 'cy': 'BIOL'}, 2, 3],\n   [['ann', 'CHEM-110', 'daily_max'], ['ann', 'CHEM-110', 'own_subject'], ['bob', 'MATH-101', 'double']]),\n  ('normal control 7',\n   [[['ann', 'BIO-201', 1], ['bob', 'BIOL-300', 0], ['cy', 'MATH-101', 2], ['bob', 'CHEM-110', 5]],\n    {'ann': [0], 'bob': [1]}, {'ann': 'MATH', 'bob': 'MATH', 'cy': 'MATH'}, 1, 3],\n   [['cy', 'MATH-101', 'own_subject']]),\n  ('normal control 8',\n   [[['ann', 'CHEM-110', 2], ['cy', 'MATH-101', 5], ['bob', 'BIOL-300', 2], ['cy', 'CHEM-110', 0],\n     ['cy', 'CHEM-110', 4], ['ann', 'BIOL-300', 0], ['ann', 'CHEM-110', 4]],\n    {'bob': [1, 2], 'cy': [0, 5]}, {'ann': 'BIOL', 'bob': 'BIOL', 'cy': 'CHEM'}, 1, 3],\n   [['ann', 'BIOL-300', 'daily_max'], ['ann', 'BIOL-300', 'own_subject'], ['bob', 'BIOL-300', 'busy'],\n    ['bob', 'BIOL-300', 'own_subject'], ['cy', 'CHEM-110', 'busy'], ['cy', 'CHEM-110', 'daily_max'],\n    ['cy', 'CHEM-110', 'own_subject'], ['cy', 'CHEM-110', 'own_subject'], ['cy', 'MATH-101', 'busy']])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Stipulated toy exam-timetabling rule set for a bounded model; it does not claim conformance with any institution's regulations or a benchmark specification, and it performs no search or optimisation. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-exam-timetabling-constraints-invigilation-duty-validation-double-duty-key","generated_at":"2026-09-29T14:52:05.877141+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Invigilation rosters must respect teaching commitments, conflict-of-interest rules and daily limits.","root_cause":"The seen map is keyed by period only.","sha256":"22a7918c8a12e5a6cfa495571c2da20142b0abdbd352a5aee71c6b86115b587a","title":"Double-duty check shared across invigilators · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":42.241,"exit_code":1,"observations":[{"actual":[],"check":"regression: double duty key 1","expected":[],"passed":true},{"actual":[["ann","BIO-201","daily_max"],["ann","BIO-201","double"],["ann","BIOL-300","own_subject"],["bob","BIOL-300","busy"],["bob","BIOL-300","daily_max"],["bob","BIOL-300","double"],["bob","CHEM-110","own_subject"]],"check":"regression variant: double duty key 2","expected":[["ann","BIO-201","daily_max"],["ann","BIOL-300","own_subject"],["bob","BIOL-300","busy"],["bob","BIOL-300","daily_max"],["bob","CHEM-110","own_subject"]],"passed":false},{"actual":[["ann","BIO-201","daily_max"],["ann","BIO-201","double"]],"check":"partial repair guard 3","expected":[["ann","BIO-201","daily_max"],["ann","BIO-201","double"],["ann","MATH-101","double"]],"passed":false},{"actual":[],"check":"boundary control 4","expected":[],"passed":true},{"actual":[["ann","BIOL-300","own_subject"],["cy","MATH-101","double"]],"check":"normal control 5","expected":[["ann","BIOL-300","own_subject"]],"passed":false},{"actual":[["bob","CHEM-110","own_subject"]],"check":"normal control 6","expected":[["bob","CHEM-110","own_subject"]],"passed":true},{"actual":[["ann","BIOL-300","own_subject"],["bob","MATH-101","own_subject"],["cy","CHEM-110","daily_max"]],"check":"normal control 7","expected":[["ann","BIOL-300","own_subject"],["bob","MATH-101","own_subject"],["cy","CHEM-110","daily_max"],["cy","CHEM-110","double"]],"passed":false},{"actual":[["ann","BIO-201","own_subject"]],"check":"normal control 8","expected":[["ann","BIO-201","own_subject"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: double duty key 1\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"regression variant: double duty key 2\", \"actual\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIO-201\", \"double\"], [\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"BIOL-300\", \"busy\"], [\"bob\", \"BIOL-300\", \"daily_max\"], [\"bob\", \"BIOL-300\", \"double\"], [\"bob\", \"CHEM-110\", \"own_subject\"]], \"expected\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"BIOL-300\", \"busy\"], [\"bob\", \"BIOL-300\", \"daily_max\"], [\"bob\", \"CHEM-110\", \"own_subject\"]], \"passed\": false}, {\"check\": \"partial repair guard 3\", \"actual\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIO-201\", \"double\"]], \"expected\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIO-201\", \"double\"], [\"ann\", \"MATH-101\", \"double\"]], \"passed\": false}, {\"check\": \"boundary control 4\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 5\", \"actual\": [[\"ann\", \"BIOL-300\", \"own_subject\"], [\"cy\", \"MATH-101\", \"double\"]], \"expected\": [[\"ann\", \"BIOL-300\", \"own_subject\"]], \"passed\": false}, {\"check\": \"normal control 6\", \"actual\": [[\"bob\", \"CHEM-110\", \"own_subject\"]], \"expected\": [[\"bob\", \"CHEM-110\", \"own_subject\"]], \"passed\": true}, {\"check\": \"normal control 7\", \"actual\": [[\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"MATH-101\", \"own_subject\"], [\"cy\", \"CHEM-110\", \"daily_max\"]], \"expected\": [[\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"MATH-101\", \"own_subject\"], [\"cy\", \"CHEM-110\", \"daily_max\"], [\"cy\", \"CHEM-110\", \"double\"]], \"passed\": false}, {\"check\": \"normal control 8\", \"actual\": [[\"ann\", \"BIO-201\", \"own_subject\"]], \"expected\": [[\"ann\", \"BIO-201\", \"own_subject\"]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":41.372,"exit_code":1,"observations":[{"actual":[["bob","CHEM-110","double"]],"check":"regression: double duty key 1","expected":[],"passed":false},{"actual":[["ann","BIO-201","daily_max"],["ann","BIO-201","double"],["ann","BIOL-300","double"],["ann","BIOL-300","own_subject"],["bob","BIOL-300","busy"],["bob","BIOL-300","daily_max"],["bob","CHEM-110","own_subject"],["cy","BIO-201","double"]],"check":"regression variant: double duty key 2","expected":[["ann","BIO-201","daily_max"],["ann","BIOL-300","own_subject"],["bob","BIOL-300","busy"],["bob","BIOL-300","daily_max"],["bob","CHEM-110","own_subject"]],"passed":false},{"actual":[["ann","BIO-201","daily_max"],["ann","BIO-201","double"],["ann","MATH-101","double"]],"check":"partial repair guard 3","expected":[["ann","BIO-201","daily_max"],["ann","BIO-201","double"],["ann","MATH-101","double"]],"passed":true},{"actual":[],"check":"boundary control 4","expected":[],"passed":true},{"actual":[["ann","BIOL-300","own_subject"]],"check":"normal control 5","expected":[["ann","BIOL-300","own_subject"]],"passed":true},{"actual":[["bob","CHEM-110","own_subject"]],"check":"normal control 6","expected":[["bob","CHEM-110","own_subject"]],"passed":true},{"actual":[["ann","BIOL-300","double"],["ann","BIOL-300","own_subject"],["bob","MATH-101","own_subject"],["cy","CHEM-110","daily_max"],["cy","CHEM-110","double"]],"check":"normal control 7","expected":[["ann","BIOL-300","own_subject"],["bob","MATH-101","own_subject"],["cy","CHEM-110","daily_max"],["cy","CHEM-110","double"]],"passed":false},{"actual":[["ann","BIO-201","own_subject"]],"check":"normal control 8","expected":[["ann","BIO-201","own_subject"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: double duty key 1\", \"actual\": [[\"bob\", \"CHEM-110\", \"double\"]], \"expected\": [], \"passed\": false}, {\"check\": \"regression variant: double duty key 2\", \"actual\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIO-201\", \"double\"], [\"ann\", \"BIOL-300\", \"double\"], [\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"BIOL-300\", \"busy\"], [\"bob\", \"BIOL-300\", \"daily_max\"], [\"bob\", \"CHEM-110\", \"own_subject\"], [\"cy\", \"BIO-201\", \"double\"]], \"expected\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"BIOL-300\", \"busy\"], [\"bob\", \"BIOL-300\", \"daily_max\"], [\"bob\", \"CHEM-110\", \"own_subject\"]], \"passed\": false}, {\"check\": \"partial repair guard 3\", \"actual\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIO-201\", \"double\"], [\"ann\", \"MATH-101\", \"double\"]], \"expected\": [[\"ann\", \"BIO-201\", \"daily_max\"], [\"ann\", \"BIO-201\", \"double\"], [\"ann\", \"MATH-101\", \"double\"]], \"passed\": true}, {\"check\": \"boundary control 4\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"normal control 5\", \"actual\": [[\"ann\", \"BIOL-300\", \"own_subject\"]], \"expected\": [[\"ann\", \"BIOL-300\", \"own_subject\"]], \"passed\": true}, {\"check\": \"normal control 6\", \"actual\": [[\"bob\", \"CHEM-110\", \"own_subject\"]], \"expected\": [[\"bob\", \"CHEM-110\", \"own_subject\"]], \"passed\": true}, {\"check\": \"normal control 7\", \"actual\": [[\"ann\", \"BIOL-300\", \"double\"], [\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"MATH-101\", \"own_subject\"], [\"cy\", \"CHEM-110\", \"daily_max\"], [\"cy\", \"CHEM-110\", \"double\"]], \"expected\": [[\"ann\", \"BIOL-300\", \"own_subject\"], [\"bob\", \"MATH-101\", \"own_subject\"], [\"cy\", \"CHEM-110\", \"daily_max\"], [\"cy\", \"CHEM-110\", \"double\"]], \"passed\": false}, {\"check\": \"normal control 8\", \"actual\": [[\"ann\", \"BIO-201\", \"own_subject\"]], \"expected\": [[\"ann\", \"BIO-201\", \"own_subject\"]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}