{"abstract":"A signal clears into a section that is already occupied.","category":"Railway interlocking logic","checks":8,"contract":"Each step gives [section beyond occupied, route set, approach occupied]. An auto signal behaves as permanently routed. A signal shows danger whenever the section beyond is occupied; a signal that was clear when a train occupies that section latches a stick that keeps it at danger until the route is set afresh (off then on); auto signals drop the stick every step. Otherwise it clears when routed, not stuck, and for approach-released signals only with the approach occupied. Output the state per step.","contract_signature":"x","evaluation_group":"w2-railway_interlocking_logic-signal-replacement-stick","failed_approach":"Exempting automatic signals lets them clear into an occupied block.","family":"w2-railway_interlocking_logic-signal-replacement-stick-danger-on-occupancy","id":"FA-67196","implementations":{"attempt":{"sha256":"154227ceae6eb646272fa0f01aaa82042e8d330b5e70caf28f0906e3c83e0f92","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    mode = x['mode']\n    state = 'danger'\n    stick = False\n    prev_route = False\n    out = []\n    for occ, route, appr in x['steps']:\n        if mode == 'auto':\n            route = True\n        if (route and not prev_route) or mode == 'auto':\n            stick = False\n        if occ and mode != 'auto':\n            if state == 'clear':\n                stick = True\n            state = 'danger'\n        elif route and not stick and (mode != 'approach' or appr):\n            state = 'clear'\n        else:\n            state = 'danger'\n        prev_route = route\n        out.append(state)\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('boundary: automatic signal re-clears', {'mode': 'auto', 'steps': [[False, False, False], [True, False, True], [False, False, False]]}, ['clear', 'danger', 'clear']), ('sampled regression 12', {'mode': 'controlled', 'steps': [[False, False, True], [False, True, True], [True, False, True], [False, False, False], [False, False, True], [True, True, True], [True, False, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger']), ('boundary: second train behind on the same route', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, True, True]]}, ['clear', 'danger', 'danger']), ('boundary: route re-set after a train', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, False, True], [False, True, True]]}, ['clear', 'danger', 'danger', 'clear']), ('control 1', {'mode': 'auto', 'steps': [[False, True, False], [False, False, True], [False, True, False], [False, False, True], [False, False, False]]}, ['clear', 'clear', 'clear', 'clear', 'clear']), ('control 4', {'mode': 'controlled', 'steps': [[False, False, False], [False, True, True], [True, True, True], [False, True, True], [False, False, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger']), ('control 7', {'mode': 'approach', 'steps': [[False, False, False], [False, False, False], [False, False, True], [False, False, True], [False, True, False], [False, False, True], [False, True, True], [False, True, True], [False, True, True], [True, True, True]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear', 'clear', 'clear', 'danger'])], [('regression: controlled signal with a standing train', {'mode': 'controlled', 'steps': [[True, True, True], [False, True, True]]}, ['danger', 'clear']), ('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('sampled regression 31', {'mode': 'auto', 'steps': [[False, True, False], [False, True, False], [False, True, False], [False, True, True], [False, True, False], [False, True, False], [True, True, False], [True, False, True], [True, False, True]]}, ['clear', 'clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'danger', 'danger']), ('boundary: approach-released signal with empty approach', {'mode': 'approach', 'steps': [[False, True, False], [False, True, True]]}, ['danger', 'clear']), ('boundary: approach-released signal replaced by train', {'mode': 'approach', 'steps': [[False, True, True], [True, True, True], [False, True, True]]}, ['clear', 'danger', 'danger']), ('sampled regression 12', {'mode': 'controlled', 'steps': [[False, False, True], [False, True, True], [True, False, True], [False, False, False], [False, False, True], [True, True, True], [True, False, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger']), ('control 15', {'mode': 'approach', 'steps': [[False, True, True], [False, True, False], [False, True, True]]}, ['clear', 'danger', 'clear']), ('sampled regression 18', {'mode': 'approach', 'steps': [[False, True, False], [False, False, False], [False, False, False], [True, True, False], [False, True, False], [True, True, True], [False, True, True]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear'])], [('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('boundary: automatic signal re-clears', {'mode': 'auto', 'steps': [[False, False, False], [True, False, True], [False, False, False]]}, ['clear', 'danger', 'clear']), ('sampled regression 51', {'mode': 'controlled', 'steps': [[False, False, True], [False, False, False], [False, True, False], [False, True, True], [True, False, True], [False, False, True], [True, True, False]]}, ['danger', 'danger', 'clear', 'clear', 'danger', 'danger', 'danger']), ('sampled regression 54', {'mode': 'auto', 'steps': [[True, True, False], [False, True, False], [False, False, True], [False, False, True], [False, False, True], [False, True, True], [True, True, True], [False, True, False], [False, True, True], [False, True, False]]}, ['danger', 'clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'clear', 'clear', 'clear']), ('regression: controlled signal with a standing train', {'mode': 'controlled', 'steps': [[True, True, True], [False, True, True]]}, ['danger', 'clear']), ('control 23', {'mode': 'controlled', 'steps': [[False, True, True], [False, True, False], [False, True, True], [True, True, False], [False, True, False]]}, ['clear', 'clear', 'clear', 'danger', 'danger']), ('control 26', {'mode': 'approach', 'steps': [[False, False, False], [False, True, True], [True, True, False], [True, False, True], [True, True, False], [True, False, True], [False, False, False], [False, True, True], [False, False, True], [False, True, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear', 'danger', 'danger']), ('sampled regression 29', {'mode': 'auto', 'steps': [[True, False, False], [False, False, False], [True, False, False], [False, False, True], [False, False, False], [False, True, True], [False, True, True], [False, False, False], [True, False, True], [False, True, False]]}, ['danger', 'clear', 'danger', 'clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'clear'])], [('regression: controlled signal with a standing train', {'mode': 'controlled', 'steps': [[True, True, True], [False, True, True]]}, ['danger', 'clear']), ('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('sampled regression 71', {'mode': 'approach', 'steps': [[False, True, False], [True, True, True], [False, True, True], [False, True, True], [True, True, True], [False, True, False]]}, ['danger', 'danger', 'clear', 'clear', 'danger', 'danger']), ('control 69', {'mode': 'auto', 'steps': [[False, False, False], [False, True, False], [False, True, False], [False, False, False], [False, False, True], [True, False, False], [False, False, True], [False, False, True], [False, False, False]]}, ['clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'clear', 'clear', 'clear']), ('boundary: second train behind on the same route', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, True, True]]}, ['clear', 'danger', 'danger']), ('control 34', {'mode': 'approach', 'steps': [[False, True, True], [False, False, False], [False, True, True], [False, False, False], [True, False, True], [False, False, True], [True, False, False], [True, False, True]]}, ['clear', 'danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger']), ('control 37', {'mode': 'approach', 'steps': [[False, False, True], [True, False, False], [False, False, True], [False, False, True], [True, False, True], [False, False, False], [False, False, True], [False, False, True], [False, False, False]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger']), ('sampled regression 40', {'mode': 'auto', 'steps': [[False, True, True], [True, True, True], [False, True, True], [False, True, False], [True, False, True], [True, False, True], [True, False, True]]}, ['clear', 'danger', 'clear', 'clear', 'danger', 'danger', 'danger'])], [('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('boundary: automatic signal re-clears', {'mode': 'auto', 'steps': [[False, False, False], [True, False, True], [False, False, False]]}, ['clear', 'danger', 'clear']), ('sampled regression 79', {'mode': 'auto', 'steps': [[False, True, False], [True, True, False], [True, True, False]]}, ['clear', 'danger', 'danger']), ('boundary: route re-set after a train', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, False, True], [False, True, True]]}, ['clear', 'danger', 'danger', 'clear']), ('boundary: approach-released signal with empty approach', {'mode': 'approach', 'steps': [[False, True, False], [False, True, True]]}, ['danger', 'clear']), ('control 45', {'mode': 'approach', 'steps': [[False, False, False], [False, False, False], [False, True, False], [False, True, False], [True, True, False], [False, True, False], [False, True, False], [False, True, True]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear']), ('control 48', {'mode': 'approach', 'steps': [[True, True, False], [False, True, True], [False, False, False], [False, False, True], [False, True, True], [True, True, False]]}, ['danger', 'clear', 'danger', 'danger', 'clear', 'danger']), ('sampled regression 51', {'mode': 'controlled', 'steps': [[False, False, True], [False, False, False], [False, True, False], [False, True, True], [True, False, True], [False, False, True], [True, True, False]]}, ['danger', 'danger', 'clear', 'clear', 'danger', 'danger', 'danger'])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"9dcaa46dacd4224d2305bd1f13eea058e25b4f2d607133172967cd3551bbdcaa","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    mode = x['mode']\n    state = 'danger'\n    stick = False\n    prev_route = False\n    out = []\n    for occ, route, appr in x['steps']:\n        if mode == 'auto':\n            route = True\n        if (route and not prev_route) or mode == 'auto':\n            stick = False\n        if occ and state == 'clear':\n            if state == 'clear':\n                stick = True\n            state = 'danger'\n        elif route and not stick and (mode != 'approach' or appr):\n            state = 'clear'\n        else:\n            state = 'danger'\n        prev_route = route\n        out.append(state)\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('boundary: automatic signal re-clears', {'mode': 'auto', 'steps': [[False, False, False], [True, False, True], [False, False, False]]}, ['clear', 'danger', 'clear']), ('sampled regression 12', {'mode': 'controlled', 'steps': [[False, False, True], [False, True, True], [True, False, True], [False, False, False], [False, False, True], [True, True, True], [True, False, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger']), ('boundary: second train behind on the same route', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, True, True]]}, ['clear', 'danger', 'danger']), ('boundary: route re-set after a train', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, False, True], [False, True, True]]}, ['clear', 'danger', 'danger', 'clear']), ('control 1', {'mode': 'auto', 'steps': [[False, True, False], [False, False, True], [False, True, False], [False, False, True], [False, False, False]]}, ['clear', 'clear', 'clear', 'clear', 'clear']), ('control 4', {'mode': 'controlled', 'steps': [[False, False, False], [False, True, True], [True, True, True], [False, True, True], [False, False, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger']), ('control 7', {'mode': 'approach', 'steps': [[False, False, False], [False, False, False], [False, False, True], [False, False, True], [False, True, False], [False, False, True], [False, True, True], [False, True, True], [False, True, True], [True, True, True]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear', 'clear', 'clear', 'danger'])], [('regression: controlled signal with a standing train', {'mode': 'controlled', 'steps': [[True, True, True], [False, True, True]]}, ['danger', 'clear']), ('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('sampled regression 31', {'mode': 'auto', 'steps': [[False, True, False], [False, True, False], [False, True, False], [False, True, True], [False, True, False], [False, True, False], [True, True, False], [True, False, True], [True, False, True]]}, ['clear', 'clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'danger', 'danger']), ('boundary: approach-released signal with empty approach', {'mode': 'approach', 'steps': [[False, True, False], [False, True, True]]}, ['danger', 'clear']), ('boundary: approach-released signal replaced by train', {'mode': 'approach', 'steps': [[False, True, True], [True, True, True], [False, True, True]]}, ['clear', 'danger', 'danger']), ('sampled regression 12', {'mode': 'controlled', 'steps': [[False, False, True], [False, True, True], [True, False, True], [False, False, False], [False, False, True], [True, True, True], [True, False, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger']), ('control 15', {'mode': 'approach', 'steps': [[False, True, True], [False, True, False], [False, True, True]]}, ['clear', 'danger', 'clear']), ('sampled regression 18', {'mode': 'approach', 'steps': [[False, True, False], [False, False, False], [False, False, False], [True, True, False], [False, True, False], [True, True, True], [False, True, True]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear'])], [('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('boundary: automatic signal re-clears', {'mode': 'auto', 'steps': [[False, False, False], [True, False, True], [False, False, False]]}, ['clear', 'danger', 'clear']), ('sampled regression 51', {'mode': 'controlled', 'steps': [[False, False, True], [False, False, False], [False, True, False], [False, True, True], [True, False, True], [False, False, True], [True, True, False]]}, ['danger', 'danger', 'clear', 'clear', 'danger', 'danger', 'danger']), ('sampled regression 54', {'mode': 'auto', 'steps': [[True, True, False], [False, True, False], [False, False, True], [False, False, True], [False, False, True], [False, True, True], [True, True, True], [False, True, False], [False, True, True], [False, True, False]]}, ['danger', 'clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'clear', 'clear', 'clear']), ('regression: controlled signal with a standing train', {'mode': 'controlled', 'steps': [[True, True, True], [False, True, True]]}, ['danger', 'clear']), ('control 23', {'mode': 'controlled', 'steps': [[False, True, True], [False, True, False], [False, True, True], [True, True, False], [False, True, False]]}, ['clear', 'clear', 'clear', 'danger', 'danger']), ('control 26', {'mode': 'approach', 'steps': [[False, False, False], [False, True, True], [True, True, False], [True, False, True], [True, True, False], [True, False, True], [False, False, False], [False, True, True], [False, False, True], [False, True, False]]}, ['danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear', 'danger', 'danger']), ('sampled regression 29', {'mode': 'auto', 'steps': [[True, False, False], [False, False, False], [True, False, False], [False, False, True], [False, False, False], [False, True, True], [False, True, True], [False, False, False], [True, False, True], [False, True, False]]}, ['danger', 'clear', 'danger', 'clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'clear'])], [('regression: controlled signal with a standing train', {'mode': 'controlled', 'steps': [[True, True, True], [False, True, True]]}, ['danger', 'clear']), ('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('sampled regression 71', {'mode': 'approach', 'steps': [[False, True, False], [True, True, True], [False, True, True], [False, True, True], [True, True, True], [False, True, False]]}, ['danger', 'danger', 'clear', 'clear', 'danger', 'danger']), ('control 69', {'mode': 'auto', 'steps': [[False, False, False], [False, True, False], [False, True, False], [False, False, False], [False, False, True], [True, False, False], [False, False, True], [False, False, True], [False, False, False]]}, ['clear', 'clear', 'clear', 'clear', 'clear', 'danger', 'clear', 'clear', 'clear']), ('boundary: second train behind on the same route', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, True, True]]}, ['clear', 'danger', 'danger']), ('control 34', {'mode': 'approach', 'steps': [[False, True, True], [False, False, False], [False, True, True], [False, False, False], [True, False, True], [False, False, True], [True, False, False], [True, False, True]]}, ['clear', 'danger', 'clear', 'danger', 'danger', 'danger', 'danger', 'danger']), ('control 37', {'mode': 'approach', 'steps': [[False, False, True], [True, False, False], [False, False, True], [False, False, True], [True, False, True], [False, False, False], [False, False, True], [False, False, True], [False, False, False]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger']), ('sampled regression 40', {'mode': 'auto', 'steps': [[False, True, True], [True, True, True], [False, True, True], [False, True, False], [True, False, True], [True, False, True], [True, False, True]]}, ['clear', 'danger', 'clear', 'clear', 'danger', 'danger', 'danger'])], [('regression: occupied before clearing', {'mode': 'auto', 'steps': [[True, False, False], [True, False, False], [False, False, False]]}, ['danger', 'danger', 'clear']), ('boundary: automatic signal re-clears', {'mode': 'auto', 'steps': [[False, False, False], [True, False, True], [False, False, False]]}, ['clear', 'danger', 'clear']), ('sampled regression 79', {'mode': 'auto', 'steps': [[False, True, False], [True, True, False], [True, True, False]]}, ['clear', 'danger', 'danger']), ('boundary: route re-set after a train', {'mode': 'controlled', 'steps': [[False, True, True], [True, True, True], [False, False, True], [False, True, True]]}, ['clear', 'danger', 'danger', 'clear']), ('boundary: approach-released signal with empty approach', {'mode': 'approach', 'steps': [[False, True, False], [False, True, True]]}, ['danger', 'clear']), ('control 45', {'mode': 'approach', 'steps': [[False, False, False], [False, False, False], [False, True, False], [False, True, False], [True, True, False], [False, True, False], [False, True, False], [False, True, True]]}, ['danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'danger', 'clear']), ('control 48', {'mode': 'approach', 'steps': [[True, True, False], [False, True, True], [False, False, False], [False, False, True], [False, True, True], [True, True, False]]}, ['danger', 'clear', 'danger', 'danger', 'clear', 'danger']), ('sampled regression 51', {'mode': 'controlled', 'steps': [[False, False, True], [False, False, False], [False, True, False], [False, True, True], [True, False, True], [False, False, True], [True, True, False]]}, ['danger', 'danger', 'clear', 'clear', 'danger', 'danger', 'danger'])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Stipulated toy interlocking contract for a bounded teaching model; it makes no claim of conformance to any railway signalling standard and omits real safety cases. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-railway_interlocking_logic-signal-replacement-stick-danger-on-occupancy","generated_at":"2026-09-29T14:47:50.665862+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Interlocking logic decides whether trains may be given authority; a wrong decision at this point either grants unsafe movements or strands traffic.","root_cause":"The occupancy test only replaces a clear signal; a danger signal can then clear over the occupied section.","sha256":"71e2c6fb05f9a5c9aba470dd66f79f0b33cb1f52386585b948badf83df6eaed1","title":"Signal replacement and stick control: danger on occupancy · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":39.134,"exit_code":1,"observations":[{"actual":["clear","clear","clear"],"check":"regression: occupied before clearing","expected":["danger","danger","clear"],"passed":false},{"actual":["clear","clear","clear"],"check":"boundary: automatic signal re-clears","expected":["clear","danger","clear"],"passed":false},{"actual":["danger","clear","danger","danger","danger","danger","danger"],"check":"sampled regression 12","expected":["danger","clear","danger","danger","danger","danger","danger"],"passed":true},{"actual":["clear","danger","danger"],"check":"boundary: second train behind on the same route","expected":["clear","danger","danger"],"passed":true},{"actual":["clear","danger","danger","clear"],"check":"boundary: route re-set after a train","expected":["clear","danger","danger","clear"],"passed":true},{"actual":["clear","clear","clear","clear","clear"],"check":"control 1","expected":["clear","clear","clear","clear","clear"],"passed":true},{"actual":["danger","clear","danger","danger","danger"],"check":"control 4","expected":["danger","clear","danger","danger","danger"],"passed":true},{"actual":["danger","danger","danger","danger","danger","danger","clear","clear","clear","danger"],"check":"control 7","expected":["danger","danger","danger","danger","danger","danger","clear","clear","clear","danger"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: occupied before clearing\", \"actual\": [\"clear\", \"clear\", \"clear\"], \"expected\": [\"danger\", \"danger\", \"clear\"], \"passed\": false}, {\"check\": \"boundary: automatic signal re-clears\", \"actual\": [\"clear\", \"clear\", \"clear\"], \"expected\": [\"clear\", \"danger\", \"clear\"], \"passed\": false}, {\"check\": \"sampled regression 12\", \"actual\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\"], \"expected\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\"], \"passed\": true}, {\"check\": \"boundary: second train behind on the same route\", \"actual\": [\"clear\", \"danger\", \"danger\"], \"expected\": [\"clear\", \"danger\", \"danger\"], \"passed\": true}, {\"check\": \"boundary: route re-set after a train\", \"actual\": [\"clear\", \"danger\", \"danger\", \"clear\"], \"expected\": [\"clear\", \"danger\", \"danger\", \"clear\"], \"passed\": true}, {\"check\": \"control 1\", \"actual\": [\"clear\", \"clear\", \"clear\", \"clear\", \"clear\"], \"expected\": [\"clear\", \"clear\", \"clear\", \"clear\", \"clear\"], \"passed\": true}, {\"check\": \"control 4\", \"actual\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\"], \"expected\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\"], \"passed\": true}, {\"check\": \"control 7\", \"actual\": [\"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"clear\", \"clear\", \"clear\", \"danger\"], \"expected\": [\"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"clear\", \"clear\", \"clear\", \"danger\"], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":41.306,"exit_code":1,"observations":[{"actual":["clear","danger","clear"],"check":"regression: occupied before clearing","expected":["danger","danger","clear"],"passed":false},{"actual":["clear","danger","clear"],"check":"boundary: automatic signal re-clears","expected":["clear","danger","clear"],"passed":true},{"actual":["danger","clear","danger","danger","danger","clear","danger"],"check":"sampled regression 12","expected":["danger","clear","danger","danger","danger","danger","danger"],"passed":false},{"actual":["clear","danger","danger"],"check":"boundary: second train behind on the same route","expected":["clear","danger","danger"],"passed":true},{"actual":["clear","danger","danger","clear"],"check":"boundary: route re-set after a train","expected":["clear","danger","danger","clear"],"passed":true},{"actual":["clear","clear","clear","clear","clear"],"check":"control 1","expected":["clear","clear","clear","clear","clear"],"passed":true},{"actual":["danger","clear","danger","danger","danger"],"check":"control 4","expected":["danger","clear","danger","danger","danger"],"passed":true},{"actual":["danger","danger","danger","danger","danger","danger","clear","clear","clear","danger"],"check":"control 7","expected":["danger","danger","danger","danger","danger","danger","clear","clear","clear","danger"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: occupied before clearing\", \"actual\": [\"clear\", \"danger\", \"clear\"], \"expected\": [\"danger\", \"danger\", \"clear\"], \"passed\": false}, {\"check\": \"boundary: automatic signal re-clears\", \"actual\": [\"clear\", \"danger\", \"clear\"], \"expected\": [\"clear\", \"danger\", \"clear\"], \"passed\": true}, {\"check\": \"sampled regression 12\", \"actual\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\", \"clear\", \"danger\"], \"expected\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\"], \"passed\": false}, {\"check\": \"boundary: second train behind on the same route\", \"actual\": [\"clear\", \"danger\", \"danger\"], \"expected\": [\"clear\", \"danger\", \"danger\"], \"passed\": true}, {\"check\": \"boundary: route re-set after a train\", \"actual\": [\"clear\", \"danger\", \"danger\", \"clear\"], \"expected\": [\"clear\", \"danger\", \"danger\", \"clear\"], \"passed\": true}, {\"check\": \"control 1\", \"actual\": [\"clear\", \"clear\", \"clear\", \"clear\", \"clear\"], \"expected\": [\"clear\", \"clear\", \"clear\", \"clear\", \"clear\"], \"passed\": true}, {\"check\": \"control 4\", \"actual\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\"], \"expected\": [\"danger\", \"clear\", \"danger\", \"danger\", \"danger\"], \"passed\": true}, {\"check\": \"control 7\", \"actual\": [\"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"clear\", \"clear\", \"clear\", \"danger\"], \"expected\": [\"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"danger\", \"clear\", \"clear\", \"clear\", \"danger\"], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}