{"abstract":"A relevel continues after a fault sample.","category":"Elevator dispatch scheduling","checks":8,"contract":"While standing at a floor the level offset (mm) is sampled. Beyond +-200 mm the sample is a fault and any relevel stops. Relevelling starts when |offset| > 10 and continues until |offset| <= 3 (hysteresis). A relevel runs with doors open when |offset| <= 75, otherwise the doors close first (close-relevel). Output hold, relevel, close-relevel or fault per sample.","evaluation_group":"w2-elevator_dispatch_scheduling-relevelling-control","failed_approach":"Recomputing active from the fault offset re-arms relevelling.","family":"w2-elevator_dispatch_scheduling-relevelling-control-fault-handling","id":"FA-67671","implementations":{"attempt":{"sha256":"2964d18e003a61dad9d91f96b078aae2f47f7704ff13291bd203a082cef500af","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    active = False\n    out = []\n    for off in x['samples']:\n        a = abs(off)\n        if a > 200:\n            out.append('fault')\n            active = a > 10\n            continue\n        if active:\n            if a <= 3:\n                active = False\n                out.append('hold')\n            else:\n                out.append('relevel' if a <= 75 else 'close-relevel')\n        elif a > 10:\n            active = True\n            out.append('relevel' if a <= 75 else 'close-relevel')\n        else:\n            out.append('hold')\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 14', {'samples': [-11, 9, -11, 2, -76, 200, -4, -250, 201, -4]}, ['relevel', 'relevel', 'relevel', 'hold', 'close-relevel', 'close-relevel', 'relevel', 'fault', 'fault', 'hold']), ('sampled regression 3', {'samples': [76, -250, 201, -11, 10, 201, 4]}, ['close-relevel', 'fault', 'fault', 'relevel', 'relevel', 'fault', 'hold']), ('boundary: hysteresis band', {'samples': [11, 8, 4, 3]}, ['relevel', 'relevel', 'relevel', 'hold']), ('boundary: large offset while relevelling', {'samples': [20, 90, 30]}, ['relevel', 'close-relevel', 'relevel']), ('control 1', {'samples': [200, 40, 200, 9, 4]}, ['close-relevel', 'relevel', 'close-relevel', 'relevel', 'relevel']), ('sampled regression 4', {'samples': [150, 4, 200, 201, 4, -250, 9, 0]}, ['close-relevel', 'relevel', 'close-relevel', 'fault', 'hold', 'fault', 'hold', 'hold']), ('control 7', {'samples': [-250, 201, 4, 2, 4, 11, 76, 75, 10]}, ['fault', 'fault', 'hold', 'hold', 'hold', 'relevel', 'close-relevel', 'relevel', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 75', {'samples': [11, 9, -250, 10, 10, 0, -11]}, ['relevel', 'relevel', 'fault', 'hold', 'hold', 'hold', 'relevel']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('control 12', {'samples': [-4, 150, 11]}, ['hold', 'close-relevel', 'relevel']), ('control 15', {'samples': [-3, 2, 75, 201, 75, 200]}, ['hold', 'hold', 'relevel', 'fault', 'relevel', 'close-relevel']), ('sampled regression 18', {'samples': [-76, 10, 10, -250, 201, -4, 40]}, ['close-relevel', 'relevel', 'relevel', 'fault', 'fault', 'hold', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('sampled regression 55', {'samples': [75, 10, -250, 10, -76, -4, 4, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'close-relevel', 'relevel', 'relevel', 'relevel']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('boundary: open door limit', {'samples': [75, 76]}, ['relevel', 'close-relevel']), ('control 23', {'samples': [3, 10, 200, 0, 3, -4, 0, 200, -4, 150]}, ['hold', 'hold', 'close-relevel', 'hold', 'hold', 'hold', 'hold', 'close-relevel', 'relevel', 'close-relevel']), ('control 26', {'samples': [76, 201, 3, 3]}, ['close-relevel', 'fault', 'hold', 'hold']), ('control 29', {'samples': [2, 4, 75, 0, 11, -3, -3, 4]}, ['hold', 'hold', 'relevel', 'hold', 'relevel', 'hold', 'hold', 'hold'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 3', {'samples': [76, -250, 201, -11, 10, 201, 4]}, ['close-relevel', 'fault', 'fault', 'relevel', 'relevel', 'fault', 'hold']), ('boundary: hysteresis band', {'samples': [11, 8, 4, 3]}, ['relevel', 'relevel', 'relevel', 'hold']), ('boundary: large offset while relevelling', {'samples': [20, 90, 30]}, ['relevel', 'close-relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('control 34', {'samples': [150, 10, 200]}, ['close-relevel', 'relevel', 'close-relevel']), ('control 37', {'samples': [-76, 0, 76, 11, -11, 200, 150, 9]}, ['close-relevel', 'hold', 'close-relevel', 'relevel', 'relevel', 'close-relevel', 'close-relevel', 'relevel']), ('control 40', {'samples': [40, 76, -4]}, ['relevel', 'close-relevel', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 33', {'samples': [4, -11, -11, 40, 11, 201, 9, -4]}, ['hold', 'relevel', 'relevel', 'relevel', 'relevel', 'fault', 'hold', 'hold']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('control 45', {'samples': [150, 75, 4, 75, -11, 75, 40, -4, 3, 9]}, ['close-relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'hold', 'hold']), ('control 48', {'samples': [150, -76, 10, 4, -250, 40, 10]}, ['close-relevel', 'close-relevel', 'relevel', 'relevel', 'fault', 'relevel', 'relevel']), ('control 51', {'samples': [200, -4, -4, 76, 75, 76]}, ['close-relevel', 'relevel', 'relevel', 'close-relevel', 'relevel', 'close-relevel'])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"7eddda11239f2fc7b4836b464bc19d1db4707ca667e87808ff7b95e8987d97aa","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    active = False\n    out = []\n    for off in x['samples']:\n        a = abs(off)\n        if a > 200:\n            out.append('fault')\n            continue\n        if active:\n            if a <= 3:\n                active = False\n                out.append('hold')\n            else:\n                out.append('relevel' if a <= 75 else 'close-relevel')\n        elif a > 10:\n            active = True\n            out.append('relevel' if a <= 75 else 'close-relevel')\n        else:\n            out.append('hold')\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 14', {'samples': [-11, 9, -11, 2, -76, 200, -4, -250, 201, -4]}, ['relevel', 'relevel', 'relevel', 'hold', 'close-relevel', 'close-relevel', 'relevel', 'fault', 'fault', 'hold']), ('sampled regression 3', {'samples': [76, -250, 201, -11, 10, 201, 4]}, ['close-relevel', 'fault', 'fault', 'relevel', 'relevel', 'fault', 'hold']), ('boundary: hysteresis band', {'samples': [11, 8, 4, 3]}, ['relevel', 'relevel', 'relevel', 'hold']), ('boundary: large offset while relevelling', {'samples': [20, 90, 30]}, ['relevel', 'close-relevel', 'relevel']), ('control 1', {'samples': [200, 40, 200, 9, 4]}, ['close-relevel', 'relevel', 'close-relevel', 'relevel', 'relevel']), ('sampled regression 4', {'samples': [150, 4, 200, 201, 4, -250, 9, 0]}, ['close-relevel', 'relevel', 'close-relevel', 'fault', 'hold', 'fault', 'hold', 'hold']), ('control 7', {'samples': [-250, 201, 4, 2, 4, 11, 76, 75, 10]}, ['fault', 'fault', 'hold', 'hold', 'hold', 'relevel', 'close-relevel', 'relevel', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 75', {'samples': [11, 9, -250, 10, 10, 0, -11]}, ['relevel', 'relevel', 'fault', 'hold', 'hold', 'hold', 'relevel']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('control 12', {'samples': [-4, 150, 11]}, ['hold', 'close-relevel', 'relevel']), ('control 15', {'samples': [-3, 2, 75, 201, 75, 200]}, ['hold', 'hold', 'relevel', 'fault', 'relevel', 'close-relevel']), ('sampled regression 18', {'samples': [-76, 10, 10, -250, 201, -4, 40]}, ['close-relevel', 'relevel', 'relevel', 'fault', 'fault', 'hold', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('sampled regression 55', {'samples': [75, 10, -250, 10, -76, -4, 4, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'close-relevel', 'relevel', 'relevel', 'relevel']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('boundary: open door limit', {'samples': [75, 76]}, ['relevel', 'close-relevel']), ('control 23', {'samples': [3, 10, 200, 0, 3, -4, 0, 200, -4, 150]}, ['hold', 'hold', 'close-relevel', 'hold', 'hold', 'hold', 'hold', 'close-relevel', 'relevel', 'close-relevel']), ('control 26', {'samples': [76, 201, 3, 3]}, ['close-relevel', 'fault', 'hold', 'hold']), ('control 29', {'samples': [2, 4, 75, 0, 11, -3, -3, 4]}, ['hold', 'hold', 'relevel', 'hold', 'relevel', 'hold', 'hold', 'hold'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 3', {'samples': [76, -250, 201, -11, 10, 201, 4]}, ['close-relevel', 'fault', 'fault', 'relevel', 'relevel', 'fault', 'hold']), ('boundary: hysteresis band', {'samples': [11, 8, 4, 3]}, ['relevel', 'relevel', 'relevel', 'hold']), ('boundary: large offset while relevelling', {'samples': [20, 90, 30]}, ['relevel', 'close-relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('control 34', {'samples': [150, 10, 200]}, ['close-relevel', 'relevel', 'close-relevel']), ('control 37', {'samples': [-76, 0, 76, 11, -11, 200, 150, 9]}, ['close-relevel', 'hold', 'close-relevel', 'relevel', 'relevel', 'close-relevel', 'close-relevel', 'relevel']), ('control 40', {'samples': [40, 76, -4]}, ['relevel', 'close-relevel', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 33', {'samples': [4, -11, -11, 40, 11, 201, 9, -4]}, ['hold', 'relevel', 'relevel', 'relevel', 'relevel', 'fault', 'hold', 'hold']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('control 45', {'samples': [150, 75, 4, 75, -11, 75, 40, -4, 3, 9]}, ['close-relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'hold', 'hold']), ('control 48', {'samples': [150, -76, 10, 4, -250, 40, 10]}, ['close-relevel', 'close-relevel', 'relevel', 'relevel', 'fault', 'relevel', 'relevel']), ('control 51', {'samples': [200, -4, -4, 76, 75, 76]}, ['close-relevel', 'relevel', 'relevel', 'close-relevel', 'relevel', 'close-relevel'])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"4a12f8a5a56a1e3ff18bcf070efdb89287cb0c1a1e4109af63422819769e1b71","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    active = False\n    out = []\n    for off in x['samples']:\n        a = abs(off)\n        if a > 200:\n            out.append('fault')\n            active = False\n            continue\n        if active:\n            if a <= 3:\n                active = False\n                out.append('hold')\n            else:\n                out.append('relevel' if a <= 75 else 'close-relevel')\n        elif a > 10:\n            active = True\n            out.append('relevel' if a <= 75 else 'close-relevel')\n        else:\n            out.append('hold')\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 14', {'samples': [-11, 9, -11, 2, -76, 200, -4, -250, 201, -4]}, ['relevel', 'relevel', 'relevel', 'hold', 'close-relevel', 'close-relevel', 'relevel', 'fault', 'fault', 'hold']), ('sampled regression 3', {'samples': [76, -250, 201, -11, 10, 201, 4]}, ['close-relevel', 'fault', 'fault', 'relevel', 'relevel', 'fault', 'hold']), ('boundary: hysteresis band', {'samples': [11, 8, 4, 3]}, ['relevel', 'relevel', 'relevel', 'hold']), ('boundary: large offset while relevelling', {'samples': [20, 90, 30]}, ['relevel', 'close-relevel', 'relevel']), ('control 1', {'samples': [200, 40, 200, 9, 4]}, ['close-relevel', 'relevel', 'close-relevel', 'relevel', 'relevel']), ('sampled regression 4', {'samples': [150, 4, 200, 201, 4, -250, 9, 0]}, ['close-relevel', 'relevel', 'close-relevel', 'fault', 'hold', 'fault', 'hold', 'hold']), ('control 7', {'samples': [-250, 201, 4, 2, 4, 11, 76, 75, 10]}, ['fault', 'fault', 'hold', 'hold', 'hold', 'relevel', 'close-relevel', 'relevel', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 75', {'samples': [11, 9, -250, 10, 10, 0, -11]}, ['relevel', 'relevel', 'fault', 'hold', 'hold', 'hold', 'relevel']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('control 12', {'samples': [-4, 150, 11]}, ['hold', 'close-relevel', 'relevel']), ('control 15', {'samples': [-3, 2, 75, 201, 75, 200]}, ['hold', 'hold', 'relevel', 'fault', 'relevel', 'close-relevel']), ('sampled regression 18', {'samples': [-76, 10, 10, -250, 201, -4, 40]}, ['close-relevel', 'relevel', 'relevel', 'fault', 'fault', 'hold', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('sampled regression 55', {'samples': [75, 10, -250, 10, -76, -4, 4, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'close-relevel', 'relevel', 'relevel', 'relevel']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('boundary: open door limit', {'samples': [75, 76]}, ['relevel', 'close-relevel']), ('control 23', {'samples': [3, 10, 200, 0, 3, -4, 0, 200, -4, 150]}, ['hold', 'hold', 'close-relevel', 'hold', 'hold', 'hold', 'hold', 'close-relevel', 'relevel', 'close-relevel']), ('control 26', {'samples': [76, 201, 3, 3]}, ['close-relevel', 'fault', 'hold', 'hold']), ('control 29', {'samples': [2, 4, 75, 0, 11, -3, -3, 4]}, ['hold', 'hold', 'relevel', 'hold', 'relevel', 'hold', 'hold', 'hold'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 3', {'samples': [76, -250, 201, -11, 10, 201, 4]}, ['close-relevel', 'fault', 'fault', 'relevel', 'relevel', 'fault', 'hold']), ('boundary: hysteresis band', {'samples': [11, 8, 4, 3]}, ['relevel', 'relevel', 'relevel', 'hold']), ('boundary: large offset while relevelling', {'samples': [20, 90, 30]}, ['relevel', 'close-relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('control 34', {'samples': [150, 10, 200]}, ['close-relevel', 'relevel', 'close-relevel']), ('control 37', {'samples': [-76, 0, 76, 11, -11, 200, 150, 9]}, ['close-relevel', 'hold', 'close-relevel', 'relevel', 'relevel', 'close-relevel', 'close-relevel', 'relevel']), ('control 40', {'samples': [40, 76, -4]}, ['relevel', 'close-relevel', 'relevel'])], [('regression: fault clears relevelling', {'samples': [20, 250, 5]}, ['relevel', 'fault', 'hold']), ('sampled regression 33', {'samples': [4, -11, -11, 40, 11, 201, 9, -4]}, ['hold', 'relevel', 'relevel', 'relevel', 'relevel', 'fault', 'hold', 'hold']), ('sampled regression 21', {'samples': [75, 40, 201, 9, 11, 4]}, ['relevel', 'relevel', 'fault', 'hold', 'relevel', 'relevel']), ('boundary: exactly at the fault limit', {'samples': [200, 201]}, ['close-relevel', 'fault']), ('boundary: negative offsets', {'samples': [-11, -4, -3]}, ['relevel', 'relevel', 'hold']), ('control 45', {'samples': [150, 75, 4, 75, -11, 75, 40, -4, 3, 9]}, ['close-relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'relevel', 'hold', 'hold']), ('control 48', {'samples': [150, -76, 10, 4, -250, 40, 10]}, ['close-relevel', 'close-relevel', 'relevel', 'relevel', 'fault', 'relevel', 'relevel']), ('control 51', {'samples': [200, -4, -4, 76, 75, 76]}, ['close-relevel', 'relevel', 'relevel', 'close-relevel', 'relevel', 'close-relevel'])]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Stipulated toy lift-control contract for a bounded teaching model; it makes no claim of conformance to any lift code or vendor dispatcher and omits real safety cases. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-elevator_dispatch_scheduling-relevelling-control-fault-handling","generated_at":"2026-09-29T14:47:55.086516+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Lift group controllers make these decisions many times per minute; a wrong answer strands passengers, wastes trips or overrides a safety rule.","repair":"Stop relevelling on a fault sample.","root_cause":"The fault sample does not stop the active relevel.","sha256":"e5df506811036368b70cc98d1fde66196dd6c8e5072352faa3550b5b84d6d153","title":"Car relevelling with doors open: fault handling · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":41.109,"exit_code":1,"observations":[{"actual":["relevel","fault","relevel"],"check":"regression: fault clears relevelling","expected":["relevel","fault","hold"],"passed":false},{"actual":["relevel","relevel","relevel","hold","close-relevel","close-relevel","relevel","fault","fault","relevel"],"check":"sampled regression 14","expected":["relevel","relevel","relevel","hold","close-relevel","close-relevel","relevel","fault","fault","hold"],"passed":false},{"actual":["close-relevel","fault","fault","relevel","relevel","fault","relevel"],"check":"sampled regression 3","expected":["close-relevel","fault","fault","relevel","relevel","fault","hold"],"passed":false},{"actual":["relevel","relevel","relevel","hold"],"check":"boundary: hysteresis band","expected":["relevel","relevel","relevel","hold"],"passed":true},{"actual":["relevel","close-relevel","relevel"],"check":"boundary: large offset while relevelling","expected":["relevel","close-relevel","relevel"],"passed":true},{"actual":["close-relevel","relevel","close-relevel","relevel","relevel"],"check":"control 1","expected":["close-relevel","relevel","close-relevel","relevel","relevel"],"passed":true},{"actual":["close-relevel","relevel","close-relevel","fault","relevel","fault","relevel","hold"],"check":"sampled regression 4","expected":["close-relevel","relevel","close-relevel","fault","hold","fault","hold","hold"],"passed":false},{"actual":["fault","fault","relevel","hold","hold","relevel","close-relevel","relevel","relevel"],"check":"control 7","expected":["fault","fault","hold","hold","hold","relevel","close-relevel","relevel","relevel"],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: fault clears relevelling\", \"actual\": [\"relevel\", \"fault\", \"relevel\"], \"expected\": [\"relevel\", \"fault\", \"hold\"], \"passed\": false}, {\"check\": \"sampled regression 14\", \"actual\": [\"relevel\", \"relevel\", \"relevel\", \"hold\", \"close-relevel\", \"close-relevel\", \"relevel\", \"fault\", \"fault\", \"relevel\"], \"expected\": [\"relevel\", \"relevel\", \"relevel\", \"hold\", \"close-relevel\", \"close-relevel\", \"relevel\", \"fault\", \"fault\", \"hold\"], \"passed\": false}, {\"check\": \"sampled regression 3\", \"actual\": [\"close-relevel\", \"fault\", \"fault\", \"relevel\", \"relevel\", \"fault\", \"relevel\"], \"expected\": [\"close-relevel\", \"fault\", \"fault\", \"relevel\", \"relevel\", \"fault\", \"hold\"], \"passed\": false}, {\"check\": \"boundary: hysteresis band\", \"actual\": [\"relevel\", \"relevel\", \"relevel\", \"hold\"], \"expected\": [\"relevel\", \"relevel\", \"relevel\", \"hold\"], \"passed\": true}, {\"check\": \"boundary: large offset while relevelling\", \"actual\": [\"relevel\", \"close-relevel\", \"relevel\"], \"expected\": [\"relevel\", \"close-relevel\", \"relevel\"], \"passed\": true}, {\"check\": \"control 1\", \"actual\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"expected\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"passed\": true}, {\"check\": \"sampled regression 4\", \"actual\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"fault\", \"relevel\", \"fault\", \"relevel\", \"hold\"], \"expected\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"fault\", \"hold\", \"fault\", \"hold\", \"hold\"], \"passed\": false}, {\"check\": \"control 7\", \"actual\": [\"fault\", \"fault\", \"relevel\", \"hold\", \"hold\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"expected\": [\"fault\", \"fault\", \"hold\", \"hold\", \"hold\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"passed\": false}], \"passed\": false}\n"},"broken":{"elapsed_ms":36.959,"exit_code":1,"observations":[{"actual":["relevel","fault","relevel"],"check":"regression: fault clears relevelling","expected":["relevel","fault","hold"],"passed":false},{"actual":["relevel","relevel","relevel","hold","close-relevel","close-relevel","relevel","fault","fault","relevel"],"check":"sampled regression 14","expected":["relevel","relevel","relevel","hold","close-relevel","close-relevel","relevel","fault","fault","hold"],"passed":false},{"actual":["close-relevel","fault","fault","relevel","relevel","fault","relevel"],"check":"sampled regression 3","expected":["close-relevel","fault","fault","relevel","relevel","fault","hold"],"passed":false},{"actual":["relevel","relevel","relevel","hold"],"check":"boundary: hysteresis band","expected":["relevel","relevel","relevel","hold"],"passed":true},{"actual":["relevel","close-relevel","relevel"],"check":"boundary: large offset while relevelling","expected":["relevel","close-relevel","relevel"],"passed":true},{"actual":["close-relevel","relevel","close-relevel","relevel","relevel"],"check":"control 1","expected":["close-relevel","relevel","close-relevel","relevel","relevel"],"passed":true},{"actual":["close-relevel","relevel","close-relevel","fault","relevel","fault","relevel","hold"],"check":"sampled regression 4","expected":["close-relevel","relevel","close-relevel","fault","hold","fault","hold","hold"],"passed":false},{"actual":["fault","fault","hold","hold","hold","relevel","close-relevel","relevel","relevel"],"check":"control 7","expected":["fault","fault","hold","hold","hold","relevel","close-relevel","relevel","relevel"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: fault clears relevelling\", \"actual\": [\"relevel\", \"fault\", \"relevel\"], \"expected\": [\"relevel\", \"fault\", \"hold\"], \"passed\": false}, {\"check\": \"sampled regression 14\", \"actual\": [\"relevel\", \"relevel\", \"relevel\", \"hold\", \"close-relevel\", \"close-relevel\", \"relevel\", \"fault\", \"fault\", \"relevel\"], \"expected\": [\"relevel\", \"relevel\", \"relevel\", \"hold\", \"close-relevel\", \"close-relevel\", \"relevel\", \"fault\", \"fault\", \"hold\"], \"passed\": false}, {\"check\": \"sampled regression 3\", \"actual\": [\"close-relevel\", \"fault\", \"fault\", \"relevel\", \"relevel\", \"fault\", \"relevel\"], \"expected\": [\"close-relevel\", \"fault\", \"fault\", \"relevel\", \"relevel\", \"fault\", \"hold\"], \"passed\": false}, {\"check\": \"boundary: hysteresis band\", \"actual\": [\"relevel\", \"relevel\", \"relevel\", \"hold\"], \"expected\": [\"relevel\", \"relevel\", \"relevel\", \"hold\"], \"passed\": true}, {\"check\": \"boundary: large offset while relevelling\", \"actual\": [\"relevel\", \"close-relevel\", \"relevel\"], \"expected\": [\"relevel\", \"close-relevel\", \"relevel\"], \"passed\": true}, {\"check\": \"control 1\", \"actual\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"expected\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"passed\": true}, {\"check\": \"sampled regression 4\", \"actual\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"fault\", \"relevel\", \"fault\", \"relevel\", \"hold\"], \"expected\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"fault\", \"hold\", \"fault\", \"hold\", \"hold\"], \"passed\": false}, {\"check\": \"control 7\", \"actual\": [\"fault\", \"fault\", \"hold\", \"hold\", \"hold\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"expected\": [\"fault\", \"fault\", \"hold\", \"hold\", \"hold\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":39.352,"exit_code":0,"observations":[{"actual":["relevel","fault","hold"],"check":"regression: fault clears relevelling","expected":["relevel","fault","hold"],"passed":true},{"actual":["relevel","relevel","relevel","hold","close-relevel","close-relevel","relevel","fault","fault","hold"],"check":"sampled regression 14","expected":["relevel","relevel","relevel","hold","close-relevel","close-relevel","relevel","fault","fault","hold"],"passed":true},{"actual":["close-relevel","fault","fault","relevel","relevel","fault","hold"],"check":"sampled regression 3","expected":["close-relevel","fault","fault","relevel","relevel","fault","hold"],"passed":true},{"actual":["relevel","relevel","relevel","hold"],"check":"boundary: hysteresis band","expected":["relevel","relevel","relevel","hold"],"passed":true},{"actual":["relevel","close-relevel","relevel"],"check":"boundary: large offset while relevelling","expected":["relevel","close-relevel","relevel"],"passed":true},{"actual":["close-relevel","relevel","close-relevel","relevel","relevel"],"check":"control 1","expected":["close-relevel","relevel","close-relevel","relevel","relevel"],"passed":true},{"actual":["close-relevel","relevel","close-relevel","fault","hold","fault","hold","hold"],"check":"sampled regression 4","expected":["close-relevel","relevel","close-relevel","fault","hold","fault","hold","hold"],"passed":true},{"actual":["fault","fault","hold","hold","hold","relevel","close-relevel","relevel","relevel"],"check":"control 7","expected":["fault","fault","hold","hold","hold","relevel","close-relevel","relevel","relevel"],"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: fault clears relevelling\", \"actual\": [\"relevel\", \"fault\", \"hold\"], \"expected\": [\"relevel\", \"fault\", \"hold\"], \"passed\": true}, {\"check\": \"sampled regression 14\", \"actual\": [\"relevel\", \"relevel\", \"relevel\", \"hold\", \"close-relevel\", \"close-relevel\", \"relevel\", \"fault\", \"fault\", \"hold\"], \"expected\": [\"relevel\", \"relevel\", \"relevel\", \"hold\", \"close-relevel\", \"close-relevel\", \"relevel\", \"fault\", \"fault\", \"hold\"], \"passed\": true}, {\"check\": \"sampled regression 3\", \"actual\": [\"close-relevel\", \"fault\", \"fault\", \"relevel\", \"relevel\", \"fault\", \"hold\"], \"expected\": [\"close-relevel\", \"fault\", \"fault\", \"relevel\", \"relevel\", \"fault\", \"hold\"], \"passed\": true}, {\"check\": \"boundary: hysteresis band\", \"actual\": [\"relevel\", \"relevel\", \"relevel\", \"hold\"], \"expected\": [\"relevel\", \"relevel\", \"relevel\", \"hold\"], \"passed\": true}, {\"check\": \"boundary: large offset while relevelling\", \"actual\": [\"relevel\", \"close-relevel\", \"relevel\"], \"expected\": [\"relevel\", \"close-relevel\", \"relevel\"], \"passed\": true}, {\"check\": \"control 1\", \"actual\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"expected\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"passed\": true}, {\"check\": \"sampled regression 4\", \"actual\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"fault\", \"hold\", \"fault\", \"hold\", \"hold\"], \"expected\": [\"close-relevel\", \"relevel\", \"close-relevel\", \"fault\", \"hold\", \"fault\", \"hold\", \"hold\"], \"passed\": true}, {\"check\": \"control 7\", \"actual\": [\"fault\", \"fault\", \"hold\", \"hold\", \"hold\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"expected\": [\"fault\", \"fault\", \"hold\", \"hold\", \"hold\", \"relevel\", \"close-relevel\", \"relevel\", \"relevel\"], \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}