{"abstract":"The major fault is logged later than it occurred, after the watchdog should already have stopped the task.","category":"PLC ladder logic scan cycles","checks":8,"contract":"Periodic task triggered every period ms from t=0; exec_times[k] is how long the k-th triggered execution would take. A trigger arriving while the previous execution is still running (trigger time < completion time) is an overlap: it is counted and skipped, not queued; a trigger exactly at completion starts normally. An execution longer than watchdog raises a major fault at start + watchdog and scheduling stops. Return [start_times, overlap_count, fault_time or None].","evaluation_group":"w2-plc-ladder-logic-scan-cycles-periodic-task-overlap","failed_approach":"Reporting the watchdog limit alone drops the task start time.","family":"w2-plc-ladder-logic-scan-cycles-periodic-task-overlap-fault-timestamp","id":"FA-92071","implementations":{"attempt":{"sha256":"5d2b49ffb2ed235e03f16c3ffe0585e162e09ceb017b40f2b4c24913310b0f03","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(period, watchdog, exec_times):\n    t_free = 0\n    starts = []\n    overlaps = 0\n    fault = None\n    for k, ex in enumerate(exec_times):\n        trig = k * period\n        if trig < t_free:\n            overlaps += 1\n            continue\n        starts.append(trig)\n        if ex > watchdog:\n            fault = watchdog\n            break\n        t_free = trig + ex\n    return [starts, overlaps, fault]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['regression: scenario 4',\n   [50, 60, [21, 100, 100, 60, 100, 100, 60, 60, 45, 50, 100, 100]],\n   [[0, 50], 0, 110]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [50, 100, [100, 100, 100, 100, 50, 25]], [[0, 100, 200, 250], 2, None]],\n  ['control: scenario 2', [20, 100, [100, 100, 60, 39, 20, 40, 54, 40]], [[0, 100, 140], 5, None]]],\n [['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['regression: scenario 4', [10, 30, [20, 20, 51, 30, 26, 20, 54, 2]], [[0, 20], 1, 50]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [20, 60, [60, 20, 36, 40, 20]], [[0, 60], 3, None]],\n  ['control: scenario 2',\n   [10, 100, [10, 10, 10, 10, 10, 20, 100, 3, 20, 10, 100]],\n   [[0, 10, 20, 30, 40, 50, 70, 80, 100], 2, None]]],\n [['regression: scenario 2', [10, 40, [50, 40, 10, 40, 10, 61, 60, 40, 20, 20, 10, 10]], [[0], 0, 40]],\n  ['regression: scenario 4', [25, 30, [30, 30, 6, 16, 50, 30]], [[0, 50, 75, 100], 1, 130]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [20, 100, [100, 20, 60, 100, 40, 20, 30, 12]], [[0, 100, 120], 5, None]]],\n [['regression: scenario 3',\n   [10, 40, [20, 20, 20, 20, 10, 61, 55, 66, 20, 37, 40, 40]],\n   [[0, 20, 40, 50], 2, 90]],\n  ['regression: scenario 22', [25, 40, [25, 64, 50, 50, 40, 67, 25]], [[0, 25], 0, 65]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['regression: scenario 1',\n   [20, 30, [21, 20, 20, 20, 40, 30, 20, 30, 40, 30, 40]],\n   [[0, 40, 60, 80], 1, 110]]],\n [['regression: scenario 3', [50, 30, [50, 50, 100, 30, 25, 30, 50, 100]], [[0], 0, 30]],\n  ['regression: scenario 13', [50, 40, [40, 50, 50, 10, 50, 100, 40, 20, 37, 41]], [[0, 50], 0, 90]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['regression: scenario 1', [25, 60, [70, 25, 60, 35, 25, 15, 60, 60, 25, 50, 25, 4]], [[0], 0, 60]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"c55ff300918faa46dabab84623434f042c565c9afefe4f421edf1ea0a42a8848","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(period, watchdog, exec_times):\n    t_free = 0\n    starts = []\n    overlaps = 0\n    fault = None\n    for k, ex in enumerate(exec_times):\n        trig = k * period\n        if trig < t_free:\n            overlaps += 1\n            continue\n        starts.append(trig)\n        if ex > watchdog:\n            fault = trig + ex\n            break\n        t_free = trig + ex\n    return [starts, overlaps, fault]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['regression: scenario 4',\n   [50, 60, [21, 100, 100, 60, 100, 100, 60, 60, 45, 50, 100, 100]],\n   [[0, 50], 0, 110]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [50, 100, [100, 100, 100, 100, 50, 25]], [[0, 100, 200, 250], 2, None]],\n  ['control: scenario 2', [20, 100, [100, 100, 60, 39, 20, 40, 54, 40]], [[0, 100, 140], 5, None]]],\n [['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['regression: scenario 4', [10, 30, [20, 20, 51, 30, 26, 20, 54, 2]], [[0, 20], 1, 50]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [20, 60, [60, 20, 36, 40, 20]], [[0, 60], 3, None]],\n  ['control: scenario 2',\n   [10, 100, [10, 10, 10, 10, 10, 20, 100, 3, 20, 10, 100]],\n   [[0, 10, 20, 30, 40, 50, 70, 80, 100], 2, None]]],\n [['regression: scenario 2', [10, 40, [50, 40, 10, 40, 10, 61, 60, 40, 20, 20, 10, 10]], [[0], 0, 40]],\n  ['regression: scenario 4', [25, 30, [30, 30, 6, 16, 50, 30]], [[0, 50, 75, 100], 1, 130]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [20, 100, [100, 20, 60, 100, 40, 20, 30, 12]], [[0, 100, 120], 5, None]]],\n [['regression: scenario 3',\n   [10, 40, [20, 20, 20, 20, 10, 61, 55, 66, 20, 37, 40, 40]],\n   [[0, 20, 40, 50], 2, 90]],\n  ['regression: scenario 22', [25, 40, [25, 64, 50, 50, 40, 67, 25]], [[0, 25], 0, 65]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['regression: scenario 1',\n   [20, 30, [21, 20, 20, 20, 40, 30, 20, 30, 40, 30, 40]],\n   [[0, 40, 60, 80], 1, 110]]],\n [['regression: scenario 3', [50, 30, [50, 50, 100, 30, 25, 30, 50, 100]], [[0], 0, 30]],\n  ['regression: scenario 13', [50, 40, [40, 50, 50, 10, 50, 100, 40, 20, 37, 41]], [[0, 50], 0, 90]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['regression: scenario 1', [25, 60, [70, 25, 60, 35, 25, 15, 60, 60, 25, 50, 25, 4]], [[0], 0, 60]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"7619cf21a96a905c75a198f108394518ac67a9d6261372371c09f555ab183710","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(period, watchdog, exec_times):\n    t_free = 0\n    starts = []\n    overlaps = 0\n    fault = None\n    for k, ex in enumerate(exec_times):\n        trig = k * period\n        if trig < t_free:\n            overlaps += 1\n            continue\n        starts.append(trig)\n        if ex > watchdog:\n            fault = trig + watchdog\n            break\n        t_free = trig + ex\n    return [starts, overlaps, fault]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['regression: scenario 4',\n   [50, 60, [21, 100, 100, 60, 100, 100, 60, 60, 45, 50, 100, 100]],\n   [[0, 50], 0, 110]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [50, 100, [100, 100, 100, 100, 50, 25]], [[0, 100, 200, 250], 2, None]],\n  ['control: scenario 2', [20, 100, [100, 100, 60, 39, 20, 40, 54, 40]], [[0, 100, 140], 5, None]]],\n [['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['regression: scenario 4', [10, 30, [20, 20, 51, 30, 26, 20, 54, 2]], [[0, 20], 1, 50]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [20, 60, [60, 20, 36, 40, 20]], [[0, 60], 3, None]],\n  ['control: scenario 2',\n   [10, 100, [10, 10, 10, 10, 10, 20, 100, 3, 20, 10, 100]],\n   [[0, 10, 20, 30, 40, 50, 70, 80, 100], 2, None]]],\n [['regression: scenario 2', [10, 40, [50, 40, 10, 40, 10, 61, 60, 40, 20, 20, 10, 10]], [[0], 0, 40]],\n  ['regression: scenario 4', [25, 30, [30, 30, 6, 16, 50, 30]], [[0, 50, 75, 100], 1, 130]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['control: scenario 1', [20, 100, [100, 20, 60, 100, 40, 20, 30, 12]], [[0, 100, 120], 5, None]]],\n [['regression: scenario 3',\n   [10, 40, [20, 20, 20, 20, 10, 61, 55, 66, 20, 37, 40, 40]],\n   [[0, 20, 40, 50], 2, 90]],\n  ['regression: scenario 22', [25, 40, [25, 64, 50, 50, 40, 67, 25]], [[0, 25], 0, 65]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['regression: scenario 1',\n   [20, 30, [21, 20, 20, 20, 40, 30, 20, 30, 40, 30, 40]],\n   [[0, 40, 60, 80], 1, 110]]],\n [['regression: scenario 3', [50, 30, [50, 50, 100, 30, 25, 30, 50, 100]], [[0], 0, 30]],\n  ['regression: scenario 13', [50, 40, [40, 50, 50, 10, 50, 100, 40, 20, 37, 41]], [[0, 50], 0, 90]],\n  ['control: mixed overlaps', [10, 50, [5, 15, 3, 10, 12, 4]], [[0, 10, 30, 40], 2, None]],\n  ['regression: watchdog exceeded', [10, 12, [5, 13, 4]], [[0, 10], 0, 22]],\n  ['control: exact watchdog', [20, 30, [30, 5, 5, 5]], [[0, 40, 60], 1, None]],\n  ['regression: first execution overruns', [10, 25, [30, 5]], [[0], 0, 25]],\n  ['control: skip then drift', [10, 100, [25, 1, 1, 1, 1, 1]], [[0, 30, 40, 50], 2, None]],\n  ['regression: scenario 1', [25, 60, [70, 25, 60, 35, 25, 15, 60, 60, 25, 50, 25, 4]], [[0], 0, 60]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic bounded teaching model of one PLC instruction or rung pattern evaluated scan by scan. The stated contract is a stipulated toy convention, not a claim of conformance to any vendor controller or IEC 61131-3 runtime. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-plc-ladder-logic-scan-cycles-periodic-task-overlap-fault-timestamp","generated_at":"2026-09-29T14:51:42.328781+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Ladder programs are executed as repeated scans; each defect here changes what a rung, timer, counter or data-table instruction reports on a particular scan, which is how commissioning and field faults are actually observed.","repair":"The fault occurs at start time + watchdog.","root_cause":"The fault time adds the full execution time rather than the watchdog limit to the start time.","sha256":"f3d5a8c46e97df068f92f588cd7caf29bb38b475c5adad34ce4be2820bef6752","title":"Watchdog fault time is reported at the end of the overrunning execution · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":41.023,"exit_code":1,"observations":[{"actual":[[0,10],0,12],"check":"regression: watchdog exceeded","expected":[[0,10],0,22],"passed":false},{"actual":[[0,50],0,60],"check":"regression: scenario 4","expected":[[0,50],0,110],"passed":false},{"actual":[[0,10,30,40],2,null],"check":"control: mixed overlaps","expected":[[0,10,30,40],2,null],"passed":true},{"actual":[[0,40,60],1,null],"check":"control: exact watchdog","expected":[[0,40,60],1,null],"passed":true},{"actual":[[0],0,25],"check":"regression: first execution overruns","expected":[[0],0,25],"passed":true},{"actual":[[0,30,40,50],2,null],"check":"control: skip then drift","expected":[[0,30,40,50],2,null],"passed":true},{"actual":[[0,100,200,250],2,null],"check":"control: scenario 1","expected":[[0,100,200,250],2,null],"passed":true},{"actual":[[0,100,140],5,null],"check":"control: scenario 2","expected":[[0,100,140],5,null],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: watchdog exceeded\", \"actual\": [[0, 10], 0, 12], \"expected\": [[0, 10], 0, 22], \"passed\": false}, {\"check\": \"regression: scenario 4\", \"actual\": [[0, 50], 0, 60], \"expected\": [[0, 50], 0, 110], \"passed\": false}, {\"check\": \"control: mixed overlaps\", \"actual\": [[0, 10, 30, 40], 2, null], \"expected\": [[0, 10, 30, 40], 2, null], \"passed\": true}, {\"check\": \"control: exact watchdog\", \"actual\": [[0, 40, 60], 1, null], \"expected\": [[0, 40, 60], 1, null], \"passed\": true}, {\"check\": \"regression: first execution overruns\", \"actual\": [[0], 0, 25], \"expected\": [[0], 0, 25], \"passed\": true}, {\"check\": \"control: skip then drift\", \"actual\": [[0, 30, 40, 50], 2, null], \"expected\": [[0, 30, 40, 50], 2, null], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[0, 100, 200, 250], 2, null], \"expected\": [[0, 100, 200, 250], 2, null], \"passed\": true}, {\"check\": \"control: scenario 2\", \"actual\": [[0, 100, 140], 5, null], \"expected\": [[0, 100, 140], 5, null], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":38.729,"exit_code":1,"observations":[{"actual":[[0,10],0,23],"check":"regression: watchdog exceeded","expected":[[0,10],0,22],"passed":false},{"actual":[[0,50],0,150],"check":"regression: scenario 4","expected":[[0,50],0,110],"passed":false},{"actual":[[0,10,30,40],2,null],"check":"control: mixed overlaps","expected":[[0,10,30,40],2,null],"passed":true},{"actual":[[0,40,60],1,null],"check":"control: exact watchdog","expected":[[0,40,60],1,null],"passed":true},{"actual":[[0],0,30],"check":"regression: first execution overruns","expected":[[0],0,25],"passed":false},{"actual":[[0,30,40,50],2,null],"check":"control: skip then drift","expected":[[0,30,40,50],2,null],"passed":true},{"actual":[[0,100,200,250],2,null],"check":"control: scenario 1","expected":[[0,100,200,250],2,null],"passed":true},{"actual":[[0,100,140],5,null],"check":"control: scenario 2","expected":[[0,100,140],5,null],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: watchdog exceeded\", \"actual\": [[0, 10], 0, 23], \"expected\": [[0, 10], 0, 22], \"passed\": false}, {\"check\": \"regression: scenario 4\", \"actual\": [[0, 50], 0, 150], \"expected\": [[0, 50], 0, 110], \"passed\": false}, {\"check\": \"control: mixed overlaps\", \"actual\": [[0, 10, 30, 40], 2, null], \"expected\": [[0, 10, 30, 40], 2, null], \"passed\": true}, {\"check\": \"control: exact watchdog\", \"actual\": [[0, 40, 60], 1, null], \"expected\": [[0, 40, 60], 1, null], \"passed\": true}, {\"check\": \"regression: first execution overruns\", \"actual\": [[0], 0, 30], \"expected\": [[0], 0, 25], \"passed\": false}, {\"check\": \"control: skip then drift\", \"actual\": [[0, 30, 40, 50], 2, null], \"expected\": [[0, 30, 40, 50], 2, null], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[0, 100, 200, 250], 2, null], \"expected\": [[0, 100, 200, 250], 2, null], \"passed\": true}, {\"check\": \"control: scenario 2\", \"actual\": [[0, 100, 140], 5, null], \"expected\": [[0, 100, 140], 5, null], \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":40.128,"exit_code":0,"observations":[{"actual":[[0,10],0,22],"check":"regression: watchdog exceeded","expected":[[0,10],0,22],"passed":true},{"actual":[[0,50],0,110],"check":"regression: scenario 4","expected":[[0,50],0,110],"passed":true},{"actual":[[0,10,30,40],2,null],"check":"control: mixed overlaps","expected":[[0,10,30,40],2,null],"passed":true},{"actual":[[0,40,60],1,null],"check":"control: exact watchdog","expected":[[0,40,60],1,null],"passed":true},{"actual":[[0],0,25],"check":"regression: first execution overruns","expected":[[0],0,25],"passed":true},{"actual":[[0,30,40,50],2,null],"check":"control: skip then drift","expected":[[0,30,40,50],2,null],"passed":true},{"actual":[[0,100,200,250],2,null],"check":"control: scenario 1","expected":[[0,100,200,250],2,null],"passed":true},{"actual":[[0,100,140],5,null],"check":"control: scenario 2","expected":[[0,100,140],5,null],"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: watchdog exceeded\", \"actual\": [[0, 10], 0, 22], \"expected\": [[0, 10], 0, 22], \"passed\": true}, {\"check\": \"regression: scenario 4\", \"actual\": [[0, 50], 0, 110], \"expected\": [[0, 50], 0, 110], \"passed\": true}, {\"check\": \"control: mixed overlaps\", \"actual\": [[0, 10, 30, 40], 2, null], \"expected\": [[0, 10, 30, 40], 2, null], \"passed\": true}, {\"check\": \"control: exact watchdog\", \"actual\": [[0, 40, 60], 1, null], \"expected\": [[0, 40, 60], 1, null], \"passed\": true}, {\"check\": \"regression: first execution overruns\", \"actual\": [[0], 0, 25], \"expected\": [[0], 0, 25], \"passed\": true}, {\"check\": \"control: skip then drift\", \"actual\": [[0, 30, 40, 50], 2, null], \"expected\": [[0, 30, 40, 50], 2, null], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[0, 100, 200, 250], 2, null], \"expected\": [[0, 100, 200, 250], 2, null], \"passed\": true}, {\"check\": \"control: scenario 2\", \"actual\": [[0, 100, 140], 5, null], \"expected\": [[0, 100, 140], 5, null], \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}