{"abstract":"Only the terminator touching the number is attached.","category":"Bidirectional text layout","checks":8,"contract":"Input [classes of one isolating run sequence, sos]. W1 NSM takes the previous type (sos at start; ON after LRI/RLI/FSI/PDI). W2 EN after the last strong AL becomes AN. W3 AL->R. W4 a single ES between EN and EN -> EN; a single CS between two numbers of the same type takes that type. W5 a run of ET adjacent to EN -> EN. W6 remaining ES/ET/CS -> ON. W7 EN whose last strong (sos at start) is L -> L. Return resolved classes.","contract_signature":"x","evaluation_group":"w2-bidirectional-text-layout-weak-types","failed_approach":"Letting ES join the run absorbs separators into numbers.","family":"w2-bidirectional-text-layout-weak-types-terminator-run-extent","id":"FA-80401","implementations":{"attempt":{"sha256":"a310dc32e4dee76378cd2ca914787f7cf2a91a1134773510c1edaffa99035d98","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    types, sos = x\n    t = list(types)\n    n = len(t)\n    prev = sos\n    for i in range(n):\n        if t[i] == 'NSM':\n            t[i] = 'ON' if prev in ('LRI', 'RLI', 'FSI', 'PDI') else prev\n        prev = t[i]\n    last_strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R', 'AL'):\n            last_strong = t[i]\n        elif t[i] == 'EN' and last_strong == 'AL':\n            t[i] = 'AN'\n    t = ['R' if c == 'AL' else c for c in t]\n    for i in range(1, n - 1):\n        if t[i] == 'ES' and t[i - 1] == 'EN' and t[i + 1] == 'EN':\n            t[i] = 'EN'\n        elif t[i] == 'CS' and t[i - 1] == t[i + 1] and t[i - 1] in ('EN', 'AN'):\n            t[i] = t[i - 1]\n    i = 0\n    while i < n:\n        if t[i] == 'ET':\n            j = i\n            while j < n and t[j] in ('ET', 'ES'):\n                j += 1\n            if (i > 0 and t[i - 1] == 'EN') or (j < n and t[j] == 'EN'):\n                for k in range(i, j):\n                    t[k] = 'EN'\n            i = j\n        else:\n            i += 1\n    t = ['ON' if c in ('ES', 'ET', 'CS') else c for c in t]\n    strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R'):\n            strong = t[i]\n        elif t[i] == 'EN' and strong == 'L':\n            t[i] = 'L'\n    return t\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('regression: terminator run extent', [['ES', 'L', 'CS', 'AN', 'ET', 'NSM', 'EN', 'R', 'CS', 'EN'], 'L'], ['ON', 'L', 'ON', 'AN', 'L', 'L', 'L', 'R', 'ON', 'EN']), ('partial-repair probe', [['EN', 'EN', 'ET', 'EN', 'ET', 'ES'], 'L'], ['L', 'L', 'L', 'L', 'L', 'ON']), ('partial-repair probe', [['EN', 'ET', 'ES', 'EN'], 'R'], ['EN', 'EN', 'ON', 'EN']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('control layout', [['EN', 'L', 'ON', 'R'], 'R'], ['EN', 'L', 'ON', 'R']), ('control layout', [['EN', 'ET', 'WS', 'LRI', 'AL', 'LRI', 'R', 'EN', 'AL'], 'L'], ['L', 'L', 'WS', 'LRI', 'R', 'LRI', 'R', 'EN', 'R'])], [('regression: terminator run extent', [['ES', 'L', 'CS', 'AN', 'ET', 'NSM', 'EN', 'R', 'CS', 'EN'], 'L'], ['ON', 'L', 'ON', 'AN', 'L', 'L', 'L', 'R', 'ON', 'EN']), ('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('partial-repair probe', [['LRI', 'CS', 'ET', 'EN', 'NSM', 'ET', 'ES'], 'R'], ['LRI', 'ON', 'EN', 'EN', 'EN', 'EN', 'ON']), ('partial-repair probe', [['L', 'L', 'AN', 'ET', 'ES', 'EN', 'ON', 'EN'], 'L'], ['L', 'L', 'AN', 'ON', 'ON', 'L', 'ON', 'L']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('control layout', [['ES', 'ET', 'R', 'ES', 'CS', 'ES'], 'R'], ['ON', 'ON', 'R', 'ON', 'ON', 'ON']), ('control layout', [['EN', 'WS', 'L', 'AN', 'L', 'AN'], 'R'], ['EN', 'WS', 'L', 'AN', 'L', 'AN'])], [('regression: terminator run extent', [['CS', 'EN', 'L', 'ET', 'NSM', 'EN', 'CS', 'EN', 'ON', 'ET'], 'R'], ['ON', 'EN', 'L', 'L', 'L', 'L', 'L', 'L', 'ON', 'ON']), ('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('partial-repair probe', [['ET', 'ES', 'EN', 'AL'], 'R'], ['ON', 'ON', 'EN', 'R']), ('partial-repair probe', [['L', 'EN', 'ET', 'ES'], 'L'], ['L', 'L', 'L', 'ON']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('percent after number', [['EN', 'ET', 'ET', 'L'], 'R'], ['EN', 'EN', 'EN', 'L']), ('control layout', [['LRI', 'ON', 'L'], 'L'], ['LRI', 'ON', 'L']), ('control layout', [['AL', 'AN', 'L', 'LRI', 'ET', 'EN', 'AL', 'L', 'NSM', 'PDI', 'EN'], 'L'], ['R', 'AN', 'L', 'LRI', 'L', 'L', 'R', 'L', 'L', 'PDI', 'L'])], [('regression: terminator run extent', [['ES', 'L', 'CS', 'AN', 'ET', 'NSM', 'EN', 'R', 'CS', 'EN'], 'L'], ['ON', 'L', 'ON', 'AN', 'L', 'L', 'L', 'R', 'ON', 'EN']), ('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('partial-repair probe', [['L', 'EN', 'ET', 'ES'], 'L'], ['L', 'L', 'L', 'ON']), ('partial-repair probe', [['LRI', 'CS', 'ET', 'EN', 'NSM', 'ET', 'ES'], 'R'], ['LRI', 'ON', 'EN', 'EN', 'EN', 'EN', 'ON']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('control layout', [['AL', 'AN'], 'L'], ['R', 'AN']), ('control layout', [['ES', 'WS', 'L', 'EN', 'AL', 'PDI', 'CS'], 'R'], ['ON', 'WS', 'L', 'L', 'R', 'PDI', 'ON'])], [('regression: terminator run extent', [['CS', 'EN', 'L', 'ET', 'NSM', 'EN', 'CS', 'EN', 'ON', 'ET'], 'R'], ['ON', 'EN', 'L', 'L', 'L', 'L', 'L', 'L', 'ON', 'ON']), ('regression: terminator run extent', [['ES', 'ET', 'ET', 'EN', 'AL', 'ES', 'R', 'R'], 'R'], ['ON', 'EN', 'EN', 'EN', 'R', 'ON', 'R', 'R']), ('partial-repair probe', [['CS', 'ET', 'ES', 'EN', 'L', 'CS'], 'R'], ['ON', 'ON', 'ON', 'EN', 'L', 'ON']), ('partial-repair probe', [['ET', 'ES', 'EN', 'AL'], 'R'], ['ON', 'ON', 'EN', 'R']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('NSM after isolate initiator', [['LRI', 'NSM', 'L', 'PDI'], 'R'], ['LRI', 'ON', 'L', 'PDI']), ('control layout', [['AL', 'ON', 'AN', 'ON', 'EN', 'AL', 'ES'], 'L'], ['R', 'ON', 'AN', 'ON', 'AN', 'R', 'ON']), ('control layout', [['L', 'EN', 'LRI', 'ET', 'AL', 'EN'], 'R'], ['L', 'L', 'LRI', 'ON', 'R', 'AN'])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"a6534c8b2a12f24b054f5982be59816213c324ad1ddd1c213bc9aff14c21829f","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    types, sos = x\n    t = list(types)\n    n = len(t)\n    prev = sos\n    for i in range(n):\n        if t[i] == 'NSM':\n            t[i] = 'ON' if prev in ('LRI', 'RLI', 'FSI', 'PDI') else prev\n        prev = t[i]\n    last_strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R', 'AL'):\n            last_strong = t[i]\n        elif t[i] == 'EN' and last_strong == 'AL':\n            t[i] = 'AN'\n    t = ['R' if c == 'AL' else c for c in t]\n    for i in range(1, n - 1):\n        if t[i] == 'ES' and t[i - 1] == 'EN' and t[i + 1] == 'EN':\n            t[i] = 'EN'\n        elif t[i] == 'CS' and t[i - 1] == t[i + 1] and t[i - 1] in ('EN', 'AN'):\n            t[i] = t[i - 1]\n    i = 0\n    while i < n:\n        if t[i] == 'ET':\n            j = i\n            j = i + 1\n            if (i > 0 and t[i - 1] == 'EN') or (j < n and t[j] == 'EN'):\n                for k in range(i, j):\n                    t[k] = 'EN'\n            i = j\n        else:\n            i += 1\n    t = ['ON' if c in ('ES', 'ET', 'CS') else c for c in t]\n    strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R'):\n            strong = t[i]\n        elif t[i] == 'EN' and strong == 'L':\n            t[i] = 'L'\n    return t\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('regression: terminator run extent', [['ES', 'L', 'CS', 'AN', 'ET', 'NSM', 'EN', 'R', 'CS', 'EN'], 'L'], ['ON', 'L', 'ON', 'AN', 'L', 'L', 'L', 'R', 'ON', 'EN']), ('partial-repair probe', [['EN', 'EN', 'ET', 'EN', 'ET', 'ES'], 'L'], ['L', 'L', 'L', 'L', 'L', 'ON']), ('partial-repair probe', [['EN', 'ET', 'ES', 'EN'], 'R'], ['EN', 'EN', 'ON', 'EN']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('control layout', [['EN', 'L', 'ON', 'R'], 'R'], ['EN', 'L', 'ON', 'R']), ('control layout', [['EN', 'ET', 'WS', 'LRI', 'AL', 'LRI', 'R', 'EN', 'AL'], 'L'], ['L', 'L', 'WS', 'LRI', 'R', 'LRI', 'R', 'EN', 'R'])], [('regression: terminator run extent', [['ES', 'L', 'CS', 'AN', 'ET', 'NSM', 'EN', 'R', 'CS', 'EN'], 'L'], ['ON', 'L', 'ON', 'AN', 'L', 'L', 'L', 'R', 'ON', 'EN']), ('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('partial-repair probe', [['LRI', 'CS', 'ET', 'EN', 'NSM', 'ET', 'ES'], 'R'], ['LRI', 'ON', 'EN', 'EN', 'EN', 'EN', 'ON']), ('partial-repair probe', [['L', 'L', 'AN', 'ET', 'ES', 'EN', 'ON', 'EN'], 'L'], ['L', 'L', 'AN', 'ON', 'ON', 'L', 'ON', 'L']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('control layout', [['ES', 'ET', 'R', 'ES', 'CS', 'ES'], 'R'], ['ON', 'ON', 'R', 'ON', 'ON', 'ON']), ('control layout', [['EN', 'WS', 'L', 'AN', 'L', 'AN'], 'R'], ['EN', 'WS', 'L', 'AN', 'L', 'AN'])], [('regression: terminator run extent', [['CS', 'EN', 'L', 'ET', 'NSM', 'EN', 'CS', 'EN', 'ON', 'ET'], 'R'], ['ON', 'EN', 'L', 'L', 'L', 'L', 'L', 'L', 'ON', 'ON']), ('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('partial-repair probe', [['ET', 'ES', 'EN', 'AL'], 'R'], ['ON', 'ON', 'EN', 'R']), ('partial-repair probe', [['L', 'EN', 'ET', 'ES'], 'L'], ['L', 'L', 'L', 'ON']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('percent after number', [['EN', 'ET', 'ET', 'L'], 'R'], ['EN', 'EN', 'EN', 'L']), ('control layout', [['LRI', 'ON', 'L'], 'L'], ['LRI', 'ON', 'L']), ('control layout', [['AL', 'AN', 'L', 'LRI', 'ET', 'EN', 'AL', 'L', 'NSM', 'PDI', 'EN'], 'L'], ['R', 'AN', 'L', 'LRI', 'L', 'L', 'R', 'L', 'L', 'PDI', 'L'])], [('regression: terminator run extent', [['ES', 'L', 'CS', 'AN', 'ET', 'NSM', 'EN', 'R', 'CS', 'EN'], 'L'], ['ON', 'L', 'ON', 'AN', 'L', 'L', 'L', 'R', 'ON', 'EN']), ('regression: terminator run extent', [['L', 'CS', 'EN', 'PDI', 'EN', 'R', 'ET', 'NSM', 'EN'], 'L'], ['L', 'ON', 'L', 'PDI', 'L', 'R', 'EN', 'EN', 'EN']), ('partial-repair probe', [['L', 'EN', 'ET', 'ES'], 'L'], ['L', 'L', 'L', 'ON']), ('partial-repair probe', [['LRI', 'CS', 'ET', 'EN', 'NSM', 'ET', 'ES'], 'R'], ['LRI', 'ON', 'EN', 'EN', 'EN', 'EN', 'ON']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('control layout', [['AL', 'AN'], 'L'], ['R', 'AN']), ('control layout', [['ES', 'WS', 'L', 'EN', 'AL', 'PDI', 'CS'], 'R'], ['ON', 'WS', 'L', 'L', 'R', 'PDI', 'ON'])], [('regression: terminator run extent', [['CS', 'EN', 'L', 'ET', 'NSM', 'EN', 'CS', 'EN', 'ON', 'ET'], 'R'], ['ON', 'EN', 'L', 'L', 'L', 'L', 'L', 'L', 'ON', 'ON']), ('regression: terminator run extent', [['ES', 'ET', 'ET', 'EN', 'AL', 'ES', 'R', 'R'], 'R'], ['ON', 'EN', 'EN', 'EN', 'R', 'ON', 'R', 'R']), ('partial-repair probe', [['CS', 'ET', 'ES', 'EN', 'L', 'CS'], 'R'], ['ON', 'ON', 'ON', 'EN', 'L', 'ON']), ('partial-repair probe', [['ET', 'ES', 'EN', 'AL'], 'R'], ['ON', 'ON', 'EN', 'R']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('NSM after isolate initiator', [['LRI', 'NSM', 'L', 'PDI'], 'R'], ['LRI', 'ON', 'L', 'PDI']), ('control layout', [['AL', 'ON', 'AN', 'ON', 'EN', 'AL', 'ES'], 'L'], ['R', 'ON', 'AN', 'ON', 'AN', 'R', 'ON']), ('control layout', [['L', 'EN', 'LRI', 'ET', 'AL', 'EN'], 'R'], ['L', 'L', 'LRI', 'ON', 'R', 'AN'])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic toy bidi model over stipulated class labels and integer levels; it is inspired by, but does not claim conformance to, any published algorithm. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-bidirectional-text-layout-weak-types-terminator-run-extent","generated_at":"2026-09-29T14:49:53.528704+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Mixed right-to-left and left-to-right text must resolve levels and visual order exactly, or words, numbers and carets land in the wrong place.","root_cause":"W5 treats each ET separately instead of as a run.","sha256":"e12bb27572c5dbd664dcc214ea5111d6dc9672044d2f6dcfb24d1cdfec84c116","title":"Weak type resolution: terminator run extent · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":40.371,"exit_code":1,"observations":[{"actual":["L","ON","L","PDI","L","R","EN","EN","EN"],"check":"regression: terminator run extent","expected":["L","ON","L","PDI","L","R","EN","EN","EN"],"passed":true},{"actual":["ON","L","ON","AN","L","L","L","R","ON","EN"],"check":"regression: terminator run extent","expected":["ON","L","ON","AN","L","L","L","R","ON","EN"],"passed":true},{"actual":["L","L","L","L","L","L"],"check":"partial-repair probe","expected":["L","L","L","L","L","ON"],"passed":false},{"actual":["EN","EN","EN","EN"],"check":"partial-repair probe","expected":["EN","EN","ON","EN"],"passed":false},{"actual":["R","R","R","EN"],"check":"NSM chain after R","expected":["R","R","R","EN"],"passed":true},{"actual":["EN","EN","EN","R"],"check":"plus between numbers","expected":["EN","EN","EN","R"],"passed":true},{"actual":["EN","L","ON","R"],"check":"control layout","expected":["EN","L","ON","R"],"passed":true},{"actual":["L","L","WS","LRI","R","LRI","R","EN","R"],"check":"control layout","expected":["L","L","WS","LRI","R","LRI","R","EN","R"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: terminator run extent\", \"actual\": [\"L\", \"ON\", \"L\", \"PDI\", \"L\", \"R\", \"EN\", \"EN\", \"EN\"], \"expected\": [\"L\", \"ON\", \"L\", \"PDI\", \"L\", \"R\", \"EN\", \"EN\", \"EN\"], \"passed\": true}, {\"check\": \"regression: terminator run extent\", \"actual\": [\"ON\", \"L\", \"ON\", \"AN\", \"L\", \"L\", \"L\", \"R\", \"ON\", \"EN\"], \"expected\": [\"ON\", \"L\", \"ON\", \"AN\", \"L\", \"L\", \"L\", \"R\", \"ON\", \"EN\"], \"passed\": true}, {\"check\": \"partial-repair probe\", \"actual\": [\"L\", \"L\", \"L\", \"L\", \"L\", \"L\"], \"expected\": [\"L\", \"L\", \"L\", \"L\", \"L\", \"ON\"], \"passed\": false}, {\"check\": \"partial-repair probe\", \"actual\": [\"EN\", \"EN\", \"EN\", \"EN\"], \"expected\": [\"EN\", \"EN\", \"ON\", \"EN\"], \"passed\": false}, {\"check\": \"NSM chain after R\", \"actual\": [\"R\", \"R\", \"R\", \"EN\"], \"expected\": [\"R\", \"R\", \"R\", \"EN\"], \"passed\": true}, {\"check\": \"plus between numbers\", \"actual\": [\"EN\", \"EN\", \"EN\", \"R\"], \"expected\": [\"EN\", \"EN\", \"EN\", \"R\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"EN\", \"L\", \"ON\", \"R\"], \"expected\": [\"EN\", \"L\", \"ON\", \"R\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"L\", \"L\", \"WS\", \"LRI\", \"R\", \"LRI\", \"R\", \"EN\", \"R\"], \"expected\": [\"L\", \"L\", \"WS\", \"LRI\", \"R\", \"LRI\", \"R\", \"EN\", \"R\"], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":40.543,"exit_code":1,"observations":[{"actual":["L","ON","L","PDI","L","R","ON","EN","EN"],"check":"regression: terminator run extent","expected":["L","ON","L","PDI","L","R","EN","EN","EN"],"passed":false},{"actual":["ON","L","ON","AN","ON","L","L","R","ON","EN"],"check":"regression: terminator run extent","expected":["ON","L","ON","AN","L","L","L","R","ON","EN"],"passed":false},{"actual":["L","L","L","L","L","ON"],"check":"partial-repair probe","expected":["L","L","L","L","L","ON"],"passed":true},{"actual":["EN","EN","ON","EN"],"check":"partial-repair probe","expected":["EN","EN","ON","EN"],"passed":true},{"actual":["R","R","R","EN"],"check":"NSM chain after R","expected":["R","R","R","EN"],"passed":true},{"actual":["EN","EN","EN","R"],"check":"plus between numbers","expected":["EN","EN","EN","R"],"passed":true},{"actual":["EN","L","ON","R"],"check":"control layout","expected":["EN","L","ON","R"],"passed":true},{"actual":["L","L","WS","LRI","R","LRI","R","EN","R"],"check":"control layout","expected":["L","L","WS","LRI","R","LRI","R","EN","R"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: terminator run extent\", \"actual\": [\"L\", \"ON\", \"L\", \"PDI\", \"L\", \"R\", \"ON\", \"EN\", \"EN\"], \"expected\": [\"L\", \"ON\", \"L\", \"PDI\", \"L\", \"R\", \"EN\", \"EN\", \"EN\"], \"passed\": false}, {\"check\": \"regression: terminator run extent\", \"actual\": [\"ON\", \"L\", \"ON\", \"AN\", \"ON\", \"L\", \"L\", \"R\", \"ON\", \"EN\"], \"expected\": [\"ON\", \"L\", \"ON\", \"AN\", \"L\", \"L\", \"L\", \"R\", \"ON\", \"EN\"], \"passed\": false}, {\"check\": \"partial-repair probe\", \"actual\": [\"L\", \"L\", \"L\", \"L\", \"L\", \"ON\"], \"expected\": [\"L\", \"L\", \"L\", \"L\", \"L\", \"ON\"], \"passed\": true}, {\"check\": \"partial-repair probe\", \"actual\": [\"EN\", \"EN\", \"ON\", \"EN\"], \"expected\": [\"EN\", \"EN\", \"ON\", \"EN\"], \"passed\": true}, {\"check\": \"NSM chain after R\", \"actual\": [\"R\", \"R\", \"R\", \"EN\"], \"expected\": [\"R\", \"R\", \"R\", \"EN\"], \"passed\": true}, {\"check\": \"plus between numbers\", \"actual\": [\"EN\", \"EN\", \"EN\", \"R\"], \"expected\": [\"EN\", \"EN\", \"EN\", \"R\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"EN\", \"L\", \"ON\", \"R\"], \"expected\": [\"EN\", \"L\", \"ON\", \"R\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"L\", \"L\", \"WS\", \"LRI\", \"R\", \"LRI\", \"R\", \"EN\", \"R\"], \"expected\": [\"L\", \"L\", \"WS\", \"LRI\", \"R\", \"LRI\", \"R\", \"EN\", \"R\"], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}