{"abstract":"A plus between Arabic numbers joins them, or European pairs split.","category":"Bidirectional text layout","checks":8,"contract":"Input [classes of one isolating run sequence, sos]. W1 NSM takes the previous type (sos at start; ON after LRI/RLI/FSI/PDI). W2 EN after the last strong AL becomes AN. W3 AL->R. W4 a single ES between EN and EN -> EN; a single CS between two numbers of the same type takes that type. W5 a run of ET adjacent to EN -> EN. W6 remaining ES/ET/CS -> ON. W7 EN whose last strong (sos at start) is L -> L. Return resolved classes.","contract_signature":"x","evaluation_group":"w2-bidirectional-text-layout-weak-types","failed_approach":"Ignoring the right neighbour joins a number to whatever follows.","family":"w2-bidirectional-text-layout-weak-types-plus-sign-between-numbers","id":"FA-80386","implementations":{"attempt":{"sha256":"442ea5c2d9d5eb654d39fb897d4c6074f0f71610a9fc1656f6abbbde1c3365e3","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    types, sos = x\n    t = list(types)\n    n = len(t)\n    prev = sos\n    for i in range(n):\n        if t[i] == 'NSM':\n            t[i] = 'ON' if prev in ('LRI', 'RLI', 'FSI', 'PDI') else prev\n        prev = t[i]\n    last_strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R', 'AL'):\n            last_strong = t[i]\n        elif t[i] == 'EN' and last_strong == 'AL':\n            t[i] = 'AN'\n    t = ['R' if c == 'AL' else c for c in t]\n    for i in range(1, n - 1):\n        if t[i] == 'ES' and t[i - 1] == 'EN':\n            t[i] = 'EN'\n        elif t[i] == 'CS' and t[i - 1] == t[i + 1] and t[i - 1] in ('EN', 'AN'):\n            t[i] = t[i - 1]\n    i = 0\n    while i < n:\n        if t[i] == 'ET':\n            j = i\n            while j < n and t[j] == 'ET':\n                j += 1\n            if (i > 0 and t[i - 1] == 'EN') or (j < n and t[j] == 'EN'):\n                for k in range(i, j):\n                    t[k] = 'EN'\n            i = j\n        else:\n            i += 1\n    t = ['ON' if c in ('ES', 'ET', 'CS') else c for c in t]\n    strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R'):\n            strong = t[i]\n        elif t[i] == 'EN' and strong == 'L':\n            t[i] = 'L'\n    return t\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['ES', 'WS', 'CS', 'EN', 'ES', 'CS'], 'R'], ['ON', 'WS', 'ON', 'EN', 'ON', 'ON']), ('partial-repair probe', [['EN', 'ES', 'AL', 'ET', 'ET', 'ON', 'L', 'EN', 'LRI', 'PDI'], 'L'], ['L', 'ON', 'R', 'ON', 'ON', 'ON', 'L', 'L', 'LRI', 'PDI']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('NSM after isolate initiator', [['LRI', 'NSM', 'L', 'PDI'], 'R'], ['LRI', 'ON', 'L', 'PDI']), ('control layout', [['WS', 'ES'], 'L'], ['WS', 'ON']), ('control layout', [['AN', 'L', 'ES', 'WS', 'AN', 'AL', 'LRI', 'AL', 'NSM', 'ES'], 'L'], ['AN', 'L', 'ON', 'WS', 'AN', 'R', 'LRI', 'R', 'R', 'ON'])], [('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('partial-repair probe', [['AN', 'L', 'EN', 'ES', 'L'], 'R'], ['AN', 'L', 'L', 'ON', 'L']), ('partial-repair probe', [['ES', 'EN', 'ES', 'AN', 'AL', 'CS', 'ET', 'R', 'AN'], 'R'], ['ON', 'EN', 'ON', 'AN', 'R', 'ON', 'ON', 'R', 'AN']), ('percent after number', [['EN', 'ET', 'ET', 'L'], 'R'], ['EN', 'EN', 'EN', 'L']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('control layout', [['AL', 'EN', 'ET', 'L', 'EN', 'CS'], 'L'], ['R', 'AN', 'ON', 'L', 'L', 'ON']), ('control layout', [['NSM', 'R', 'L', 'AL', 'AL'], 'R'], ['R', 'R', 'L', 'R', 'R'])], [('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['ET', 'R', 'EN', 'NSM', 'ES', 'AL', 'CS', 'NSM', 'AL'], 'R'], ['ON', 'R', 'EN', 'EN', 'ON', 'R', 'ON', 'ON', 'R']), ('partial-repair probe', [['PDI', 'EN', 'EN', 'NSM', 'ES', 'ET', 'EN'], 'R'], ['PDI', 'EN', 'EN', 'EN', 'ON', 'EN', 'EN']), ('percent after number', [['EN', 'ET', 'ET', 'L'], 'R'], ['EN', 'EN', 'EN', 'L']), ('NSM after isolate initiator', [['LRI', 'NSM', 'L', 'PDI'], 'R'], ['LRI', 'ON', 'L', 'PDI']), ('control layout', [['EN', 'EN', 'NSM'], 'R'], ['EN', 'EN', 'EN']), ('control layout', [['AL', 'ON', 'NSM'], 'R'], ['R', 'ON', 'ON'])], [('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['EN', 'ES', 'CS'], 'L'], ['L', 'ON', 'ON']), ('partial-repair probe', [['PDI', 'EN', 'EN', 'NSM', 'ES', 'ET', 'EN'], 'R'], ['PDI', 'EN', 'EN', 'EN', 'ON', 'EN', 'EN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('control layout', [['ET', 'CS', 'ES', 'WS', 'AN', 'CS', 'ES', 'L'], 'L'], ['ON', 'ON', 'ON', 'WS', 'AN', 'ON', 'ON', 'L']), ('control layout', [['EN', 'ET', 'L', 'ES', 'AL', 'AL', 'ES', 'PDI'], 'R'], ['EN', 'EN', 'L', 'ON', 'R', 'R', 'ON', 'PDI'])], [('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['ET', 'R', 'EN', 'NSM', 'ES', 'AL', 'CS', 'NSM', 'AL'], 'R'], ['ON', 'R', 'EN', 'EN', 'ON', 'R', 'ON', 'ON', 'R']), ('partial-repair probe', [['AL', 'CS', 'EN', 'EN', 'ES', 'L', 'EN', 'ES', 'L', 'ES'], 'R'], ['R', 'ON', 'AN', 'AN', 'ON', 'L', 'L', 'ON', 'L', 'ON']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('control layout', [['AN', 'L', 'EN'], 'R'], ['AN', 'L', 'L']), ('control layout', [['AL', 'AN', 'L', 'LRI', 'ET', 'EN', 'AL', 'L', 'NSM', 'PDI', 'EN'], 'L'], ['R', 'AN', 'L', 'LRI', 'L', 'L', 'R', 'L', 'L', 'PDI', 'L'])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"d344b2a82b306018c3069c5c1154591365c1c2aa1f7555d6006de95193e102b7","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    types, sos = x\n    t = list(types)\n    n = len(t)\n    prev = sos\n    for i in range(n):\n        if t[i] == 'NSM':\n            t[i] = 'ON' if prev in ('LRI', 'RLI', 'FSI', 'PDI') else prev\n        prev = t[i]\n    last_strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R', 'AL'):\n            last_strong = t[i]\n        elif t[i] == 'EN' and last_strong == 'AL':\n            t[i] = 'AN'\n    t = ['R' if c == 'AL' else c for c in t]\n    for i in range(1, n - 1):\n        if t[i] == 'ES' and t[i - 1] == t[i + 1] and t[i - 1] in ('EN', 'AN'):\n            t[i] = 'EN'\n        elif t[i] == 'CS' and t[i - 1] == t[i + 1] and t[i - 1] in ('EN', 'AN'):\n            t[i] = t[i - 1]\n    i = 0\n    while i < n:\n        if t[i] == 'ET':\n            j = i\n            while j < n and t[j] == 'ET':\n                j += 1\n            if (i > 0 and t[i - 1] == 'EN') or (j < n and t[j] == 'EN'):\n                for k in range(i, j):\n                    t[k] = 'EN'\n            i = j\n        else:\n            i += 1\n    t = ['ON' if c in ('ES', 'ET', 'CS') else c for c in t]\n    strong = sos\n    for i in range(n):\n        if t[i] in ('L', 'R'):\n            strong = t[i]\n        elif t[i] == 'EN' and strong == 'L':\n            t[i] = 'L'\n    return t\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['ES', 'WS', 'CS', 'EN', 'ES', 'CS'], 'R'], ['ON', 'WS', 'ON', 'EN', 'ON', 'ON']), ('partial-repair probe', [['EN', 'ES', 'AL', 'ET', 'ET', 'ON', 'L', 'EN', 'LRI', 'PDI'], 'L'], ['L', 'ON', 'R', 'ON', 'ON', 'ON', 'L', 'L', 'LRI', 'PDI']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('NSM after isolate initiator', [['LRI', 'NSM', 'L', 'PDI'], 'R'], ['LRI', 'ON', 'L', 'PDI']), ('control layout', [['WS', 'ES'], 'L'], ['WS', 'ON']), ('control layout', [['AN', 'L', 'ES', 'WS', 'AN', 'AL', 'LRI', 'AL', 'NSM', 'ES'], 'L'], ['AN', 'L', 'ON', 'WS', 'AN', 'R', 'LRI', 'R', 'R', 'ON'])], [('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('partial-repair probe', [['AN', 'L', 'EN', 'ES', 'L'], 'R'], ['AN', 'L', 'L', 'ON', 'L']), ('partial-repair probe', [['ES', 'EN', 'ES', 'AN', 'AL', 'CS', 'ET', 'R', 'AN'], 'R'], ['ON', 'EN', 'ON', 'AN', 'R', 'ON', 'ON', 'R', 'AN']), ('percent after number', [['EN', 'ET', 'ET', 'L'], 'R'], ['EN', 'EN', 'EN', 'L']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('control layout', [['AL', 'EN', 'ET', 'L', 'EN', 'CS'], 'L'], ['R', 'AN', 'ON', 'L', 'L', 'ON']), ('control layout', [['NSM', 'R', 'L', 'AL', 'AL'], 'R'], ['R', 'R', 'L', 'R', 'R'])], [('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['ET', 'R', 'EN', 'NSM', 'ES', 'AL', 'CS', 'NSM', 'AL'], 'R'], ['ON', 'R', 'EN', 'EN', 'ON', 'R', 'ON', 'ON', 'R']), ('partial-repair probe', [['PDI', 'EN', 'EN', 'NSM', 'ES', 'ET', 'EN'], 'R'], ['PDI', 'EN', 'EN', 'EN', 'ON', 'EN', 'EN']), ('percent after number', [['EN', 'ET', 'ET', 'L'], 'R'], ['EN', 'EN', 'EN', 'L']), ('NSM after isolate initiator', [['LRI', 'NSM', 'L', 'PDI'], 'R'], ['LRI', 'ON', 'L', 'PDI']), ('control layout', [['EN', 'EN', 'NSM'], 'R'], ['EN', 'EN', 'EN']), ('control layout', [['AL', 'ON', 'NSM'], 'R'], ['R', 'ON', 'ON'])], [('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['EN', 'ES', 'CS'], 'L'], ['L', 'ON', 'ON']), ('partial-repair probe', [['PDI', 'EN', 'EN', 'NSM', 'ES', 'ET', 'EN'], 'R'], ['PDI', 'EN', 'EN', 'EN', 'ON', 'EN', 'EN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('NSM chain after R', [['R', 'NSM', 'NSM', 'EN'], 'L'], ['R', 'R', 'R', 'EN']), ('control layout', [['ET', 'CS', 'ES', 'WS', 'AN', 'CS', 'ES', 'L'], 'L'], ['ON', 'ON', 'ON', 'WS', 'AN', 'ON', 'ON', 'L']), ('control layout', [['EN', 'ET', 'L', 'ES', 'AL', 'AL', 'ES', 'PDI'], 'R'], ['EN', 'EN', 'L', 'ON', 'R', 'R', 'ON', 'PDI'])], [('regression: plus sign between numbers', [['L', 'CS', 'AL', 'NSM', 'ET', 'CS', 'AN', 'ES', 'EN'], 'R'], ['L', 'ON', 'R', 'R', 'ON', 'ON', 'AN', 'ON', 'AN']), ('regression: plus sign between numbers', [['ES', 'EN', 'ES', 'WS', 'LRI', 'EN', 'EN', 'LRI', 'AN', 'ES', 'AN'], 'L'], ['ON', 'L', 'ON', 'WS', 'LRI', 'L', 'L', 'LRI', 'AN', 'ON', 'AN']), ('partial-repair probe', [['ET', 'R', 'EN', 'NSM', 'ES', 'AL', 'CS', 'NSM', 'AL'], 'R'], ['ON', 'R', 'EN', 'EN', 'ON', 'R', 'ON', 'ON', 'R']), ('partial-repair probe', [['AL', 'CS', 'EN', 'EN', 'ES', 'L', 'EN', 'ES', 'L', 'ES'], 'R'], ['R', 'ON', 'AN', 'AN', 'ON', 'L', 'L', 'ON', 'L', 'ON']), ('Arabic number context', [['AL', 'EN', 'CS', 'EN'], 'L'], ['R', 'AN', 'AN', 'AN']), ('plus between numbers', [['EN', 'ES', 'EN', 'R'], 'R'], ['EN', 'EN', 'EN', 'R']), ('control layout', [['AN', 'L', 'EN'], 'R'], ['AN', 'L', 'L']), ('control layout', [['AL', 'AN', 'L', 'LRI', 'ET', 'EN', 'AL', 'L', 'NSM', 'PDI', 'EN'], 'L'], ['R', 'AN', 'L', 'LRI', 'L', 'L', 'R', 'L', 'L', 'PDI', 'L'])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic toy bidi model over stipulated class labels and integer levels; it is inspired by, but does not claim conformance to, any published algorithm. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-bidirectional-text-layout-weak-types-plus-sign-between-numbers","generated_at":"2026-09-29T14:49:53.486078+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Mixed right-to-left and left-to-right text must resolve levels and visual order exactly, or words, numbers and carets land in the wrong place.","root_cause":"The W4 ES rule accepts any matching number type instead of European numbers only.","sha256":"8c8d05deb3bd138dc326e9a863e006c727c9fcc2ec5268ca3c2c7f717451ff80","title":"Weak type resolution: plus sign between numbers · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":40.502,"exit_code":1,"observations":[{"actual":["L","ON","R","R","ON","ON","AN","ON","AN"],"check":"regression: plus sign between numbers","expected":["L","ON","R","R","ON","ON","AN","ON","AN"],"passed":true},{"actual":["ON","L","L","WS","LRI","L","L","LRI","AN","ON","AN"],"check":"regression: plus sign between numbers","expected":["ON","L","ON","WS","LRI","L","L","LRI","AN","ON","AN"],"passed":false},{"actual":["ON","WS","ON","EN","EN","ON"],"check":"partial-repair probe","expected":["ON","WS","ON","EN","ON","ON"],"passed":false},{"actual":["L","L","R","ON","ON","ON","L","L","LRI","PDI"],"check":"partial-repair probe","expected":["L","ON","R","ON","ON","ON","L","L","LRI","PDI"],"passed":false},{"actual":["EN","EN","EN","R"],"check":"plus between numbers","expected":["EN","EN","EN","R"],"passed":true},{"actual":["LRI","ON","L","PDI"],"check":"NSM after isolate initiator","expected":["LRI","ON","L","PDI"],"passed":true},{"actual":["WS","ON"],"check":"control layout","expected":["WS","ON"],"passed":true},{"actual":["AN","L","ON","WS","AN","R","LRI","R","R","ON"],"check":"control layout","expected":["AN","L","ON","WS","AN","R","LRI","R","R","ON"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: plus sign between numbers\", \"actual\": [\"L\", \"ON\", \"R\", \"R\", \"ON\", \"ON\", \"AN\", \"ON\", \"AN\"], \"expected\": [\"L\", \"ON\", \"R\", \"R\", \"ON\", \"ON\", \"AN\", \"ON\", \"AN\"], \"passed\": true}, {\"check\": \"regression: plus sign between numbers\", \"actual\": [\"ON\", \"L\", \"L\", \"WS\", \"LRI\", \"L\", \"L\", \"LRI\", \"AN\", \"ON\", \"AN\"], \"expected\": [\"ON\", \"L\", \"ON\", \"WS\", \"LRI\", \"L\", \"L\", \"LRI\", \"AN\", \"ON\", \"AN\"], \"passed\": false}, {\"check\": \"partial-repair probe\", \"actual\": [\"ON\", \"WS\", \"ON\", \"EN\", \"EN\", \"ON\"], \"expected\": [\"ON\", \"WS\", \"ON\", \"EN\", \"ON\", \"ON\"], \"passed\": false}, {\"check\": \"partial-repair probe\", \"actual\": [\"L\", \"L\", \"R\", \"ON\", \"ON\", \"ON\", \"L\", \"L\", \"LRI\", \"PDI\"], \"expected\": [\"L\", \"ON\", \"R\", \"ON\", \"ON\", \"ON\", \"L\", \"L\", \"LRI\", \"PDI\"], \"passed\": false}, {\"check\": \"plus between numbers\", \"actual\": [\"EN\", \"EN\", \"EN\", \"R\"], \"expected\": [\"EN\", \"EN\", \"EN\", \"R\"], \"passed\": true}, {\"check\": \"NSM after isolate initiator\", \"actual\": [\"LRI\", \"ON\", \"L\", \"PDI\"], \"expected\": [\"LRI\", \"ON\", \"L\", \"PDI\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"WS\", \"ON\"], \"expected\": [\"WS\", \"ON\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"AN\", \"L\", \"ON\", \"WS\", \"AN\", \"R\", \"LRI\", \"R\", \"R\", \"ON\"], \"expected\": [\"AN\", \"L\", \"ON\", \"WS\", \"AN\", \"R\", \"LRI\", \"R\", \"R\", \"ON\"], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":40.598,"exit_code":1,"observations":[{"actual":["L","ON","R","R","ON","ON","AN","EN","AN"],"check":"regression: plus sign between numbers","expected":["L","ON","R","R","ON","ON","AN","ON","AN"],"passed":false},{"actual":["ON","L","ON","WS","LRI","L","L","LRI","AN","L","AN"],"check":"regression: plus sign between numbers","expected":["ON","L","ON","WS","LRI","L","L","LRI","AN","ON","AN"],"passed":false},{"actual":["ON","WS","ON","EN","ON","ON"],"check":"partial-repair probe","expected":["ON","WS","ON","EN","ON","ON"],"passed":true},{"actual":["L","ON","R","ON","ON","ON","L","L","LRI","PDI"],"check":"partial-repair probe","expected":["L","ON","R","ON","ON","ON","L","L","LRI","PDI"],"passed":true},{"actual":["EN","EN","EN","R"],"check":"plus between numbers","expected":["EN","EN","EN","R"],"passed":true},{"actual":["LRI","ON","L","PDI"],"check":"NSM after isolate initiator","expected":["LRI","ON","L","PDI"],"passed":true},{"actual":["WS","ON"],"check":"control layout","expected":["WS","ON"],"passed":true},{"actual":["AN","L","ON","WS","AN","R","LRI","R","R","ON"],"check":"control layout","expected":["AN","L","ON","WS","AN","R","LRI","R","R","ON"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: plus sign between numbers\", \"actual\": [\"L\", \"ON\", \"R\", \"R\", \"ON\", \"ON\", \"AN\", \"EN\", \"AN\"], \"expected\": [\"L\", \"ON\", \"R\", \"R\", \"ON\", \"ON\", \"AN\", \"ON\", \"AN\"], \"passed\": false}, {\"check\": \"regression: plus sign between numbers\", \"actual\": [\"ON\", \"L\", \"ON\", \"WS\", \"LRI\", \"L\", \"L\", \"LRI\", \"AN\", \"L\", \"AN\"], \"expected\": [\"ON\", \"L\", \"ON\", \"WS\", \"LRI\", \"L\", \"L\", \"LRI\", \"AN\", \"ON\", \"AN\"], \"passed\": false}, {\"check\": \"partial-repair probe\", \"actual\": [\"ON\", \"WS\", \"ON\", \"EN\", \"ON\", \"ON\"], \"expected\": [\"ON\", \"WS\", \"ON\", \"EN\", \"ON\", \"ON\"], \"passed\": true}, {\"check\": \"partial-repair probe\", \"actual\": [\"L\", \"ON\", \"R\", \"ON\", \"ON\", \"ON\", \"L\", \"L\", \"LRI\", \"PDI\"], \"expected\": [\"L\", \"ON\", \"R\", \"ON\", \"ON\", \"ON\", \"L\", \"L\", \"LRI\", \"PDI\"], \"passed\": true}, {\"check\": \"plus between numbers\", \"actual\": [\"EN\", \"EN\", \"EN\", \"R\"], \"expected\": [\"EN\", \"EN\", \"EN\", \"R\"], \"passed\": true}, {\"check\": \"NSM after isolate initiator\", \"actual\": [\"LRI\", \"ON\", \"L\", \"PDI\"], \"expected\": [\"LRI\", \"ON\", \"L\", \"PDI\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"WS\", \"ON\"], \"expected\": [\"WS\", \"ON\"], \"passed\": true}, {\"check\": \"control layout\", \"actual\": [\"AN\", \"L\", \"ON\", \"WS\", \"AN\", \"R\", \"LRI\", \"R\", \"R\", \"ON\"], \"expected\": [\"AN\", \"L\", \"ON\", \"WS\", \"AN\", \"R\", \"LRI\", \"R\", \"R\", \"ON\"], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}