{"abstract":"Token labels leak across neighboring annotations.","category":"Annotation span alignment","checks":7,"contract":"For each token interval, emit labels in annotation order whose half-open intervals positively overlap it.","contract_signature":"tokens, spans","evaluation_group":"annotation-span-token-label-projection","failed_approach":"Checking only token start drops a label when an annotation begins inside a token.","family":"w3-annotation-span-alignment-token-label-projection","id":"FA-100166","implementations":{"attempt":{"sha256":"6dc17ded388b589e003c1e6414c897a27c8a2c568c12d0437c4fb31b1738a8e5","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(tokens, spans):\n    return [[label for s,e,label in spans if s<=a<e] for a,b in tokens]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('inside token overlap', solve([[0,4]],[[3,6,'x']]), [['x']])\ncheck('left touching excluded', solve([[0,3]],[[3,6,'x']]), [[]])\ncheck('right touching excluded', solve([[6,9]],[[3,6,'x']]), [[]])\ncheck('two labels preserve order', solve([[2,7]],[[0,4,'a'],[5,8,'b']]), [['a','b']])\ncheck('empty annotation set', solve([[0,2]],[]), [[]])\ncheck('empty token set', solve([],[[0,2,'x']]), [])\ncheck('identical bounds', solve([[N,N+2]],[[N,N+2,'q']]), [['q']])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"047fd49dcae1535ac330edc322840c3c03c40d051dcfd41fa3bf5c6da62be558","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(tokens, spans):\n    return [[label for s,e,label in spans if a<=e and s<=b] for a,b in tokens]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('inside token overlap', solve([[0,4]],[[3,6,'x']]), [['x']])\ncheck('left touching excluded', solve([[0,3]],[[3,6,'x']]), [[]])\ncheck('right touching excluded', solve([[6,9]],[[3,6,'x']]), [[]])\ncheck('two labels preserve order', solve([[2,7]],[[0,4,'a'],[5,8,'b']]), [['a','b']])\ncheck('empty annotation set', solve([[0,2]],[]), [[]])\ncheck('empty token set', solve([],[[0,2,'x']]), [])\ncheck('identical bounds', solve([[N,N+2]],[[N,N+2,'q']]), [['q']])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Contracts use integer offsets, explicit edits, and supplied token boundaries; they do not define a tokenizer or production annotation format. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w3-annotation-span-alignment-token-label-projection","generated_at":"2026-09-30T16:48:32.646179+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"A small offline annotation transformation keeps span coordinates explicit when text or token boundaries change.","root_cause":"A token is labeled by any annotation with an inclusive endpoint touch.","sha256":"8c26b4bd5479923b491890bea93af65a33b4fd329c65c530904919fc273e2ab0","title":"Token labels leak across neighboring annotations · case 01","variant":1,"variant_policy":"The fixture code references N, supplied as 1 through 5. Fixed boundary checks may repeat. These records share one mechanism and must remain together in evaluation splits.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":27.752,"exit_code":1,"observations":[{"actual":[[]],"check":"inside token overlap","expected":[["x"]],"passed":false},{"actual":[[]],"check":"left touching excluded","expected":[[]],"passed":true},{"actual":[[]],"check":"right touching excluded","expected":[[]],"passed":true},{"actual":[["a"]],"check":"two labels preserve order","expected":[["a","b"]],"passed":false},{"actual":[[]],"check":"empty annotation set","expected":[[]],"passed":true},{"actual":[],"check":"empty token set","expected":[],"passed":true},{"actual":[["q"]],"check":"identical bounds","expected":[["q"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"inside token overlap\", \"actual\": [[]], \"expected\": [[\"x\"]], \"passed\": false}, {\"check\": \"left touching excluded\", \"actual\": [[]], \"expected\": [[]], \"passed\": true}, {\"check\": \"right touching excluded\", \"actual\": [[]], \"expected\": [[]], \"passed\": true}, {\"check\": \"two labels preserve order\", \"actual\": [[\"a\"]], \"expected\": [[\"a\", \"b\"]], \"passed\": false}, {\"check\": \"empty annotation set\", \"actual\": [[]], \"expected\": [[]], \"passed\": true}, {\"check\": \"empty token set\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"identical bounds\", \"actual\": [[\"q\"]], \"expected\": [[\"q\"]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":28.434,"exit_code":1,"observations":[{"actual":[["x"]],"check":"inside token overlap","expected":[["x"]],"passed":true},{"actual":[["x"]],"check":"left touching excluded","expected":[[]],"passed":false},{"actual":[["x"]],"check":"right touching excluded","expected":[[]],"passed":false},{"actual":[["a","b"]],"check":"two labels preserve order","expected":[["a","b"]],"passed":true},{"actual":[[]],"check":"empty annotation set","expected":[[]],"passed":true},{"actual":[],"check":"empty token set","expected":[],"passed":true},{"actual":[["q"]],"check":"identical bounds","expected":[["q"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"inside token overlap\", \"actual\": [[\"x\"]], \"expected\": [[\"x\"]], \"passed\": true}, {\"check\": \"left touching excluded\", \"actual\": [[\"x\"]], \"expected\": [[]], \"passed\": false}, {\"check\": \"right touching excluded\", \"actual\": [[\"x\"]], \"expected\": [[]], \"passed\": false}, {\"check\": \"two labels preserve order\", \"actual\": [[\"a\", \"b\"]], \"expected\": [[\"a\", \"b\"]], \"passed\": true}, {\"check\": \"empty annotation set\", \"actual\": [[]], \"expected\": [[]], \"passed\": true}, {\"check\": \"empty token set\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"identical bounds\", \"actual\": [[\"q\"]], \"expected\": [[\"q\"]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}