{"abstract":"Filtering examples leaves the original label list attached.","category":"Training label alignment","checks":7,"contract":"Examples and labels have equal length. Keep pairs where the example passes predicate flag; preserve order and all label values.","contract_signature":"examples, labels","evaluation_group":"training-label-alignment-paired-filter","failed_approach":"Filtering labels by truthiness drops legitimate zero labels and still misaligns later rows.","family":"w3-training-label-alignment-filtered-row-label-pairs","id":"FA-97956","implementations":{"attempt":{"sha256":"0d84f0185e8fc1cdb3a0dd7c486daacb8c6ecc12d48d4627635a24da1c880950","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(examples, labels):\n    return [[e,y] for e,y in zip(examples,labels) if e[1] and y]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('zero label kept',solve([['a',True],['b',False]],[0,N]),[['a',0]])\ncheck('middle retained',solve([['a',False],['b',True],['c',True]],[N,N+1,N+2]),[['b',N+1],['c',N+2]])\ncheck('all filtered',solve([[0,False]],[N]),[])\ncheck('empty input',solve([],[]),[])\ncheck('false payload',solve([[0,True]],[False]),[[0,False]])\ncheck('single retained',solve([['x',True]],['label']),[['x','label']])\ncheck('order preserved',solve([['c',True],['a',True]],[N+1,N]),[['c',N+1],['a',N]])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"3b3662413262fe4721309a106212d8f0a8643e8de31dae9651c8b74293b97b88","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(examples, labels):\n    kept=[e for e in examples if e[1]]\n    return [[e[0],y] for e,y in zip(kept,labels)]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('zero label kept',solve([['a',True],['b',False]],[0,N]),[['a',0]])\ncheck('middle retained',solve([['a',False],['b',True],['c',True]],[N,N+1,N+2]),[['b',N+1],['c',N+2]])\ncheck('all filtered',solve([[0,False]],[N]),[])\ncheck('empty input',solve([],[]),[])\ncheck('false payload',solve([[0,True]],[False]),[[0,False]])\ncheck('single retained',solve([['x',True]],['label']),[['x','label']])\ncheck('order preserved',solve([['c',True],['a',True]],[N+1,N]),[['c',N+1],['a',N]])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Example rows are [payload,keep_flag], and lengths are equal. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w3-training-label-alignment-filtered-row-label-pairs","generated_at":"2026-09-30T16:48:07.548646+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"A small deterministic training-data operation makes label ownership and ordering explicit.","root_cause":"The filter is applied to examples after positional pairs have been discarded.","sha256":"d012f5ec976db8254252314ca1bb41d70fcf489b409255a3b515be49718f5756","title":"Filtering examples leaves the original label list attached · case 01","variant":1,"variant_policy":"The fixture code references N, supplied as 1 through 5. Fixed boundary checks may repeat. These records share one mechanism and must remain together in evaluation splits.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":27.249,"exit_code":1,"observations":[{"actual":[],"check":"zero label kept","expected":[["a",0]],"passed":false},{"actual":[[["b",true],2],[["c",true],3]],"check":"middle retained","expected":[["b",2],["c",3]],"passed":false},{"actual":[],"check":"all filtered","expected":[],"passed":true},{"actual":[],"check":"empty input","expected":[],"passed":true},{"actual":[],"check":"false payload","expected":[[0,false]],"passed":false},{"actual":[[["x",true],"label"]],"check":"single retained","expected":[["x","label"]],"passed":false},{"actual":[[["c",true],2],[["a",true],1]],"check":"order preserved","expected":[["c",2],["a",1]],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"zero label kept\", \"actual\": [], \"expected\": [[\"a\", 0]], \"passed\": false}, {\"check\": \"middle retained\", \"actual\": [[[\"b\", true], 2], [[\"c\", true], 3]], \"expected\": [[\"b\", 2], [\"c\", 3]], \"passed\": false}, {\"check\": \"all filtered\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"empty input\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"false payload\", \"actual\": [], \"expected\": [[0, false]], \"passed\": false}, {\"check\": \"single retained\", \"actual\": [[[\"x\", true], \"label\"]], \"expected\": [[\"x\", \"label\"]], \"passed\": false}, {\"check\": \"order preserved\", \"actual\": [[[\"c\", true], 2], [[\"a\", true], 1]], \"expected\": [[\"c\", 2], [\"a\", 1]], \"passed\": false}], \"passed\": false}\n"},"broken":{"elapsed_ms":26.651,"exit_code":1,"observations":[{"actual":[["a",0]],"check":"zero label kept","expected":[["a",0]],"passed":true},{"actual":[["b",1],["c",2]],"check":"middle retained","expected":[["b",2],["c",3]],"passed":false},{"actual":[],"check":"all filtered","expected":[],"passed":true},{"actual":[],"check":"empty input","expected":[],"passed":true},{"actual":[[0,false]],"check":"false payload","expected":[[0,false]],"passed":true},{"actual":[["x","label"]],"check":"single retained","expected":[["x","label"]],"passed":true},{"actual":[["c",2],["a",1]],"check":"order preserved","expected":[["c",2],["a",1]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"zero label kept\", \"actual\": [[\"a\", 0]], \"expected\": [[\"a\", 0]], \"passed\": true}, {\"check\": \"middle retained\", \"actual\": [[\"b\", 1], [\"c\", 2]], \"expected\": [[\"b\", 2], [\"c\", 3]], \"passed\": false}, {\"check\": \"all filtered\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"empty input\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"false payload\", \"actual\": [[0, false]], \"expected\": [[0, false]], \"passed\": true}, {\"check\": \"single retained\", \"actual\": [[\"x\", \"label\"]], \"expected\": [[\"x\", \"label\"]], \"passed\": true}, {\"check\": \"order preserved\", \"actual\": [[\"c\", 2], [\"a\", 1]], \"expected\": [[\"c\", 2], [\"a\", 1]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}