{"abstract":"unexpected checkpoint tensors are accepted.","category":"Checkpoint tensor mapping","checks":6,"contract":"Return missing and unexpected names as sorted lists in a pair; names present in both sets are matched.","contract_signature":"expected, incoming","evaluation_group":"w3-checkpoint-tensor-mapping-name-coverage","failed_approach":"Reporting only the first extra name misses simultaneous unexpected entries.","family":"w3-checkpoint-tensor-mapping-name-coverage","id":"FA-99171","implementations":{"attempt":{"sha256":"596d0648dff70ae8d25ccadd6e5fa96963599549a75cff0e0369a1a20de0fd47","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(expected, incoming):\n    return (sorted(set(expected)-set(incoming)), sorted(set(incoming)-set(expected))[:1])\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('extra many', solve(*(['a'], ['a', 'z', 'y'])), ([], ['y', 'z']))\ncheck('missing', solve(*(['a', 'b'], ['a'])), (['b'], []))\ncheck('exact', solve(*(['a'], ['a'])), ([], []))\ncheck('both empty', solve(*([], [])), ([], []))\ncheck('all extra', solve(*([], ['z', 'y'])), ([], ['y', 'z']))\ncheck('mixed', solve(*(['a', 'b'], ['a', 'x'])), (['b'], ['x']))\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"19eb465224b86eea67bc1870056d4cfcdd9685313a6e7d2fc20849a53d759e0f","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(expected, incoming):\n    return (sorted(set(expected)-set(incoming)), [])\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('extra many', solve(*(['a'], ['a', 'z', 'y'])), ([], ['y', 'z']))\ncheck('missing', solve(*(['a', 'b'], ['a'])), (['b'], []))\ncheck('exact', solve(*(['a'], ['a'])), ([], []))\ncheck('both empty', solve(*([], [])), ([], []))\ncheck('all extra', solve(*([], ['z', 'y'])), ([], ['y', 'z']))\ncheck('mixed', solve(*(['a', 'b'], ['a', 'x'])), (['b'], ['x']))\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Inputs are already decoded Python values; this toy contract makes no claim about a framework, file format, or production checkpoint. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w3-checkpoint-tensor-mapping-name-coverage","generated_at":"2026-09-30T16:48:21.244030+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"A bounded offline model of checkpoint tensor bookkeeping in a training workflow.","root_cause":"Only missing names are reported, concealing unexpected payloads.","sha256":"4eddc04a08c4f0b12edfc62a6382e9d7d6660b62bc8fad8536c355bed872da0d","title":"Checkpoint mapping: unexpected checkpoint tensors are accepted · case 01","variant":1,"variant_policy":"The same explicitly authored fixtures repeat across all five numbered records; runtime N is unused. These records share one mechanism and must remain together in evaluation splits.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":27.844,"exit_code":1,"observations":[{"actual":[[],["y"]],"check":"extra many","expected":[[],["y","z"]],"passed":false},{"actual":[["b"],[]],"check":"missing","expected":[["b"],[]],"passed":true},{"actual":[[],[]],"check":"exact","expected":[[],[]],"passed":true},{"actual":[[],[]],"check":"both empty","expected":[[],[]],"passed":true},{"actual":[[],["y"]],"check":"all extra","expected":[[],["y","z"]],"passed":false},{"actual":[["b"],["x"]],"check":"mixed","expected":[["b"],["x"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"extra many\", \"actual\": [[], [\"y\"]], \"expected\": [[], [\"y\", \"z\"]], \"passed\": false}, {\"check\": \"missing\", \"actual\": [[\"b\"], []], \"expected\": [[\"b\"], []], \"passed\": true}, {\"check\": \"exact\", \"actual\": [[], []], \"expected\": [[], []], \"passed\": true}, {\"check\": \"both empty\", \"actual\": [[], []], \"expected\": [[], []], \"passed\": true}, {\"check\": \"all extra\", \"actual\": [[], [\"y\"]], \"expected\": [[], [\"y\", \"z\"]], \"passed\": false}, {\"check\": \"mixed\", \"actual\": [[\"b\"], [\"x\"]], \"expected\": [[\"b\"], [\"x\"]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":28.042,"exit_code":1,"observations":[{"actual":[[],[]],"check":"extra many","expected":[[],["y","z"]],"passed":false},{"actual":[["b"],[]],"check":"missing","expected":[["b"],[]],"passed":true},{"actual":[[],[]],"check":"exact","expected":[[],[]],"passed":true},{"actual":[[],[]],"check":"both empty","expected":[[],[]],"passed":true},{"actual":[[],[]],"check":"all extra","expected":[[],["y","z"]],"passed":false},{"actual":[["b"],[]],"check":"mixed","expected":[["b"],["x"]],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"extra many\", \"actual\": [[], []], \"expected\": [[], [\"y\", \"z\"]], \"passed\": false}, {\"check\": \"missing\", \"actual\": [[\"b\"], []], \"expected\": [[\"b\"], []], \"passed\": true}, {\"check\": \"exact\", \"actual\": [[], []], \"expected\": [[], []], \"passed\": true}, {\"check\": \"both empty\", \"actual\": [[], []], \"expected\": [[], []], \"passed\": true}, {\"check\": \"all extra\", \"actual\": [[], []], \"expected\": [[], [\"y\", \"z\"]], \"passed\": false}, {\"check\": \"mixed\", \"actual\": [[\"b\"], []], \"expected\": [[\"b\"], [\"x\"]], \"passed\": false}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}