{"abstract":"Untested artifacts reach the target.","category":"Deployment models","checks":6,"contract":"Reject unknown targets, reject downgrade unless allowed, skip identical digests, reject missing test evidence, otherwise update target to candidate digest and version while preserving other environments.","evaluation_group":"xt-promotion-plan","failed_approach":"The attempted repair substitutes if tested:. Fixture 3 still yields 'untested' instead of {'prod': (1, 'a')}.","family":"xt-promotion-plan-test-evidence","id":"FA-10221","implementations":{"attempt":{"sha256":"2169019d3c93bddfb679f5bd89135fa33f3b2e2006103478601879ffaf79828d","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(environments, target, version, digest, tested, allow_downgrade):\n    if target not in environments: return 'unknown'\n    old_version, old_digest = environments[target]\n    if version < old_version and not allow_downgrade: return 'downgrade'\n    if digest == old_digest: return 'unchanged'\n    if tested: return 'untested'\n    result = dict(environments)\n    result[target] = (version, digest)\n    return result\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, 'prod', 1, 'a', True, False), 'unknown')\ncheck('fixture 2', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, False), 'downgrade')\ncheck('fixture 3', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, True), {'prod': (1, 'a')})\ncheck('fixture 4', solve({'prod': (1, 'a')}, 'prod', 1, 'a', False, False), 'unchanged')\ncheck('fixture 5', solve({'prod': (1, 'a')}, 'prod', 2, 'b', False, False), 'untested')\ncheck('fixture 6', solve({'prod': (1, 'a'), 'stage': (2, 'b')}, 'prod', 2, 'b', True, False), {'prod': (2, 'b'), 'stage': (2, 'b')})\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"38837464f5552fdf12edf54b1cdc9d0a39982f7e2664c7ec3f6719e1272f03ba","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(environments, target, version, digest, tested, allow_downgrade):\n    if target not in environments: return 'unknown'\n    old_version, old_digest = environments[target]\n    if version < old_version and not allow_downgrade: return 'downgrade'\n    if digest == old_digest: return 'unchanged'\n    if False: return 'untested'\n    result = dict(environments)\n    result[target] = (version, digest)\n    return result\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, 'prod', 1, 'a', True, False), 'unknown')\ncheck('fixture 2', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, False), 'downgrade')\ncheck('fixture 3', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, True), {'prod': (1, 'a')})\ncheck('fixture 4', solve({'prod': (1, 'a')}, 'prod', 1, 'a', False, False), 'unchanged')\ncheck('fixture 5', solve({'prod': (1, 'a')}, 'prod', 2, 'b', False, False), 'untested')\ncheck('fixture 6', solve({'prod': (1, 'a'), 'stage': (2, 'b')}, 'prod', 2, 'b', True, False), {'prod': (2, 'b'), 'stage': (2, 'b')})\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"da9ffb36334f677e30b5cece004ddbd130b619c2077b96c8e4b30fa9ea92394c","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(environments, target, version, digest, tested, allow_downgrade):\n    if target not in environments: return 'unknown'\n    old_version, old_digest = environments[target]\n    if version < old_version and not allow_downgrade: return 'downgrade'\n    if digest == old_digest: return 'unchanged'\n    if not tested: return 'untested'\n    result = dict(environments)\n    result[target] = (version, digest)\n    return result\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, 'prod', 1, 'a', True, False), 'unknown')\ncheck('fixture 2', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, False), 'downgrade')\ncheck('fixture 3', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, True), {'prod': (1, 'a')})\ncheck('fixture 4', solve({'prod': (1, 'a')}, 'prod', 1, 'a', False, False), 'unchanged')\ncheck('fixture 5', solve({'prod': (1, 'a')}, 'prod', 2, 'b', False, False), 'untested')\ncheck('fixture 6', solve({'prod': (1, 'a'), 'stage': (2, 'b')}, 'prod', 2, 'b', True, False), {'prod': (2, 'b'), 'stage': (2, 'b')})\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":" This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"xt-promotion-plan-test-evidence","generated_at":"2026-09-29T14:38:36.984364+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"An offline model of environment promotion plan, suitable for testing build and release tooling without external services.","repair":"Require test evidence for an actual promotion.","root_cause":"The implementation substitutes if False: for if not tested:, so untested artifacts reach the target.","sha256":"34606f4d1fbc934b243faa0f1947d1bbcc948848328627647e1cbbf70c350399","title":"Environment promotion plan: Untested artifacts reach the target · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":42.662,"exit_code":1,"observations":[{"actual":"unknown","check":"fixture 1","expected":"unknown","passed":true},{"actual":"downgrade","check":"fixture 2","expected":"downgrade","passed":true},{"actual":"untested","check":"fixture 3","expected":{"prod":[1,"a"]},"passed":false},{"actual":"unchanged","check":"fixture 4","expected":"unchanged","passed":true},{"actual":{"prod":[2,"b"]},"check":"fixture 5","expected":"untested","passed":false},{"actual":"untested","check":"fixture 6","expected":{"prod":[2,"b"],"stage":[2,"b"]},"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": \"unknown\", \"expected\": \"unknown\", \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": \"downgrade\", \"expected\": \"downgrade\", \"passed\": true}, {\"check\": \"fixture 3\", \"actual\": \"untested\", \"expected\": {\"prod\": [1, \"a\"]}, \"passed\": false}, {\"check\": \"fixture 4\", \"actual\": \"unchanged\", \"expected\": \"unchanged\", \"passed\": true}, {\"check\": \"fixture 5\", \"actual\": {\"prod\": [2, \"b\"]}, \"expected\": \"untested\", \"passed\": false}, {\"check\": \"fixture 6\", \"actual\": \"untested\", \"expected\": {\"prod\": [2, \"b\"], \"stage\": [2, \"b\"]}, \"passed\": false}], \"passed\": false}\n"},"broken":{"elapsed_ms":41.362,"exit_code":1,"observations":[{"actual":"unknown","check":"fixture 1","expected":"unknown","passed":true},{"actual":"downgrade","check":"fixture 2","expected":"downgrade","passed":true},{"actual":{"prod":[1,"a"]},"check":"fixture 3","expected":{"prod":[1,"a"]},"passed":true},{"actual":"unchanged","check":"fixture 4","expected":"unchanged","passed":true},{"actual":{"prod":[2,"b"]},"check":"fixture 5","expected":"untested","passed":false},{"actual":{"prod":[2,"b"],"stage":[2,"b"]},"check":"fixture 6","expected":{"prod":[2,"b"],"stage":[2,"b"]},"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": \"unknown\", \"expected\": \"unknown\", \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": \"downgrade\", \"expected\": \"downgrade\", \"passed\": true}, {\"check\": \"fixture 3\", \"actual\": {\"prod\": [1, \"a\"]}, \"expected\": {\"prod\": [1, \"a\"]}, \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": \"unchanged\", \"expected\": \"unchanged\", \"passed\": true}, {\"check\": \"fixture 5\", \"actual\": {\"prod\": [2, \"b\"]}, \"expected\": \"untested\", \"passed\": false}, {\"check\": \"fixture 6\", \"actual\": {\"prod\": [2, \"b\"], \"stage\": [2, \"b\"]}, \"expected\": {\"prod\": [2, \"b\"], \"stage\": [2, \"b\"]}, \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":46.725,"exit_code":0,"observations":[{"actual":"unknown","check":"fixture 1","expected":"unknown","passed":true},{"actual":"downgrade","check":"fixture 2","expected":"downgrade","passed":true},{"actual":{"prod":[1,"a"]},"check":"fixture 3","expected":{"prod":[1,"a"]},"passed":true},{"actual":"unchanged","check":"fixture 4","expected":"unchanged","passed":true},{"actual":"untested","check":"fixture 5","expected":"untested","passed":true},{"actual":{"prod":[2,"b"],"stage":[2,"b"]},"check":"fixture 6","expected":{"prod":[2,"b"],"stage":[2,"b"]},"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": \"unknown\", \"expected\": \"unknown\", \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": \"downgrade\", \"expected\": \"downgrade\", \"passed\": true}, {\"check\": \"fixture 3\", \"actual\": {\"prod\": [1, \"a\"]}, \"expected\": {\"prod\": [1, \"a\"]}, \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": \"unchanged\", \"expected\": \"unchanged\", \"passed\": true}, {\"check\": \"fixture 5\", \"actual\": \"untested\", \"expected\": \"untested\", \"passed\": true}, {\"check\": \"fixture 6\", \"actual\": {\"prod\": [2, \"b\"], \"stage\": [2, \"b\"]}, \"expected\": {\"prod\": [2, \"b\"], \"stage\": [2, \"b\"]}, \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}