{"abstract":"Sensitive values escape telemetry redaction.","category":"Observability","checks":7,"contract":"Remove forbidden keys, replace sensitive field values with REDACTED, truncate long public string values, preserve nonstring values, and return keys in lexical order. Forbidden removal dominates sensitive replacement.","evaluation_group":"xt-telemetry-redaction","failed_approach":"The attempted repair substitutes if key in sensitive: value = value[:limit]. Fixture 4 still yields [('a', 'sec')] instead of [('a', 'REDACTED')].","family":"xt-telemetry-redaction-sensitive-value","id":"FA-10336","implementations":{"attempt":{"sha256":"da3f6a6ce1dae5acc1f3f3dcf1898b0aed3c743f2778a74b169a749a9ff201a5","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(fields, forbidden, sensitive, limit):\n    result = {}\n    for key in sorted(fields):\n        if key in forbidden: continue\n        value = fields[key]\n        if key in sensitive: value = value[:limit]\n        elif isinstance(value, str): value = value[:limit]\n        result[key] = value\n    return list(result.items())\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, [], [], 3), [])\ncheck('fixture 2', solve({'b': 'hello', 'a': 'xy'}, [], [], 3), [('a', 'xy'), ('b', 'hel')])\ncheck('fixture 3', solve({'a': 'secret'}, ['a'], ['a'], 3), [])\ncheck('fixture 4', solve({'a': 'secret'}, [], ['a'], 3), [('a', 'REDACTED')])\ncheck('fixture 5', solve({'a': 0, 'b': False}, [], [], 3), [('a', 0), ('b', False)])\ncheck('fixture 6', solve({'a': 'hello'}, [], [], 0), [('a', '')])\ncheck('fixture 7', solve({'a': 'abc'}, [], [], 3), [('a', 'abc')])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"68cd4db06d94a29ee647449a92e64a708aab1531460b87cf6ac70d5e530f9734","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(fields, forbidden, sensitive, limit):\n    result = {}\n    for key in sorted(fields):\n        if key in forbidden: continue\n        value = fields[key]\n        if False: value = 'REDACTED'\n        elif isinstance(value, str): value = value[:limit]\n        result[key] = value\n    return list(result.items())\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, [], [], 3), [])\ncheck('fixture 2', solve({'b': 'hello', 'a': 'xy'}, [], [], 3), [('a', 'xy'), ('b', 'hel')])\ncheck('fixture 3', solve({'a': 'secret'}, ['a'], ['a'], 3), [])\ncheck('fixture 4', solve({'a': 'secret'}, [], ['a'], 3), [('a', 'REDACTED')])\ncheck('fixture 5', solve({'a': 0, 'b': False}, [], [], 3), [('a', 0), ('b', False)])\ncheck('fixture 6', solve({'a': 'hello'}, [], [], 0), [('a', '')])\ncheck('fixture 7', solve({'a': 'abc'}, [], [], 3), [('a', 'abc')])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"169f7043df42461de1fb63a690c7e1f5176f86c68bc043da8a33a4640416f00a","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(fields, forbidden, sensitive, limit):\n    result = {}\n    for key in sorted(fields):\n        if key in forbidden: continue\n        value = fields[key]\n        if key in sensitive: value = 'REDACTED'\n        elif isinstance(value, str): value = value[:limit]\n        result[key] = value\n    return list(result.items())\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, [], [], 3), [])\ncheck('fixture 2', solve({'b': 'hello', 'a': 'xy'}, [], [], 3), [('a', 'xy'), ('b', 'hel')])\ncheck('fixture 3', solve({'a': 'secret'}, ['a'], ['a'], 3), [])\ncheck('fixture 4', solve({'a': 'secret'}, [], ['a'], 3), [('a', 'REDACTED')])\ncheck('fixture 5', solve({'a': 0, 'b': False}, [], [], 3), [('a', 0), ('b', False)])\ncheck('fixture 6', solve({'a': 'hello'}, [], [], 0), [('a', '')])\ncheck('fixture 7', solve({'a': 'abc'}, [], [], 3), [('a', 'abc')])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":" This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"xt-telemetry-redaction-sensitive-value","generated_at":"2026-09-29T14:38:38.050062+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"An offline model of structured telemetry field redaction, suitable for testing build and release tooling without external services.","repair":"Replace sensitive values with the fixed redaction marker.","root_cause":"The implementation substitutes if False: value = 'REDACTED' for if key in sensitive: value = 'REDACTED', so sensitive values escape telemetry redaction.","sha256":"accc3462dec70ee7dfef5bd065c9bbae9447412e59b3295724ba393aa59bd402","title":"Structured telemetry field redaction: Sensitive values escape telemetry redaction · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":38.983,"exit_code":1,"observations":[{"actual":[],"check":"fixture 1","expected":[],"passed":true},{"actual":[["a","xy"],["b","hel"]],"check":"fixture 2","expected":[["a","xy"],["b","hel"]],"passed":true},{"actual":[],"check":"fixture 3","expected":[],"passed":true},{"actual":[["a","sec"]],"check":"fixture 4","expected":[["a","REDACTED"]],"passed":false},{"actual":[["a",0],["b",false]],"check":"fixture 5","expected":[["a",0],["b",false]],"passed":true},{"actual":[["a",""]],"check":"fixture 6","expected":[["a",""]],"passed":true},{"actual":[["a","abc"]],"check":"fixture 7","expected":[["a","abc"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"expected\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"passed\": true}, {\"check\": \"fixture 3\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": [[\"a\", \"sec\"]], \"expected\": [[\"a\", \"REDACTED\"]], \"passed\": false}, {\"check\": \"fixture 5\", \"actual\": [[\"a\", 0], [\"b\", false]], \"expected\": [[\"a\", 0], [\"b\", false]], \"passed\": true}, {\"check\": \"fixture 6\", \"actual\": [[\"a\", \"\"]], \"expected\": [[\"a\", \"\"]], \"passed\": true}, {\"check\": \"fixture 7\", \"actual\": [[\"a\", \"abc\"]], \"expected\": [[\"a\", \"abc\"]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":42.368,"exit_code":1,"observations":[{"actual":[],"check":"fixture 1","expected":[],"passed":true},{"actual":[["a","xy"],["b","hel"]],"check":"fixture 2","expected":[["a","xy"],["b","hel"]],"passed":true},{"actual":[],"check":"fixture 3","expected":[],"passed":true},{"actual":[["a","sec"]],"check":"fixture 4","expected":[["a","REDACTED"]],"passed":false},{"actual":[["a",0],["b",false]],"check":"fixture 5","expected":[["a",0],["b",false]],"passed":true},{"actual":[["a",""]],"check":"fixture 6","expected":[["a",""]],"passed":true},{"actual":[["a","abc"]],"check":"fixture 7","expected":[["a","abc"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"expected\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"passed\": true}, {\"check\": \"fixture 3\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": [[\"a\", \"sec\"]], \"expected\": [[\"a\", \"REDACTED\"]], \"passed\": false}, {\"check\": \"fixture 5\", \"actual\": [[\"a\", 0], [\"b\", false]], \"expected\": [[\"a\", 0], [\"b\", false]], \"passed\": true}, {\"check\": \"fixture 6\", \"actual\": [[\"a\", \"\"]], \"expected\": [[\"a\", \"\"]], \"passed\": true}, {\"check\": \"fixture 7\", \"actual\": [[\"a\", \"abc\"]], \"expected\": [[\"a\", \"abc\"]], \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":43.049,"exit_code":0,"observations":[{"actual":[],"check":"fixture 1","expected":[],"passed":true},{"actual":[["a","xy"],["b","hel"]],"check":"fixture 2","expected":[["a","xy"],["b","hel"]],"passed":true},{"actual":[],"check":"fixture 3","expected":[],"passed":true},{"actual":[["a","REDACTED"]],"check":"fixture 4","expected":[["a","REDACTED"]],"passed":true},{"actual":[["a",0],["b",false]],"check":"fixture 5","expected":[["a",0],["b",false]],"passed":true},{"actual":[["a",""]],"check":"fixture 6","expected":[["a",""]],"passed":true},{"actual":[["a","abc"]],"check":"fixture 7","expected":[["a","abc"]],"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"expected\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"passed\": true}, {\"check\": \"fixture 3\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": [[\"a\", \"REDACTED\"]], \"expected\": [[\"a\", \"REDACTED\"]], \"passed\": true}, {\"check\": \"fixture 5\", \"actual\": [[\"a\", 0], [\"b\", false]], \"expected\": [[\"a\", 0], [\"b\", false]], \"passed\": true}, {\"check\": \"fixture 6\", \"actual\": [[\"a\", \"\"]], \"expected\": [[\"a\", \"\"]], \"passed\": true}, {\"check\": \"fixture 7\", \"actual\": [[\"a\", \"abc\"]], \"expected\": [[\"a\", \"abc\"]], \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}