{"abstract":"Redacted telemetry fields retain arbitrary insertion order.","category":"Observability","checks":7,"contract":"Remove forbidden keys, replace sensitive field values with REDACTED, truncate long public string values, preserve nonstring values, and return keys in lexical order. Forbidden removal dominates sensitive replacement.","contract_signature":"fields, forbidden, sensitive, limit","evaluation_group":"xt-telemetry-redaction","failed_approach":"The attempted repair substitutes for key in sorted(fields, reverse=True):. Fixture 2 still yields [('b', 'hel'), ('a', 'xy')] instead of [('a', 'xy'), ('b', 'hel')].","family":"xt-telemetry-redaction-redaction-order","id":"FA-10351","implementations":{"attempt":{"sha256":"1d20e8450864a625b6917271cad6e8ee934ded2c0a1c8df7cc3641a4b320c4c2","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(fields, forbidden, sensitive, limit):\n    result = {}\n    for key in sorted(fields, reverse=True):\n        if key in forbidden: continue\n        value = fields[key]\n        if key in sensitive: value = 'REDACTED'\n        elif isinstance(value, str): value = value[:limit]\n        result[key] = value\n    return list(result.items())\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, [], [], 3), [])\ncheck('fixture 2', solve({'b': 'hello', 'a': 'xy'}, [], [], 3), [('a', 'xy'), ('b', 'hel')])\ncheck('fixture 3', solve({'a': 'secret'}, ['a'], ['a'], 3), [])\ncheck('fixture 4', solve({'a': 'secret'}, [], ['a'], 3), [('a', 'REDACTED')])\ncheck('fixture 5', solve({'a': 0, 'b': False}, [], [], 3), [('a', 0), ('b', False)])\ncheck('fixture 6', solve({'a': 'hello'}, [], [], 0), [('a', '')])\ncheck('fixture 7', solve({'a': 'abc'}, [], [], 3), [('a', 'abc')])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"87ebff5dcdaf364593dfd870af62c647231f13c1bc5f5eef7fc99fb6f8429326","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(fields, forbidden, sensitive, limit):\n    result = {}\n    for key in fields:\n        if key in forbidden: continue\n        value = fields[key]\n        if key in sensitive: value = 'REDACTED'\n        elif isinstance(value, str): value = value[:limit]\n        result[key] = value\n    return list(result.items())\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1', solve({}, [], [], 3), [])\ncheck('fixture 2', solve({'b': 'hello', 'a': 'xy'}, [], [], 3), [('a', 'xy'), ('b', 'hel')])\ncheck('fixture 3', solve({'a': 'secret'}, ['a'], ['a'], 3), [])\ncheck('fixture 4', solve({'a': 'secret'}, [], ['a'], 3), [('a', 'REDACTED')])\ncheck('fixture 5', solve({'a': 0, 'b': False}, [], [], 3), [('a', 0), ('b', False)])\ncheck('fixture 6', solve({'a': 'hello'}, [], [], 0), [('a', '')])\ncheck('fixture 7', solve({'a': 'abc'}, [], [], 3), [('a', 'abc')])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":" This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"xt-telemetry-redaction-redaction-order","generated_at":"2026-09-29T14:38:38.127772+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"An offline model of structured telemetry field redaction, suitable for testing build and release tooling without external services.","root_cause":"The implementation substitutes for key in fields: for for key in sorted(fields):, so redacted telemetry fields retain arbitrary insertion order.","sha256":"cba6da291fcad37fb1ae05a7827cf1e8c4a5ec8af8df611abbd39c8056939d53","title":"Structured telemetry field redaction: Redacted telemetry fields retain arbitrary insertion order · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":40.815,"exit_code":1,"observations":[{"actual":[],"check":"fixture 1","expected":[],"passed":true},{"actual":[["b","hel"],["a","xy"]],"check":"fixture 2","expected":[["a","xy"],["b","hel"]],"passed":false},{"actual":[],"check":"fixture 3","expected":[],"passed":true},{"actual":[["a","REDACTED"]],"check":"fixture 4","expected":[["a","REDACTED"]],"passed":true},{"actual":[["b",false],["a",0]],"check":"fixture 5","expected":[["a",0],["b",false]],"passed":false},{"actual":[["a",""]],"check":"fixture 6","expected":[["a",""]],"passed":true},{"actual":[["a","abc"]],"check":"fixture 7","expected":[["a","abc"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": [[\"b\", \"hel\"], [\"a\", \"xy\"]], \"expected\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"passed\": false}, {\"check\": \"fixture 3\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": [[\"a\", \"REDACTED\"]], \"expected\": [[\"a\", \"REDACTED\"]], \"passed\": true}, {\"check\": \"fixture 5\", \"actual\": [[\"b\", false], [\"a\", 0]], \"expected\": [[\"a\", 0], [\"b\", false]], \"passed\": false}, {\"check\": \"fixture 6\", \"actual\": [[\"a\", \"\"]], \"expected\": [[\"a\", \"\"]], \"passed\": true}, {\"check\": \"fixture 7\", \"actual\": [[\"a\", \"abc\"]], \"expected\": [[\"a\", \"abc\"]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":42.094,"exit_code":1,"observations":[{"actual":[],"check":"fixture 1","expected":[],"passed":true},{"actual":[["b","hel"],["a","xy"]],"check":"fixture 2","expected":[["a","xy"],["b","hel"]],"passed":false},{"actual":[],"check":"fixture 3","expected":[],"passed":true},{"actual":[["a","REDACTED"]],"check":"fixture 4","expected":[["a","REDACTED"]],"passed":true},{"actual":[["a",0],["b",false]],"check":"fixture 5","expected":[["a",0],["b",false]],"passed":true},{"actual":[["a",""]],"check":"fixture 6","expected":[["a",""]],"passed":true},{"actual":[["a","abc"]],"check":"fixture 7","expected":[["a","abc"]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 2\", \"actual\": [[\"b\", \"hel\"], [\"a\", \"xy\"]], \"expected\": [[\"a\", \"xy\"], [\"b\", \"hel\"]], \"passed\": false}, {\"check\": \"fixture 3\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"fixture 4\", \"actual\": [[\"a\", \"REDACTED\"]], \"expected\": [[\"a\", \"REDACTED\"]], \"passed\": true}, {\"check\": \"fixture 5\", \"actual\": [[\"a\", 0], [\"b\", false]], \"expected\": [[\"a\", 0], [\"b\", false]], \"passed\": true}, {\"check\": \"fixture 6\", \"actual\": [[\"a\", \"\"]], \"expected\": [[\"a\", \"\"]], \"passed\": true}, {\"check\": \"fixture 7\", \"actual\": [[\"a\", \"abc\"]], \"expected\": [[\"a\", \"abc\"]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}