{"abstract":"canonically equivalent text receives separate keys.","category":"Dataset deduplication grouping","checks":6,"contract":"Return the number of distinct NFC-normalized strings; case remains significant.","contract_signature":"values","evaluation_group":"dedup-unicode-nfc","failed_approach":"Case-folding alone does not compose canonically equivalent sequences.","family":"w3-dataset-deduplication-grouping-unicode-normalization-key","id":"FA-100246","implementations":{"attempt":{"sha256":"3e5f1e414658898584c82a66fedb2d9bb08e8753ae62ef81892d5ac1048cad58","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport unicodedata\nN = 1\nobservations = []\ndef solve(values):\n    return len({s.casefold() for s in values})\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('composed form',solve(['é','e\\u0301']),1)\ncheck('case remains distinct',solve(['A','a']),2)\ncheck('empty',solve([]),0)\ncheck('same repeated',solve(['x']*N),1)\ncheck('different accents',solve(['é','ê']),2)\ncheck('normalized alongside plain',solve(['e','e\\u0301']),2)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"9068b12ffbd8099574c64b8970437de272c7515e216aa6b4309e2b17d1aee05b","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport unicodedata\nN = 1\nobservations = []\ndef solve(values):\n    return len(set(values))\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('composed form',solve(['é','e\\u0301']),1)\ncheck('case remains distinct',solve(['A','a']),2)\ncheck('empty',solve([]),0)\ncheck('same repeated',solve(['x']*N),1)\ncheck('different accents',solve(['é','ê']),2)\ncheck('normalized alongside plain',solve(['e','e\\u0301']),2)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Inputs are small in-memory fixtures with the stated contract; results do not claim production deduplication quality. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w3-dataset-deduplication-grouping-unicode-normalization-key","generated_at":"2026-09-30T16:48:33.560779+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"This deterministic toy operation makes one dataset equivalence or representative rule explicit.","root_cause":"The key compares code-point sequences without canonical normalization.","sha256":"b8b8e051122e5f6951320995505c8ae364a38e6d05e7db84b41984a025c3065c","title":"Dataset deduplication: canonically equivalent text receives separate keys · case 01","variant":1,"variant_policy":"The fixture code references N, supplied as 1 through 5. Fixed boundary checks may repeat. These records share one mechanism and must remain together in evaluation splits.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":29.944,"exit_code":1,"observations":[{"actual":2,"check":"composed form","expected":1,"passed":false},{"actual":1,"check":"case remains distinct","expected":2,"passed":false},{"actual":0,"check":"empty","expected":0,"passed":true},{"actual":1,"check":"same repeated","expected":1,"passed":true},{"actual":2,"check":"different accents","expected":2,"passed":true},{"actual":2,"check":"normalized alongside plain","expected":2,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"composed form\", \"actual\": 2, \"expected\": 1, \"passed\": false}, {\"check\": \"case remains distinct\", \"actual\": 1, \"expected\": 2, \"passed\": false}, {\"check\": \"empty\", \"actual\": 0, \"expected\": 0, \"passed\": true}, {\"check\": \"same repeated\", \"actual\": 1, \"expected\": 1, \"passed\": true}, {\"check\": \"different accents\", \"actual\": 2, \"expected\": 2, \"passed\": true}, {\"check\": \"normalized alongside plain\", \"actual\": 2, \"expected\": 2, \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":31.237,"exit_code":1,"observations":[{"actual":2,"check":"composed form","expected":1,"passed":false},{"actual":2,"check":"case remains distinct","expected":2,"passed":true},{"actual":0,"check":"empty","expected":0,"passed":true},{"actual":1,"check":"same repeated","expected":1,"passed":true},{"actual":2,"check":"different accents","expected":2,"passed":true},{"actual":2,"check":"normalized alongside plain","expected":2,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"composed form\", \"actual\": 2, \"expected\": 1, \"passed\": false}, {\"check\": \"case remains distinct\", \"actual\": 2, \"expected\": 2, \"passed\": true}, {\"check\": \"empty\", \"actual\": 0, \"expected\": 0, \"passed\": true}, {\"check\": \"same repeated\", \"actual\": 1, \"expected\": 1, \"passed\": true}, {\"check\": \"different accents\", \"actual\": 2, \"expected\": 2, \"passed\": true}, {\"check\": \"normalized alongside plain\", \"actual\": 2, \"expected\": 2, \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}