{"abstract":"Adding input lengths double-counts the intersection and duplicates.","category":"Statistics","checks":4,"contract":"Integer finite observations and equal lengths for paired samples. Counts and weights are nonnegative. Rational results use reduced Fraction strings. Empty or undefined statistics return None where shown. Duplicates do not affect either set. Two empty sets have similarity one; exactly one empty set has zero. Exact operational definition: str(Fraction(len(set(a)&set(b)),len(set(a)|set(b)))) if a or b else \"1\"","evaluation_group":"model-71c168fa1c58b270","failed_approach":"The overlap coefficient ignores elements outside the smaller set.","family":"xn-jaccard-set-similarity","id":"FA-6291","implementations":{"attempt":{"sha256":"73260e74b0bd421db9102e4803fb8993096d679a563cfac743f42772084e232b","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport math\nimport calendar\nimport statistics\nimport itertools\nfrom fractions import Fraction\nfrom datetime import date, datetime, timedelta, timezone\nfrom decimal import Decimal, ROUND_HALF_UP, ROUND_DOWN, ROUND_CEILING, ROUND_FLOOR\n\nN = 1\nobservations = []\ndef solve(a, b):\n    return str(Fraction(len(set(a)&set(b)),min(len(set(a)),len(set(b))))) if a and b else \"1\"\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1: ([1, 2], [2, 3])', solve(*([1, 2], [2, 3])), '1/3')\ncheck('fixture 2: ([1, 1], [1])', solve(*([1, 1], [1])), '1')\ncheck('fixture 3: ([], [])', solve(*([], [])), '1')\ncheck('fixture 4: ([1], [])', solve(*([1], [])), '0')\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"a8ff40e9d0e59b79d1e3bf593d1c5353c18950c21c8e8c95f0d2c77a8aa61a81","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport math\nimport calendar\nimport statistics\nimport itertools\nfrom fractions import Fraction\nfrom datetime import date, datetime, timedelta, timezone\nfrom decimal import Decimal, ROUND_HALF_UP, ROUND_DOWN, ROUND_CEILING, ROUND_FLOOR\n\nN = 1\nobservations = []\ndef solve(a, b):\n    return str(Fraction(len(set(a)&set(b)),len(a)+len(b))) if a or b else \"1\"\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1: ([1, 2], [2, 3])', solve(*([1, 2], [2, 3])), '1/3')\ncheck('fixture 2: ([1, 1], [1])', solve(*([1, 1], [1])), '1')\ncheck('fixture 3: ([], [])', solve(*([], [])), '1')\ncheck('fixture 4: ([1], [])', solve(*([1], [])), '0')\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"1f6f3df3cee8e5a1f67a79cdb3da32759d847f3d0233366201f67f2c09e75edd","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport math\nimport calendar\nimport statistics\nimport itertools\nfrom fractions import Fraction\nfrom datetime import date, datetime, timedelta, timezone\nfrom decimal import Decimal, ROUND_HALF_UP, ROUND_DOWN, ROUND_CEILING, ROUND_FLOOR\n\nN = 1\nobservations = []\ndef solve(a, b):\n    return str(Fraction(len(set(a)&set(b)),len(set(a)|set(b)))) if a or b else \"1\"\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('fixture 1: ([1, 2], [2, 3])', solve(*([1, 2], [2, 3])), '1/3')\ncheck('fixture 2: ([1, 1], [1])', solve(*([1, 1], [1])), '1')\ncheck('fixture 3: ([], [])', solve(*([], [])), '1')\ncheck('fixture 4: ([1], [])', solve(*([1], [])), '0')\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":" This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"xn-jaccard-set-similarity","generated_at":"2026-09-29T14:37:59.744165+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Small exact fixtures expose this error without platform timing, external services, or probabilistic observations. Statistical estimators results depend on the stated convention.","repair":"Apply the specified mathematical contract directly, preserving all terms and boundary cases: return str(Fraction(len(set(a)&set(b)),len(set(a)|set(b)))) if a or b else \"1\"","root_cause":"Adding input lengths double-counts the intersection and duplicates.","sha256":"3689bde37e6439e9004be97774ca388aaa060edb53d145cd7e0aa89818ec3bed","title":"Jaccard set similarity · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":87.294,"exit_code":1,"observations":[{"actual":"1/2","check":"fixture 1: ([1, 2], [2, 3])","expected":"1/3","passed":false},{"actual":"1","check":"fixture 2: ([1, 1], [1])","expected":"1","passed":true},{"actual":"1","check":"fixture 3: ([], [])","expected":"1","passed":true},{"actual":"1","check":"fixture 4: ([1], [])","expected":"0","passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1: ([1, 2], [2, 3])\", \"actual\": \"1/2\", \"expected\": \"1/3\", \"passed\": false}, {\"check\": \"fixture 2: ([1, 1], [1])\", \"actual\": \"1\", \"expected\": \"1\", \"passed\": true}, {\"check\": \"fixture 3: ([], [])\", \"actual\": \"1\", \"expected\": \"1\", \"passed\": true}, {\"check\": \"fixture 4: ([1], [])\", \"actual\": \"1\", \"expected\": \"0\", \"passed\": false}], \"passed\": false}\n"},"broken":{"elapsed_ms":51.467,"exit_code":1,"observations":[{"actual":"1/4","check":"fixture 1: ([1, 2], [2, 3])","expected":"1/3","passed":false},{"actual":"1/3","check":"fixture 2: ([1, 1], [1])","expected":"1","passed":false},{"actual":"1","check":"fixture 3: ([], [])","expected":"1","passed":true},{"actual":"0","check":"fixture 4: ([1], [])","expected":"0","passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1: ([1, 2], [2, 3])\", \"actual\": \"1/4\", \"expected\": \"1/3\", \"passed\": false}, {\"check\": \"fixture 2: ([1, 1], [1])\", \"actual\": \"1/3\", \"expected\": \"1\", \"passed\": false}, {\"check\": \"fixture 3: ([], [])\", \"actual\": \"1\", \"expected\": \"1\", \"passed\": true}, {\"check\": \"fixture 4: ([1], [])\", \"actual\": \"0\", \"expected\": \"0\", \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":87.794,"exit_code":0,"observations":[{"actual":"1/3","check":"fixture 1: ([1, 2], [2, 3])","expected":"1/3","passed":true},{"actual":"1","check":"fixture 2: ([1, 1], [1])","expected":"1","passed":true},{"actual":"1","check":"fixture 3: ([], [])","expected":"1","passed":true},{"actual":"0","check":"fixture 4: ([1], [])","expected":"0","passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"fixture 1: ([1, 2], [2, 3])\", \"actual\": \"1/3\", \"expected\": \"1/3\", \"passed\": true}, {\"check\": \"fixture 2: ([1, 1], [1])\", \"actual\": \"1\", \"expected\": \"1\", \"passed\": true}, {\"check\": \"fixture 3: ([], [])\", \"actual\": \"1\", \"expected\": \"1\", \"passed\": true}, {\"check\": \"fixture 4: ([1], [])\", \"actual\": \"0\", \"expected\": \"0\", \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}