{"abstract":"A defense allowing exactly 6 points lands in the 7-13 tier.","category":"Fantasy sports scoring","checks":7,"contract":"Score a team defense/special teams unit in hundredths. Points allowed exclude points the opponent scored on returns against our offense. Tiers: 0 -> 10, 1-6 -> 7, 7-13 -> 4, 14-20 -> 1, 21-27 -> 0, 28-34 -> -1, 35+ -> -4. Yards allowed: <=99 -> 5, 100-199 -> 3, 200-299 -> 2, 300-349 -> 0, 350-399 -> -1, 400-449 -> -3, 450+ -> -5. Sacks are recorded in half-sack units and score 1 per full sack (0.5 per half). Interceptions and opponent fumbles recovered 2 each (own fumble recoveries score nothing), safety 2, defensive or special-teams TD 6, blocked kick 2.","evaluation_group":"w2-fantasy-sports-scoring-team-defense","failed_approach":"Moving only the shutout limit to 1 repairs zero points allowed but every other tier edge stays shifted.","family":"w2-fantasy-sports-scoring-team-defense-points-allowed-tier-comparator","id":"FA-84881","implementations":{"attempt":{"sha256":"706987831a4f3a6e77e680a9c46d3e8120aa2e823eb42e9ab99e89f0d70ee9ab","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(game):\n    pa = game['pa_total'] - game['pa_offense_returns']\n    tiers = [(1, 1000), (6, 700), (13, 400), (20, 100), (27, 0), (34, -100)]\n    pts = -400\n    for limit, value in tiers:\n        if pa < limit:\n            pts = value\n            break\n    ya = game['yards_allowed']\n    ytiers = [(99, 500), (199, 300), (299, 200), (349, 0), (399, -100), (449, -300)]\n    ypts = -500\n    for limit, value in ytiers:\n        if ya <= limit:\n            ypts = value\n            break\n    pts += ypts\n    pts += game['sack_halves'] * 50\n    pts += game['ints'] * 200 + game['fum_rec'] * 200\n    pts += game['safeties'] * 200\n    pts += (game['def_td'] + game['st_td']) * 600\n    pts += game['blocked_kicks'] * 200\n    return pts\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 15,\n     'sack_halves': 6,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 200}],\n   2500),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 20,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 100}],\n   2800),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 6,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 300}],\n   2650),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 9,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 272}],\n   2250),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 43,\n     'sack_halves': 6,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 299}],\n   2100),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 21,\n     'sack_halves': 7,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   2750),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 7,\n     'pa_total': 42,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   1150)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 34,\n     'sack_halves': 4,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 200}],\n   1200),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 13,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   2550),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 7,\n     'pa_total': 7,\n     'sack_halves': 6,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 450}],\n   3000),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 23,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 449}],\n   750),\n  ('normal control 2',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 6,\n     'pa_total': 20,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 400}],\n   850),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 9,\n     'sack_halves': 6,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 100}],\n   2400),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 30,\n     'sack_halves': 5,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   2250)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 0,\n     'pa_total': 0,\n     'sack_halves': 7,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   3050),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 12,\n     'sack_halves': 3,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 400}],\n   1750),\n  ('second regression',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 34,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   950),\n  ('normal control 1',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 41,\n     'sack_halves': 8,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 300}],\n   1200),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 0,\n     'pa_total': 35,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 200}],\n   2250),\n  ('normal control 3',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 4,\n     'sack_halves': 1,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 449}],\n   1250),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 14,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 183}],\n   1350)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 2,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 495}],\n   1300),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 6,\n     'pa_total': 33,\n     'sack_halves': 9,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 199}],\n   2750),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 13,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 300}],\n   1850),\n  ('normal control 1',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 14,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 450}],\n   1750),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 40,\n     'sack_halves': 7,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 100}],\n   850),\n  ('normal control 3',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 42,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 400}],\n   -50),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 35,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 299}],\n   1550)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 2,\n     'sack_halves': 4,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 349}],\n   3600),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 7,\n     'pa_total': 34,\n     'sack_halves': 2,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 200}],\n   1100),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 0,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 6,\n     'pa_total': 6,\n     'sack_halves': 1,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 399}],\n   2150),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 14,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 170}],\n   1400),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 1,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 6,\n     'pa_total': 20,\n     'sack_halves': 8,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 349}],\n   1900),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 7,\n     'pa_total': 30,\n     'sack_halves': 3,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   1450),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 21,\n     'sack_halves': 0,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 99}],\n   2200)]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"c8f97dc3eb8cabac420fbe5ff20a5cb402248f8ee6ccf9b59bc6f9b111c01f30","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(game):\n    pa = game['pa_total'] - game['pa_offense_returns']\n    tiers = [(0, 1000), (6, 700), (13, 400), (20, 100), (27, 0), (34, -100)]\n    pts = -400\n    for limit, value in tiers:\n        if pa < limit:\n            pts = value\n            break\n    ya = game['yards_allowed']\n    ytiers = [(99, 500), (199, 300), (299, 200), (349, 0), (399, -100), (449, -300)]\n    ypts = -500\n    for limit, value in ytiers:\n        if ya <= limit:\n            ypts = value\n            break\n    pts += ypts\n    pts += game['sack_halves'] * 50\n    pts += game['ints'] * 200 + game['fum_rec'] * 200\n    pts += game['safeties'] * 200\n    pts += (game['def_td'] + game['st_td']) * 600\n    pts += game['blocked_kicks'] * 200\n    return pts\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 15,\n     'sack_halves': 6,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 200}],\n   2500),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 20,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 100}],\n   2800),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 6,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 300}],\n   2650),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 9,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 272}],\n   2250),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 43,\n     'sack_halves': 6,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 299}],\n   2100),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 21,\n     'sack_halves': 7,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   2750),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 7,\n     'pa_total': 42,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   1150)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 34,\n     'sack_halves': 4,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 200}],\n   1200),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 13,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   2550),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 7,\n     'pa_total': 7,\n     'sack_halves': 6,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 450}],\n   3000),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 23,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 449}],\n   750),\n  ('normal control 2',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 6,\n     'pa_total': 20,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 400}],\n   850),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 9,\n     'sack_halves': 6,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 100}],\n   2400),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 30,\n     'sack_halves': 5,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   2250)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 0,\n     'pa_total': 0,\n     'sack_halves': 7,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   3050),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 12,\n     'sack_halves': 3,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 400}],\n   1750),\n  ('second regression',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 34,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   950),\n  ('normal control 1',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 41,\n     'sack_halves': 8,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 300}],\n   1200),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 0,\n     'pa_total': 35,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 200}],\n   2250),\n  ('normal control 3',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 4,\n     'sack_halves': 1,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 449}],\n   1250),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 14,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 183}],\n   1350)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 2,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 495}],\n   1300),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 6,\n     'pa_total': 33,\n     'sack_halves': 9,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 199}],\n   2750),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 13,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 300}],\n   1850),\n  ('normal control 1',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 14,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 450}],\n   1750),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 40,\n     'sack_halves': 7,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 100}],\n   850),\n  ('normal control 3',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 42,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 400}],\n   -50),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 35,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 299}],\n   1550)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 2,\n     'sack_halves': 4,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 349}],\n   3600),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 7,\n     'pa_total': 34,\n     'sack_halves': 2,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 200}],\n   1100),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 0,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 6,\n     'pa_total': 6,\n     'sack_halves': 1,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 399}],\n   2150),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 14,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 170}],\n   1400),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 1,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 6,\n     'pa_total': 20,\n     'sack_halves': 8,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 349}],\n   1900),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 7,\n     'pa_total': 30,\n     'sack_halves': 3,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   1450),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 21,\n     'sack_halves': 0,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 99}],\n   2200)]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"1abc1b60f02dad63a08c19dc0561c6d92241111c50f7cb04f9b6842cc410ae2d","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(game):\n    pa = game['pa_total'] - game['pa_offense_returns']\n    tiers = [(0, 1000), (6, 700), (13, 400), (20, 100), (27, 0), (34, -100)]\n    pts = -400\n    for limit, value in tiers:\n        if pa <= limit:\n            pts = value\n            break\n    ya = game['yards_allowed']\n    ytiers = [(99, 500), (199, 300), (299, 200), (349, 0), (399, -100), (449, -300)]\n    ypts = -500\n    for limit, value in ytiers:\n        if ya <= limit:\n            ypts = value\n            break\n    pts += ypts\n    pts += game['sack_halves'] * 50\n    pts += game['ints'] * 200 + game['fum_rec'] * 200\n    pts += game['safeties'] * 200\n    pts += (game['def_td'] + game['st_td']) * 600\n    pts += game['blocked_kicks'] * 200\n    return pts\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 15,\n     'sack_halves': 6,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 200}],\n   2500),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 20,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 100}],\n   2800),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 6,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 300}],\n   2650),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 9,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 272}],\n   2250),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 43,\n     'sack_halves': 6,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 299}],\n   2100),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 21,\n     'sack_halves': 7,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   2750),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 7,\n     'pa_total': 42,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   1150)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 34,\n     'sack_halves': 4,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 200}],\n   1200),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 13,\n     'sack_halves': 9,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   2550),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 7,\n     'pa_total': 7,\n     'sack_halves': 6,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 450}],\n   3000),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 23,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 449}],\n   750),\n  ('normal control 2',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 6,\n     'pa_total': 20,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 400}],\n   850),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 9,\n     'sack_halves': 6,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 100}],\n   2400),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 30,\n     'sack_halves': 5,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 99}],\n   2250)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 0,\n     'pa_total': 0,\n     'sack_halves': 7,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   3050),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 12,\n     'sack_halves': 3,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 400}],\n   1750),\n  ('second regression',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 34,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   950),\n  ('normal control 1',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 1,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 6,\n     'pa_total': 41,\n     'sack_halves': 8,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 300}],\n   1200),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 0,\n     'pa_total': 35,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 200}],\n   2250),\n  ('normal control 3',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 4,\n     'sack_halves': 1,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 449}],\n   1250),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 14,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 183}],\n   1350)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 2,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 495}],\n   1300),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 6,\n     'pa_total': 33,\n     'sack_halves': 9,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 199}],\n   2750),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 0,\n     'pa_total': 13,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 300}],\n   1850),\n  ('normal control 1',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 14,\n     'sack_halves': 1,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 450}],\n   1750),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 2,\n     'pa_total': 40,\n     'sack_halves': 7,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 100}],\n   850),\n  ('normal control 3',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 2,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 42,\n     'sack_halves': 5,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 400}],\n   -50),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 35,\n     'sack_halves': 3,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 299}],\n   1550)],\n [('regression: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 3,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 2,\n     'pa_total': 2,\n     'sack_halves': 4,\n     'safeties': 1,\n     'st_td': 1,\n     'yards_allowed': 349}],\n   3600),\n  ('partial repair probe: points allowed tier comparator',\n   [{'blocked_kicks': 0,\n     'def_td': 0,\n     'fum_rec': 0,\n     'ints': 3,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 7,\n     'pa_total': 34,\n     'sack_halves': 2,\n     'safeties': 1,\n     'st_td': 0,\n     'yards_allowed': 200}],\n   1100),\n  ('second regression',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 2,\n     'ints': 0,\n     'own_fum_rec': 1,\n     'pa_offense_returns': 6,\n     'pa_total': 6,\n     'sack_halves': 1,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 399}],\n   2150),\n  ('normal control 1',\n   [{'blocked_kicks': 0,\n     'def_td': 1,\n     'fum_rec': 1,\n     'ints': 0,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 0,\n     'pa_total': 14,\n     'sack_halves': 4,\n     'safeties': 0,\n     'st_td': 0,\n     'yards_allowed': 170}],\n   1400),\n  ('normal control 2',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 1,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 6,\n     'pa_total': 20,\n     'sack_halves': 8,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 349}],\n   1900),\n  ('normal control 3',\n   [{'blocked_kicks': 1,\n     'def_td': 0,\n     'fum_rec': 2,\n     'ints': 2,\n     'own_fum_rec': 0,\n     'pa_offense_returns': 7,\n     'pa_total': 30,\n     'sack_halves': 3,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 449}],\n   1450),\n  ('normal control 4',\n   [{'blocked_kicks': 1,\n     'def_td': 1,\n     'fum_rec': 0,\n     'ints': 1,\n     'own_fum_rec': 2,\n     'pa_offense_returns': 7,\n     'pa_total': 21,\n     'sack_halves': 0,\n     'safeties': 0,\n     'st_td': 1,\n     'yards_allowed': 99}],\n   2200)]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic toy scoring contract stipulated for this example; it is not the rulebook of any real fantasy platform. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-fantasy-sports-scoring-team-defense-points-allowed-tier-comparator","generated_at":"2026-09-29T14:50:35.219530+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Defense scoring hinges on tier boundaries and on which points count against the defense, the most disputed part of weekly scoring.","repair":"Compare pa <= limit so each listed maximum belongs to its own tier.","root_cause":"The tier scan compares pa < limit although each tier limit is an inclusive maximum.","sha256":"8e6addc5816fd3e2a2987f7676f7d2ae2f5ddef2203f2155395b54c909e9987f","title":"Points allowed tier upper bounds treated as exclusive · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":41.423,"exit_code":1,"observations":[{"actual":2200,"check":"regression: points allowed tier comparator","expected":2500,"passed":false},{"actual":2700,"check":"partial repair probe: points allowed tier comparator","expected":2800,"passed":false},{"actual":2650,"check":"second regression","expected":2650,"passed":true},{"actual":2250,"check":"normal control 1","expected":2250,"passed":true},{"actual":2100,"check":"normal control 2","expected":2100,"passed":true},{"actual":2750,"check":"normal control 3","expected":2750,"passed":true},{"actual":1150,"check":"normal control 4","expected":1150,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: points allowed tier comparator\", \"actual\": 2200, \"expected\": 2500, \"passed\": false}, {\"check\": \"partial repair probe: points allowed tier comparator\", \"actual\": 2700, \"expected\": 2800, \"passed\": false}, {\"check\": \"second regression\", \"actual\": 2650, \"expected\": 2650, \"passed\": true}, {\"check\": \"normal control 1\", \"actual\": 2250, \"expected\": 2250, \"passed\": true}, {\"check\": \"normal control 2\", \"actual\": 2100, \"expected\": 2100, \"passed\": true}, {\"check\": \"normal control 3\", \"actual\": 2750, \"expected\": 2750, \"passed\": true}, {\"check\": \"normal control 4\", \"actual\": 1150, \"expected\": 1150, \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":38.825,"exit_code":1,"observations":[{"actual":2200,"check":"regression: points allowed tier comparator","expected":2500,"passed":false},{"actual":2700,"check":"partial repair probe: points allowed tier comparator","expected":2800,"passed":false},{"actual":2350,"check":"second regression","expected":2650,"passed":false},{"actual":2250,"check":"normal control 1","expected":2250,"passed":true},{"actual":2100,"check":"normal control 2","expected":2100,"passed":true},{"actual":2750,"check":"normal control 3","expected":2750,"passed":true},{"actual":1150,"check":"normal control 4","expected":1150,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: points allowed tier comparator\", \"actual\": 2200, \"expected\": 2500, \"passed\": false}, {\"check\": \"partial repair probe: points allowed tier comparator\", \"actual\": 2700, \"expected\": 2800, \"passed\": false}, {\"check\": \"second regression\", \"actual\": 2350, \"expected\": 2650, \"passed\": false}, {\"check\": \"normal control 1\", \"actual\": 2250, \"expected\": 2250, \"passed\": true}, {\"check\": \"normal control 2\", \"actual\": 2100, \"expected\": 2100, \"passed\": true}, {\"check\": \"normal control 3\", \"actual\": 2750, \"expected\": 2750, \"passed\": true}, {\"check\": \"normal control 4\", \"actual\": 1150, \"expected\": 1150, \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":39.297,"exit_code":0,"observations":[{"actual":2500,"check":"regression: points allowed tier comparator","expected":2500,"passed":true},{"actual":2800,"check":"partial repair probe: points allowed tier comparator","expected":2800,"passed":true},{"actual":2650,"check":"second regression","expected":2650,"passed":true},{"actual":2250,"check":"normal control 1","expected":2250,"passed":true},{"actual":2100,"check":"normal control 2","expected":2100,"passed":true},{"actual":2750,"check":"normal control 3","expected":2750,"passed":true},{"actual":1150,"check":"normal control 4","expected":1150,"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: points allowed tier comparator\", \"actual\": 2500, \"expected\": 2500, \"passed\": true}, {\"check\": \"partial repair probe: points allowed tier comparator\", \"actual\": 2800, \"expected\": 2800, \"passed\": true}, {\"check\": \"second regression\", \"actual\": 2650, \"expected\": 2650, \"passed\": true}, {\"check\": \"normal control 1\", \"actual\": 2250, \"expected\": 2250, \"passed\": true}, {\"check\": \"normal control 2\", \"actual\": 2100, \"expected\": 2100, \"passed\": true}, {\"check\": \"normal control 3\", \"actual\": 2750, \"expected\": 2750, \"passed\": true}, {\"check\": \"normal control 4\", \"actual\": 1150, \"expected\": 1150, \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}