{"abstract":"A tiebreak at 7-6 is reported as won instead of continuing.","category":"Sports scoring and tiebreakers","checks":10,"contract":"Tiebreak game. points is a string of A/B point winners; target is 7 (standard) or 10 (match tiebreak). The tiebreak ends at the first point where a player has at least target points and a two-point lead; later points are ignored. first_server serves point 0, then serve alternates every two points (point k is served by first_server when ((k + 1) // 2) is even). Return [a, b, winner or None, server of the next point or None when finished, ends_change] where ends_change is true when the tiebreak is unfinished and a positive multiple of 6 points has been played.","evaluation_group":"w2-sports-scoring-tennis-tiebreak-service","failed_approach":"Demanding a lead greater than two points prolongs tiebreaks won 7-5.","family":"w2-sports-scoring-tennis-tiebreak-service-two-point-margin","id":"FA-83861","implementations":{"attempt":{"sha256":"62c42c4decd49263aeef3d8bdc88f7bbed44f8355e591f775e09970c67964d14","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(points, first_server, target):\n    def finished(x, y):\n        return max(x, y) >= target and abs(x - y) > 2\n    a = b = 0\n    for p in points:\n        if p == 'A':\n            a += 1\n        else:\n            b += 1\n        if finished(a, b):\n            break\n    played = a + b\n    winner = None\n    if finished(a, b):\n        winner = 'A' if a > b else 'B'\n    other = 'B' if first_server == 'A' else 'A'\n    server = first_server if ((played + 1) // 2) % 2 == 0 else other\n    ends_change = played > 0 and played % 6 == 0 and winner is None\n    return [a, b, winner, None if winner else server, ends_change]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ndef run(args):\n    try:\n        return solve(*args)\n    except Exception as exc:\n        return 'raised ' + type(exc).__name__\ncases = [[('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('AAAABABABBBBB', 'A', 7), [6, 7, None, 'B', False]),\n  ('regression: two point margin', ('BABABBBAABABA', 'B', 7), [5, 7, 'B', None, False]),\n  ('variant scenario 1', ('BAABA', 'A', 10), [3, 2, None, 'B', False]),\n  ('variant scenario 2', ('ABBA', 'A', 7), [2, 2, None, 'A', False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('BABABAAABBBB', 'B', 7), [5, 7, 'B', None, False]),\n  ('regression: two point margin', ('ABBAABBBBAAAB', 'A', 7), [6, 7, None, 'B', False]),\n  ('variant scenario 1', ('BAABBBBBABBAABBB', 'B', 10), [5, 10, 'B', None, False]),\n  ('variant scenario 2', ('A', 'A', 7), [1, 0, None, 'B', False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('AABBBABBAAAABAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('regression: two point margin', ('BAAAABBBBABABABBA', 'A', 7), [7, 9, 'B', None, False]),\n  ('variant scenario 1', ('BBABABB', 'B', 10), [2, 5, None, 'B', False]),\n  ('variant scenario 2', ('ABBBABAAAAABAABBBAB', 'B', 7), [7, 4, 'A', None, False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('ABBAAABBAABBBBABBABA', 'B', 7), [6, 8, 'B', None, False]),\n  ('variant scenario 1', ('ABBAA', 'B', 10), [3, 2, None, 'A', False]),\n  ('variant scenario 2', ('AAAAAAABAABAABBBBBAABA', 'B', 10), [10, 2, 'A', None, False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin',\n   ('BABABBABAABAABBBABABABBB', 'A', 10),\n   [8, 10, 'B', None, False]),\n  ('regression: two point margin', ('BABBAABBAABABBABBBAAA', 'B', 7), [6, 8, 'B', None, False]),\n  ('variant scenario 1', ('ABBBBAAABBBAABBAAA', 'A', 7), [4, 7, 'B', None, False]),\n  ('variant scenario 2', ('BABABAB', 'A', 7), [3, 4, None, 'A', False])]]\nfor label, args, expected in cases[N - 1]:\n    check(label, run(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"d938b3323b89d68d53d2de902673b6971cf4d7dfb023c21bcda24e49906c07bd","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(points, first_server, target):\n    def finished(x, y):\n        return max(x, y) >= target and abs(x - y) >= 1\n    a = b = 0\n    for p in points:\n        if p == 'A':\n            a += 1\n        else:\n            b += 1\n        if finished(a, b):\n            break\n    played = a + b\n    winner = None\n    if finished(a, b):\n        winner = 'A' if a > b else 'B'\n    other = 'B' if first_server == 'A' else 'A'\n    server = first_server if ((played + 1) // 2) % 2 == 0 else other\n    ends_change = played > 0 and played % 6 == 0 and winner is None\n    return [a, b, winner, None if winner else server, ends_change]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ndef run(args):\n    try:\n        return solve(*args)\n    except Exception as exc:\n        return 'raised ' + type(exc).__name__\ncases = [[('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('AAAABABABBBBB', 'A', 7), [6, 7, None, 'B', False]),\n  ('regression: two point margin', ('BABABBBAABABA', 'B', 7), [5, 7, 'B', None, False]),\n  ('variant scenario 1', ('BAABA', 'A', 10), [3, 2, None, 'B', False]),\n  ('variant scenario 2', ('ABBA', 'A', 7), [2, 2, None, 'A', False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('BABABAAABBBB', 'B', 7), [5, 7, 'B', None, False]),\n  ('regression: two point margin', ('ABBAABBBBAAAB', 'A', 7), [6, 7, None, 'B', False]),\n  ('variant scenario 1', ('BAABBBBBABBAABBB', 'B', 10), [5, 10, 'B', None, False]),\n  ('variant scenario 2', ('A', 'A', 7), [1, 0, None, 'B', False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('AABBBABBAAAABAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('regression: two point margin', ('BAAAABBBBABABABBA', 'A', 7), [7, 9, 'B', None, False]),\n  ('variant scenario 1', ('BBABABB', 'B', 10), [2, 5, None, 'B', False]),\n  ('variant scenario 2', ('ABBBABAAAAABAABBBAB', 'B', 7), [7, 4, 'A', None, False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('ABBAAABBAABBBBABBABA', 'B', 7), [6, 8, 'B', None, False]),\n  ('variant scenario 1', ('ABBAA', 'B', 10), [3, 2, None, 'A', False]),\n  ('variant scenario 2', ('AAAAAAABAABAABBBBBAABA', 'B', 10), [10, 2, 'A', None, False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin',\n   ('BABABBABAABAABBBABABABBB', 'A', 10),\n   [8, 10, 'B', None, False]),\n  ('regression: two point margin', ('BABBAABBAABABBABBBAAA', 'B', 7), [6, 8, 'B', None, False]),\n  ('variant scenario 1', ('ABBBBAAABBBAABBAAA', 'A', 7), [4, 7, 'B', None, False]),\n  ('variant scenario 2', ('BABABAB', 'A', 7), [3, 4, None, 'A', False])]]\nfor label, args, expected in cases[N - 1]:\n    check(label, run(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"922e152c3f5c9bb2f4186c87350e3baae786fc37f3506b7c086dc2b2a2aeb792","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(points, first_server, target):\n    def finished(x, y):\n        return max(x, y) >= target and abs(x - y) >= 2\n    a = b = 0\n    for p in points:\n        if p == 'A':\n            a += 1\n        else:\n            b += 1\n        if finished(a, b):\n            break\n    played = a + b\n    winner = None\n    if finished(a, b):\n        winner = 'A' if a > b else 'B'\n    other = 'B' if first_server == 'A' else 'A'\n    server = first_server if ((played + 1) // 2) % 2 == 0 else other\n    ends_change = played > 0 and played % 6 == 0 and winner is None\n    return [a, b, winner, None if winner else server, ends_change]\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ndef run(args):\n    try:\n        return solve(*args)\n    except Exception as exc:\n        return 'raised ' + type(exc).__name__\ncases = [[('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('AAAABABABBBBB', 'A', 7), [6, 7, None, 'B', False]),\n  ('regression: two point margin', ('BABABBBAABABA', 'B', 7), [5, 7, 'B', None, False]),\n  ('variant scenario 1', ('BAABA', 'A', 10), [3, 2, None, 'B', False]),\n  ('variant scenario 2', ('ABBA', 'A', 7), [2, 2, None, 'A', False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('BABABAAABBBB', 'B', 7), [5, 7, 'B', None, False]),\n  ('regression: two point margin', ('ABBAABBBBAAAB', 'A', 7), [6, 7, None, 'B', False]),\n  ('variant scenario 1', ('BAABBBBBABBAABBB', 'B', 10), [5, 10, 'B', None, False]),\n  ('variant scenario 2', ('A', 'A', 7), [1, 0, None, 'B', False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('AABBBABBAAAABAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('regression: two point margin', ('BAAAABBBBABABABBA', 'A', 7), [7, 9, 'B', None, False]),\n  ('variant scenario 1', ('BBABABB', 'B', 10), [2, 5, None, 'B', False]),\n  ('variant scenario 2', ('ABBBABAAAAABAABBBAB', 'B', 7), [7, 4, 'A', None, False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin', ('ABBAAABBAABBBBABBABA', 'B', 7), [6, 8, 'B', None, False]),\n  ('variant scenario 1', ('ABBAA', 'B', 10), [3, 2, None, 'A', False]),\n  ('variant scenario 2', ('AAAAAAABAABAABBBBBAABA', 'B', 10), [10, 2, 'A', None, False])],\n [('control opening point', ('', 'A', 7), [0, 0, None, 'A', False]),\n  ('boundary second server pair', ('A', 'A', 7), [1, 0, None, 'B', False]),\n  ('boundary third point back to first', ('AB', 'B', 7), [1, 1, None, 'A', False]),\n  ('control seven-five tiebreak', ('AAAAABBBBBAA', 'A', 7), [7, 5, 'A', None, False]),\n  ('boundary change of ends at six', ('ABABAB', 'A', 7), [3, 3, None, 'B', True]),\n  ('control match tiebreak not over at seven', ('AAAAAAA', 'B', 10), [7, 0, None, 'B', False]),\n  ('regression: two point margin',\n   ('BABABBABAABAABBBABABABBB', 'A', 10),\n   [8, 10, 'B', None, False]),\n  ('regression: two point margin', ('BABBAABBAABABBABBBAAA', 'B', 7), [6, 8, 'B', None, False]),\n  ('variant scenario 1', ('ABBBBAAABBBAABBAAA', 'A', 7), [4, 7, 'B', None, False]),\n  ('variant scenario 2', ('BABABAB', 'A', 7), [3, 4, None, 'A', False])]]\nfor label, args, expected in cases[N - 1]:\n    check(label, run(args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Stipulated, bounded toy contract stated in the contract field; not a claim of conformance with any governing body rulebook or operator house rules. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-sports-scoring-tennis-tiebreak-service-two-point-margin","generated_at":"2026-09-29T14:50:25.468196+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Chair-umpire scoring software must drive the server indicator and change-of-ends prompt during tiebreaks.","repair":"Require at least target points and a lead of two.","root_cause":"The tiebreak completion test only requires the leader to be ahead by one point.","sha256":"dc37793014d553121e51e88acafbbe2c63d2052e7f61eb5a2f596ee071d2dae8","title":"Tiebreak closes on a one-point lead · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":40.102,"exit_code":1,"observations":[{"actual":[0,0,null,"A",false],"check":"control opening point","expected":[0,0,null,"A",false],"passed":true},{"actual":[1,0,null,"B",false],"check":"boundary second server pair","expected":[1,0,null,"B",false],"passed":true},{"actual":[1,1,null,"A",false],"check":"boundary third point back to first","expected":[1,1,null,"A",false],"passed":true},{"actual":[7,5,null,"A",true],"check":"control seven-five tiebreak","expected":[7,5,"A",null,false],"passed":false},{"actual":[3,3,null,"B",true],"check":"boundary change of ends at six","expected":[3,3,null,"B",true],"passed":true},{"actual":[7,0,null,"B",false],"check":"control match tiebreak not over at seven","expected":[7,0,null,"B",false],"passed":true},{"actual":[6,7,null,"B",false],"check":"regression: two point margin","expected":[6,7,null,"B",false],"passed":true},{"actual":[6,7,null,"A",false],"check":"regression: two point margin","expected":[5,7,"B",null,false],"passed":false},{"actual":[3,2,null,"B",false],"check":"variant scenario 1","expected":[3,2,null,"B",false],"passed":true},{"actual":[2,2,null,"A",false],"check":"variant scenario 2","expected":[2,2,null,"A",false],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"control opening point\", \"actual\": [0, 0, null, \"A\", false], \"expected\": [0, 0, null, \"A\", false], \"passed\": true}, {\"check\": \"boundary second server pair\", \"actual\": [1, 0, null, \"B\", false], \"expected\": [1, 0, null, \"B\", false], \"passed\": true}, {\"check\": \"boundary third point back to first\", \"actual\": [1, 1, null, \"A\", false], \"expected\": [1, 1, null, \"A\", false], \"passed\": true}, {\"check\": \"control seven-five tiebreak\", \"actual\": [7, 5, null, \"A\", true], \"expected\": [7, 5, \"A\", null, false], \"passed\": false}, {\"check\": \"boundary change of ends at six\", \"actual\": [3, 3, null, \"B\", true], \"expected\": [3, 3, null, \"B\", true], \"passed\": true}, {\"check\": \"control match tiebreak not over at seven\", \"actual\": [7, 0, null, \"B\", false], \"expected\": [7, 0, null, \"B\", false], \"passed\": true}, {\"check\": \"regression: two point margin\", \"actual\": [6, 7, null, \"B\", false], \"expected\": [6, 7, null, \"B\", false], \"passed\": true}, {\"check\": \"regression: two point margin\", \"actual\": [6, 7, null, \"A\", false], \"expected\": [5, 7, \"B\", null, false], \"passed\": false}, {\"check\": \"variant scenario 1\", \"actual\": [3, 2, null, \"B\", false], \"expected\": [3, 2, null, \"B\", false], \"passed\": true}, {\"check\": \"variant scenario 2\", \"actual\": [2, 2, null, \"A\", false], \"expected\": [2, 2, null, \"A\", false], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":41.319,"exit_code":1,"observations":[{"actual":[0,0,null,"A",false],"check":"control opening point","expected":[0,0,null,"A",false],"passed":true},{"actual":[1,0,null,"B",false],"check":"boundary second server pair","expected":[1,0,null,"B",false],"passed":true},{"actual":[1,1,null,"A",false],"check":"boundary third point back to first","expected":[1,1,null,"A",false],"passed":true},{"actual":[7,5,"A",null,false],"check":"control seven-five tiebreak","expected":[7,5,"A",null,false],"passed":true},{"actual":[3,3,null,"B",true],"check":"boundary change of ends at six","expected":[3,3,null,"B",true],"passed":true},{"actual":[7,0,null,"B",false],"check":"control match tiebreak not over at seven","expected":[7,0,null,"B",false],"passed":true},{"actual":[6,7,"B",null,false],"check":"regression: two point margin","expected":[6,7,null,"B",false],"passed":false},{"actual":[5,7,"B",null,false],"check":"regression: two point margin","expected":[5,7,"B",null,false],"passed":true},{"actual":[3,2,null,"B",false],"check":"variant scenario 1","expected":[3,2,null,"B",false],"passed":true},{"actual":[2,2,null,"A",false],"check":"variant scenario 2","expected":[2,2,null,"A",false],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"control opening point\", \"actual\": [0, 0, null, \"A\", false], \"expected\": [0, 0, null, \"A\", false], \"passed\": true}, {\"check\": \"boundary second server pair\", \"actual\": [1, 0, null, \"B\", false], \"expected\": [1, 0, null, \"B\", false], \"passed\": true}, {\"check\": \"boundary third point back to first\", \"actual\": [1, 1, null, \"A\", false], \"expected\": [1, 1, null, \"A\", false], \"passed\": true}, {\"check\": \"control seven-five tiebreak\", \"actual\": [7, 5, \"A\", null, false], \"expected\": [7, 5, \"A\", null, false], \"passed\": true}, {\"check\": \"boundary change of ends at six\", \"actual\": [3, 3, null, \"B\", true], \"expected\": [3, 3, null, \"B\", true], \"passed\": true}, {\"check\": \"control match tiebreak not over at seven\", \"actual\": [7, 0, null, \"B\", false], \"expected\": [7, 0, null, \"B\", false], \"passed\": true}, {\"check\": \"regression: two point margin\", \"actual\": [6, 7, \"B\", null, false], \"expected\": [6, 7, null, \"B\", false], \"passed\": false}, {\"check\": \"regression: two point margin\", \"actual\": [5, 7, \"B\", null, false], \"expected\": [5, 7, \"B\", null, false], \"passed\": true}, {\"check\": \"variant scenario 1\", \"actual\": [3, 2, null, \"B\", false], \"expected\": [3, 2, null, \"B\", false], \"passed\": true}, {\"check\": \"variant scenario 2\", \"actual\": [2, 2, null, \"A\", false], \"expected\": [2, 2, null, \"A\", false], \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":38.982,"exit_code":0,"observations":[{"actual":[0,0,null,"A",false],"check":"control opening point","expected":[0,0,null,"A",false],"passed":true},{"actual":[1,0,null,"B",false],"check":"boundary second server pair","expected":[1,0,null,"B",false],"passed":true},{"actual":[1,1,null,"A",false],"check":"boundary third point back to first","expected":[1,1,null,"A",false],"passed":true},{"actual":[7,5,"A",null,false],"check":"control seven-five tiebreak","expected":[7,5,"A",null,false],"passed":true},{"actual":[3,3,null,"B",true],"check":"boundary change of ends at six","expected":[3,3,null,"B",true],"passed":true},{"actual":[7,0,null,"B",false],"check":"control match tiebreak not over at seven","expected":[7,0,null,"B",false],"passed":true},{"actual":[6,7,null,"B",false],"check":"regression: two point margin","expected":[6,7,null,"B",false],"passed":true},{"actual":[5,7,"B",null,false],"check":"regression: two point margin","expected":[5,7,"B",null,false],"passed":true},{"actual":[3,2,null,"B",false],"check":"variant scenario 1","expected":[3,2,null,"B",false],"passed":true},{"actual":[2,2,null,"A",false],"check":"variant scenario 2","expected":[2,2,null,"A",false],"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"control opening point\", \"actual\": [0, 0, null, \"A\", false], \"expected\": [0, 0, null, \"A\", false], \"passed\": true}, {\"check\": \"boundary second server pair\", \"actual\": [1, 0, null, \"B\", false], \"expected\": [1, 0, null, \"B\", false], \"passed\": true}, {\"check\": \"boundary third point back to first\", \"actual\": [1, 1, null, \"A\", false], \"expected\": [1, 1, null, \"A\", false], \"passed\": true}, {\"check\": \"control seven-five tiebreak\", \"actual\": [7, 5, \"A\", null, false], \"expected\": [7, 5, \"A\", null, false], \"passed\": true}, {\"check\": \"boundary change of ends at six\", \"actual\": [3, 3, null, \"B\", true], \"expected\": [3, 3, null, \"B\", true], \"passed\": true}, {\"check\": \"control match tiebreak not over at seven\", \"actual\": [7, 0, null, \"B\", false], \"expected\": [7, 0, null, \"B\", false], \"passed\": true}, {\"check\": \"regression: two point margin\", \"actual\": [6, 7, null, \"B\", false], \"expected\": [6, 7, null, \"B\", false], \"passed\": true}, {\"check\": \"regression: two point margin\", \"actual\": [5, 7, \"B\", null, false], \"expected\": [5, 7, \"B\", null, false], \"passed\": true}, {\"check\": \"variant scenario 1\", \"actual\": [3, 2, null, \"B\", false], \"expected\": [3, 2, null, \"B\", false], \"passed\": true}, {\"check\": \"variant scenario 2\", \"actual\": [2, 2, null, \"A\", false], \"expected\": [2, 2, null, \"A\", false], \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}