{"abstract":"A wait one second past the grace is billed for the full wait including the free minutes.","category":"Ride-hailing fare and surge pricing","checks":7,"contract":"Wait time starts at driver arrival, or at the scheduled pickup time if the ride was scheduled and the driver arrived early. The first grace seconds are free; beyond that each started minute is billed at per_min cents, up to cap_min billed minutes. Return the wait fee in cents.","evaluation_group":"w2-ride-hailing-fare-surge-pickup-wait-billing","failed_approach":"Adding one minute to the floored excess overbills exact minute multiples.","family":"w2-ride-hailing-fare-surge-pickup-wait-billing-grace-deduction","id":"FA-85441","implementations":{"attempt":{"sha256":"e063f54485efa1b386518ac2e01cc6dd4818f49a010879f0d13b8b54c96072de","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(ev, policy):\n    start = ev['arrive'] if ev['scheduled'] is None else max(ev['arrive'], ev['scheduled'])\n    wait = ev['board'] - start\n    if wait <= policy['grace']:\n        return 0\n    minutes = (wait - policy['grace']) // 60 + 1\n    return min(minutes, policy['cap_min']) * policy['per_min']\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10301, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   50),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   200),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10180, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11020, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   250),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': 9940}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 70),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   320),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10301, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   80),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11483, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 25}],\n   125)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 70),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10480, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   40),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10180, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 35),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 25}],\n   125),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11020, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 35}],\n   350),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 35}],\n   350),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10121, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10300, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   40),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 25}], 50),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11487, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   250),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10120, 'scheduled': 10120}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10120, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 0)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10121, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10480, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   25),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 50),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 0),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 40}], 0)]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"52a1e636e35c67789f9531899a32d8aa105540a9f5d0247b3c656dd0a0d484bf","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(ev, policy):\n    start = ev['arrive'] if ev['scheduled'] is None else max(ev['arrive'], ev['scheduled'])\n    wait = ev['board'] - start\n    if wait <= policy['grace']:\n        return 0\n    minutes = -(-wait // 60)\n    return min(minutes, policy['cap_min']) * policy['per_min']\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10301, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   50),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   200),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10180, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11020, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   250),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': 9940}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 70),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   320),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10301, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   80),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11483, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 25}],\n   125)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 70),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10480, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   40),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10180, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 35),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 25}],\n   125),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11020, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 35}],\n   350),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 35}],\n   350),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10121, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10300, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   40),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 25}], 50),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11487, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   250),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10120, 'scheduled': 10120}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10120, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 0)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10121, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10480, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   25),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 50),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 0),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 40}], 0)]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"8c16965b43e968f6f9c6e5f3649ef9a2806e49910467f586677b9683e45a35ff","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(ev, policy):\n    start = ev['arrive'] if ev['scheduled'] is None else max(ev['arrive'], ev['scheduled'])\n    wait = ev['board'] - start\n    if wait <= policy['grace']:\n        return 0\n    minutes = -(-(wait - policy['grace']) // 60)\n    return min(minutes, policy['cap_min']) * policy['per_min']\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10301, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   50),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   200),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10180, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11020, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   250),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': 9940}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 70),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   320),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10301, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   80),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11483, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 25}],\n   125)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 70),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10480, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   40),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10180, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 35),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 25}],\n   125),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11020, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 35}],\n   350),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 35}],\n   350),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10600, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10121, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10300, 'scheduled': 10120}, {'cap_min': 10, 'grace': 120, 'per_min': 40}],\n   40),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 25}], 50),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 11487, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   250),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10120, 'scheduled': 10120}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 0),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10120, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 35}], 0)],\n [('regression: grace deduction',\n   [{'arrive': 10000, 'board': 10121, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 25),\n  ('partial repair probe: grace deduction',\n   [{'arrive': 10000, 'board': 10480, 'scheduled': 10300}, {'cap_min': 10, 'grace': 120, 'per_min': 25}],\n   25),\n  ('second regression',\n   [{'arrive': 10000, 'board': 10181, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 50),\n  ('normal control 1',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 5, 'grace': 120, 'per_min': 25}], 0),\n  ('normal control 2',\n   [{'arrive': 10000, 'board': 11200, 'scheduled': 10300}, {'cap_min': 5, 'grace': 120, 'per_min': 40}],\n   200),\n  ('normal control 3',\n   [{'arrive': 10000, 'board': 10900, 'scheduled': 9940}, {'cap_min': 5, 'grace': 120, 'per_min': 35}], 175),\n  ('normal control 4',\n   [{'arrive': 10000, 'board': 10000, 'scheduled': None}, {'cap_min': 10, 'grace': 120, 'per_min': 40}], 0)]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic toy pricing contract stipulated for this example; it does not reproduce the pricing of any real ride-hailing operator or regulator. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-ride-hailing-fare-surge-pickup-wait-billing-grace-deduction","generated_at":"2026-09-29T14:50:40.448475+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Ride-hailing prices are computed per trip at scale; ordering, unit and boundary slips become systematic over- or under-charging.","repair":"Bill only the seconds beyond the grace period.","root_cause":"After the grace test passes, the whole wait is billed.","sha256":"61d386c6ca745f8995a2873e64bc5ec13c79244fa0c7808e8e3435354c4ea864","title":"Grace period billed once exceeded · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":42.475,"exit_code":1,"observations":[{"actual":50,"check":"regression: grace deduction","expected":50,"passed":true},{"actual":225,"check":"partial repair probe: grace deduction","expected":200,"passed":false},{"actual":50,"check":"second regression","expected":25,"passed":false},{"actual":250,"check":"normal control 1","expected":250,"passed":true},{"actual":175,"check":"normal control 2","expected":175,"passed":true},{"actual":0,"check":"normal control 3","expected":0,"passed":true},{"actual":200,"check":"normal control 4","expected":200,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: grace deduction\", \"actual\": 50, \"expected\": 50, \"passed\": true}, {\"check\": \"partial repair probe: grace deduction\", \"actual\": 225, \"expected\": 200, \"passed\": false}, {\"check\": \"second regression\", \"actual\": 50, \"expected\": 25, \"passed\": false}, {\"check\": \"normal control 1\", \"actual\": 250, \"expected\": 250, \"passed\": true}, {\"check\": \"normal control 2\", \"actual\": 175, \"expected\": 175, \"passed\": true}, {\"check\": \"normal control 3\", \"actual\": 0, \"expected\": 0, \"passed\": true}, {\"check\": \"normal control 4\", \"actual\": 200, \"expected\": 200, \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":39.437,"exit_code":1,"observations":[{"actual":100,"check":"regression: grace deduction","expected":50,"passed":false},{"actual":250,"check":"partial repair probe: grace deduction","expected":200,"passed":false},{"actual":75,"check":"second regression","expected":25,"passed":false},{"actual":250,"check":"normal control 1","expected":250,"passed":true},{"actual":175,"check":"normal control 2","expected":175,"passed":true},{"actual":0,"check":"normal control 3","expected":0,"passed":true},{"actual":200,"check":"normal control 4","expected":200,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: grace deduction\", \"actual\": 100, \"expected\": 50, \"passed\": false}, {\"check\": \"partial repair probe: grace deduction\", \"actual\": 250, \"expected\": 200, \"passed\": false}, {\"check\": \"second regression\", \"actual\": 75, \"expected\": 25, \"passed\": false}, {\"check\": \"normal control 1\", \"actual\": 250, \"expected\": 250, \"passed\": true}, {\"check\": \"normal control 2\", \"actual\": 175, \"expected\": 175, \"passed\": true}, {\"check\": \"normal control 3\", \"actual\": 0, \"expected\": 0, \"passed\": true}, {\"check\": \"normal control 4\", \"actual\": 200, \"expected\": 200, \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":39.072,"exit_code":0,"observations":[{"actual":50,"check":"regression: grace deduction","expected":50,"passed":true},{"actual":200,"check":"partial repair probe: grace deduction","expected":200,"passed":true},{"actual":25,"check":"second regression","expected":25,"passed":true},{"actual":250,"check":"normal control 1","expected":250,"passed":true},{"actual":175,"check":"normal control 2","expected":175,"passed":true},{"actual":0,"check":"normal control 3","expected":0,"passed":true},{"actual":200,"check":"normal control 4","expected":200,"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: grace deduction\", \"actual\": 50, \"expected\": 50, \"passed\": true}, {\"check\": \"partial repair probe: grace deduction\", \"actual\": 200, \"expected\": 200, \"passed\": true}, {\"check\": \"second regression\", \"actual\": 25, \"expected\": 25, \"passed\": true}, {\"check\": \"normal control 1\", \"actual\": 250, \"expected\": 250, \"passed\": true}, {\"check\": \"normal control 2\", \"actual\": 175, \"expected\": 175, \"passed\": true}, {\"check\": \"normal control 3\", \"actual\": 0, \"expected\": 0, \"passed\": true}, {\"check\": \"normal control 4\", \"actual\": 200, \"expected\": 200, \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}