{"abstract":"Early looks spend far too little alpha and late looks too much.","category":"Experiment statistics","checks":8,"contract":"Cumulative alpha spent at information fraction t is 2 - 2 Phi(z_{1-alpha/2} / sqrt(t)) (t capped at 1). Information fractions must strictly increase from 0, otherwise return None. Return the incremental alpha spent at each look rounded to 6.","evaluation_group":"w2-experiment-statistics-alpha-spending","failed_approach":"Multiplying by sqrt(t) spends most alpha at the first look.","family":"w2-experiment-statistics-alpha-spending-information-scaling","id":"FA-74736","implementations":{"attempt":{"sha256":"92bcafb189b481e3532cc4c087cab5a8929a6db177e944d5739bca4b1525c7a7","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport math\nimport statistics\nN = 1\nobservations = []\ndef solve(info_fractions, alpha):\n    nd = statistics.NormalDist()\n    z = nd.inv_cdf(1 - alpha / 2)\n    out = []\n    prev = 0.0\n    last_t = 0.0\n    for t in info_fractions:\n        if t <= last_t:\n            return None\n        t = min(t, 1.0)\n        spent = 2 - 2 * nd.cdf(z * math.sqrt(t))\n        out.append(round(spent - prev, 6))\n        prev = spent\n        last_t = t\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 1', [[0.6, 0.8, 1.0], 0.01], [0.000883, 0.003095, 0.006022]),\n  ('look schedule sample 2', [[0.2, 0.4, 0.5, 1.0], 0.1], [0.000235, 0.009067, 0.010707, 0.079991])],\n [('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 5', [[0.2, 0.5, 0.75, 1.0], 0.05], [1.2e-05, 0.005563, 0.018051, 0.026375]),\n  ('look schedule sample 6', [[0.2], 0.1], [0.000235]),\n  ('look schedule sample 7', [[1.0], 0.01], [0.01])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 11', [[0.2, 0.25, 0.8], 0.01], [0.0, 0.0, 0.003978]),\n  ('look schedule sample 12', [[0.5, 0.6, 0.6], 0.01], None),\n  ('look schedule sample 17', [[0.25, 0.5], 0.1], [0.001003, 0.019006])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 16', [[0.4, 0.5, 0.5], 0.1], None),\n  ('look schedule sample 17', [[0.25, 0.5], 0.1], [0.001003, 0.019006]),\n  ('look schedule sample 26', [[0.25], 0.1], [0.001003])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 21', [[0.2, 0.4, 0.8], 0.01], [0.0, 4.6e-05, 0.003932]),\n  ('look schedule sample 22', [[0.4, 0.75], 0.1], [0.009302, 0.048221]),\n  ('look schedule sample 37', [[0.25, 0.4, 0.6, 0.75], 0.05], [8.9e-05, 0.001853, 0.009455, 0.012229])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"e381d7b97f274fd8dbafe8c576022a25d723739d0df3b43fcd1cc1347e6115ef","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport math\nimport statistics\nN = 1\nobservations = []\ndef solve(info_fractions, alpha):\n    nd = statistics.NormalDist()\n    z = nd.inv_cdf(1 - alpha / 2)\n    out = []\n    prev = 0.0\n    last_t = 0.0\n    for t in info_fractions:\n        if t <= last_t:\n            return None\n        t = min(t, 1.0)\n        spent = 2 - 2 * nd.cdf(z / t)\n        out.append(round(spent - prev, 6))\n        prev = spent\n        last_t = t\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 1', [[0.6, 0.8, 1.0], 0.01], [0.000883, 0.003095, 0.006022]),\n  ('look schedule sample 2', [[0.2, 0.4, 0.5, 1.0], 0.1], [0.000235, 0.009067, 0.010707, 0.079991])],\n [('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 5', [[0.2, 0.5, 0.75, 1.0], 0.05], [1.2e-05, 0.005563, 0.018051, 0.026375]),\n  ('look schedule sample 6', [[0.2], 0.1], [0.000235]),\n  ('look schedule sample 7', [[1.0], 0.01], [0.01])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 11', [[0.2, 0.25, 0.8], 0.01], [0.0, 0.0, 0.003978]),\n  ('look schedule sample 12', [[0.5, 0.6, 0.6], 0.01], None),\n  ('look schedule sample 17', [[0.25, 0.5], 0.1], [0.001003, 0.019006])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 16', [[0.4, 0.5, 0.5], 0.1], None),\n  ('look schedule sample 17', [[0.25, 0.5], 0.1], [0.001003, 0.019006]),\n  ('look schedule sample 26', [[0.25], 0.1], [0.001003])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 21', [[0.2, 0.4, 0.8], 0.01], [0.0, 4.6e-05, 0.003932]),\n  ('look schedule sample 22', [[0.4, 0.75], 0.1], [0.009302, 0.048221]),\n  ('look schedule sample 37', [[0.25, 0.4, 0.6, 0.75], 0.05], [8.9e-05, 0.001853, 0.009455, 0.012229])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"00b9af7b6d9f9e7751795f8d27399282214a0ed2fb4531813da277f4a27ab3a6","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\nimport math\nimport statistics\nN = 1\nobservations = []\ndef solve(info_fractions, alpha):\n    nd = statistics.NormalDist()\n    z = nd.inv_cdf(1 - alpha / 2)\n    out = []\n    prev = 0.0\n    last_t = 0.0\n    for t in info_fractions:\n        if t <= last_t:\n            return None\n        t = min(t, 1.0)\n        spent = 2 - 2 * nd.cdf(z / math.sqrt(t))\n        out.append(round(spent - prev, 6))\n        prev = spent\n        last_t = t\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 1', [[0.6, 0.8, 1.0], 0.01], [0.000883, 0.003095, 0.006022]),\n  ('look schedule sample 2', [[0.2, 0.4, 0.5, 1.0], 0.1], [0.000235, 0.009067, 0.010707, 0.079991])],\n [('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 5', [[0.2, 0.5, 0.75, 1.0], 0.05], [1.2e-05, 0.005563, 0.018051, 0.026375]),\n  ('look schedule sample 6', [[0.2], 0.1], [0.000235]),\n  ('look schedule sample 7', [[1.0], 0.01], [0.01])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 11', [[0.2, 0.25, 0.8], 0.01], [0.0, 0.0, 0.003978]),\n  ('look schedule sample 12', [[0.5, 0.6, 0.6], 0.01], None),\n  ('look schedule sample 17', [[0.25, 0.5], 0.1], [0.001003, 0.019006])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('repeated fraction is invalid', [[0.5, 0.5], 0.05], None),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 16', [[0.4, 0.5, 0.5], 0.1], None),\n  ('look schedule sample 17', [[0.25, 0.5], 0.1], [0.001003, 0.019006]),\n  ('look schedule sample 26', [[0.25], 0.1], [0.001003])],\n [('four equally spaced looks', [[0.25, 0.5, 0.75, 1.0], 0.05], [8.9e-05, 0.005486, 0.018051, 0.026375]),\n  ('single final look spends all alpha', [[1.0], 0.05], [0.05]),\n  ('two looks at stricter alpha', [[0.5, 1.0], 0.01], [0.00027, 0.00973]),\n  ('decreasing fractions are invalid', [[0.6, 0.4], 0.05], None),\n  ('overrun beyond full information', [[0.8, 1.2], 0.05], [0.02843, 0.02157]),\n  ('look schedule sample 21', [[0.2, 0.4, 0.8], 0.01], [0.0, 4.6e-05, 0.003932]),\n  ('look schedule sample 22', [[0.4, 0.75], 0.1], [0.009302, 0.048221]),\n  ('look schedule sample 37', [[0.25, 0.4, 0.6, 0.75], 0.05], [8.9e-05, 0.001853, 0.009455, 0.012229])]]\nfor label, args, expected in fixtures[N - 1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic toy experiment-analysis model with a stipulated contract; results are rounded and are not a substitute for a validated statistics package. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-experiment-statistics-alpha-spending-information-scaling","generated_at":"2026-09-29T14:48:59.589220+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Spending functions let teams peek at experiments without inflating the false positive rate.","repair":"Divide the critical value by sqrt(t).","root_cause":"The spending function uses z / t.","sha256":"e4999861fddc39c93a615ab864a228c150776cd57bce95baab3cafcddafa4fe4","title":"O'Brien-Fleming type alpha spending: Boundary scales with t instead of sqrt(t) · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":41.584,"exit_code":1,"observations":[{"actual":[0.327095,-0.161319,-0.076151,-0.039625],"check":"four equally spaced looks","expected":[8.9e-05,0.005486,0.018051,0.026375],"passed":false},{"actual":[0.05],"check":"single final look spends all alpha","expected":[0.05],"passed":true},{"actual":[0.068548,-0.058548],"check":"two looks at stricter alpha","expected":[0.00027,0.00973],"passed":false},{"actual":null,"check":"repeated fraction is invalid","expected":null,"passed":true},{"actual":null,"check":"decreasing fractions are invalid","expected":null,"passed":true},{"actual":[0.079594,-0.029594],"check":"overrun beyond full information","expected":[0.02843,0.02157],"passed":false},{"actual":[0.046018,-0.024789,-0.011229],"check":"look schedule sample 1","expected":[0.000883,0.003095,0.006022],"passed":false},{"actual":[0.461974,-0.163772,-0.053408,-0.144794],"check":"look schedule sample 2","expected":[0.000235,0.009067,0.010707,0.079991],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"four equally spaced looks\", \"actual\": [0.327095, -0.161319, -0.076151, -0.039625], \"expected\": [8.9e-05, 0.005486, 0.018051, 0.026375], \"passed\": false}, {\"check\": \"single final look spends all alpha\", \"actual\": [0.05], \"expected\": [0.05], \"passed\": true}, {\"check\": \"two looks at stricter alpha\", \"actual\": [0.068548, -0.058548], \"expected\": [0.00027, 0.00973], \"passed\": false}, {\"check\": \"repeated fraction is invalid\", \"actual\": null, \"expected\": null, \"passed\": true}, {\"check\": \"decreasing fractions are invalid\", \"actual\": null, \"expected\": null, \"passed\": true}, {\"check\": \"overrun beyond full information\", \"actual\": [0.079594, -0.029594], \"expected\": [0.02843, 0.02157], \"passed\": false}, {\"check\": \"look schedule sample 1\", \"actual\": [0.046018, -0.024789, -0.011229], \"expected\": [0.000883, 0.003095, 0.006022], \"passed\": false}, {\"check\": \"look schedule sample 2\", \"actual\": [0.461974, -0.163772, -0.053408, -0.144794], \"expected\": [0.000235, 0.009067, 0.010707, 0.079991], \"passed\": false}], \"passed\": false}\n"},"broken":{"elapsed_ms":43.466,"exit_code":1,"observations":[{"actual":[0.0,8.9e-05,0.008879,0.041032],"check":"four equally spaced looks","expected":[8.9e-05,0.005486,0.018051,0.026375],"passed":false},{"actual":[0.05],"check":"single final look spends all alpha","expected":[0.05],"passed":true},{"actual":[0.0,0.01],"check":"two looks at stricter alpha","expected":[0.00027,0.00973],"passed":false},{"actual":null,"check":"repeated fraction is invalid","expected":null,"passed":true},{"actual":null,"check":"decreasing fractions are invalid","expected":null,"passed":true},{"actual":[0.014287,0.035713],"check":"overrun beyond full information","expected":[0.02843,0.02157],"passed":false},{"actual":[1.8e-05,0.001265,0.008717],"check":"look schedule sample 1","expected":[0.000883,0.003095,0.006022],"passed":false},{"actual":[0.0,3.9e-05,0.000964,0.098997],"check":"look schedule sample 2","expected":[0.000235,0.009067,0.010707,0.079991],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"four equally spaced looks\", \"actual\": [0.0, 8.9e-05, 0.008879, 0.041032], \"expected\": [8.9e-05, 0.005486, 0.018051, 0.026375], \"passed\": false}, {\"check\": \"single final look spends all alpha\", \"actual\": [0.05], \"expected\": [0.05], \"passed\": true}, {\"check\": \"two looks at stricter alpha\", \"actual\": [0.0, 0.01], \"expected\": [0.00027, 0.00973], \"passed\": false}, {\"check\": \"repeated fraction is invalid\", \"actual\": null, \"expected\": null, \"passed\": true}, {\"check\": \"decreasing fractions are invalid\", \"actual\": null, \"expected\": null, \"passed\": true}, {\"check\": \"overrun beyond full information\", \"actual\": [0.014287, 0.035713], \"expected\": [0.02843, 0.02157], \"passed\": false}, {\"check\": \"look schedule sample 1\", \"actual\": [1.8e-05, 0.001265, 0.008717], \"expected\": [0.000883, 0.003095, 0.006022], \"passed\": false}, {\"check\": \"look schedule sample 2\", \"actual\": [0.0, 3.9e-05, 0.000964, 0.098997], \"expected\": [0.000235, 0.009067, 0.010707, 0.079991], \"passed\": false}], \"passed\": false}\n"},"fixed":{"elapsed_ms":44.767,"exit_code":0,"observations":[{"actual":[8.9e-05,0.005486,0.018051,0.026375],"check":"four equally spaced looks","expected":[8.9e-05,0.005486,0.018051,0.026375],"passed":true},{"actual":[0.05],"check":"single final look spends all alpha","expected":[0.05],"passed":true},{"actual":[0.00027,0.00973],"check":"two looks at stricter alpha","expected":[0.00027,0.00973],"passed":true},{"actual":null,"check":"repeated fraction is invalid","expected":null,"passed":true},{"actual":null,"check":"decreasing fractions are invalid","expected":null,"passed":true},{"actual":[0.02843,0.02157],"check":"overrun beyond full information","expected":[0.02843,0.02157],"passed":true},{"actual":[0.000883,0.003095,0.006022],"check":"look schedule sample 1","expected":[0.000883,0.003095,0.006022],"passed":true},{"actual":[0.000235,0.009067,0.010707,0.079991],"check":"look schedule sample 2","expected":[0.000235,0.009067,0.010707,0.079991],"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"four equally spaced looks\", \"actual\": [8.9e-05, 0.005486, 0.018051, 0.026375], \"expected\": [8.9e-05, 0.005486, 0.018051, 0.026375], \"passed\": true}, {\"check\": \"single final look spends all alpha\", \"actual\": [0.05], \"expected\": [0.05], \"passed\": true}, {\"check\": \"two looks at stricter alpha\", \"actual\": [0.00027, 0.00973], \"expected\": [0.00027, 0.00973], \"passed\": true}, {\"check\": \"repeated fraction is invalid\", \"actual\": null, \"expected\": null, \"passed\": true}, {\"check\": \"decreasing fractions are invalid\", \"actual\": null, \"expected\": null, \"passed\": true}, {\"check\": \"overrun beyond full information\", \"actual\": [0.02843, 0.02157], \"expected\": [0.02843, 0.02157], \"passed\": true}, {\"check\": \"look schedule sample 1\", \"actual\": [0.000883, 0.003095, 0.006022], \"expected\": [0.000883, 0.003095, 0.006022], \"passed\": true}, {\"check\": \"look schedule sample 2\", \"actual\": [0.000235, 0.009067, 0.010707, 0.079991], \"expected\": [0.000235, 0.009067, 0.010707, 0.079991], \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}