{"abstract":"The second stage kicks in after ten minutes even when the room is within a few tenths of setpoint, overshooting.","category":"HVAC thermostat control","checks":8,"contract":"Two-stage furnace thermostat sampled per minute. Stage 1 starts at temp <= setpoint - 1.0 F and ends at temp >= setpoint. Stage 2 requires stage 1 and starts either on droop (temp <= setpoint - 3.0 F) or after stage 1 has been on for more than 10 samples of the current cycle while still below setpoint - 0.5 F; it ends at temp >= setpoint - 0.3 F or when stage 1 ends, and cannot restart within 3 minutes of ending. Return [stage1, stage2] per minute.","contract_signature":"setpoint, temps","evaluation_group":"w2-hvac-thermostat-control-two-stage-heat-upstage","failed_approach":"Qualifying with temp < setpoint still upstages within the last half degree.","family":"w2-hvac-thermostat-control-two-stage-heat-upstage-upstage-temperature-gate","id":"FA-92371","implementations":{"attempt":{"sha256":"36592134f90e6e4d4dc68f6b6e99c74bc80a718492f23fbed9480553a2f89a70","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(setpoint, temps):\n    s1 = False\n    s2 = False\n    run1 = 0\n    s2_off = None\n    out = []\n    for minute, temp in enumerate(temps):\n        if s1 and temp >= setpoint:\n            s1 = False\n        elif not s1 and temp <= setpoint - 10:\n            s1 = True\n            run1 = 0\n        if s1:\n            run1 += 1\n        if s2 and (temp >= setpoint - 3 or not s1):\n            s2 = False\n            s2_off = minute\n        elif not s2 and s1 and (temp <= setpoint - 30 or (run1 > 10 and temp < setpoint)):\n            if s2_off is None or minute - s2_off >= 3:\n                s2 = True\n        out.append([s1, s2])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: scenario 27',\n   [700,\n    [678,\n     676,\n     674,\n     680,\n     681,\n     673,\n     681,\n     680,\n     680,\n     684,\n     689,\n     693,\n     699,\n     693,\n     695,\n     698,\n     690,\n     695,\n     688,\n     693,\n     698,\n     690,\n     698,\n     703]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False]]],\n  ['regression: scenario 36',\n   [700, [681, 681, 689, 682, 678, 685, 693, 687, 691, 695, 695, 694, 702, 707, 701, 707]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [668,\n     676,\n     684,\n     689,\n     688,\n     685,\n     691,\n     686,\n     690,\n     688,\n     696,\n     688,\n     691,\n     693,\n     690,\n     693,\n     693,\n     686,\n     679,\n     685,\n     678,\n     682,\n     677,\n     685,\n     679,\n     675,\n     682,\n     688,\n     696]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 34',\n   [700, [690, 690, 690, 688, 693, 697, 698, 694, 696, 688, 695, 691, 687, 687, 684, 678, 674, 680, 680]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['regression: scenario 39',\n   [700, [677, 677, 684, 690, 693, 687, 689, 689, 691, 694, 695, 701, 709, 710, 704, 709, 708, 706]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [664,\n     664,\n     656,\n     661,\n     657,\n     652,\n     647,\n     647,\n     642,\n     647,\n     646,\n     644,\n     642,\n     634,\n     634,\n     637,\n     640,\n     644,\n     650,\n     643,\n     640,\n     640]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 29',\n   [700, [694, 696, 695, 690, 689, 697, 697, 689, 687, 688, 692, 696, 694, 697, 703]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False]]],\n  ['regression: scenario 48',\n   [700,\n    [698,\n     693,\n     699,\n     698,\n     690,\n     698,\n     699,\n     695,\n     688,\n     689,\n     681,\n     681,\n     689,\n     688,\n     696,\n     702,\n     710,\n     710,\n     710,\n     710,\n     710,\n     710,\n     703,\n     705,\n     705,\n     702,\n     702,\n     710,\n     706,\n     698]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [697,\n     690,\n     685,\n     682,\n     687,\n     690,\n     693,\n     687,\n     689,\n     697,\n     689,\n     685,\n     680,\n     679,\n     671,\n     675,\n     680,\n     675,\n     676,\n     678,\n     673,\n     668,\n     663,\n     662,\n     665,\n     662,\n     661,\n     669,\n     666,\n     665]],\n   [[False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 58',\n   [700,\n    [692,\n     687,\n     679,\n     674,\n     681,\n     675,\n     679,\n     687,\n     692,\n     694,\n     690,\n     696,\n     695,\n     700,\n     695,\n     692,\n     691,\n     687,\n     687,\n     682,\n     686,\n     680,\n     685,\n     692,\n     690]],\n   [[False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [682,\n     679,\n     685,\n     683,\n     680,\n     678,\n     684,\n     682,\n     681,\n     688,\n     693,\n     698,\n     702,\n     710,\n     710,\n     710,\n     708,\n     701,\n     694,\n     696,\n     693]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 2',\n   [700,\n    [665,\n     665,\n     663,\n     660,\n     657,\n     651,\n     650,\n     644,\n     639,\n     643,\n     637,\n     635,\n     628,\n     628,\n     636,\n     634,\n     634,\n     638,\n     645,\n     647,\n     654,\n     655,\n     659,\n     660,\n     657,\n     657]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 13',\n   [700,\n    [686,\n     678,\n     680,\n     680,\n     686,\n     686,\n     692,\n     695,\n     697,\n     696,\n     699,\n     697,\n     704,\n     710,\n     706,\n     709,\n     707,\n     709,\n     702,\n     707,\n     707,\n     709,\n     710,\n     710,\n     703,\n     702,\n     702]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['regression: scenario 12',\n   [700,\n    [677,\n     675,\n     680,\n     674,\n     677,\n     682,\n     688,\n     683,\n     683,\n     691,\n     696,\n     700,\n     703,\n     696,\n     697,\n     696,\n     692,\n     690,\n     686,\n     678,\n     682,\n     686,\n     689,\n     685,\n     677,\n     672,\n     668,\n     671,\n     674]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700, [690, 685, 681, 689, 689, 687, 693, 701, 709, 709, 706, 703, 698, 694, 697, 699, 700, 702]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"bcf04204496d598a0baaf1be56252150f9dd1ce469f573ed485efbd5213d2054","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(setpoint, temps):\n    s1 = False\n    s2 = False\n    run1 = 0\n    s2_off = None\n    out = []\n    for minute, temp in enumerate(temps):\n        if s1 and temp >= setpoint:\n            s1 = False\n        elif not s1 and temp <= setpoint - 10:\n            s1 = True\n            run1 = 0\n        if s1:\n            run1 += 1\n        if s2 and (temp >= setpoint - 3 or not s1):\n            s2 = False\n            s2_off = minute\n        elif not s2 and s1 and (temp <= setpoint - 30 or (run1 > 10)):\n            if s2_off is None or minute - s2_off >= 3:\n                s2 = True\n        out.append([s1, s2])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: scenario 27',\n   [700,\n    [678,\n     676,\n     674,\n     680,\n     681,\n     673,\n     681,\n     680,\n     680,\n     684,\n     689,\n     693,\n     699,\n     693,\n     695,\n     698,\n     690,\n     695,\n     688,\n     693,\n     698,\n     690,\n     698,\n     703]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False]]],\n  ['regression: scenario 36',\n   [700, [681, 681, 689, 682, 678, 685, 693, 687, 691, 695, 695, 694, 702, 707, 701, 707]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [668,\n     676,\n     684,\n     689,\n     688,\n     685,\n     691,\n     686,\n     690,\n     688,\n     696,\n     688,\n     691,\n     693,\n     690,\n     693,\n     693,\n     686,\n     679,\n     685,\n     678,\n     682,\n     677,\n     685,\n     679,\n     675,\n     682,\n     688,\n     696]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 34',\n   [700, [690, 690, 690, 688, 693, 697, 698, 694, 696, 688, 695, 691, 687, 687, 684, 678, 674, 680, 680]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['regression: scenario 39',\n   [700, [677, 677, 684, 690, 693, 687, 689, 689, 691, 694, 695, 701, 709, 710, 704, 709, 708, 706]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [664,\n     664,\n     656,\n     661,\n     657,\n     652,\n     647,\n     647,\n     642,\n     647,\n     646,\n     644,\n     642,\n     634,\n     634,\n     637,\n     640,\n     644,\n     650,\n     643,\n     640,\n     640]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 29',\n   [700, [694, 696, 695, 690, 689, 697, 697, 689, 687, 688, 692, 696, 694, 697, 703]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False]]],\n  ['regression: scenario 48',\n   [700,\n    [698,\n     693,\n     699,\n     698,\n     690,\n     698,\n     699,\n     695,\n     688,\n     689,\n     681,\n     681,\n     689,\n     688,\n     696,\n     702,\n     710,\n     710,\n     710,\n     710,\n     710,\n     710,\n     703,\n     705,\n     705,\n     702,\n     702,\n     710,\n     706,\n     698]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [697,\n     690,\n     685,\n     682,\n     687,\n     690,\n     693,\n     687,\n     689,\n     697,\n     689,\n     685,\n     680,\n     679,\n     671,\n     675,\n     680,\n     675,\n     676,\n     678,\n     673,\n     668,\n     663,\n     662,\n     665,\n     662,\n     661,\n     669,\n     666,\n     665]],\n   [[False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 58',\n   [700,\n    [692,\n     687,\n     679,\n     674,\n     681,\n     675,\n     679,\n     687,\n     692,\n     694,\n     690,\n     696,\n     695,\n     700,\n     695,\n     692,\n     691,\n     687,\n     687,\n     682,\n     686,\n     680,\n     685,\n     692,\n     690]],\n   [[False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [682,\n     679,\n     685,\n     683,\n     680,\n     678,\n     684,\n     682,\n     681,\n     688,\n     693,\n     698,\n     702,\n     710,\n     710,\n     710,\n     708,\n     701,\n     694,\n     696,\n     693]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 2',\n   [700,\n    [665,\n     665,\n     663,\n     660,\n     657,\n     651,\n     650,\n     644,\n     639,\n     643,\n     637,\n     635,\n     628,\n     628,\n     636,\n     634,\n     634,\n     638,\n     645,\n     647,\n     654,\n     655,\n     659,\n     660,\n     657,\n     657]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 13',\n   [700,\n    [686,\n     678,\n     680,\n     680,\n     686,\n     686,\n     692,\n     695,\n     697,\n     696,\n     699,\n     697,\n     704,\n     710,\n     706,\n     709,\n     707,\n     709,\n     702,\n     707,\n     707,\n     709,\n     710,\n     710,\n     703,\n     702,\n     702]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['regression: scenario 12',\n   [700,\n    [677,\n     675,\n     680,\n     674,\n     677,\n     682,\n     688,\n     683,\n     683,\n     691,\n     696,\n     700,\n     703,\n     696,\n     697,\n     696,\n     692,\n     690,\n     686,\n     678,\n     682,\n     686,\n     689,\n     685,\n     677,\n     672,\n     668,\n     671,\n     674]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700, [690, 685, 681, 689, 689, 687, 693, 701, 709, 709, 706, 703, 698, 694, 697, 699, 700, 702]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic bounded teaching model of one thermostat or HVAC controller decision evaluated per sample. Temperatures are integer tenths of a degree Fahrenheit unless stated otherwise. The contract is a stipulated toy convention, not a claim of conformance to any manufacturer, ASHRAE guideline or code. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-hvac-thermostat-control-two-stage-heat-upstage-upstage-temperature-gate","generated_at":"2026-09-29T14:51:45.133380+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Residential and light-commercial thermostats make these decisions sample by sample; each defect changes equipment calls in a way that shows up as short cycling, comfort complaints or equipment stress.","root_cause":"The time-based upstage condition omits the temperature qualifier.","sha256":"097398175b0c4839554e670e1b2e05aebbe437c18502353b092ca803bb93f6f4","title":"Stage-2 time upstage ignores how close the room is to setpoint · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":40.01,"exit_code":1,"observations":[{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[true,true],[true,false],[true,false],[true,false],[false,false]],"check":"regression: scenario 27","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[true,false],[true,false],[true,false],[false,false]],"passed":false},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[false,false],[false,false],[false,false],[false,false]],"check":"regression: scenario 36","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[false,false],[false,false],[false,false],[false,false]],"passed":false},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: slow recovery upstages on time","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"check":"control: second cycle after short first","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: droop recovery above upstage exit","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[false,false]],"check":"control: stage two cycling","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[false,false]],"passed":true},{"actual":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true]],"check":"control: stage two cycling late","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 1","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: scenario 27\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [true, true], [true, false], [true, false], [true, false], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [true, false], [true, false], [true, false], [false, false]], \"passed\": false}, {\"check\": \"regression: scenario 36\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [false, false], [false, false], [false, false], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [false, false], [false, false], [false, false], [false, false]], \"passed\": false}, {\"check\": \"control: slow recovery upstages on time\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: second cycle after short first\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"passed\": true}, {\"check\": \"control: droop recovery above upstage exit\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: stage two cycling\", \"actual\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [false, false]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [false, false]], \"passed\": true}, {\"check\": \"control: stage two cycling late\", \"actual\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":40.549,"exit_code":1,"observations":[{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[true,true],[true,false],[true,false],[true,false],[false,false]],"check":"regression: scenario 27","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[true,false],[true,false],[true,false],[false,false]],"passed":false},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[false,false],[false,false],[false,false],[false,false]],"check":"regression: scenario 36","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[false,false],[false,false],[false,false],[false,false]],"passed":false},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: slow recovery upstages on time","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"check":"control: second cycle after short first","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: droop recovery above upstage exit","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[false,false]],"check":"control: stage two cycling","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[false,false]],"passed":true},{"actual":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true]],"check":"control: stage two cycling late","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 1","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: scenario 27\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [true, true], [true, false], [true, false], [true, false], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [true, false], [true, false], [true, false], [false, false]], \"passed\": false}, {\"check\": \"regression: scenario 36\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [false, false], [false, false], [false, false], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [false, false], [false, false], [false, false], [false, false]], \"passed\": false}, {\"check\": \"control: slow recovery upstages on time\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: second cycle after short first\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"passed\": true}, {\"check\": \"control: droop recovery above upstage exit\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: stage two cycling\", \"actual\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [false, false]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [false, false]], \"passed\": true}, {\"check\": \"control: stage two cycling late\", \"actual\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}