{"abstract":"The second stage cycles on and off every minute during a deep droop.","category":"HVAC thermostat control","checks":8,"contract":"Two-stage furnace thermostat sampled per minute. Stage 1 starts at temp <= setpoint - 1.0 F and ends at temp >= setpoint. Stage 2 requires stage 1 and starts either on droop (temp <= setpoint - 3.0 F) or after stage 1 has been on for more than 10 samples of the current cycle while still below setpoint - 0.5 F; it ends at temp >= setpoint - 0.3 F or when stage 1 ends, and cannot restart within 3 minutes of ending. Return [stage1, stage2] per minute.","contract_signature":"setpoint, temps","evaluation_group":"w2-hvac-thermostat-control-two-stage-heat-upstage","failed_approach":"Letting droop bypass the guard still short-cycles stage 2 when the room is far below setpoint.","family":"w2-hvac-thermostat-control-two-stage-heat-upstage-stage2-min-off","id":"FA-92381","implementations":{"attempt":{"sha256":"cbae724caaee922c4f2ce935d1b9d10218da78be5f556d972aee122c829ae73f","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(setpoint, temps):\n    s1 = False\n    s2 = False\n    run1 = 0\n    s2_off = None\n    out = []\n    for minute, temp in enumerate(temps):\n        if s1 and temp >= setpoint:\n            s1 = False\n        elif not s1 and temp <= setpoint - 10:\n            s1 = True\n            run1 = 0\n        if s1:\n            run1 += 1\n        if s2 and (temp >= setpoint - 3 or not s1):\n            s2 = False\n            s2_off = minute\n        elif not s2 and s1 and (temp <= setpoint - 30 or (run1 > 10 and temp < setpoint - 5)):\n            if s2_off is None or minute - s2_off >= 3 or temp <= setpoint - 30:\n                s2 = True\n        out.append([s1, s2])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700,\n    [668,\n     676,\n     684,\n     689,\n     688,\n     685,\n     691,\n     686,\n     690,\n     688,\n     696,\n     688,\n     691,\n     693,\n     690,\n     693,\n     693,\n     686,\n     679,\n     685,\n     678,\n     682,\n     677,\n     685,\n     679,\n     675,\n     682,\n     688,\n     696]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 2',\n   [700, [650, 652, 648, 644, 640, 637, 645, 650, 657, 654, 651, 644, 643, 651, 645, 643, 635]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 3',\n   [700,\n    [653,\n     657,\n     660,\n     661,\n     657,\n     663,\n     657,\n     661,\n     660,\n     665,\n     673,\n     677,\n     673,\n     677,\n     676,\n     681,\n     681,\n     679,\n     685,\n     677,\n     676,\n     676,\n     679,\n     681,\n     674,\n     677,\n     677]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700,\n    [664,\n     664,\n     656,\n     661,\n     657,\n     652,\n     647,\n     647,\n     642,\n     647,\n     646,\n     644,\n     642,\n     634,\n     634,\n     637,\n     640,\n     644,\n     650,\n     643,\n     640,\n     640]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 2',\n   [700, [678, 683, 689, 697, 705, 705, 710, 705, 704, 709, 701, 709, 710, 710, 704, 696, 702, 705, 709]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 3',\n   [700,\n    [699,\n     691,\n     687,\n     680,\n     688,\n     682,\n     680,\n     676,\n     681,\n     675,\n     672,\n     664,\n     661,\n     665,\n     665,\n     667,\n     674,\n     669,\n     677,\n     671,\n     664,\n     665,\n     672,\n     666,\n     666,\n     664,\n     660,\n     665,\n     662]],\n   [[False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 17',\n   [700,\n    [683,\n     681,\n     687,\n     683,\n     687,\n     689,\n     688,\n     685,\n     684,\n     679,\n     672,\n     678,\n     683,\n     691,\n     683,\n     682,\n     688,\n     687,\n     692,\n     697,\n     692]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, False],\n    [True, False]]],\n  ['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [697,\n     690,\n     685,\n     682,\n     687,\n     690,\n     693,\n     687,\n     689,\n     697,\n     689,\n     685,\n     680,\n     679,\n     671,\n     675,\n     680,\n     675,\n     676,\n     678,\n     673,\n     668,\n     663,\n     662,\n     665,\n     662,\n     661,\n     669,\n     666,\n     665]],\n   [[False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 2',\n   [700,\n    [658,\n     664,\n     670,\n     678,\n     675,\n     681,\n     682,\n     675,\n     677,\n     682,\n     682,\n     680,\n     676,\n     669,\n     672,\n     669,\n     672,\n     671,\n     663,\n     665,\n     663,\n     664,\n     663,\n     656,\n     655,\n     653,\n     661,\n     666,\n     665,\n     657]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700,\n    [682,\n     679,\n     685,\n     683,\n     680,\n     678,\n     684,\n     682,\n     681,\n     688,\n     693,\n     698,\n     702,\n     710,\n     710,\n     710,\n     708,\n     701,\n     694,\n     696,\n     693]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 2',\n   [700,\n    [665,\n     665,\n     663,\n     660,\n     657,\n     651,\n     650,\n     644,\n     639,\n     643,\n     637,\n     635,\n     628,\n     628,\n     636,\n     634,\n     634,\n     638,\n     645,\n     647,\n     654,\n     655,\n     659,\n     660,\n     657,\n     657]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 3',\n   [700, [657, 654, 650, 653, 658, 666, 658, 661, 654, 654, 647, 641, 635, 640, 646]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700, [690, 685, 681, 689, 689, 687, 693, 701, 709, 709, 706, 703, 698, 694, 697, 699, 700, 702]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 2',\n   [700,\n    [696,\n     698,\n     700,\n     696,\n     691,\n     693,\n     688,\n     684,\n     676,\n     671,\n     667,\n     669,\n     667,\n     673,\n     679,\n     684,\n     683,\n     689,\n     681,\n     689,\n     683,\n     689,\n     695,\n     700]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: scenario 3',\n   [700,\n    [653,\n     653,\n     648,\n     651,\n     657,\n     659,\n     654,\n     661,\n     654,\n     662,\n     659,\n     656,\n     662,\n     659,\n     651,\n     658,\n     662,\n     655,\n     662,\n     655,\n     660,\n     659,\n     663,\n     669,\n     665]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"2db29d610d9c655b4dcb412e460729948d47e1dd9e197d9dd23d21c1fbebb4fc","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(setpoint, temps):\n    s1 = False\n    s2 = False\n    run1 = 0\n    s2_off = None\n    out = []\n    for minute, temp in enumerate(temps):\n        if s1 and temp >= setpoint:\n            s1 = False\n        elif not s1 and temp <= setpoint - 10:\n            s1 = True\n            run1 = 0\n        if s1:\n            run1 += 1\n        if s2 and (temp >= setpoint - 3 or not s1):\n            s2 = False\n            s2_off = minute\n        elif not s2 and s1 and (temp <= setpoint - 30 or (run1 > 10 and temp < setpoint - 5)):\n            s2 = True\n        out.append([s1, s2])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700,\n    [668,\n     676,\n     684,\n     689,\n     688,\n     685,\n     691,\n     686,\n     690,\n     688,\n     696,\n     688,\n     691,\n     693,\n     690,\n     693,\n     693,\n     686,\n     679,\n     685,\n     678,\n     682,\n     677,\n     685,\n     679,\n     675,\n     682,\n     688,\n     696]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 2',\n   [700, [650, 652, 648, 644, 640, 637, 645, 650, 657, 654, 651, 644, 643, 651, 645, 643, 635]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 3',\n   [700,\n    [653,\n     657,\n     660,\n     661,\n     657,\n     663,\n     657,\n     661,\n     660,\n     665,\n     673,\n     677,\n     673,\n     677,\n     676,\n     681,\n     681,\n     679,\n     685,\n     677,\n     676,\n     676,\n     679,\n     681,\n     674,\n     677,\n     677]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700,\n    [664,\n     664,\n     656,\n     661,\n     657,\n     652,\n     647,\n     647,\n     642,\n     647,\n     646,\n     644,\n     642,\n     634,\n     634,\n     637,\n     640,\n     644,\n     650,\n     643,\n     640,\n     640]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 2',\n   [700, [678, 683, 689, 697, 705, 705, 710, 705, 704, 709, 701, 709, 710, 710, 704, 696, 702, 705, 709]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 3',\n   [700,\n    [699,\n     691,\n     687,\n     680,\n     688,\n     682,\n     680,\n     676,\n     681,\n     675,\n     672,\n     664,\n     661,\n     665,\n     665,\n     667,\n     674,\n     669,\n     677,\n     671,\n     664,\n     665,\n     672,\n     666,\n     666,\n     664,\n     660,\n     665,\n     662]],\n   [[False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: scenario 17',\n   [700,\n    [683,\n     681,\n     687,\n     683,\n     687,\n     689,\n     688,\n     685,\n     684,\n     679,\n     672,\n     678,\n     683,\n     691,\n     683,\n     682,\n     688,\n     687,\n     692,\n     697,\n     692]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, False],\n    [True, False]]],\n  ['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: scenario 1',\n   [700,\n    [697,\n     690,\n     685,\n     682,\n     687,\n     690,\n     693,\n     687,\n     689,\n     697,\n     689,\n     685,\n     680,\n     679,\n     671,\n     675,\n     680,\n     675,\n     676,\n     678,\n     673,\n     668,\n     663,\n     662,\n     665,\n     662,\n     661,\n     669,\n     666,\n     665]],\n   [[False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 2',\n   [700,\n    [658,\n     664,\n     670,\n     678,\n     675,\n     681,\n     682,\n     675,\n     677,\n     682,\n     682,\n     680,\n     676,\n     669,\n     672,\n     669,\n     672,\n     671,\n     663,\n     665,\n     663,\n     664,\n     663,\n     656,\n     655,\n     653,\n     661,\n     666,\n     665,\n     657]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700,\n    [682,\n     679,\n     685,\n     683,\n     680,\n     678,\n     684,\n     682,\n     681,\n     688,\n     693,\n     698,\n     702,\n     710,\n     710,\n     710,\n     708,\n     701,\n     694,\n     696,\n     693]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 2',\n   [700,\n    [665,\n     665,\n     663,\n     660,\n     657,\n     651,\n     650,\n     644,\n     639,\n     643,\n     637,\n     635,\n     628,\n     628,\n     636,\n     634,\n     634,\n     638,\n     645,\n     647,\n     654,\n     655,\n     659,\n     660,\n     657,\n     657]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['control: scenario 3',\n   [700, [657, 654, 650, 653, 658, 666, 658, 661, 654, 654, 647, 641, 635, 640, 646]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]],\n [['regression: stage two cycling late',\n   [700, [669, 698, 669, 669, 666, 669, 669]],\n   [[True, True], [True, False], [True, False], [True, False], [True, True], [True, True], [True, True]]],\n  ['regression: stage two cycling',\n   [700, [665, 698, 668, 668, 668, 668, 699, 700]],\n   [[True, True],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, False],\n    [False, False]]],\n  ['control: slow recovery upstages on time',\n   [700, [690, 691, 692, 692, 693, 693, 694, 694, 694, 694, 694, 694, 695, 696, 700]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: second cycle after short first',\n   [700, [690, 692, 694, 696, 698, 700, 690, 692, 694, 694, 694, 694, 694, 694, 694, 694, 694]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True]]],\n  ['control: droop recovery above upstage exit',\n   [700, [665, 675, 685, 693, 696, 700]],\n   [[True, True], [True, True], [True, True], [True, True], [True, True], [False, False]]],\n  ['control: scenario 1',\n   [700, [690, 685, 681, 689, 689, 687, 693, 701, 709, 709, 706, 703, 698, 694, 697, 699, 700, 702]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False]]],\n  ['control: scenario 2',\n   [700,\n    [696,\n     698,\n     700,\n     696,\n     691,\n     693,\n     688,\n     684,\n     676,\n     671,\n     667,\n     669,\n     667,\n     673,\n     679,\n     684,\n     683,\n     689,\n     681,\n     689,\n     683,\n     689,\n     695,\n     700]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['control: scenario 3',\n   [700,\n    [653,\n     653,\n     648,\n     651,\n     657,\n     659,\n     654,\n     661,\n     654,\n     662,\n     659,\n     656,\n     662,\n     659,\n     651,\n     658,\n     662,\n     655,\n     662,\n     655,\n     660,\n     659,\n     663,\n     669,\n     665]],\n   [[True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True],\n    [True, True]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic bounded teaching model of one thermostat or HVAC controller decision evaluated per sample. Temperatures are integer tenths of a degree Fahrenheit unless stated otherwise. The contract is a stipulated toy convention, not a claim of conformance to any manufacturer, ASHRAE guideline or code. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-hvac-thermostat-control-two-stage-heat-upstage-stage2-min-off","generated_at":"2026-09-29T14:51:45.166493+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Residential and light-commercial thermostats make these decisions sample by sample; each defect changes equipment calls in a way that shows up as short cycling, comfort complaints or equipment stress.","root_cause":"The minimum off-time guard for stage 2 is missing.","sha256":"d87ccdf79e107c2c030d8e8b6fc7509b139c474677595290daa49b6eb63cf020","title":"Stage 2 restarts immediately after dropping out · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":42.403,"exit_code":1,"observations":[{"actual":[[true,true],[true,false],[true,true],[true,true],[true,true],[true,true],[true,false],[false,false]],"check":"regression: stage two cycling","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[false,false]],"passed":false},{"actual":[[true,true],[true,false],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"regression: stage two cycling late","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true]],"passed":false},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: slow recovery upstages on time","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"check":"control: second cycle after short first","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: droop recovery above upstage exit","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 1","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 2","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 3","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: stage two cycling\", \"actual\": [[true, true], [true, false], [true, true], [true, true], [true, true], [true, true], [true, false], [false, false]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [false, false]], \"passed\": false}, {\"check\": \"regression: stage two cycling late\", \"actual\": [[true, true], [true, false], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true]], \"passed\": false}, {\"check\": \"control: slow recovery upstages on time\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: second cycle after short first\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"passed\": true}, {\"check\": \"control: droop recovery above upstage exit\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"control: scenario 2\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"control: scenario 3\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":41.624,"exit_code":1,"observations":[{"actual":[[true,true],[true,false],[true,true],[true,true],[true,true],[true,true],[true,false],[false,false]],"check":"regression: stage two cycling","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,false],[false,false]],"passed":false},{"actual":[[true,true],[true,false],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"regression: stage two cycling late","expected":[[true,true],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true]],"passed":false},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: slow recovery upstages on time","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"check":"control: second cycle after short first","expected":[[true,false],[true,false],[true,false],[true,false],[true,false],[false,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,false],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"check":"control: droop recovery above upstage exit","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[false,false]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 1","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 2","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"check":"control: scenario 3","expected":[[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true],[true,true]],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: stage two cycling\", \"actual\": [[true, true], [true, false], [true, true], [true, true], [true, true], [true, true], [true, false], [false, false]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, false], [false, false]], \"passed\": false}, {\"check\": \"regression: stage two cycling late\", \"actual\": [[true, true], [true, false], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true]], \"passed\": false}, {\"check\": \"control: slow recovery upstages on time\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: second cycle after short first\", \"actual\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"expected\": [[true, false], [true, false], [true, false], [true, false], [true, false], [false, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, false], [true, true]], \"passed\": true}, {\"check\": \"control: droop recovery above upstage exit\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [false, false]], \"passed\": true}, {\"check\": \"control: scenario 1\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"control: scenario 2\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"control: scenario 3\", \"actual\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"expected\": [[true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true], [true, true]], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}