{"abstract":"The valve clicks over at the end of every cooling call and must shift back (with an equalization delay) on the next call.","category":"HVAC thermostat control","checks":8,"contract":"Heat pump reversing valve output (O/B terminal) and compressor per sample; samples are the call (heat, cool or None). An O-type valve is energized for cooling, a B-type for heating. The valve is de-energized at power-up and holds its last position while idle. On a sample where the valve changes position the compressor waits (off) for pressure equalization. Return [compressor, valve_energized].","evaluation_group":"w2-hvac-thermostat-control-reversing-valve-terminal","failed_approach":"Reporting the valve de-energized while remembering it internally misreports the terminal.","family":"w2-hvac-thermostat-control-reversing-valve-terminal-idle-valve-hold","id":"FA-92781","implementations":{"attempt":{"sha256":"93fd2ee97f0b9eb59c64074f161947649fd2b1ac79f5571a08c90d064a4290f0","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(valve_type, samples):\n    valve = False\n    out = []\n    for call in samples:\n        if call is None:\n            out.append([False, False])\n            continue\n        want = (call == 'cool') if valve_type == 'O' else (call == 'heat')\n        changed = want != valve\n        valve = want\n        out.append([not changed, valve])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['B', ['cool', 'heat', 'heat', None, None, 'cool', 'cool', 'heat', 'heat', 'heat', 'heat']],\n   [[True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['regression: scenario 2',\n   ['B',\n    ['heat',\n     'heat',\n     'cool',\n     'cool',\n     'heat',\n     None,\n     'heat',\n     'cool',\n     'heat',\n     'heat',\n     'cool',\n     None,\n     'heat',\n     'cool']],\n   [[False, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, True],\n    [False, False]]],\n  ['control: scenario 3',\n   ['O', ['cool', 'cool', 'cool', 'heat', None, None, 'heat', 'cool', 'heat', 'heat', None, 'heat', 'heat']],\n   [[False, True],\n    [True, True],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False]]],\n  ['regression: scenario 4',\n   ['B', [None, 'heat', 'cool', 'cool', 'cool', 'cool', 'heat', 'heat', None, 'cool']],\n   [[False, False],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, False]]]],\n [['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['regression: scenario 1',\n   ['B', [None, None, 'heat', None, 'cool', 'cool', 'cool', 'heat', None, 'cool', None]],\n   [[False, False],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 2',\n   ['B', ['heat', 'cool', 'heat', None, 'cool', 'heat', None, 'heat', None, 'cool', None]],\n   [[False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, False],\n    [False, False]]],\n  ['regression: scenario 3',\n   ['B', [None, 'heat', None, None, None, None, 'cool', 'heat', 'heat', None]],\n   [[False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [False, True]]],\n  ['regression: scenario 4',\n   ['B', ['heat', 'cool', 'cool', 'heat', 'heat', None, 'heat']],\n   [[False, True], [False, False], [True, False], [False, True], [True, True], [False, True], [True, True]]]],\n [['regression: scenario 1',\n   ['B', ['cool', 'heat', 'heat', 'cool', 'cool', None, 'cool', 'heat', 'heat', None, None, 'heat']],\n   [[True, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True],\n    [True, True]]],\n  ['regression: scenario 3',\n   ['B', ['cool', 'heat', None, None, None, 'heat', 'heat', 'cool']],\n   [[True, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['control: scenario 2',\n   ['O', [None, 'cool', 'heat', 'cool', 'heat', 'heat']],\n   [[False, False], [False, True], [False, False], [False, True], [False, False], [True, False]]],\n  ['regression: scenario 4',\n   ['O', ['heat', 'heat', 'heat', 'heat', 'heat', 'cool', None, 'cool', 'cool', None]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, True]]]],\n [['regression: scenario 2',\n   ['B', ['cool', 'cool', 'heat', None, 'cool', 'cool', None, 'cool']],\n   [[True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False]]],\n  ['regression: scenario 3',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'heat', 'cool', 'heat', None, 'heat', None, 'heat']],\n   [[False, True],\n    [True, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['O', ['heat', 'cool', None, 'cool', None, None, 'cool']],\n   [[True, False], [False, True], [False, True], [True, True], [False, True], [False, True], [True, True]]],\n  ['regression: scenario 4',\n   ['O', ['cool', None, None, 'heat', 'cool', None, 'heat', None, None, 'cool', 'cool']],\n   [[False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, True],\n    [True, True]]]],\n [['regression: scenario 5',\n   ['O', [None, 'cool', None, None, 'heat', 'cool', 'heat', None, 'cool', 'heat']],\n   [[False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, False],\n    [False, True],\n    [False, False]]],\n  ['regression: scenario 8',\n   ['B',\n    [None,\n     'heat',\n     'heat',\n     'cool',\n     'heat',\n     'heat',\n     'heat',\n     'cool',\n     'cool',\n     'cool',\n     'heat',\n     'heat',\n     None,\n     None]],\n   [[False, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['O', ['heat', None, 'cool', None, 'heat', 'cool', 'heat', 'cool', None, None, None]],\n   [[True, False],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True]]],\n  ['control: scenario 2',\n   ['B', [None, None, None, None, 'cool', None, 'heat', 'cool', None]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, False]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"a51383a89e68d67b96135209a68d3083422ce8a4f222eba32a94cc28cb362047","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(valve_type, samples):\n    valve = False\n    out = []\n    for call in samples:\n        if call is None:\n            valve = False\n            out.append([False, valve])\n            continue\n        want = (call == 'cool') if valve_type == 'O' else (call == 'heat')\n        changed = want != valve\n        valve = want\n        out.append([not changed, valve])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['B', ['cool', 'heat', 'heat', None, None, 'cool', 'cool', 'heat', 'heat', 'heat', 'heat']],\n   [[True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['regression: scenario 2',\n   ['B',\n    ['heat',\n     'heat',\n     'cool',\n     'cool',\n     'heat',\n     None,\n     'heat',\n     'cool',\n     'heat',\n     'heat',\n     'cool',\n     None,\n     'heat',\n     'cool']],\n   [[False, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, True],\n    [False, False]]],\n  ['control: scenario 3',\n   ['O', ['cool', 'cool', 'cool', 'heat', None, None, 'heat', 'cool', 'heat', 'heat', None, 'heat', 'heat']],\n   [[False, True],\n    [True, True],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False]]],\n  ['regression: scenario 4',\n   ['B', [None, 'heat', 'cool', 'cool', 'cool', 'cool', 'heat', 'heat', None, 'cool']],\n   [[False, False],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, False]]]],\n [['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['regression: scenario 1',\n   ['B', [None, None, 'heat', None, 'cool', 'cool', 'cool', 'heat', None, 'cool', None]],\n   [[False, False],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 2',\n   ['B', ['heat', 'cool', 'heat', None, 'cool', 'heat', None, 'heat', None, 'cool', None]],\n   [[False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, False],\n    [False, False]]],\n  ['regression: scenario 3',\n   ['B', [None, 'heat', None, None, None, None, 'cool', 'heat', 'heat', None]],\n   [[False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [False, True]]],\n  ['regression: scenario 4',\n   ['B', ['heat', 'cool', 'cool', 'heat', 'heat', None, 'heat']],\n   [[False, True], [False, False], [True, False], [False, True], [True, True], [False, True], [True, True]]]],\n [['regression: scenario 1',\n   ['B', ['cool', 'heat', 'heat', 'cool', 'cool', None, 'cool', 'heat', 'heat', None, None, 'heat']],\n   [[True, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True],\n    [True, True]]],\n  ['regression: scenario 3',\n   ['B', ['cool', 'heat', None, None, None, 'heat', 'heat', 'cool']],\n   [[True, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['control: scenario 2',\n   ['O', [None, 'cool', 'heat', 'cool', 'heat', 'heat']],\n   [[False, False], [False, True], [False, False], [False, True], [False, False], [True, False]]],\n  ['regression: scenario 4',\n   ['O', ['heat', 'heat', 'heat', 'heat', 'heat', 'cool', None, 'cool', 'cool', None]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, True]]]],\n [['regression: scenario 2',\n   ['B', ['cool', 'cool', 'heat', None, 'cool', 'cool', None, 'cool']],\n   [[True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False]]],\n  ['regression: scenario 3',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'heat', 'cool', 'heat', None, 'heat', None, 'heat']],\n   [[False, True],\n    [True, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['O', ['heat', 'cool', None, 'cool', None, None, 'cool']],\n   [[True, False], [False, True], [False, True], [True, True], [False, True], [False, True], [True, True]]],\n  ['regression: scenario 4',\n   ['O', ['cool', None, None, 'heat', 'cool', None, 'heat', None, None, 'cool', 'cool']],\n   [[False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, True],\n    [True, True]]]],\n [['regression: scenario 5',\n   ['O', [None, 'cool', None, None, 'heat', 'cool', 'heat', None, 'cool', 'heat']],\n   [[False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, False],\n    [False, True],\n    [False, False]]],\n  ['regression: scenario 8',\n   ['B',\n    [None,\n     'heat',\n     'heat',\n     'cool',\n     'heat',\n     'heat',\n     'heat',\n     'cool',\n     'cool',\n     'cool',\n     'heat',\n     'heat',\n     None,\n     None]],\n   [[False, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['O', ['heat', None, 'cool', None, 'heat', 'cool', 'heat', 'cool', None, None, None]],\n   [[True, False],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True]]],\n  ['control: scenario 2',\n   ['B', [None, None, None, None, 'cool', None, 'heat', 'cool', None]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, False]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"db0530edcb222da8ca5893ff150403abe4795114a33125e57ee7bb8ff32b3462","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(valve_type, samples):\n    valve = False\n    out = []\n    for call in samples:\n        if call is None:\n            out.append([False, valve])\n            continue\n        want = (call == 'cool') if valve_type == 'O' else (call == 'heat')\n        changed = want != valve\n        valve = want\n        out.append([not changed, valve])\n    return out\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [[['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['B', ['cool', 'heat', 'heat', None, None, 'cool', 'cool', 'heat', 'heat', 'heat', 'heat']],\n   [[True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [True, True],\n    [True, True]]],\n  ['regression: scenario 2',\n   ['B',\n    ['heat',\n     'heat',\n     'cool',\n     'cool',\n     'heat',\n     None,\n     'heat',\n     'cool',\n     'heat',\n     'heat',\n     'cool',\n     None,\n     'heat',\n     'cool']],\n   [[False, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, True],\n    [False, False]]],\n  ['control: scenario 3',\n   ['O', ['cool', 'cool', 'cool', 'heat', None, None, 'heat', 'cool', 'heat', 'heat', None, 'heat', 'heat']],\n   [[False, True],\n    [True, True],\n    [True, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [True, False]]],\n  ['regression: scenario 4',\n   ['B', [None, 'heat', 'cool', 'cool', 'cool', 'cool', 'heat', 'heat', None, 'cool']],\n   [[False, False],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, False]]]],\n [['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['regression: scenario 1',\n   ['B', [None, None, 'heat', None, 'cool', 'cool', 'cool', 'heat', None, 'cool', None]],\n   [[False, False],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 2',\n   ['B', ['heat', 'cool', 'heat', None, 'cool', 'heat', None, 'heat', None, 'cool', None]],\n   [[False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, False],\n    [False, False]]],\n  ['regression: scenario 3',\n   ['B', [None, 'heat', None, None, None, None, 'cool', 'heat', 'heat', None]],\n   [[False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [False, True]]],\n  ['regression: scenario 4',\n   ['B', ['heat', 'cool', 'cool', 'heat', 'heat', None, 'heat']],\n   [[False, True], [False, False], [True, False], [False, True], [True, True], [False, True], [True, True]]]],\n [['regression: scenario 1',\n   ['B', ['cool', 'heat', 'heat', 'cool', 'cool', None, 'cool', 'heat', 'heat', None, None, 'heat']],\n   [[True, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True],\n    [True, True]]],\n  ['regression: scenario 3',\n   ['B', ['cool', 'heat', None, None, None, 'heat', 'heat', 'cool']],\n   [[True, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['control: scenario 2',\n   ['O', [None, 'cool', 'heat', 'cool', 'heat', 'heat']],\n   [[False, False], [False, True], [False, False], [False, True], [False, False], [True, False]]],\n  ['regression: scenario 4',\n   ['O', ['heat', 'heat', 'heat', 'heat', 'heat', 'cool', None, 'cool', 'cool', None]],\n   [[True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, True]]]],\n [['regression: scenario 2',\n   ['B', ['cool', 'cool', 'heat', None, 'cool', 'cool', None, 'cool']],\n   [[True, False],\n    [True, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False]]],\n  ['regression: scenario 3',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'heat', 'cool', 'heat', None, 'heat', None, 'heat']],\n   [[False, True],\n    [True, True],\n    [False, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, False],\n    [True, False]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['O', ['heat', 'cool', None, 'cool', None, None, 'cool']],\n   [[True, False], [False, True], [False, True], [True, True], [False, True], [False, True], [True, True]]],\n  ['regression: scenario 4',\n   ['O', ['cool', None, None, 'heat', 'cool', None, 'heat', None, None, 'cool', 'cool']],\n   [[False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, False],\n    [False, False],\n    [False, True],\n    [True, True]]]],\n [['regression: scenario 5',\n   ['O', [None, 'cool', None, None, 'heat', 'cool', 'heat', None, 'cool', 'heat']],\n   [[False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, False],\n    [False, True],\n    [False, False]]],\n  ['regression: scenario 8',\n   ['B',\n    [None,\n     'heat',\n     'heat',\n     'cool',\n     'heat',\n     'heat',\n     'heat',\n     'cool',\n     'cool',\n     'cool',\n     'heat',\n     'heat',\n     None,\n     None]],\n   [[False, False],\n    [False, True],\n    [True, True],\n    [False, False],\n    [False, True],\n    [True, True],\n    [True, True],\n    [False, False],\n    [True, False],\n    [True, False],\n    [False, True],\n    [True, True],\n    [False, True],\n    [False, True]]],\n  ['regression: O valve season change',\n   ['O', ['cool', 'cool', None, 'heat', 'heat', 'cool']],\n   [[False, True], [True, True], [False, True], [False, False], [True, False], [False, True]]],\n  ['regression: B valve idle hold',\n   ['B', ['heat', None, 'heat']],\n   [[False, True], [False, True], [True, True]]],\n  ['control: first call heat on O',\n   ['O', ['heat', 'heat', None, 'cool']],\n   [[True, False], [True, False], [False, False], [False, True]]],\n  ['control: first call cool on B',\n   ['B', ['cool', None, 'cool', 'heat']],\n   [[True, False], [False, False], [True, False], [False, True]]],\n  ['regression: scenario 1',\n   ['O', ['heat', None, 'cool', None, 'heat', 'cool', 'heat', 'cool', None, None, None]],\n   [[True, False],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, True],\n    [False, True],\n    [False, True],\n    [False, True]]],\n  ['control: scenario 2',\n   ['B', [None, None, None, None, 'cool', None, 'heat', 'cool', None]],\n   [[False, False],\n    [False, False],\n    [False, False],\n    [False, False],\n    [True, False],\n    [False, False],\n    [False, True],\n    [False, False],\n    [False, False]]]]]\nfor label, args, expected in fixtures[N-1]:\n    check(label, solve(*args), expected)\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"A deterministic bounded teaching model of one thermostat or HVAC controller decision evaluated per sample. Temperatures are integer tenths of a degree Fahrenheit unless stated otherwise. The contract is a stipulated toy convention, not a claim of conformance to any manufacturer, ASHRAE guideline or code. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w2-hvac-thermostat-control-reversing-valve-terminal-idle-valve-hold","generated_at":"2026-09-29T14:51:49.092427+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Residential and light-commercial thermostats make these decisions sample by sample; each defect changes equipment calls in a way that shows up as short cycling, comfort complaints or equipment stress.","repair":"Hold the valve position while idle.","root_cause":"The idle branch de-energizes the valve.","sha256":"91a9e15dee98b776add1c8b2edf9ca49ded69bcf8aa11182e8d50dbc221ec29e","title":"Reversing valve drops out between calls · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":39.335,"exit_code":1,"observations":[{"actual":[[false,true],[true,true],[false,false],[false,false],[true,false],[false,true]],"check":"regression: O valve season change","expected":[[false,true],[true,true],[false,true],[false,false],[true,false],[false,true]],"passed":false},{"actual":[[false,true],[false,false],[true,true]],"check":"regression: B valve idle hold","expected":[[false,true],[false,true],[true,true]],"passed":false},{"actual":[[true,false],[true,false],[false,false],[false,true]],"check":"control: first call heat on O","expected":[[true,false],[true,false],[false,false],[false,true]],"passed":true},{"actual":[[true,false],[false,false],[true,false],[false,true]],"check":"control: first call cool on B","expected":[[true,false],[false,false],[true,false],[false,true]],"passed":true},{"actual":[[true,false],[false,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[true,true],[true,true],[true,true]],"check":"regression: scenario 1","expected":[[true,false],[false,true],[true,true],[false,true],[false,true],[false,false],[true,false],[false,true],[true,true],[true,true],[true,true]],"passed":false},{"actual":[[false,true],[true,true],[false,false],[true,false],[false,true],[false,false],[true,true],[false,false],[false,true],[true,true],[false,false],[false,false],[false,true],[false,false]],"check":"regression: scenario 2","expected":[[false,true],[true,true],[false,false],[true,false],[false,true],[false,true],[true,true],[false,false],[false,true],[true,true],[false,false],[false,false],[false,true],[false,false]],"passed":false},{"actual":[[false,true],[true,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[false,false],[true,false],[false,false],[true,false],[true,false]],"check":"control: scenario 3","expected":[[false,true],[true,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[false,false],[true,false],[false,false],[true,false],[true,false]],"passed":true},{"actual":[[false,false],[false,true],[false,false],[true,false],[true,false],[true,false],[false,true],[true,true],[false,false],[false,false]],"check":"regression: scenario 4","expected":[[false,false],[false,true],[false,false],[true,false],[true,false],[true,false],[false,true],[true,true],[false,true],[false,false]],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: O valve season change\", \"actual\": [[false, true], [true, true], [false, false], [false, false], [true, false], [false, true]], \"expected\": [[false, true], [true, true], [false, true], [false, false], [true, false], [false, true]], \"passed\": false}, {\"check\": \"regression: B valve idle hold\", \"actual\": [[false, true], [false, false], [true, true]], \"expected\": [[false, true], [false, true], [true, true]], \"passed\": false}, {\"check\": \"control: first call heat on O\", \"actual\": [[true, false], [true, false], [false, false], [false, true]], \"expected\": [[true, false], [true, false], [false, false], [false, true]], \"passed\": true}, {\"check\": \"control: first call cool on B\", \"actual\": [[true, false], [false, false], [true, false], [false, true]], \"expected\": [[true, false], [false, false], [true, false], [false, true]], \"passed\": true}, {\"check\": \"regression: scenario 1\", \"actual\": [[true, false], [false, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [true, true], [true, true], [true, true]], \"expected\": [[true, false], [false, true], [true, true], [false, true], [false, true], [false, false], [true, false], [false, true], [true, true], [true, true], [true, true]], \"passed\": false}, {\"check\": \"regression: scenario 2\", \"actual\": [[false, true], [true, true], [false, false], [true, false], [false, true], [false, false], [true, true], [false, false], [false, true], [true, true], [false, false], [false, false], [false, true], [false, false]], \"expected\": [[false, true], [true, true], [false, false], [true, false], [false, true], [false, true], [true, true], [false, false], [false, true], [true, true], [false, false], [false, false], [false, true], [false, false]], \"passed\": false}, {\"check\": \"control: scenario 3\", \"actual\": [[false, true], [true, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [false, false], [true, false], [false, false], [true, false], [true, false]], \"expected\": [[false, true], [true, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [false, false], [true, false], [false, false], [true, false], [true, false]], \"passed\": true}, {\"check\": \"regression: scenario 4\", \"actual\": [[false, false], [false, true], [false, false], [true, false], [true, false], [true, false], [false, true], [true, true], [false, false], [false, false]], \"expected\": [[false, false], [false, true], [false, false], [true, false], [true, false], [true, false], [false, true], [true, true], [false, true], [false, false]], \"passed\": false}], \"passed\": false}\n"},"broken":{"elapsed_ms":38.959,"exit_code":1,"observations":[{"actual":[[false,true],[true,true],[false,false],[true,false],[true,false],[false,true]],"check":"regression: O valve season change","expected":[[false,true],[true,true],[false,true],[false,false],[true,false],[false,true]],"passed":false},{"actual":[[false,true],[false,false],[false,true]],"check":"regression: B valve idle hold","expected":[[false,true],[false,true],[true,true]],"passed":false},{"actual":[[true,false],[true,false],[false,false],[false,true]],"check":"control: first call heat on O","expected":[[true,false],[true,false],[false,false],[false,true]],"passed":true},{"actual":[[true,false],[false,false],[true,false],[false,true]],"check":"control: first call cool on B","expected":[[true,false],[false,false],[true,false],[false,true]],"passed":true},{"actual":[[true,false],[false,true],[true,true],[false,false],[false,false],[true,false],[true,false],[false,true],[true,true],[true,true],[true,true]],"check":"regression: scenario 1","expected":[[true,false],[false,true],[true,true],[false,true],[false,true],[false,false],[true,false],[false,true],[true,true],[true,true],[true,true]],"passed":false},{"actual":[[false,true],[true,true],[false,false],[true,false],[false,true],[false,false],[false,true],[false,false],[false,true],[true,true],[false,false],[false,false],[false,true],[false,false]],"check":"regression: scenario 2","expected":[[false,true],[true,true],[false,false],[true,false],[false,true],[false,true],[true,true],[false,false],[false,true],[true,true],[false,false],[false,false],[false,true],[false,false]],"passed":false},{"actual":[[false,true],[true,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[false,false],[true,false],[false,false],[true,false],[true,false]],"check":"control: scenario 3","expected":[[false,true],[true,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[false,false],[true,false],[false,false],[true,false],[true,false]],"passed":true},{"actual":[[false,false],[false,true],[false,false],[true,false],[true,false],[true,false],[false,true],[true,true],[false,false],[true,false]],"check":"regression: scenario 4","expected":[[false,false],[false,true],[false,false],[true,false],[true,false],[true,false],[false,true],[true,true],[false,true],[false,false]],"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: O valve season change\", \"actual\": [[false, true], [true, true], [false, false], [true, false], [true, false], [false, true]], \"expected\": [[false, true], [true, true], [false, true], [false, false], [true, false], [false, true]], \"passed\": false}, {\"check\": \"regression: B valve idle hold\", \"actual\": [[false, true], [false, false], [false, true]], \"expected\": [[false, true], [false, true], [true, true]], \"passed\": false}, {\"check\": \"control: first call heat on O\", \"actual\": [[true, false], [true, false], [false, false], [false, true]], \"expected\": [[true, false], [true, false], [false, false], [false, true]], \"passed\": true}, {\"check\": \"control: first call cool on B\", \"actual\": [[true, false], [false, false], [true, false], [false, true]], \"expected\": [[true, false], [false, false], [true, false], [false, true]], \"passed\": true}, {\"check\": \"regression: scenario 1\", \"actual\": [[true, false], [false, true], [true, true], [false, false], [false, false], [true, false], [true, false], [false, true], [true, true], [true, true], [true, true]], \"expected\": [[true, false], [false, true], [true, true], [false, true], [false, true], [false, false], [true, false], [false, true], [true, true], [true, true], [true, true]], \"passed\": false}, {\"check\": \"regression: scenario 2\", \"actual\": [[false, true], [true, true], [false, false], [true, false], [false, true], [false, false], [false, true], [false, false], [false, true], [true, true], [false, false], [false, false], [false, true], [false, false]], \"expected\": [[false, true], [true, true], [false, false], [true, false], [false, true], [false, true], [true, true], [false, false], [false, true], [true, true], [false, false], [false, false], [false, true], [false, false]], \"passed\": false}, {\"check\": \"control: scenario 3\", \"actual\": [[false, true], [true, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [false, false], [true, false], [false, false], [true, false], [true, false]], \"expected\": [[false, true], [true, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [false, false], [true, false], [false, false], [true, false], [true, false]], \"passed\": true}, {\"check\": \"regression: scenario 4\", \"actual\": [[false, false], [false, true], [false, false], [true, false], [true, false], [true, false], [false, true], [true, true], [false, false], [true, false]], \"expected\": [[false, false], [false, true], [false, false], [true, false], [true, false], [true, false], [false, true], [true, true], [false, true], [false, false]], \"passed\": false}], \"passed\": false}\n"},"fixed":{"elapsed_ms":41.575,"exit_code":0,"observations":[{"actual":[[false,true],[true,true],[false,true],[false,false],[true,false],[false,true]],"check":"regression: O valve season change","expected":[[false,true],[true,true],[false,true],[false,false],[true,false],[false,true]],"passed":true},{"actual":[[false,true],[false,true],[true,true]],"check":"regression: B valve idle hold","expected":[[false,true],[false,true],[true,true]],"passed":true},{"actual":[[true,false],[true,false],[false,false],[false,true]],"check":"control: first call heat on O","expected":[[true,false],[true,false],[false,false],[false,true]],"passed":true},{"actual":[[true,false],[false,false],[true,false],[false,true]],"check":"control: first call cool on B","expected":[[true,false],[false,false],[true,false],[false,true]],"passed":true},{"actual":[[true,false],[false,true],[true,true],[false,true],[false,true],[false,false],[true,false],[false,true],[true,true],[true,true],[true,true]],"check":"regression: scenario 1","expected":[[true,false],[false,true],[true,true],[false,true],[false,true],[false,false],[true,false],[false,true],[true,true],[true,true],[true,true]],"passed":true},{"actual":[[false,true],[true,true],[false,false],[true,false],[false,true],[false,true],[true,true],[false,false],[false,true],[true,true],[false,false],[false,false],[false,true],[false,false]],"check":"regression: scenario 2","expected":[[false,true],[true,true],[false,false],[true,false],[false,true],[false,true],[true,true],[false,false],[false,true],[true,true],[false,false],[false,false],[false,true],[false,false]],"passed":true},{"actual":[[false,true],[true,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[false,false],[true,false],[false,false],[true,false],[true,false]],"check":"control: scenario 3","expected":[[false,true],[true,true],[true,true],[false,false],[false,false],[false,false],[true,false],[false,true],[false,false],[true,false],[false,false],[true,false],[true,false]],"passed":true},{"actual":[[false,false],[false,true],[false,false],[true,false],[true,false],[true,false],[false,true],[true,true],[false,true],[false,false]],"check":"regression: scenario 4","expected":[[false,false],[false,true],[false,false],[true,false],[true,false],[true,false],[false,true],[true,true],[false,true],[false,false]],"passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"regression: O valve season change\", \"actual\": [[false, true], [true, true], [false, true], [false, false], [true, false], [false, true]], \"expected\": [[false, true], [true, true], [false, true], [false, false], [true, false], [false, true]], \"passed\": true}, {\"check\": \"regression: B valve idle hold\", \"actual\": [[false, true], [false, true], [true, true]], \"expected\": [[false, true], [false, true], [true, true]], \"passed\": true}, {\"check\": \"control: first call heat on O\", \"actual\": [[true, false], [true, false], [false, false], [false, true]], \"expected\": [[true, false], [true, false], [false, false], [false, true]], \"passed\": true}, {\"check\": \"control: first call cool on B\", \"actual\": [[true, false], [false, false], [true, false], [false, true]], \"expected\": [[true, false], [false, false], [true, false], [false, true]], \"passed\": true}, {\"check\": \"regression: scenario 1\", \"actual\": [[true, false], [false, true], [true, true], [false, true], [false, true], [false, false], [true, false], [false, true], [true, true], [true, true], [true, true]], \"expected\": [[true, false], [false, true], [true, true], [false, true], [false, true], [false, false], [true, false], [false, true], [true, true], [true, true], [true, true]], \"passed\": true}, {\"check\": \"regression: scenario 2\", \"actual\": [[false, true], [true, true], [false, false], [true, false], [false, true], [false, true], [true, true], [false, false], [false, true], [true, true], [false, false], [false, false], [false, true], [false, false]], \"expected\": [[false, true], [true, true], [false, false], [true, false], [false, true], [false, true], [true, true], [false, false], [false, true], [true, true], [false, false], [false, false], [false, true], [false, false]], \"passed\": true}, {\"check\": \"control: scenario 3\", \"actual\": [[false, true], [true, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [false, false], [true, false], [false, false], [true, false], [true, false]], \"expected\": [[false, true], [true, true], [true, true], [false, false], [false, false], [false, false], [true, false], [false, true], [false, false], [true, false], [false, false], [true, false], [true, false]], \"passed\": true}, {\"check\": \"regression: scenario 4\", \"actual\": [[false, false], [false, true], [false, false], [true, false], [true, false], [true, false], [false, true], [true, true], [false, true], [false, false]], \"expected\": [[false, false], [false, true], [false, false], [true, false], [true, false], [true, false], [false, true], [true, true], [false, true], [false, false]], \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}