FA-92416 / HVAC thermostat control / Open access
Heat pump compressor lockout has no release differential · case 01
Near the balance point the compressor and auxiliary heat swap every sample as outdoor temperature jitters.
ROOT CAUSE
Lockout state is recomputed from outdoor < comp_lockout each sample.
THE FAILURE
Lockout state is recomputed from outdoor < comp_lockout each sample.
Unsuccessful approach: Locking below the release temperature without state keeps the compressor off too long and still has no memory.
Case contract
Heat pump with electric auxiliary heat; samples are [indoor, outdoor, mode] in tenths F. The compressor is locked out when outdoor < comp_lockout and released when outdoor >= comp_lockout + 2.0 F. Stage 1 demand is indoor < sp - 1.0 F, stage 2 is indoor < sp - 3.0 F. Emergency mode: no compressor, aux on stage-1 demand. Compressor locked out: aux replaces it on stage-1 demand regardless of the aux lockout. Otherwise the compressor serves stage 1 and aux serves stage 2 only when outdoor <= aux_lockout. Return [compressor, aux] per sample.
Why this case matters
Residential and light-commercial thermostats make these decisions sample by sample; each defect changes equipment calls in a way that shows up as short cycling, comfort complaints or equipment stress.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(settings, samples):
locked = False
out = []
for indoor, outdoor, mode in samples:
locked = outdoor < settings['comp_lockout']
stage1 = indoor < settings['sp'] - 10
stage2 = indoor < settings['sp'] - 30
if mode == 'emergency':
comp, aux = False, stage1
elif locked:
comp, aux = False, stage1
else:
comp = stage1
aux = stage2 and outdoor <= settings['aux_lockout']
out.append([comp, aux])
return out
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['regression: scenario 11',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 260},
[[673, 167, 'emergency'],
[676, 142, 'normal'],
[700, 107, 'normal'],
[686, 119, 'normal'],
[651, 114, 'normal'],
[674, 78, 'normal'],
[699, 85, 'normal'],
[689, 119, 'normal'],
[666, 128, 'normal'],
[709, 159, 'normal'],
[667, 190, 'emergency'],
[645, 174, 'normal']]],
[[False, True],
[True, False],
[False, False],
[True, False],
[True, True],
[False, True],
[False, False],
[False, True],
[True, True],
[False, False],
[False, True],
[True, True]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[687, 348, 'normal'],
[652, 381, 'normal'],
[674, 420, 'normal'],
[677, 440, 'normal'],
[683, 450, 'normal'],
[663, 450, 'normal'],
[653, 450, 'emergency'],
[676, 450, 'normal']]],
[[True, False],
[True, True],
[True, False],
[True, False],
[True, False],
[True, False],
[False, True],
[True, False]]],
['control: scenario 2',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[699, 249, 'normal'],
[700, 272, 'normal'],
[645, 234, 'normal'],
[690, 236, 'normal'],
[673, 263, 'normal'],
[640, 258, 'normal'],
[654, 238, 'normal'],
[643, 242, 'normal'],
[684, 258, 'normal'],
[708, 254, 'normal'],
[694, 251, 'normal']]],
[[False, False],
[False, False],
[True, True],
[False, False],
[True, False],
[True, True],
[True, True],
[True, True],
[True, False],
[False, False],
[False, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[686, 162, 'normal'],
[670, 135, 'normal'],
[670, 167, 'normal'],
[669, 193, 'normal'],
[644, 179, 'normal'],
[688, 208, 'normal'],
[667, 194, 'normal'],
[675, 157, 'emergency'],
[694, 183, 'normal']]],
[[True, False],
[True, False],
[True, False],
[True, True],
[True, True],
[True, False],
[True, True],
[False, True],
[False, False]]],
['control: scenario 4',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[644, 286, 'normal'],
[705, 298, 'normal'],
[682, 281, 'emergency'],
[671, 281, 'normal'],
[648, 278, 'normal'],
[676, 245, 'normal'],
[688, 265, 'normal'],
[709, 228, 'normal'],
[660, 218, 'normal'],
[665, 244, 'normal'],
[644, 223, 'emergency']]],
[[True, True],
[False, False],
[False, True],
[True, False],
[True, True],
[True, False],
[True, False],
[False, False],
[True, True],
[True, True],
[False, True]]]],
[['regression: scenario 13',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[710, 253, 'emergency'],
[657, 222, 'normal'],
[664, 261, 'normal'],
[691, 223, 'emergency'],
[655, 231, 'normal'],
[668, 223, 'emergency'],
[693, 257, 'normal'],
[662, 290, 'normal'],
[674, 324, 'normal'],
[663, 291, 'normal'],
[660, 322, 'normal']]],
[[False, False],
[False, True],
[False, True],
[False, False],
[False, True],
[False, True],
[False, False],
[True, True],
[True, False],
[True, True],
[True, True]]],
['regression: scenario 3',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 260},
[[692, 278, 'normal'],
[691, 268, 'normal'],
[684, 292, 'normal'],
[688, 283, 'normal'],
[653, 265, 'normal'],
[680, 269, 'emergency'],
[707, 242, 'normal'],
[669, 239, 'emergency'],
[643, 234, 'normal'],
[651, 213, 'normal'],
[644, 185, 'normal'],
[647, 176, 'normal'],
[663, 170, 'normal']]],
[[False, False],
[False, False],
[True, False],
[True, False],
[True, False],
[False, True],
[False, False],
[False, True],
[True, True],
[True, True],
[False, True],
[False, True],
[False, True]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[678, 181, 'normal'],
[678, 142, 'normal'],
[683, 132, 'normal'],
[658, 153, 'normal'],
[693, 132, 'normal'],
[649, 113, 'normal'],
[678, 138, 'emergency'],
[696, 166, 'emergency']]],
[[False, True],
[False, True],
[False, True],
[False, True],
[False, False],
[False, True],
[False, True],
[False, False]]],
['regression: scenario 2',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[697, 219, 'normal'],
[704, 237, 'normal'],
[668, 209, 'emergency'],
[683, 245, 'normal'],
[642, 277, 'normal'],
[657, 316, 'normal'],
[702, 302, 'normal'],
[678, 281, 'normal'],
[661, 253, 'normal']]],
[[False, False],
[False, False],
[False, True],
[False, True],
[True, True],
[True, True],
[False, False],
[True, False],
[True, True]]],
['control: scenario 4',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[698, 201, 'normal'],
[643, 184, 'normal'],
[672, 162, 'normal'],
[705, 174, 'normal'],
[677, 136, 'normal'],
[672, 158, 'normal'],
[648, 177, 'emergency'],
[670, 217, 'normal'],
[654, 224, 'normal'],
[658, 203, 'normal'],
[659, 228, 'normal'],
[710, 227, 'normal']]],
[[False, False],
[True, True],
[True, False],
[False, False],
[True, False],
[True, False],
[False, True],
[True, False],
[True, True],
[True, True],
[True, True],
[False, False]]]],
[['regression: scenario 5',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 400},
[[660, 230, 'emergency'],
[682, 226, 'normal'],
[678, 266, 'normal'],
[651, 246, 'normal'],
[666, 260, 'normal'],
[710, 220, 'normal'],
[691, 190, 'normal'],
[700, 168, 'emergency'],
[661, 186, 'normal'],
[665, 195, 'normal'],
[666, 222, 'normal'],
[697, 194, 'normal'],
[677, 202, 'normal']]],
[[False, True],
[True, False],
[True, False],
[True, True],
[True, True],
[False, False],
[False, False],
[False, False],
[False, True],
[False, True],
[True, True],
[False, False],
[False, True]]],
['regression: scenario 26',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[684, 153, 'normal'],
[644, 179, 'normal'],
[710, 153, 'normal'],
[669, 122, 'normal'],
[682, 158, 'normal'],
[654, 138, 'normal'],
[662, 142, 'normal'],
[684, 119, 'normal'],
[660, 122, 'normal'],
[705, 148, 'normal'],
[709, 180, 'normal'],
[659, 175, 'normal'],
[705, 158, 'normal']]],
[[True, False],
[True, True],
[False, False],
[True, True],
[True, False],
[True, True],
[True, True],
[True, False],
[True, True],
[False, False],
[False, False],
[True, True],
[False, False]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[656, 273, 'normal'],
[679, 265, 'normal'],
[672, 284, 'emergency'],
[690, 310, 'normal'],
[697, 308, 'normal'],
[641, 322, 'emergency'],
[679, 346, 'normal'],
[640, 329, 'normal']]],
[[True, True],
[True, False],
[False, True],
[False, False],
[False, False],
[False, True],
[True, False],
[True, True]]],
['regression: scenario 2',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[672, 231, 'normal'],
[699, 194, 'normal'],
[704, 214, 'emergency'],
[667, 230, 'normal'],
[666, 253, 'normal'],
[654, 226, 'emergency'],
[693, 222, 'normal'],
[664, 244, 'normal'],
[687, 282, 'normal']]],
[[False, True],
[False, False],
[False, False],
[False, True],
[False, True],
[False, True],
[False, False],
[False, True],
[True, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[678, 176, 'normal'],
[691, 141, 'normal'],
[686, 110, 'normal'],
[675, 124, 'emergency'],
[703, 99, 'normal'],
[680, 101, 'normal'],
[698, 114, 'normal'],
[672, 121, 'emergency'],
[691, 83, 'normal'],
[656, 108, 'emergency'],
[692, 99, 'emergency'],
[643, 79, 'normal'],
[648, 52, 'emergency']]],
[[False, True],
[False, False],
[False, True],
[False, True],
[False, False],
[False, True],
[False, False],
[False, True],
[False, False],
[False, True],
[False, False],
[False, True],
[False, True]]]],
[['regression: scenario 30',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[658, 169, 'normal'],
[681, 176, 'normal'],
[691, 189, 'normal'],
[677, 190, 'normal'],
[707, 214, 'normal'],
[691, 222, 'normal'],
[656, 251, 'normal'],
[642, 273, 'emergency'],
[708, 246, 'normal'],
[694, 243, 'normal'],
[671, 203, 'emergency'],
[697, 231, 'normal']]],
[[False, True],
[False, True],
[False, False],
[False, True],
[False, False],
[False, False],
[False, True],
[False, True],
[False, False],
[False, False],
[False, True],
[False, False]]],
['regression: scenario 59',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[665, 339, 'normal'],
[643, 312, 'normal'],
[676, 307, 'normal'],
[671, 289, 'normal'],
[664, 274, 'normal'],
[666, 282, 'normal'],
[700, 283, 'emergency'],
[693, 262, 'normal'],
[651, 238, 'normal'],
[670, 219, 'normal'],
[684, 253, 'normal'],
[668, 215, 'normal'],
[668, 187, 'normal'],
[692, 218, 'normal']]],
[[True, True],
[True, True],
[True, False],
[True, False],
[True, True],
[True, True],
[False, False],
[False, False],
[True, True],
[True, False],
[True, False],
[True, True],
[False, True],
[False, False]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[646, 150, 'normal'],
[640, 123, 'normal'],
[670, 110, 'normal'],
[675, 118, 'normal'],
[648, 101, 'normal'],
[649, 91, 'normal'],
[710, 74, 'normal'],
[697, 95, 'normal'],
[708, 135, 'normal'],
[649, 147, 'normal'],
[671, 109, 'normal'],
[710, 89, 'normal']]],
[[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, False],
[False, False],
[False, False],
[False, True],
[False, True],
[False, False]]],
['control: scenario 2',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 260},
[[658, 406, 'emergency'],
[643, 441, 'emergency'],
[654, 450, 'normal'],
[657, 450, 'normal'],
[665, 450, 'normal'],
[695, 448, 'normal'],
[697, 442, 'normal'],
[675, 450, 'normal'],
[708, 418, 'emergency'],
[709, 386, 'normal'],
[681, 419, 'normal']]],
[[False, True],
[False, True],
[True, False],
[True, False],
[True, False],
[False, False],
[False, False],
[True, False],
[False, False],
[False, False],
[True, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[690, 409, 'emergency'],
[686, 373, 'normal'],
[681, 348, 'normal'],
[644, 353, 'normal'],
[673, 341, 'normal'],
[673, 370, 'emergency'],
[680, 331, 'normal'],
[708, 324, 'normal'],
[641, 331, 'normal'],
[660, 331, 'normal'],
[697, 361, 'normal'],
[691, 365, 'emergency'],
[667, 390, 'normal']]],
[[False, False],
[True, False],
[True, False],
[True, False],
[True, False],
[False, True],
[True, False],
[False, False],
[True, True],
[True, True],
[False, False],
[False, False],
[True, False]]]],
[['regression: scenario 56',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 260},
[[687, 188, 'normal'],
[695, 188, 'normal'],
[667, 213, 'normal'],
[682, 248, 'emergency'],
[666, 278, 'normal'],
[694, 258, 'normal'],
[644, 298, 'normal'],
[678, 280, 'normal'],
[695, 250, 'normal'],
[700, 231, 'normal'],
[687, 237, 'normal'],
[677, 248, 'emergency'],
[642, 275, 'normal'],
[692, 237, 'normal']]],
[[False, True],
[False, False],
[False, True],
[False, True],
[True, False],
[False, False],
[True, False],
[True, False],
[False, False],
[False, False],
[True, False],
[False, True],
[True, False],
[False, False]]],
['regression: scenario 33',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[641, 231, 'normal'],
[675, 205, 'normal'],
[686, 205, 'normal'],
[699, 218, 'normal'],
[645, 241, 'emergency'],
[657, 237, 'normal'],
[686, 217, 'normal'],
[644, 249, 'normal'],
[642, 272, 'normal'],
[668, 258, 'normal'],
[679, 222, 'emergency'],
[671, 252, 'normal']]],
[[False, True],
[False, True],
[False, True],
[False, False],
[False, True],
[False, True],
[False, True],
[False, True],
[True, True],
[True, True],
[False, True],
[False, True]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[678, 197, 'normal'],
[653, 218, 'normal'],
[654, 208, 'normal'],
[686, 178, 'normal'],
[675, 155, 'normal'],
[678, 163, 'normal'],
[708, 201, 'normal'],
[702, 220, 'normal'],
[697, 255, 'normal']]],
[[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, False],
[False, False],
[False, False]]],
['control: scenario 2',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[696, 417, 'normal'],
[700, 441, 'normal'],
[669, 443, 'normal'],
[695, 420, 'normal'],
[699, 380, 'normal'],
[657, 360, 'emergency'],
[665, 359, 'normal'],
[646, 335, 'emergency'],
[705, 331, 'normal'],
[699, 371, 'emergency'],
[696, 334, 'emergency'],
[698, 318, 'normal']]],
[[False, False],
[False, False],
[True, False],
[False, False],
[False, False],
[False, True],
[True, False],
[False, True],
[False, False],
[False, False],
[False, False],
[False, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[670, 296, 'normal'],
[694, 303, 'normal'],
[704, 303, 'normal'],
[692, 316, 'normal'],
[688, 277, 'normal'],
[695, 304, 'normal'],
[691, 336, 'normal'],
[648, 337, 'normal'],
[686, 313, 'normal']]],
[[True, False],
[False, False],
[False, False],
[False, False],
[True, False],
[False, False],
[False, False],
[True, True],
[True, False]]]]]
for label, args, expected in fixtures[N-1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| regression: lockout band | [[True, False], [True, False], [False, True], [True, False], [True, False], [False, True], [False, False]] | [[True, False], [True, False], [False, True], [False, True], [True, False], [False, True], [False, False]] | Failed |
| regression: scenario 11 | [[False, True], [True, False], [False, False], [True, False], [True, True], [False, True], [False, False], [True, False], [True, True], [False, False], [False, True], [True, True]] | [[False, True], [True, False], [False, False], [True, False], [True, True], [False, True], [False, False], [False, True], [True, True], [False, False], [False, True], [True, True]] | Failed |
| control: emergency deep demand | [[False, True], [False, True], [False, True]] | [[False, True], [False, True], [False, True]] | Passed |
| control: mild weather second stage | [[True, True], [True, False], [True, False]] | [[True, True], [True, False], [True, False]] | Passed |
| control: scenario 1 | [[True, False], [True, True], [True, False], [True, False], [True, False], [True, False], [False, True], [True, False]] | [[True, False], [True, True], [True, False], [True, False], [True, False], [True, False], [False, True], [True, False]] | Passed |
| control: scenario 2 | [[False, False], [False, False], [True, True], [False, False], [True, False], [True, True], [True, True], [True, True], [True, False], [False, False], [False, False]] | [[False, False], [False, False], [True, True], [False, False], [True, False], [True, True], [True, True], [True, True], [True, False], [False, False], [False, False]] | Passed |
| control: scenario 3 | [[True, False], [True, False], [True, False], [True, True], [True, True], [True, False], [True, True], [False, True], [False, False]] | [[True, False], [True, False], [True, False], [True, True], [True, True], [True, False], [True, True], [False, True], [False, False]] | Passed |
| control: scenario 4 | [[True, True], [False, False], [False, True], [True, False], [True, True], [True, False], [True, False], [False, False], [True, True], [True, True], [False, True]] | [[True, True], [False, False], [False, True], [True, False], [True, True], [True, False], [True, False], [False, False], [True, True], [True, True], [False, True]] | Passed |
SHA-256 / ee58b20a093811752cb8a65bb4d72ef7b635850a763fd74c9c5fd9a99e19626b
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(settings, samples):
locked = False
out = []
for indoor, outdoor, mode in samples:
locked = outdoor < settings['comp_lockout'] + 20
stage1 = indoor < settings['sp'] - 10
stage2 = indoor < settings['sp'] - 30
if mode == 'emergency':
comp, aux = False, stage1
elif locked:
comp, aux = False, stage1
else:
comp = stage1
aux = stage2 and outdoor <= settings['aux_lockout']
out.append([comp, aux])
return out
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['regression: scenario 11',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 260},
[[673, 167, 'emergency'],
[676, 142, 'normal'],
[700, 107, 'normal'],
[686, 119, 'normal'],
[651, 114, 'normal'],
[674, 78, 'normal'],
[699, 85, 'normal'],
[689, 119, 'normal'],
[666, 128, 'normal'],
[709, 159, 'normal'],
[667, 190, 'emergency'],
[645, 174, 'normal']]],
[[False, True],
[True, False],
[False, False],
[True, False],
[True, True],
[False, True],
[False, False],
[False, True],
[True, True],
[False, False],
[False, True],
[True, True]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[687, 348, 'normal'],
[652, 381, 'normal'],
[674, 420, 'normal'],
[677, 440, 'normal'],
[683, 450, 'normal'],
[663, 450, 'normal'],
[653, 450, 'emergency'],
[676, 450, 'normal']]],
[[True, False],
[True, True],
[True, False],
[True, False],
[True, False],
[True, False],
[False, True],
[True, False]]],
['control: scenario 2',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[699, 249, 'normal'],
[700, 272, 'normal'],
[645, 234, 'normal'],
[690, 236, 'normal'],
[673, 263, 'normal'],
[640, 258, 'normal'],
[654, 238, 'normal'],
[643, 242, 'normal'],
[684, 258, 'normal'],
[708, 254, 'normal'],
[694, 251, 'normal']]],
[[False, False],
[False, False],
[True, True],
[False, False],
[True, False],
[True, True],
[True, True],
[True, True],
[True, False],
[False, False],
[False, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[686, 162, 'normal'],
[670, 135, 'normal'],
[670, 167, 'normal'],
[669, 193, 'normal'],
[644, 179, 'normal'],
[688, 208, 'normal'],
[667, 194, 'normal'],
[675, 157, 'emergency'],
[694, 183, 'normal']]],
[[True, False],
[True, False],
[True, False],
[True, True],
[True, True],
[True, False],
[True, True],
[False, True],
[False, False]]],
['control: scenario 4',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[644, 286, 'normal'],
[705, 298, 'normal'],
[682, 281, 'emergency'],
[671, 281, 'normal'],
[648, 278, 'normal'],
[676, 245, 'normal'],
[688, 265, 'normal'],
[709, 228, 'normal'],
[660, 218, 'normal'],
[665, 244, 'normal'],
[644, 223, 'emergency']]],
[[True, True],
[False, False],
[False, True],
[True, False],
[True, True],
[True, False],
[True, False],
[False, False],
[True, True],
[True, True],
[False, True]]]],
[['regression: scenario 13',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[710, 253, 'emergency'],
[657, 222, 'normal'],
[664, 261, 'normal'],
[691, 223, 'emergency'],
[655, 231, 'normal'],
[668, 223, 'emergency'],
[693, 257, 'normal'],
[662, 290, 'normal'],
[674, 324, 'normal'],
[663, 291, 'normal'],
[660, 322, 'normal']]],
[[False, False],
[False, True],
[False, True],
[False, False],
[False, True],
[False, True],
[False, False],
[True, True],
[True, False],
[True, True],
[True, True]]],
['regression: scenario 3',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 260},
[[692, 278, 'normal'],
[691, 268, 'normal'],
[684, 292, 'normal'],
[688, 283, 'normal'],
[653, 265, 'normal'],
[680, 269, 'emergency'],
[707, 242, 'normal'],
[669, 239, 'emergency'],
[643, 234, 'normal'],
[651, 213, 'normal'],
[644, 185, 'normal'],
[647, 176, 'normal'],
[663, 170, 'normal']]],
[[False, False],
[False, False],
[True, False],
[True, False],
[True, False],
[False, True],
[False, False],
[False, True],
[True, True],
[True, True],
[False, True],
[False, True],
[False, True]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[678, 181, 'normal'],
[678, 142, 'normal'],
[683, 132, 'normal'],
[658, 153, 'normal'],
[693, 132, 'normal'],
[649, 113, 'normal'],
[678, 138, 'emergency'],
[696, 166, 'emergency']]],
[[False, True],
[False, True],
[False, True],
[False, True],
[False, False],
[False, True],
[False, True],
[False, False]]],
['regression: scenario 2',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[697, 219, 'normal'],
[704, 237, 'normal'],
[668, 209, 'emergency'],
[683, 245, 'normal'],
[642, 277, 'normal'],
[657, 316, 'normal'],
[702, 302, 'normal'],
[678, 281, 'normal'],
[661, 253, 'normal']]],
[[False, False],
[False, False],
[False, True],
[False, True],
[True, True],
[True, True],
[False, False],
[True, False],
[True, True]]],
['control: scenario 4',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[698, 201, 'normal'],
[643, 184, 'normal'],
[672, 162, 'normal'],
[705, 174, 'normal'],
[677, 136, 'normal'],
[672, 158, 'normal'],
[648, 177, 'emergency'],
[670, 217, 'normal'],
[654, 224, 'normal'],
[658, 203, 'normal'],
[659, 228, 'normal'],
[710, 227, 'normal']]],
[[False, False],
[True, True],
[True, False],
[False, False],
[True, False],
[True, False],
[False, True],
[True, False],
[True, True],
[True, True],
[True, True],
[False, False]]]],
[['regression: scenario 5',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 400},
[[660, 230, 'emergency'],
[682, 226, 'normal'],
[678, 266, 'normal'],
[651, 246, 'normal'],
[666, 260, 'normal'],
[710, 220, 'normal'],
[691, 190, 'normal'],
[700, 168, 'emergency'],
[661, 186, 'normal'],
[665, 195, 'normal'],
[666, 222, 'normal'],
[697, 194, 'normal'],
[677, 202, 'normal']]],
[[False, True],
[True, False],
[True, False],
[True, True],
[True, True],
[False, False],
[False, False],
[False, False],
[False, True],
[False, True],
[True, True],
[False, False],
[False, True]]],
['regression: scenario 26',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 400},
[[684, 153, 'normal'],
[644, 179, 'normal'],
[710, 153, 'normal'],
[669, 122, 'normal'],
[682, 158, 'normal'],
[654, 138, 'normal'],
[662, 142, 'normal'],
[684, 119, 'normal'],
[660, 122, 'normal'],
[705, 148, 'normal'],
[709, 180, 'normal'],
[659, 175, 'normal'],
[705, 158, 'normal']]],
[[True, False],
[True, True],
[False, False],
[True, True],
[True, False],
[True, True],
[True, True],
[True, False],
[True, True],
[False, False],
[False, False],
[True, True],
[False, False]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[656, 273, 'normal'],
[679, 265, 'normal'],
[672, 284, 'emergency'],
[690, 310, 'normal'],
[697, 308, 'normal'],
[641, 322, 'emergency'],
[679, 346, 'normal'],
[640, 329, 'normal']]],
[[True, True],
[True, False],
[False, True],
[False, False],
[False, False],
[False, True],
[True, False],
[True, True]]],
['regression: scenario 2',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[672, 231, 'normal'],
[699, 194, 'normal'],
[704, 214, 'emergency'],
[667, 230, 'normal'],
[666, 253, 'normal'],
[654, 226, 'emergency'],
[693, 222, 'normal'],
[664, 244, 'normal'],
[687, 282, 'normal']]],
[[False, True],
[False, False],
[False, False],
[False, True],
[False, True],
[False, True],
[False, False],
[False, True],
[True, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[678, 176, 'normal'],
[691, 141, 'normal'],
[686, 110, 'normal'],
[675, 124, 'emergency'],
[703, 99, 'normal'],
[680, 101, 'normal'],
[698, 114, 'normal'],
[672, 121, 'emergency'],
[691, 83, 'normal'],
[656, 108, 'emergency'],
[692, 99, 'emergency'],
[643, 79, 'normal'],
[648, 52, 'emergency']]],
[[False, True],
[False, False],
[False, True],
[False, True],
[False, False],
[False, True],
[False, False],
[False, True],
[False, False],
[False, True],
[False, False],
[False, True],
[False, True]]]],
[['regression: scenario 30',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[658, 169, 'normal'],
[681, 176, 'normal'],
[691, 189, 'normal'],
[677, 190, 'normal'],
[707, 214, 'normal'],
[691, 222, 'normal'],
[656, 251, 'normal'],
[642, 273, 'emergency'],
[708, 246, 'normal'],
[694, 243, 'normal'],
[671, 203, 'emergency'],
[697, 231, 'normal']]],
[[False, True],
[False, True],
[False, False],
[False, True],
[False, False],
[False, False],
[False, True],
[False, True],
[False, False],
[False, False],
[False, True],
[False, False]]],
['regression: scenario 59',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[665, 339, 'normal'],
[643, 312, 'normal'],
[676, 307, 'normal'],
[671, 289, 'normal'],
[664, 274, 'normal'],
[666, 282, 'normal'],
[700, 283, 'emergency'],
[693, 262, 'normal'],
[651, 238, 'normal'],
[670, 219, 'normal'],
[684, 253, 'normal'],
[668, 215, 'normal'],
[668, 187, 'normal'],
[692, 218, 'normal']]],
[[True, True],
[True, True],
[True, False],
[True, False],
[True, True],
[True, True],
[False, False],
[False, False],
[True, True],
[True, False],
[True, False],
[True, True],
[False, True],
[False, False]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 350},
[[646, 150, 'normal'],
[640, 123, 'normal'],
[670, 110, 'normal'],
[675, 118, 'normal'],
[648, 101, 'normal'],
[649, 91, 'normal'],
[710, 74, 'normal'],
[697, 95, 'normal'],
[708, 135, 'normal'],
[649, 147, 'normal'],
[671, 109, 'normal'],
[710, 89, 'normal']]],
[[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, False],
[False, False],
[False, False],
[False, True],
[False, True],
[False, False]]],
['control: scenario 2',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 260},
[[658, 406, 'emergency'],
[643, 441, 'emergency'],
[654, 450, 'normal'],
[657, 450, 'normal'],
[665, 450, 'normal'],
[695, 448, 'normal'],
[697, 442, 'normal'],
[675, 450, 'normal'],
[708, 418, 'emergency'],
[709, 386, 'normal'],
[681, 419, 'normal']]],
[[False, True],
[False, True],
[True, False],
[True, False],
[True, False],
[False, False],
[False, False],
[True, False],
[False, False],
[False, False],
[True, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[690, 409, 'emergency'],
[686, 373, 'normal'],
[681, 348, 'normal'],
[644, 353, 'normal'],
[673, 341, 'normal'],
[673, 370, 'emergency'],
[680, 331, 'normal'],
[708, 324, 'normal'],
[641, 331, 'normal'],
[660, 331, 'normal'],
[697, 361, 'normal'],
[691, 365, 'emergency'],
[667, 390, 'normal']]],
[[False, False],
[True, False],
[True, False],
[True, False],
[True, False],
[False, True],
[True, False],
[False, False],
[True, True],
[True, True],
[False, False],
[False, False],
[True, False]]]],
[['regression: scenario 56',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 260},
[[687, 188, 'normal'],
[695, 188, 'normal'],
[667, 213, 'normal'],
[682, 248, 'emergency'],
[666, 278, 'normal'],
[694, 258, 'normal'],
[644, 298, 'normal'],
[678, 280, 'normal'],
[695, 250, 'normal'],
[700, 231, 'normal'],
[687, 237, 'normal'],
[677, 248, 'emergency'],
[642, 275, 'normal'],
[692, 237, 'normal']]],
[[False, True],
[False, False],
[False, True],
[False, True],
[True, False],
[False, False],
[True, False],
[True, False],
[False, False],
[False, False],
[True, False],
[False, True],
[True, False],
[False, False]]],
['regression: scenario 33',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 400},
[[641, 231, 'normal'],
[675, 205, 'normal'],
[686, 205, 'normal'],
[699, 218, 'normal'],
[645, 241, 'emergency'],
[657, 237, 'normal'],
[686, 217, 'normal'],
[644, 249, 'normal'],
[642, 272, 'normal'],
[668, 258, 'normal'],
[679, 222, 'emergency'],
[671, 252, 'normal']]],
[[False, True],
[False, True],
[False, True],
[False, False],
[False, True],
[False, True],
[False, True],
[False, True],
[True, True],
[True, True],
[False, True],
[False, True]]],
['regression: lockout band',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[680, 300, 'normal'],
[660, 300, 'normal'],
[680, 240, 'normal'],
[680, 265, 'normal'],
[680, 275, 'normal'],
[680, 275, 'emergency'],
[705, 275, 'normal']]],
[[True, False],
[True, False],
[False, True],
[False, True],
[True, False],
[False, True],
[False, False]]],
['control: emergency deep demand',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[660, 300, 'emergency'], [685, 300, 'emergency'], [660, 200, 'emergency']]],
[[False, True], [False, True], [False, True]]],
['control: mild weather second stage',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[660, 300, 'normal'], [660, 400, 'normal'], [685, 300, 'normal']]],
[[True, True], [True, False], [True, False]]],
['control: scenario 1',
[{'sp': 700, 'comp_lockout': 250, 'aux_lockout': 260},
[[678, 197, 'normal'],
[653, 218, 'normal'],
[654, 208, 'normal'],
[686, 178, 'normal'],
[675, 155, 'normal'],
[678, 163, 'normal'],
[708, 201, 'normal'],
[702, 220, 'normal'],
[697, 255, 'normal']]],
[[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, True],
[False, False],
[False, False],
[False, False]]],
['control: scenario 2',
[{'sp': 700, 'comp_lockout': 200, 'aux_lockout': 350},
[[696, 417, 'normal'],
[700, 441, 'normal'],
[669, 443, 'normal'],
[695, 420, 'normal'],
[699, 380, 'normal'],
[657, 360, 'emergency'],
[665, 359, 'normal'],
[646, 335, 'emergency'],
[705, 331, 'normal'],
[699, 371, 'emergency'],
[696, 334, 'emergency'],
[698, 318, 'normal']]],
[[False, False],
[False, False],
[True, False],
[False, False],
[False, False],
[False, True],
[True, False],
[False, True],
[False, False],
[False, False],
[False, False],
[False, False]]],
['control: scenario 3',
[{'sp': 700, 'comp_lockout': 100, 'aux_lockout': 350},
[[670, 296, 'normal'],
[694, 303, 'normal'],
[704, 303, 'normal'],
[692, 316, 'normal'],
[688, 277, 'normal'],
[695, 304, 'normal'],
[691, 336, 'normal'],
[648, 337, 'normal'],
[686, 313, 'normal']]],
[[True, False],
[False, False],
[False, False],
[False, False],
[True, False],
[False, False],
[False, False],
[True, True],
[True, False]]]]]
for label, args, expected in fixtures[N-1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| regression: lockout band | [[True, False], [True, False], [False, True], [False, True], [True, False], [False, True], [False, False]] | [[True, False], [True, False], [False, True], [False, True], [True, False], [False, True], [False, False]] | Passed |
| regression: scenario 11 | [[False, True], [True, False], [False, False], [False, True], [False, True], [False, True], [False, False], [False, True], [True, True], [False, False], [False, True], [True, True]] | [[False, True], [True, False], [False, False], [True, False], [True, True], [False, True], [False, False], [False, True], [True, True], [False, False], [False, True], [True, True]] | Failed |
| control: emergency deep demand | [[False, True], [False, True], [False, True]] | [[False, True], [False, True], [False, True]] | Passed |
| control: mild weather second stage | [[True, True], [True, False], [True, False]] | [[True, True], [True, False], [True, False]] | Passed |
| control: scenario 1 | [[True, False], [True, True], [True, False], [True, False], [True, False], [True, False], [False, True], [True, False]] | [[True, False], [True, True], [True, False], [True, False], [True, False], [True, False], [False, True], [True, False]] | Passed |
| control: scenario 2 | [[False, False], [False, False], [True, True], [False, False], [True, False], [True, True], [True, True], [True, True], [True, False], [False, False], [False, False]] | [[False, False], [False, False], [True, True], [False, False], [True, False], [True, True], [True, True], [True, True], [True, False], [False, False], [False, False]] | Passed |
| control: scenario 3 | [[True, False], [True, False], [True, False], [True, True], [True, True], [True, False], [True, True], [False, True], [False, False]] | [[True, False], [True, False], [True, False], [True, True], [True, True], [True, False], [True, True], [False, True], [False, False]] | Passed |
| control: scenario 4 | [[True, True], [False, False], [False, True], [True, False], [True, True], [True, False], [True, False], [False, False], [True, True], [True, True], [False, True]] | [[True, True], [False, False], [False, True], [True, False], [True, True], [True, False], [True, False], [False, False], [True, True], [True, True], [False, True]] | Passed |
SHA-256 / cc0ba5df2e1bb75cf58f4b760d5b5fc243b46d37fabc798656645d064ab30546
HELD IN THE MEMBER ARCHIVE
The verified repair and its recorded checks are member-only.
This mechanism has 8 recorded checks per implementation. The open-access tier publishes the failure and the unsuccessful fix; the repaired source that passes every check, and the observations that prove it, are available to members.
Every case sharing this mechanism uses the same contract and the same repair, so this one record is held back for all of them.
Member access is invitation-based. Sign in with your invited account to inspect the repair.
Sign in to the archive ↗Verification & scope
A deterministic bounded teaching model of one thermostat or HVAC controller decision evaluated per sample. Temperatures are integer tenths of a degree Fahrenheit unless stated otherwise. The contract is a stipulated toy convention, not a claim of conformance to any manufacturer, ASHRAE guideline or code. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:51:45.599857+00:00.
Case digest / 60011717df5f40bc885b69edc49a20a4aa4fe51e53a03f264e44d944fc81bb9b