FA-34896 / Notification interfaces / Open access
Notification visual impression qualification: exposure-satisfied from qualifying · case 01
The exposure-satisfied event leaves a notification in counted instead of reporting.
ROOT CAUSE
Local exposure is confused with persisted impression reporting.
THE FAILURE
Local exposure is confused with persisted impression reporting.
Unsuccessful approach: Resetting exposure at its threshold loses genuine views.
Case contract
Notification visual impression qualification is a bounded visual-notification workflow with mutable policy state {'exposure': 0, 'required': 4, 'covered': False, 'reports': 0}. Its default transition relation is {('offscreen', 'enters-viewport'): 'qualifying', ('qualifying', 'exposure-satisfied'): 'reporting', ('qualifying', 'leaves-viewport'): 'offscreen', ('reporting', 'report-success'): 'counted', ('reporting', 'report-failure'): 'report-error', ('report-error', 'retry-report'): 'reporting', ('qualifying', 'covered-by-overlay'): 'occluded', ('occluded', 'overlay-removed'): 'qualifying', ('counted', 'reenter-viewport'): 'counted', ('reporting', 'leaves-viewport'): 'reporting'}; domain inputs can suppress or redirect transitions and update policy fields, as specified in solve. Different-generation events are inert. Batches apply in order. Optional observe returns the selected policy field alongside the phase.
Why this case matters
Visual notification lifecycle ordering can leave an inbox or toast showing the wrong actionable state even when transport succeeds.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(initial, events, generation, payload=None, observe=None):
table = {('offscreen', 'enters-viewport'): 'qualifying', ('qualifying', 'exposure-satisfied'): 'counted', ('qualifying', 'leaves-viewport'): 'offscreen', ('reporting', 'report-success'): 'counted', ('reporting', 'report-failure'): 'report-error', ('report-error', 'retry-report'): 'reporting', ('qualifying', 'covered-by-overlay'): 'occluded', ('occluded', 'overlay-removed'): 'qualifying', ('counted', 'reenter-viewport'): 'counted', ('reporting', 'leaves-viewport'): 'reporting'}
data = json.loads(json.dumps({'exposure': 0, 'required': 4, 'covered': False, 'reports': 0})) if payload is None else {**json.loads(json.dumps({'exposure': 0, 'required': 4, 'covered': False, 'reports': 0})), **json.loads(json.dumps(payload))}
state = initial
for delivery in events:
event, event_generation = delivery[:2]
arg = delivery[2] if len(delivery) > 2 else {}
if event_generation == generation:
previous = state
if event == 'covered-by-overlay': data['covered'] = True
if event == 'overlay-removed':
data['covered'] = False
data['exposure'] = 0
if event == 'exposure-satisfied':
if not data['covered']: data['exposure'] += max(0,arg.get('elapsed',data['required']))
if data['exposure'] < data['required'] or data['covered']: event = 'unknown-event'
if event == 'leaves-viewport' and state == 'qualifying': data['exposure'] = 0
state = table.get((state, event), state)
if state == 'counted' and previous != 'counted': data['reports'] += 1
return {'phase': state, 'value': data[observe]} if observe else state
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('offscreen / enters-viewport', solve('offscreen', [('enters-viewport', N)], N), 'qualifying')
check('qualifying / exposure-satisfied', solve('qualifying', [('exposure-satisfied', N)], N), 'reporting')
check('qualifying / leaves-viewport', solve('qualifying', [('leaves-viewport', N)], N), 'offscreen')
check('reporting / report-success', solve('reporting', [('report-success', N)], N), 'counted')
check('reporting / report-failure', solve('reporting', [('report-failure', N)], N), 'report-error')
check('report-error / retry-report', solve('report-error', [('retry-report', N)], N), 'reporting')
check('qualifying / covered-by-overlay', solve('qualifying', [('covered-by-overlay', N)], N), 'occluded')
check('occluded / overlay-removed', solve('occluded', [('overlay-removed', N)], N), 'qualifying')
check('counted / reenter-viewport', solve('counted', [('reenter-viewport', N)], N), 'counted')
check('reporting / leaves-viewport', solve('reporting', [('leaves-viewport', N)], N), 'reporting')
check('older notification incarnation', solve('offscreen', [('enters-viewport', N - 1)], N), 'offscreen')
check('future notification incarnation', solve('offscreen', [('enters-viewport', N + 1)], N), 'offscreen')
check('unknown event is inert', solve('offscreen', [('unknown-event', N)], N), 'offscreen')
check('empty delivery batch', solve('offscreen', [], N), 'offscreen')
check('N stale deliveries before current delivery', solve('offscreen', [('enters-viewport', N - 1)] * N + [('enters-viewport', N)], N), 'qualifying')
check('trace enters-viewport then exposure-satisfied', solve('offscreen', [('enters-viewport', N), ('exposure-satisfied', N)], N), 'reporting')
check('trace enters-viewport then leaves-viewport', solve('offscreen', [('enters-viewport', N), ('leaves-viewport', N)], N), 'offscreen')
check('trace enters-viewport then covered-by-overlay', solve('offscreen', [('enters-viewport', N), ('covered-by-overlay', N)], N), 'occluded')
check('trace exposure-satisfied then report-success', solve('qualifying', [('exposure-satisfied', N), ('report-success', N)], N), 'counted')
check('trace exposure-satisfied then report-failure', solve('qualifying', [('exposure-satisfied', N), ('report-failure', N)], N), 'report-error')
check('trace exposure-satisfied then leaves-viewport', solve('qualifying', [('exposure-satisfied', N), ('leaves-viewport', N)], N), 'reporting')
check('trace leaves-viewport then enters-viewport', solve('qualifying', [('leaves-viewport', N), ('enters-viewport', N)], N), 'qualifying')
check('trace report-success then reenter-viewport', solve('reporting', [('report-success', N), ('reenter-viewport', N)], N), 'counted')
check('trace report-failure then retry-report', solve('reporting', [('report-failure', N), ('retry-report', N)], N), 'reporting')
check('trace retry-report then report-success', solve('report-error', [('retry-report', N), ('report-success', N)], N), 'counted')
check('trace retry-report then report-failure', solve('report-error', [('retry-report', N), ('report-failure', N)], N), 'report-error')
check('trace retry-report then leaves-viewport', solve('report-error', [('retry-report', N), ('leaves-viewport', N)], N), 'reporting')
check('trace covered-by-overlay then overlay-removed', solve('qualifying', [('covered-by-overlay', N), ('overlay-removed', N)], N), 'qualifying')
check('trace overlay-removed then exposure-satisfied', solve('occluded', [('overlay-removed', N), ('exposure-satisfied', N)], N), 'reporting')
check('trace overlay-removed then leaves-viewport', solve('occluded', [('overlay-removed', N), ('leaves-viewport', N)], N), 'offscreen')
check('trace overlay-removed then covered-by-overlay', solve('occluded', [('overlay-removed', N), ('covered-by-overlay', N)], N), 'occluded')
check('trace reenter-viewport then reenter-viewport', solve('counted', [('reenter-viewport', N), ('reenter-viewport', N)], N), 'counted')
check('trace leaves-viewport then report-success', solve('reporting', [('leaves-viewport', N), ('report-success', N)], N), 'counted')
check('trace leaves-viewport then report-failure', solve('reporting', [('leaves-viewport', N), ('report-failure', N)], N), 'report-error')
check('trace leaves-viewport then leaves-viewport', solve('reporting', [('leaves-viewport', N), ('leaves-viewport', N)], N), 'reporting')
check('domain state regression 1: exposure', solve('qualifying', [('exposure-satisfied', N, {'elapsed': 3})], N, {}, 'exposure'), {'phase': 'qualifying', 'value': 3})
check('domain state regression 2: exposure', solve('qualifying', [('exposure-satisfied', N, {'elapsed': 4})], N, {}, 'exposure'), {'phase': 'reporting', 'value': 4})
check('domain state regression 3: exposure', solve('qualifying', [('exposure-satisfied', N, {'elapsed': 9})], N, {'covered': True}, 'exposure'), {'phase': 'qualifying', 'value': 0})
check('domain state regression 4: exposure', solve('occluded', [('overlay-removed', N, {})], N, {'exposure': 3, 'covered': True}, 'exposure'), {'phase': 'qualifying', 'value': 0})
check('domain state regression 5: exposure', solve('qualifying', [('leaves-viewport', N, {})], N, {'exposure': 3}, 'exposure'), {'phase': 'offscreen', 'value': 0})
check('domain state regression 6: reports', solve('counted', [('reenter-viewport', N, {})], N, {'reports': 1}, 'reports'), {'phase': 'counted', 'value': 1})
check('domain state regression 7: exposure', solve('offscreen', [('enters-viewport', N, {}), ('exposure-satisfied', N, {'elapsed': 3}), ('covered-by-overlay', N, {}), ('overlay-removed', N, {}), ('exposure-satisfied', N, {'elapsed': 3})], N, {}, 'exposure'), {'phase': 'qualifying', 'value': 3})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| offscreen / enters-viewport | qualifying | qualifying | Passed |
| qualifying / exposure-satisfied | counted | reporting | Failed |
| qualifying / leaves-viewport | offscreen | offscreen | Passed |
| reporting / report-success | counted | counted | Passed |
| reporting / report-failure | report-error | report-error | Passed |
| report-error / retry-report | reporting | reporting | Passed |
| qualifying / covered-by-overlay | occluded | occluded | Passed |
| occluded / overlay-removed | qualifying | qualifying | Passed |
| counted / reenter-viewport | counted | counted | Passed |
| reporting / leaves-viewport | reporting | reporting | Passed |
| older notification incarnation | offscreen | offscreen | Passed |
| future notification incarnation | offscreen | offscreen | Passed |
| unknown event is inert | offscreen | offscreen | Passed |
| empty delivery batch | offscreen | offscreen | Passed |
| N stale deliveries before current delivery | qualifying | qualifying | Passed |
| trace enters-viewport then exposure-satisfied | counted | reporting | Failed |
| trace enters-viewport then leaves-viewport | offscreen | offscreen | Passed |
| trace enters-viewport then covered-by-overlay | occluded | occluded | Passed |
| trace exposure-satisfied then report-success | counted | counted | Passed |
| trace exposure-satisfied then report-failure | counted | report-error | Failed |
| trace exposure-satisfied then leaves-viewport | counted | reporting | Failed |
| trace leaves-viewport then enters-viewport | qualifying | qualifying | Passed |
| trace report-success then reenter-viewport | counted | counted | Passed |
| trace report-failure then retry-report | reporting | reporting | Passed |
| trace retry-report then report-success | counted | counted | Passed |
| trace retry-report then report-failure | report-error | report-error | Passed |
| trace retry-report then leaves-viewport | reporting | reporting | Passed |
| trace covered-by-overlay then overlay-removed | qualifying | qualifying | Passed |
| trace overlay-removed then exposure-satisfied | counted | reporting | Failed |
| trace overlay-removed then leaves-viewport | offscreen | offscreen | Passed |
| trace overlay-removed then covered-by-overlay | occluded | occluded | Passed |
| trace reenter-viewport then reenter-viewport | counted | counted | Passed |
| trace leaves-viewport then report-success | counted | counted | Passed |
| trace leaves-viewport then report-failure | report-error | report-error | Passed |
| trace leaves-viewport then leaves-viewport | reporting | reporting | Passed |
| domain state regression 1: exposure | {'phase': 'qualifying', 'value': 3} | {'phase': 'qualifying', 'value': 3} | Passed |
| domain state regression 2: exposure | {'phase': 'counted', 'value': 4} | {'phase': 'reporting', 'value': 4} | Failed |
| domain state regression 3: exposure | {'phase': 'qualifying', 'value': 0} | {'phase': 'qualifying', 'value': 0} | Passed |
| domain state regression 4: exposure | {'phase': 'qualifying', 'value': 0} | {'phase': 'qualifying', 'value': 0} | Passed |
| domain state regression 5: exposure | {'phase': 'offscreen', 'value': 0} | {'phase': 'offscreen', 'value': 0} | Passed |
| domain state regression 6: reports | {'phase': 'counted', 'value': 1} | {'phase': 'counted', 'value': 1} | Passed |
| domain state regression 7: exposure | {'phase': 'qualifying', 'value': 3} | {'phase': 'qualifying', 'value': 3} | Passed |
SHA-256 / 727cdee420cbc815ccef5b4dd8d704f58e11689c985d45637d1c848fb9ab8a8b
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(initial, events, generation, payload=None, observe=None):
table = {('offscreen', 'enters-viewport'): 'qualifying', ('qualifying', 'exposure-satisfied'): 'offscreen', ('qualifying', 'leaves-viewport'): 'offscreen', ('reporting', 'report-success'): 'counted', ('reporting', 'report-failure'): 'report-error', ('report-error', 'retry-report'): 'reporting', ('qualifying', 'covered-by-overlay'): 'occluded', ('occluded', 'overlay-removed'): 'qualifying', ('counted', 'reenter-viewport'): 'counted', ('reporting', 'leaves-viewport'): 'reporting'}
data = json.loads(json.dumps({'exposure': 0, 'required': 4, 'covered': False, 'reports': 0})) if payload is None else {**json.loads(json.dumps({'exposure': 0, 'required': 4, 'covered': False, 'reports': 0})), **json.loads(json.dumps(payload))}
state = initial
for delivery in events:
event, event_generation = delivery[:2]
arg = delivery[2] if len(delivery) > 2 else {}
if event_generation == generation:
previous = state
if event == 'covered-by-overlay': data['covered'] = True
if event == 'overlay-removed':
data['covered'] = False
data['exposure'] = 0
if event == 'exposure-satisfied':
if not data['covered']: data['exposure'] += max(0,arg.get('elapsed',data['required']))
if data['exposure'] < data['required'] or data['covered']: event = 'unknown-event'
if event == 'leaves-viewport' and state == 'qualifying': data['exposure'] = 0
state = table.get((state, event), state)
if state == 'counted' and previous != 'counted': data['reports'] += 1
return {'phase': state, 'value': data[observe]} if observe else state
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('offscreen / enters-viewport', solve('offscreen', [('enters-viewport', N)], N), 'qualifying')
check('qualifying / exposure-satisfied', solve('qualifying', [('exposure-satisfied', N)], N), 'reporting')
check('qualifying / leaves-viewport', solve('qualifying', [('leaves-viewport', N)], N), 'offscreen')
check('reporting / report-success', solve('reporting', [('report-success', N)], N), 'counted')
check('reporting / report-failure', solve('reporting', [('report-failure', N)], N), 'report-error')
check('report-error / retry-report', solve('report-error', [('retry-report', N)], N), 'reporting')
check('qualifying / covered-by-overlay', solve('qualifying', [('covered-by-overlay', N)], N), 'occluded')
check('occluded / overlay-removed', solve('occluded', [('overlay-removed', N)], N), 'qualifying')
check('counted / reenter-viewport', solve('counted', [('reenter-viewport', N)], N), 'counted')
check('reporting / leaves-viewport', solve('reporting', [('leaves-viewport', N)], N), 'reporting')
check('older notification incarnation', solve('offscreen', [('enters-viewport', N - 1)], N), 'offscreen')
check('future notification incarnation', solve('offscreen', [('enters-viewport', N + 1)], N), 'offscreen')
check('unknown event is inert', solve('offscreen', [('unknown-event', N)], N), 'offscreen')
check('empty delivery batch', solve('offscreen', [], N), 'offscreen')
check('N stale deliveries before current delivery', solve('offscreen', [('enters-viewport', N - 1)] * N + [('enters-viewport', N)], N), 'qualifying')
check('trace enters-viewport then exposure-satisfied', solve('offscreen', [('enters-viewport', N), ('exposure-satisfied', N)], N), 'reporting')
check('trace enters-viewport then leaves-viewport', solve('offscreen', [('enters-viewport', N), ('leaves-viewport', N)], N), 'offscreen')
check('trace enters-viewport then covered-by-overlay', solve('offscreen', [('enters-viewport', N), ('covered-by-overlay', N)], N), 'occluded')
check('trace exposure-satisfied then report-success', solve('qualifying', [('exposure-satisfied', N), ('report-success', N)], N), 'counted')
check('trace exposure-satisfied then report-failure', solve('qualifying', [('exposure-satisfied', N), ('report-failure', N)], N), 'report-error')
check('trace exposure-satisfied then leaves-viewport', solve('qualifying', [('exposure-satisfied', N), ('leaves-viewport', N)], N), 'reporting')
check('trace leaves-viewport then enters-viewport', solve('qualifying', [('leaves-viewport', N), ('enters-viewport', N)], N), 'qualifying')
check('trace report-success then reenter-viewport', solve('reporting', [('report-success', N), ('reenter-viewport', N)], N), 'counted')
check('trace report-failure then retry-report', solve('reporting', [('report-failure', N), ('retry-report', N)], N), 'reporting')
check('trace retry-report then report-success', solve('report-error', [('retry-report', N), ('report-success', N)], N), 'counted')
check('trace retry-report then report-failure', solve('report-error', [('retry-report', N), ('report-failure', N)], N), 'report-error')
check('trace retry-report then leaves-viewport', solve('report-error', [('retry-report', N), ('leaves-viewport', N)], N), 'reporting')
check('trace covered-by-overlay then overlay-removed', solve('qualifying', [('covered-by-overlay', N), ('overlay-removed', N)], N), 'qualifying')
check('trace overlay-removed then exposure-satisfied', solve('occluded', [('overlay-removed', N), ('exposure-satisfied', N)], N), 'reporting')
check('trace overlay-removed then leaves-viewport', solve('occluded', [('overlay-removed', N), ('leaves-viewport', N)], N), 'offscreen')
check('trace overlay-removed then covered-by-overlay', solve('occluded', [('overlay-removed', N), ('covered-by-overlay', N)], N), 'occluded')
check('trace reenter-viewport then reenter-viewport', solve('counted', [('reenter-viewport', N), ('reenter-viewport', N)], N), 'counted')
check('trace leaves-viewport then report-success', solve('reporting', [('leaves-viewport', N), ('report-success', N)], N), 'counted')
check('trace leaves-viewport then report-failure', solve('reporting', [('leaves-viewport', N), ('report-failure', N)], N), 'report-error')
check('trace leaves-viewport then leaves-viewport', solve('reporting', [('leaves-viewport', N), ('leaves-viewport', N)], N), 'reporting')
check('domain state regression 1: exposure', solve('qualifying', [('exposure-satisfied', N, {'elapsed': 3})], N, {}, 'exposure'), {'phase': 'qualifying', 'value': 3})
check('domain state regression 2: exposure', solve('qualifying', [('exposure-satisfied', N, {'elapsed': 4})], N, {}, 'exposure'), {'phase': 'reporting', 'value': 4})
check('domain state regression 3: exposure', solve('qualifying', [('exposure-satisfied', N, {'elapsed': 9})], N, {'covered': True}, 'exposure'), {'phase': 'qualifying', 'value': 0})
check('domain state regression 4: exposure', solve('occluded', [('overlay-removed', N, {})], N, {'exposure': 3, 'covered': True}, 'exposure'), {'phase': 'qualifying', 'value': 0})
check('domain state regression 5: exposure', solve('qualifying', [('leaves-viewport', N, {})], N, {'exposure': 3}, 'exposure'), {'phase': 'offscreen', 'value': 0})
check('domain state regression 6: reports', solve('counted', [('reenter-viewport', N, {})], N, {'reports': 1}, 'reports'), {'phase': 'counted', 'value': 1})
check('domain state regression 7: exposure', solve('offscreen', [('enters-viewport', N, {}), ('exposure-satisfied', N, {'elapsed': 3}), ('covered-by-overlay', N, {}), ('overlay-removed', N, {}), ('exposure-satisfied', N, {'elapsed': 3})], N, {}, 'exposure'), {'phase': 'qualifying', 'value': 3})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| offscreen / enters-viewport | qualifying | qualifying | Passed |
| qualifying / exposure-satisfied | offscreen | reporting | Failed |
| qualifying / leaves-viewport | offscreen | offscreen | Passed |
| reporting / report-success | counted | counted | Passed |
| reporting / report-failure | report-error | report-error | Passed |
| report-error / retry-report | reporting | reporting | Passed |
| qualifying / covered-by-overlay | occluded | occluded | Passed |
| occluded / overlay-removed | qualifying | qualifying | Passed |
| counted / reenter-viewport | counted | counted | Passed |
| reporting / leaves-viewport | reporting | reporting | Passed |
| older notification incarnation | offscreen | offscreen | Passed |
| future notification incarnation | offscreen | offscreen | Passed |
| unknown event is inert | offscreen | offscreen | Passed |
| empty delivery batch | offscreen | offscreen | Passed |
| N stale deliveries before current delivery | qualifying | qualifying | Passed |
| trace enters-viewport then exposure-satisfied | offscreen | reporting | Failed |
| trace enters-viewport then leaves-viewport | offscreen | offscreen | Passed |
| trace enters-viewport then covered-by-overlay | occluded | occluded | Passed |
| trace exposure-satisfied then report-success | offscreen | counted | Failed |
| trace exposure-satisfied then report-failure | offscreen | report-error | Failed |
| trace exposure-satisfied then leaves-viewport | offscreen | reporting | Failed |
| trace leaves-viewport then enters-viewport | qualifying | qualifying | Passed |
| trace report-success then reenter-viewport | counted | counted | Passed |
| trace report-failure then retry-report | reporting | reporting | Passed |
| trace retry-report then report-success | counted | counted | Passed |
| trace retry-report then report-failure | report-error | report-error | Passed |
| trace retry-report then leaves-viewport | reporting | reporting | Passed |
| trace covered-by-overlay then overlay-removed | qualifying | qualifying | Passed |
| trace overlay-removed then exposure-satisfied | offscreen | reporting | Failed |
| trace overlay-removed then leaves-viewport | offscreen | offscreen | Passed |
| trace overlay-removed then covered-by-overlay | occluded | occluded | Passed |
| trace reenter-viewport then reenter-viewport | counted | counted | Passed |
| trace leaves-viewport then report-success | counted | counted | Passed |
| trace leaves-viewport then report-failure | report-error | report-error | Passed |
| trace leaves-viewport then leaves-viewport | reporting | reporting | Passed |
| domain state regression 1: exposure | {'phase': 'qualifying', 'value': 3} | {'phase': 'qualifying', 'value': 3} | Passed |
| domain state regression 2: exposure | {'phase': 'offscreen', 'value': 4} | {'phase': 'reporting', 'value': 4} | Failed |
| domain state regression 3: exposure | {'phase': 'qualifying', 'value': 0} | {'phase': 'qualifying', 'value': 0} | Passed |
| domain state regression 4: exposure | {'phase': 'qualifying', 'value': 0} | {'phase': 'qualifying', 'value': 0} | Passed |
| domain state regression 5: exposure | {'phase': 'offscreen', 'value': 0} | {'phase': 'offscreen', 'value': 0} | Passed |
| domain state regression 6: reports | {'phase': 'counted', 'value': 1} | {'phase': 'counted', 'value': 1} | Passed |
| domain state regression 7: exposure | {'phase': 'qualifying', 'value': 3} | {'phase': 'qualifying', 'value': 3} | Passed |
SHA-256 / 097d41ca77e402131366d3c97a80b18db623f030b169e333c6786ea9caa8027c
HELD IN THE MEMBER ARCHIVE
The verified repair and its recorded checks are member-only.
This mechanism has 42 recorded checks per implementation. The open-access tier publishes the failure and the unsuccessful fix; the repaired source that passes every check, and the observations that prove it, are available to members.
Every case sharing this mechanism uses the same contract and the same repair, so this one record is held back for all of them.
Member access is invitation-based. Sign in with your invited account to inspect the repair.
Sign in to the archive ↗Verification & scope
Stipulated single-notification state and policy model only. Event delivery and acknowledgements are explicit test inputs. No DOM, accessibility announcements, live timers, networking, actual rendering, or production-platform conformance is simulated. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:42:36.740625+00:00.
Case digest / e5bc9a83d27ba9816c2d9ade74519dfc531075fcf7027236614436d4d5c9efba