FAILURE MAP
← Case archive

FA-25726 / Filter interfaces / Open access

URL versions must belong to the explicit supported set · case 01

URL versions must belong to the explicit supported set is violated by the widget projection.

Verified by executionVariant 1 · 10 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

The version-acceptance decision uses `d['version']<=max(d['supported'])` instead of the stipulated url-hydration projection.

VERIFIED REPAIR

Implement the declared version-acceptance projection: `d['version'] in d['supported']`.

Unsuccessful approach: The attempted correction `d['version']==max(d['supported'])` still violates the explicit contract fixtures.

Case contract

URL hydration validates filter fields and operators before publishing a draft, preserving duplicate value order while rejecting unknown schema references. This example checks: URL versions must belong to the explicit supported set.

Why this case matters

Filter-widget state and serialization must preserve user constraints while the view changes.

1 / The failure

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(d):
    return {'known-fields':([x for x in d['pairs'] if x[0] in d['fields']]), 'unknown-diagnostics':([x[0] for x in d['pairs'] if x[0] not in d['fields']]), 'repeat-values':([v for k,v in d['pairs'] if k==d['field']]), 'version-acceptance':(d['version']<=max(d['supported'])), 'unknown-operator':(d['op'] not in d['operators']), 'atomic-publication':(d['valid'] and d['version'] in d['supported'] and d['op'] in d['operators'])}
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = {1: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False})], 2: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False})], 3: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True})], 4: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False})], 5: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False})]}
for index, (data, expected) in enumerate(fixtures[N]):
    check("contract fixture " + str(index), solve(data), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
contract fixture 0{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': False, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': False, 'version-acceptance': False}Failed
contract fixture 1{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 2{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 3{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 4{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 5{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 6{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 7{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 8{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 9{'atomic-publication': False, 'known-fields': [['a', '']], 'repeat-values': [''], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', '']], 'repeat-values': [''], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed

SHA-256 / f58cc63375a73ff3d6e9cf24f4399bd5ce493c3ce4b7390d6508b90377b99311

2 / The unsuccessful fix

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(d):
    return {'known-fields':([x for x in d['pairs'] if x[0] in d['fields']]), 'unknown-diagnostics':([x[0] for x in d['pairs'] if x[0] not in d['fields']]), 'repeat-values':([v for k,v in d['pairs'] if k==d['field']]), 'version-acceptance':(d['version']==max(d['supported'])), 'unknown-operator':(d['op'] not in d['operators']), 'atomic-publication':(d['valid'] and d['version'] in d['supported'] and d['op'] in d['operators'])}
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = {1: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False})], 2: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False})], 3: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True})], 4: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False})], 5: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False})]}
for index, (data, expected) in enumerate(fixtures[N]):
    check("contract fixture " + str(index), solve(data), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
contract fixture 0{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': False, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': False, 'version-acceptance': False}Passed
contract fixture 1{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Failed
contract fixture 2{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 3{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Failed
contract fixture 4{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 5{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Failed
contract fixture 6{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 7{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Failed
contract fixture 8{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 9{'atomic-publication': False, 'known-fields': [['a', '']], 'repeat-values': [''], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [['a', '']], 'repeat-values': [''], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Failed

SHA-256 / 61b13fb8b41d1d7fb3e99927456e2b04d077e74d79319779d4c9150ed52dbc6f

3 / The verified repair

Exit 0
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(d):
    return {'known-fields':([x for x in d['pairs'] if x[0] in d['fields']]), 'unknown-diagnostics':([x[0] for x in d['pairs'] if x[0] not in d['fields']]), 'repeat-values':([v for k,v in d['pairs'] if k==d['field']]), 'version-acceptance':(d['version'] in d['supported']), 'unknown-operator':(d['op'] not in d['operators']), 'atomic-publication':(d['valid'] and d['version'] in d['supported'] and d['op'] in d['operators'])}
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = {1: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False})], 2: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False})], 3: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': True})], 4: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['v'], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 3, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': False, 'atomic-publication': False})], 5: [({'pairs': [['a', 'z'], ['a', 'x'], ['q', 'v']], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'eq', 'operators': ['eq'], 'valid': False}, {'known-fields': [['a', 'z'], ['a', 'x']], 'unknown-diagnostics': ['q'], 'repeat-values': ['z', 'x'], 'version-acceptance': False, 'unknown-operator': False, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 1, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': True, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [], 'fields': ['a'], 'field': 'q', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'a', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [''], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 0, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False}), ({'pairs': [['a', '']], 'fields': ['a'], 'field': 'q', 'version': 2, 'supported': [1, 3], 'op': 'bad', 'operators': ['eq'], 'valid': True}, {'known-fields': [['a', '']], 'unknown-diagnostics': [], 'repeat-values': [], 'version-acceptance': False, 'unknown-operator': True, 'atomic-publication': False})]}
for index, (data, expected) in enumerate(fixtures[N]):
    check("contract fixture " + str(index), solve(data), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
contract fixture 0{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': False, 'version-acceptance': False}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': False, 'version-acceptance': False}Passed
contract fixture 1{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 2{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['z', 'x'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 3{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 4{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', 'z'], ['a', 'x']], 'repeat-values': ['v'], 'unknown-diagnostics': ['q'], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 5{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 6{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 7{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 8{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [], 'repeat-values': [], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed
contract fixture 9{'atomic-publication': False, 'known-fields': [['a', '']], 'repeat-values': [''], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}{'atomic-publication': False, 'known-fields': [['a', '']], 'repeat-values': [''], 'unknown-diagnostics': [], 'unknown-operator': True, 'version-acceptance': True}Passed

SHA-256 / f74cc04aeedfa206cc340fb5cd42ed96a52bab9fbff4c2d9dca3b819e38bdfc1

Verification & scope

Deterministic bounded UI-state model only; no browser, query engine, network, or production-standard conformance is claimed. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:41:09.336854+00:00.

Case digest / 65cef99c0d3aba70b3067ad65233da3b60af3971f3013aa718f1600fab3415bc