FAILURE MAP
← Case archive

FA-59136 / Payroll withholding rules / Open access

W-4 exempt claim expiration: claim chronology · case 01

A newer W-4 entered before an older one in the list is overridden by the older form.

Verified by executionVariant 1 · 8 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

Claims are processed in input order instead of by filing date.

VERIFIED REPAIR

Restore the contract rule at the claim chronology step: use `sorted(x['claims'], key=lambda c: tuple(c[0]))`.

Unsuccessful approach: The attempt sorts by year only, leaving same-year forms in input order.

Case contract

Input {claims: [[[y,m,d], exempt]], pay_date [y,m,d]}. The active claim is the latest-dated claim on or before the pay date (claims processed by date; equal dates keep input order, last wins). No claim -> 'single-default'. Non-exempt claim -> 'per-form'. Exempt claim is honored through February 15 of the year after it was filed, inclusive; afterwards 'single-default'.

Why this case matters

Exempt status must lapse on a fixed date, reverting to default withholding until a new form arrives.

1 / The failure

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(x):
    pay = tuple(x['pay_date'])
    active = None
    for date, exempt in x['claims']:
        if tuple(date) <= pay:
            active = (tuple(date), exempt)
    if active is None:
        return 'single-default'
    if not active[1]:
        return 'per-form'
    expiry = (active[0][0] + 1, 2, 15)
    return 'exempt' if pay <= expiry else 'single-default'
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('regression', {'claims': [[[2023, 3, 11], True], [[2024, 4, 21], True], [[2023, 2, 25], False]], 'pay_date': [2024, 2, 4]}, 'exempt'), ('regression', {'claims': [[[2023, 9, 19], True], [[2023, 8, 5], True], [[2022, 3, 16], False]], 'pay_date': [2023, 9, 19]}, 'exempt'), ('partial-repair probe', {'claims': [[[2023, 9, 6], True], [[2023, 1, 17], False], [[2022, 11, 5], True]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2022, 2, 13], True], [[2023, 3, 1], False], [[2022, 3, 22], False]], 'pay_date': [2024, 2, 27]}, 'per-form'), ('normal control', {'claims': [[[2023, 2, 25], False]], 'pay_date': [2025, 12, 24]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2025, 2, 4]}, 'single-default'), ('normal control', {'claims': [[[2023, 7, 12], False], [[2023, 2, 5], False], [[2024, 5, 28], False]], 'pay_date': [2024, 2, 16]}, 'per-form')], [('regression', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('regression', {'claims': [[[2023, 4, 26], True], [[2022, 11, 26], False]], 'pay_date': [2023, 4, 26]}, 'exempt'), ('partial-repair probe', {'claims': [[[2022, 11, 8], True], [[2023, 11, 2], True], [[2023, 2, 20], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('normal control', {'claims': [[[2022, 7, 27], False], [[2022, 1, 5], True], [[2022, 8, 16], True]], 'pay_date': [2024, 5, 27]}, 'single-default'), ('normal control', {'claims': [[[2023, 4, 5], True]], 'pay_date': [2024, 11, 6]}, 'single-default'), ('normal control', {'claims': [[[2023, 10, 8], True], [[2024, 3, 27], True]], 'pay_date': [2023, 10, 8]}, 'exempt'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 16]}, 'single-default')], [('regression', {'claims': [[[2022, 11, 8], True], [[2023, 11, 2], True], [[2023, 2, 20], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('regression', {'claims': [[[2024, 9, 20], True], [[2022, 9, 28], False]], 'pay_date': [2025, 2, 23]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('partial-repair probe', {'claims': [[[2024, 9, 16], False], [[2024, 2, 20], True]], 'pay_date': [2024, 9, 16]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 15]}, 'single-default'), ('normal control', {'claims': [[[2024, 1, 17], False]], 'pay_date': [2025, 2, 16]}, 'per-form'), ('normal control', {'claims': [[[2022, 1, 6], False], [[2024, 2, 7], False]], 'pay_date': [2024, 2, 12]}, 'per-form'), ('normal control', {'claims': [[[2023, 2, 6], True]], 'pay_date': [2024, 2, 13]}, 'exempt')], [('regression', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('regression', {'claims': [[[2023, 3, 11], True], [[2024, 4, 21], True], [[2023, 2, 25], False]], 'pay_date': [2024, 2, 4]}, 'exempt'), ('partial-repair probe', {'claims': [[[2023, 6, 15], True], [[2023, 3, 6], False]], 'pay_date': [2023, 6, 15]}, 'exempt'), ('partial-repair probe', {'claims': [[[2022, 12, 19], True], [[2022, 5, 28], False], [[2023, 5, 27], False]], 'pay_date': [2023, 2, 11]}, 'exempt'), ('normal control', {'claims': [[[2023, 4, 9], False], [[2024, 8, 26], False], [[2022, 5, 3], False]], 'pay_date': [2024, 7, 21]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 27]}, 'single-default'), ('normal control', {'claims': [[[2024, 6, 18], True], [[2024, 1, 24], True], [[2024, 8, 3], True]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2023, 9, 14], False], [[2024, 8, 7], True], [[2024, 1, 1], True]], 'pay_date': [2023, 9, 14]}, 'per-form')], [('regression', {'claims': [[[2024, 9, 16], False], [[2024, 2, 20], True]], 'pay_date': [2024, 9, 16]}, 'per-form'), ('regression', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 11, 10], False], [[2023, 1, 11], True], [[2024, 5, 22], False]], 'pay_date': [2023, 11, 10]}, 'per-form'), ('partial-repair probe', {'claims': [[[2022, 8, 13], True], [[2022, 5, 20], True], [[2022, 4, 7], False]], 'pay_date': [2023, 2, 15]}, 'exempt'), ('normal control', {'claims': [[[2022, 5, 10], True]], 'pay_date': [2022, 5, 10]}, 'exempt'), ('normal control', {'claims': [[[2023, 10, 8], False], [[2024, 8, 1], False]], 'pay_date': [2023, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2024, 12, 15], False], [[2023, 9, 28], False]], 'pay_date': [2025, 2, 3]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2024, 7, 6]}, 'single-default')]]
for i, (label, args, expected) in enumerate(fixtures[N-1]):
    check("%s %d" % (label, i), solve(args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
regression 0per-formexemptFailed
regression 1per-formexemptFailed
partial-repair probe 2single-defaultsingle-defaultPassed
partial-repair probe 3per-formsingle-defaultFailed
normal control 4per-formper-formPassed
normal control 5per-formper-formPassed
normal control 6single-defaultsingle-defaultPassed
normal control 7per-formper-formPassed

SHA-256 / 84109e93eca5e3d758150a21ddc2715cd3435b63596e9d54f9eb176d2f815c50

2 / The unsuccessful fix

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(x):
    pay = tuple(x['pay_date'])
    active = None
    for date, exempt in sorted(x['claims'], key=lambda c: c[0][0]):
        if tuple(date) <= pay:
            active = (tuple(date), exempt)
    if active is None:
        return 'single-default'
    if not active[1]:
        return 'per-form'
    expiry = (active[0][0] + 1, 2, 15)
    return 'exempt' if pay <= expiry else 'single-default'
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('regression', {'claims': [[[2023, 3, 11], True], [[2024, 4, 21], True], [[2023, 2, 25], False]], 'pay_date': [2024, 2, 4]}, 'exempt'), ('regression', {'claims': [[[2023, 9, 19], True], [[2023, 8, 5], True], [[2022, 3, 16], False]], 'pay_date': [2023, 9, 19]}, 'exempt'), ('partial-repair probe', {'claims': [[[2023, 9, 6], True], [[2023, 1, 17], False], [[2022, 11, 5], True]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2022, 2, 13], True], [[2023, 3, 1], False], [[2022, 3, 22], False]], 'pay_date': [2024, 2, 27]}, 'per-form'), ('normal control', {'claims': [[[2023, 2, 25], False]], 'pay_date': [2025, 12, 24]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2025, 2, 4]}, 'single-default'), ('normal control', {'claims': [[[2023, 7, 12], False], [[2023, 2, 5], False], [[2024, 5, 28], False]], 'pay_date': [2024, 2, 16]}, 'per-form')], [('regression', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('regression', {'claims': [[[2023, 4, 26], True], [[2022, 11, 26], False]], 'pay_date': [2023, 4, 26]}, 'exempt'), ('partial-repair probe', {'claims': [[[2022, 11, 8], True], [[2023, 11, 2], True], [[2023, 2, 20], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('normal control', {'claims': [[[2022, 7, 27], False], [[2022, 1, 5], True], [[2022, 8, 16], True]], 'pay_date': [2024, 5, 27]}, 'single-default'), ('normal control', {'claims': [[[2023, 4, 5], True]], 'pay_date': [2024, 11, 6]}, 'single-default'), ('normal control', {'claims': [[[2023, 10, 8], True], [[2024, 3, 27], True]], 'pay_date': [2023, 10, 8]}, 'exempt'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 16]}, 'single-default')], [('regression', {'claims': [[[2022, 11, 8], True], [[2023, 11, 2], True], [[2023, 2, 20], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('regression', {'claims': [[[2024, 9, 20], True], [[2022, 9, 28], False]], 'pay_date': [2025, 2, 23]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('partial-repair probe', {'claims': [[[2024, 9, 16], False], [[2024, 2, 20], True]], 'pay_date': [2024, 9, 16]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 15]}, 'single-default'), ('normal control', {'claims': [[[2024, 1, 17], False]], 'pay_date': [2025, 2, 16]}, 'per-form'), ('normal control', {'claims': [[[2022, 1, 6], False], [[2024, 2, 7], False]], 'pay_date': [2024, 2, 12]}, 'per-form'), ('normal control', {'claims': [[[2023, 2, 6], True]], 'pay_date': [2024, 2, 13]}, 'exempt')], [('regression', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('regression', {'claims': [[[2023, 3, 11], True], [[2024, 4, 21], True], [[2023, 2, 25], False]], 'pay_date': [2024, 2, 4]}, 'exempt'), ('partial-repair probe', {'claims': [[[2023, 6, 15], True], [[2023, 3, 6], False]], 'pay_date': [2023, 6, 15]}, 'exempt'), ('partial-repair probe', {'claims': [[[2022, 12, 19], True], [[2022, 5, 28], False], [[2023, 5, 27], False]], 'pay_date': [2023, 2, 11]}, 'exempt'), ('normal control', {'claims': [[[2023, 4, 9], False], [[2024, 8, 26], False], [[2022, 5, 3], False]], 'pay_date': [2024, 7, 21]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 27]}, 'single-default'), ('normal control', {'claims': [[[2024, 6, 18], True], [[2024, 1, 24], True], [[2024, 8, 3], True]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2023, 9, 14], False], [[2024, 8, 7], True], [[2024, 1, 1], True]], 'pay_date': [2023, 9, 14]}, 'per-form')], [('regression', {'claims': [[[2024, 9, 16], False], [[2024, 2, 20], True]], 'pay_date': [2024, 9, 16]}, 'per-form'), ('regression', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 11, 10], False], [[2023, 1, 11], True], [[2024, 5, 22], False]], 'pay_date': [2023, 11, 10]}, 'per-form'), ('partial-repair probe', {'claims': [[[2022, 8, 13], True], [[2022, 5, 20], True], [[2022, 4, 7], False]], 'pay_date': [2023, 2, 15]}, 'exempt'), ('normal control', {'claims': [[[2022, 5, 10], True]], 'pay_date': [2022, 5, 10]}, 'exempt'), ('normal control', {'claims': [[[2023, 10, 8], False], [[2024, 8, 1], False]], 'pay_date': [2023, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2024, 12, 15], False], [[2023, 9, 28], False]], 'pay_date': [2025, 2, 3]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2024, 7, 6]}, 'single-default')]]
for i, (label, args, expected) in enumerate(fixtures[N-1]):
    check("%s %d" % (label, i), solve(args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
regression 0per-formexemptFailed
regression 1exemptexemptPassed
partial-repair probe 2per-formsingle-defaultFailed
partial-repair probe 3per-formsingle-defaultFailed
normal control 4per-formper-formPassed
normal control 5per-formper-formPassed
normal control 6single-defaultsingle-defaultPassed
normal control 7per-formper-formPassed

SHA-256 / 972479125c1a088d183d5eaffb4d18b0afff4d07c85ee00ffd00d810761bac3f

3 / The verified repair

Exit 0
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(x):
    pay = tuple(x['pay_date'])
    active = None
    for date, exempt in sorted(x['claims'], key=lambda c: tuple(c[0])):
        if tuple(date) <= pay:
            active = (tuple(date), exempt)
    if active is None:
        return 'single-default'
    if not active[1]:
        return 'per-form'
    expiry = (active[0][0] + 1, 2, 15)
    return 'exempt' if pay <= expiry else 'single-default'
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('regression', {'claims': [[[2023, 3, 11], True], [[2024, 4, 21], True], [[2023, 2, 25], False]], 'pay_date': [2024, 2, 4]}, 'exempt'), ('regression', {'claims': [[[2023, 9, 19], True], [[2023, 8, 5], True], [[2022, 3, 16], False]], 'pay_date': [2023, 9, 19]}, 'exempt'), ('partial-repair probe', {'claims': [[[2023, 9, 6], True], [[2023, 1, 17], False], [[2022, 11, 5], True]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2022, 2, 13], True], [[2023, 3, 1], False], [[2022, 3, 22], False]], 'pay_date': [2024, 2, 27]}, 'per-form'), ('normal control', {'claims': [[[2023, 2, 25], False]], 'pay_date': [2025, 12, 24]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2025, 2, 4]}, 'single-default'), ('normal control', {'claims': [[[2023, 7, 12], False], [[2023, 2, 5], False], [[2024, 5, 28], False]], 'pay_date': [2024, 2, 16]}, 'per-form')], [('regression', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('regression', {'claims': [[[2023, 4, 26], True], [[2022, 11, 26], False]], 'pay_date': [2023, 4, 26]}, 'exempt'), ('partial-repair probe', {'claims': [[[2022, 11, 8], True], [[2023, 11, 2], True], [[2023, 2, 20], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('normal control', {'claims': [[[2022, 7, 27], False], [[2022, 1, 5], True], [[2022, 8, 16], True]], 'pay_date': [2024, 5, 27]}, 'single-default'), ('normal control', {'claims': [[[2023, 4, 5], True]], 'pay_date': [2024, 11, 6]}, 'single-default'), ('normal control', {'claims': [[[2023, 10, 8], True], [[2024, 3, 27], True]], 'pay_date': [2023, 10, 8]}, 'exempt'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 16]}, 'single-default')], [('regression', {'claims': [[[2022, 11, 8], True], [[2023, 11, 2], True], [[2023, 2, 20], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('regression', {'claims': [[[2024, 9, 20], True], [[2022, 9, 28], False]], 'pay_date': [2025, 2, 23]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('partial-repair probe', {'claims': [[[2024, 9, 16], False], [[2024, 2, 20], True]], 'pay_date': [2024, 9, 16]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 15]}, 'single-default'), ('normal control', {'claims': [[[2024, 1, 17], False]], 'pay_date': [2025, 2, 16]}, 'per-form'), ('normal control', {'claims': [[[2022, 1, 6], False], [[2024, 2, 7], False]], 'pay_date': [2024, 2, 12]}, 'per-form'), ('normal control', {'claims': [[[2023, 2, 6], True]], 'pay_date': [2024, 2, 13]}, 'exempt')], [('regression', {'claims': [[[2023, 6, 6], False], [[2023, 1, 26], True]], 'pay_date': [2024, 2, 15]}, 'per-form'), ('regression', {'claims': [[[2023, 3, 11], True], [[2024, 4, 21], True], [[2023, 2, 25], False]], 'pay_date': [2024, 2, 4]}, 'exempt'), ('partial-repair probe', {'claims': [[[2023, 6, 15], True], [[2023, 3, 6], False]], 'pay_date': [2023, 6, 15]}, 'exempt'), ('partial-repair probe', {'claims': [[[2022, 12, 19], True], [[2022, 5, 28], False], [[2023, 5, 27], False]], 'pay_date': [2023, 2, 11]}, 'exempt'), ('normal control', {'claims': [[[2023, 4, 9], False], [[2024, 8, 26], False], [[2022, 5, 3], False]], 'pay_date': [2024, 7, 21]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2023, 2, 27]}, 'single-default'), ('normal control', {'claims': [[[2024, 6, 18], True], [[2024, 1, 24], True], [[2024, 8, 3], True]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2023, 9, 14], False], [[2024, 8, 7], True], [[2024, 1, 1], True]], 'pay_date': [2023, 9, 14]}, 'per-form')], [('regression', {'claims': [[[2024, 9, 16], False], [[2024, 2, 20], True]], 'pay_date': [2024, 9, 16]}, 'per-form'), ('regression', {'claims': [[[2024, 5, 13], True], [[2024, 1, 6], False]], 'pay_date': [2025, 2, 16]}, 'single-default'), ('partial-repair probe', {'claims': [[[2023, 11, 10], False], [[2023, 1, 11], True], [[2024, 5, 22], False]], 'pay_date': [2023, 11, 10]}, 'per-form'), ('partial-repair probe', {'claims': [[[2022, 8, 13], True], [[2022, 5, 20], True], [[2022, 4, 7], False]], 'pay_date': [2023, 2, 15]}, 'exempt'), ('normal control', {'claims': [[[2022, 5, 10], True]], 'pay_date': [2022, 5, 10]}, 'exempt'), ('normal control', {'claims': [[[2023, 10, 8], False], [[2024, 8, 1], False]], 'pay_date': [2023, 2, 16]}, 'single-default'), ('normal control', {'claims': [[[2024, 12, 15], False], [[2023, 9, 28], False]], 'pay_date': [2025, 2, 3]}, 'per-form'), ('normal control', {'claims': [], 'pay_date': [2024, 7, 6]}, 'single-default')]]
for i, (label, args, expected) in enumerate(fixtures[N-1]):
    check("%s %d" % (label, i), solve(args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
regression 0exemptexemptPassed
regression 1exemptexemptPassed
partial-repair probe 2single-defaultsingle-defaultPassed
partial-repair probe 3single-defaultsingle-defaultPassed
normal control 4per-formper-formPassed
normal control 5per-formper-formPassed
normal control 6single-defaultsingle-defaultPassed
normal control 7per-formper-formPassed

SHA-256 / 43306ba2755de6fdd4c13e0c72962ee377ef4acdc557067c562579df9b7c3e97

Verification & scope

A deterministic teaching model of a stipulated payroll rule with toy thresholds and rates. It makes no claim of conformance to any tax authority, statute or jurisdiction and is not payroll software. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:46:33.444110+00:00.

Case digest / 859749671183c05e1409d0bbd1b7dcf697e985ff67570ca19aa6d3fb7237883e