FA-73941 / Feature flag rollout bucketing / Open access
Segment membership precedence: Exclusion overrides explicit inclusion · case 01
A user deliberately added to a segment is dropped because an older exclusion list also names them.
ROOT CAUSE
The excluded-key check runs before the included-key check.
VERIFIED REPAIR
Check the included list first, then the excluded list, then the rules.
Unsuccessful approach: Skipping exclusions whenever an include list exists lets excluded users fall through to rules.
Case contract
A user is in the segment if its key is in included (reason included, which beats excluded); else not if its key is in excluded; else if some rule with a non-empty clause list has every clause matching (reason rule:i). A clause [attr, values] matches only when the attribute is present and its value (or any element of a list value) is in values. Otherwise [False, none].
Why this case matters
Segments are reused across many flags, so a precedence slip changes exposure everywhere at once.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(segment, user):
key = user.get('key')
def hit(clause):
attr, values = clause
if attr not in user:
return False
value = user[attr]
items = value if isinstance(value, list) else [value]
return any(item in values for item in items)
if key in segment.get('excluded', []):
return [False, 'excluded']
if key in segment.get('included', []):
return [True, 'included']
for i, rule in enumerate(segment.get('rules', [])):
clauses = rule.get('clauses', [])
if clauses and all(hit(c) for c in clauses):
return [True, 'rule:%d' % i]
return [False, 'none']
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 2',
[{'included': [], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['groups', ['staff', 'gold']]]}]},
{'key': 'k4', 'region': 'eu'}],
[False, 'excluded']),
('segment sample 3',
[{'included': ['k4', 'k3'], 'excluded': ['k4'], 'rules': []}, {'key': 'k3'}],
[True, 'included'])],
[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('segment sample 15',
[{'included': ['k3', 'k4'],
'excluded': ['k4', 'k1'],
'rules': [{'clauses': [['tier', ['gold', '']], ['region', ['eu', 'beta']]]}, {'clauses': []}]},
{'key': 'k4', 'groups': ['beta'], 'region': ''}],
[True, 'included']),
('segment sample 36',
[{'included': ['k1'], 'excluded': ['k2', 'k3'], 'rules': []},
{'key': 'k2', 'groups': ['x'], 'tier': None}],
[False, 'excluded'])],
[('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('segment sample 11',
[{'included': ['k1'], 'excluded': ['k3'], 'rules': [{'clauses': []}]},
{'key': 'k2', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 49',
[{'included': ['k2', 'k4'], 'excluded': ['k3'], 'rules': []}, {'key': 'k3'}],
[False, 'excluded']),
('segment sample 55',
[{'included': ['k1', 'k2'], 'excluded': ['k2'], 'rules': [{'clauses': [['tier', ['', 'beta']]]}]},
{'key': 'k2', 'groups': ['beta']}],
[True, 'included'])],
[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 16',
[{'included': ['k3', 'k1'], 'excluded': [], 'rules': [{'clauses': [['groups', ['gold', 'staff']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff'], 'region': 'eu'}],
[True, 'rule:0'])],
[('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('second rule index',
[{'included': [],
'excluded': [],
'rules': [{'clauses': [['region', ['us']]]}, {'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[True, 'rule:1']),
('segment sample 15',
[{'included': ['k3', 'k4'],
'excluded': ['k4', 'k1'],
'rules': [{'clauses': [['tier', ['gold', '']], ['region', ['eu', 'beta']]]}, {'clauses': []}]},
{'key': 'k4', 'groups': ['beta'], 'region': ''}],
[True, 'included']),
('segment sample 21',
[{'included': ['k3'], 'excluded': [], 'rules': []}, {'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 39',
[{'included': ['k2'], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['region', ['eu', 'staff']]]}]},
{'key': 'k4', 'groups': ['beta']}],
[False, 'excluded'])]]
for label, args, expected in fixtures[N - 1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| explicit inclusion beats exclusion | [False, 'excluded'] | [True, 'included'] | Failed |
| exclusion blocks a matching rule | [False, 'excluded'] | [False, 'excluded'] | Passed |
| empty clause list never matches | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match a null value | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match an empty string value | [False, 'none'] | [False, 'none'] | Passed |
| segment sample 1 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 2 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 3 | [True, 'included'] | [True, 'included'] | Passed |
SHA-256 / 4b5e0fcd972939099b9471827550b812c2de55d2226c1abf4ab8420ad7b911c5
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(segment, user):
key = user.get('key')
def hit(clause):
attr, values = clause
if attr not in user:
return False
value = user[attr]
items = value if isinstance(value, list) else [value]
return any(item in values for item in items)
if key in segment.get('included', []):
return [True, 'included']
if not segment.get('included') and key in segment.get('excluded', []):
return [False, 'excluded']
for i, rule in enumerate(segment.get('rules', [])):
clauses = rule.get('clauses', [])
if clauses and all(hit(c) for c in clauses):
return [True, 'rule:%d' % i]
return [False, 'none']
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 2',
[{'included': [], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['groups', ['staff', 'gold']]]}]},
{'key': 'k4', 'region': 'eu'}],
[False, 'excluded']),
('segment sample 3',
[{'included': ['k4', 'k3'], 'excluded': ['k4'], 'rules': []}, {'key': 'k3'}],
[True, 'included'])],
[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('segment sample 15',
[{'included': ['k3', 'k4'],
'excluded': ['k4', 'k1'],
'rules': [{'clauses': [['tier', ['gold', '']], ['region', ['eu', 'beta']]]}, {'clauses': []}]},
{'key': 'k4', 'groups': ['beta'], 'region': ''}],
[True, 'included']),
('segment sample 36',
[{'included': ['k1'], 'excluded': ['k2', 'k3'], 'rules': []},
{'key': 'k2', 'groups': ['x'], 'tier': None}],
[False, 'excluded'])],
[('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('segment sample 11',
[{'included': ['k1'], 'excluded': ['k3'], 'rules': [{'clauses': []}]},
{'key': 'k2', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 49',
[{'included': ['k2', 'k4'], 'excluded': ['k3'], 'rules': []}, {'key': 'k3'}],
[False, 'excluded']),
('segment sample 55',
[{'included': ['k1', 'k2'], 'excluded': ['k2'], 'rules': [{'clauses': [['tier', ['', 'beta']]]}]},
{'key': 'k2', 'groups': ['beta']}],
[True, 'included'])],
[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 16',
[{'included': ['k3', 'k1'], 'excluded': [], 'rules': [{'clauses': [['groups', ['gold', 'staff']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff'], 'region': 'eu'}],
[True, 'rule:0'])],
[('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('second rule index',
[{'included': [],
'excluded': [],
'rules': [{'clauses': [['region', ['us']]]}, {'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[True, 'rule:1']),
('segment sample 15',
[{'included': ['k3', 'k4'],
'excluded': ['k4', 'k1'],
'rules': [{'clauses': [['tier', ['gold', '']], ['region', ['eu', 'beta']]]}, {'clauses': []}]},
{'key': 'k4', 'groups': ['beta'], 'region': ''}],
[True, 'included']),
('segment sample 21',
[{'included': ['k3'], 'excluded': [], 'rules': []}, {'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 39',
[{'included': ['k2'], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['region', ['eu', 'staff']]]}]},
{'key': 'k4', 'groups': ['beta']}],
[False, 'excluded'])]]
for label, args, expected in fixtures[N - 1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| explicit inclusion beats exclusion | [True, 'included'] | [True, 'included'] | Passed |
| exclusion blocks a matching rule | [True, 'rule:0'] | [False, 'excluded'] | Failed |
| empty clause list never matches | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match a null value | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match an empty string value | [False, 'none'] | [False, 'none'] | Passed |
| segment sample 1 | [False, 'none'] | [False, 'excluded'] | Failed |
| segment sample 2 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 3 | [True, 'included'] | [True, 'included'] | Passed |
SHA-256 / a2a02b5eef618b51bad828056a785ed778ddca1f634a16d9774f1b2e04dbe91e
3 / The verified repair
Exit 0"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(segment, user):
key = user.get('key')
def hit(clause):
attr, values = clause
if attr not in user:
return False
value = user[attr]
items = value if isinstance(value, list) else [value]
return any(item in values for item in items)
if key in segment.get('included', []):
return [True, 'included']
if key in segment.get('excluded', []):
return [False, 'excluded']
for i, rule in enumerate(segment.get('rules', [])):
clauses = rule.get('clauses', [])
if clauses and all(hit(c) for c in clauses):
return [True, 'rule:%d' % i]
return [False, 'none']
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 2',
[{'included': [], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['groups', ['staff', 'gold']]]}]},
{'key': 'k4', 'region': 'eu'}],
[False, 'excluded']),
('segment sample 3',
[{'included': ['k4', 'k3'], 'excluded': ['k4'], 'rules': []}, {'key': 'k3'}],
[True, 'included'])],
[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('segment sample 15',
[{'included': ['k3', 'k4'],
'excluded': ['k4', 'k1'],
'rules': [{'clauses': [['tier', ['gold', '']], ['region', ['eu', 'beta']]]}, {'clauses': []}]},
{'key': 'k4', 'groups': ['beta'], 'region': ''}],
[True, 'included']),
('segment sample 36',
[{'included': ['k1'], 'excluded': ['k2', 'k3'], 'rules': []},
{'key': 'k2', 'groups': ['x'], 'tier': None}],
[False, 'excluded'])],
[('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('segment sample 11',
[{'included': ['k1'], 'excluded': ['k3'], 'rules': [{'clauses': []}]},
{'key': 'k2', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 49',
[{'included': ['k2', 'k4'], 'excluded': ['k3'], 'rules': []}, {'key': 'k3'}],
[False, 'excluded']),
('segment sample 55',
[{'included': ['k1', 'k2'], 'excluded': ['k2'], 'rules': [{'clauses': [['tier', ['', 'beta']]]}]},
{'key': 'k2', 'groups': ['beta']}],
[True, 'included'])],
[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 16',
[{'included': ['k3', 'k1'], 'excluded': [], 'rules': [{'clauses': [['groups', ['gold', 'staff']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff'], 'region': 'eu'}],
[True, 'rule:0'])],
[('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('second rule index',
[{'included': [],
'excluded': [],
'rules': [{'clauses': [['region', ['us']]]}, {'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[True, 'rule:1']),
('segment sample 15',
[{'included': ['k3', 'k4'],
'excluded': ['k4', 'k1'],
'rules': [{'clauses': [['tier', ['gold', '']], ['region', ['eu', 'beta']]]}, {'clauses': []}]},
{'key': 'k4', 'groups': ['beta'], 'region': ''}],
[True, 'included']),
('segment sample 21',
[{'included': ['k3'], 'excluded': [], 'rules': []}, {'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 39',
[{'included': ['k2'], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['region', ['eu', 'staff']]]}]},
{'key': 'k4', 'groups': ['beta']}],
[False, 'excluded'])]]
for label, args, expected in fixtures[N - 1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| explicit inclusion beats exclusion | [True, 'included'] | [True, 'included'] | Passed |
| exclusion blocks a matching rule | [False, 'excluded'] | [False, 'excluded'] | Passed |
| empty clause list never matches | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match a null value | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match an empty string value | [False, 'none'] | [False, 'none'] | Passed |
| segment sample 1 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 2 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 3 | [True, 'included'] | [True, 'included'] | Passed |
SHA-256 / df05e57386d08a86599b15db4b5d6103226bd9b070e21c591556074cf55f9f63
Verification & scope
A deterministic toy flag-evaluation model with a stipulated contract; it does not reproduce any vendor SDK byte for byte. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:48:52.057991+00:00.
Case digest / 566b9addcba14802f2820964562efee2fd557cc23b5f1dd526b7cf77ca2d5283