FA-73946 / Feature flag rollout bucketing / Open access
Segment membership precedence: A rule with no clauses captures everyone · case 01
A half-configured segment rule suddenly places every remaining user in the segment.
ROOT CAUSE
all() over an empty clause list is True and the rule is not required to have clauses.
VERIFIED REPAIR
Require a non-empty clause list and every clause to match.
Unsuccessful approach: Switching to any() rejects empty rules but turns multi-clause rules into disjunctions.
Case contract
A user is in the segment if its key is in included (reason included, which beats excluded); else not if its key is in excluded; else if some rule with a non-empty clause list has every clause matching (reason rule:i). A clause [attr, values] matches only when the attribute is present and its value (or any element of a list value) is in values. Otherwise [False, none].
Why this case matters
Segments are reused across many flags, so a precedence slip changes exposure everywhere at once.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(segment, user):
key = user.get('key')
def hit(clause):
attr, values = clause
if attr not in user:
return False
value = user[attr]
items = value if isinstance(value, list) else [value]
return any(item in values for item in items)
if key in segment.get('included', []):
return [True, 'included']
if key in segment.get('excluded', []):
return [False, 'excluded']
for i, rule in enumerate(segment.get('rules', [])):
clauses = rule.get('clauses', [])
if all(hit(c) for c in clauses):
return [True, 'rule:%d' % i]
return [False, 'none']
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 2',
[{'included': [], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['groups', ['staff', 'gold']]]}]},
{'key': 'k4', 'region': 'eu'}],
[False, 'excluded'])],
[('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 33',
[{'included': ['k1', 'k2'], 'excluded': [], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k9', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 42',
[{'included': [],
'excluded': ['k4'],
'rules': [{'clauses': [['region', ['gold', 'eu']], ['region', ['staff', '']]]},
{'clauses': [['tier', [None, 'eu']]]}]},
{'key': 'k3', 'groups': ['x'], 'region': ''}],
[False, 'none'])],
[('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('segment sample 11',
[{'included': ['k1'], 'excluded': ['k3'], 'rules': [{'clauses': []}]},
{'key': 'k2', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 12',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['staff', '']]]}, {'clauses': []}]},
{'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 34',
[{'included': [],
'excluded': ['k3'],
'rules': [{'clauses': [['tier', ['beta', None]], ['groups', ['staff', 'gold']]]},
{'clauses': [['groups', ['eu', '']], ['groups', ['', 'eu']]]}]},
{'key': 'k2', 'groups': ['x'], 'tier': None}],
[False, 'none'])],
[('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 16',
[{'included': ['k3', 'k1'], 'excluded': [], 'rules': [{'clauses': [['groups', ['gold', 'staff']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff'], 'region': 'eu'}],
[True, 'rule:0']),
('segment sample 19',
[{'included': ['k3', 'k1'],
'excluded': ['k4'],
'rules': [{'clauses': [['groups', ['staff', None]], ['groups', ['gold', '']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff']}],
[False, 'none']),
('segment sample 59',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}, {'clauses': [['tier', ['staff', 'beta']]]}]},
{'key': 'k1', 'groups': ['x']}],
[False, 'none'])],
[('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('second rule index',
[{'included': [],
'excluded': [],
'rules': [{'clauses': [['region', ['us']]]}, {'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[True, 'rule:1']),
('segment sample 21',
[{'included': ['k3'], 'excluded': [], 'rules': []}, {'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 22',
[{'included': [], 'excluded': ['k1'], 'rules': []}, {'key': 'k2', 'region': 'us'}],
[False, 'none']),
('segment sample 30',
[{'included': ['k1', 'k2'], 'excluded': ['k2', 'k4'], 'rules': [{'clauses': []}]},
{'key': 'k3', 'tier': 'gold'}],
[False, 'none'])]]
for label, args, expected in fixtures[N - 1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| explicit inclusion beats exclusion | [True, 'included'] | [True, 'included'] | Passed |
| exclusion blocks a matching rule | [False, 'excluded'] | [False, 'excluded'] | Passed |
| empty clause list never matches | [True, 'rule:0'] | [False, 'none'] | Failed |
| absent attribute does not match a null value | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match an empty string value | [False, 'none'] | [False, 'none'] | Passed |
| all clauses must match | [False, 'none'] | [False, 'none'] | Passed |
| segment sample 1 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 2 | [False, 'excluded'] | [False, 'excluded'] | Passed |
SHA-256 / 2d13c7278f4f854bf940b4fbe3e48ee3f302dffbe30d37a03e78941865524350
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(segment, user):
key = user.get('key')
def hit(clause):
attr, values = clause
if attr not in user:
return False
value = user[attr]
items = value if isinstance(value, list) else [value]
return any(item in values for item in items)
if key in segment.get('included', []):
return [True, 'included']
if key in segment.get('excluded', []):
return [False, 'excluded']
for i, rule in enumerate(segment.get('rules', [])):
clauses = rule.get('clauses', [])
if any(hit(c) for c in clauses):
return [True, 'rule:%d' % i]
return [False, 'none']
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 2',
[{'included': [], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['groups', ['staff', 'gold']]]}]},
{'key': 'k4', 'region': 'eu'}],
[False, 'excluded'])],
[('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 33',
[{'included': ['k1', 'k2'], 'excluded': [], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k9', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 42',
[{'included': [],
'excluded': ['k4'],
'rules': [{'clauses': [['region', ['gold', 'eu']], ['region', ['staff', '']]]},
{'clauses': [['tier', [None, 'eu']]]}]},
{'key': 'k3', 'groups': ['x'], 'region': ''}],
[False, 'none'])],
[('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('segment sample 11',
[{'included': ['k1'], 'excluded': ['k3'], 'rules': [{'clauses': []}]},
{'key': 'k2', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 12',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['staff', '']]]}, {'clauses': []}]},
{'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 34',
[{'included': [],
'excluded': ['k3'],
'rules': [{'clauses': [['tier', ['beta', None]], ['groups', ['staff', 'gold']]]},
{'clauses': [['groups', ['eu', '']], ['groups', ['', 'eu']]]}]},
{'key': 'k2', 'groups': ['x'], 'tier': None}],
[False, 'none'])],
[('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 16',
[{'included': ['k3', 'k1'], 'excluded': [], 'rules': [{'clauses': [['groups', ['gold', 'staff']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff'], 'region': 'eu'}],
[True, 'rule:0']),
('segment sample 19',
[{'included': ['k3', 'k1'],
'excluded': ['k4'],
'rules': [{'clauses': [['groups', ['staff', None]], ['groups', ['gold', '']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff']}],
[False, 'none']),
('segment sample 59',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}, {'clauses': [['tier', ['staff', 'beta']]]}]},
{'key': 'k1', 'groups': ['x']}],
[False, 'none'])],
[('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('second rule index',
[{'included': [],
'excluded': [],
'rules': [{'clauses': [['region', ['us']]]}, {'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[True, 'rule:1']),
('segment sample 21',
[{'included': ['k3'], 'excluded': [], 'rules': []}, {'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 22',
[{'included': [], 'excluded': ['k1'], 'rules': []}, {'key': 'k2', 'region': 'us'}],
[False, 'none']),
('segment sample 30',
[{'included': ['k1', 'k2'], 'excluded': ['k2', 'k4'], 'rules': [{'clauses': []}]},
{'key': 'k3', 'tier': 'gold'}],
[False, 'none'])]]
for label, args, expected in fixtures[N - 1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| explicit inclusion beats exclusion | [True, 'included'] | [True, 'included'] | Passed |
| exclusion blocks a matching rule | [False, 'excluded'] | [False, 'excluded'] | Passed |
| empty clause list never matches | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match a null value | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match an empty string value | [False, 'none'] | [False, 'none'] | Passed |
| all clauses must match | [True, 'rule:0'] | [False, 'none'] | Failed |
| segment sample 1 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 2 | [False, 'excluded'] | [False, 'excluded'] | Passed |
SHA-256 / 00cd7f08b283bdd7c594298b747f05cd46a228d1cd5fdf2b4cdc0be7d57b6005
3 / The verified repair
Exit 0"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(segment, user):
key = user.get('key')
def hit(clause):
attr, values = clause
if attr not in user:
return False
value = user[attr]
items = value if isinstance(value, list) else [value]
return any(item in values for item in items)
if key in segment.get('included', []):
return [True, 'included']
if key in segment.get('excluded', []):
return [False, 'excluded']
for i, rule in enumerate(segment.get('rules', [])):
clauses = rule.get('clauses', [])
if clauses and all(hit(c) for c in clauses):
return [True, 'rule:%d' % i]
return [False, 'none']
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('explicit inclusion beats exclusion',
[{'included': ['k1'], 'excluded': ['k1'], 'rules': []}, {'key': 'k1'}],
[True, 'included']),
('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 1',
[{'included': ['k3'], 'excluded': ['k2', 'k1'], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k2', 'groups': ['beta'], 'tier': 'gold'}],
[False, 'excluded']),
('segment sample 2',
[{'included': [], 'excluded': ['k4', 'k1'], 'rules': [{'clauses': [['groups', ['staff', 'gold']]]}]},
{'key': 'k4', 'region': 'eu'}],
[False, 'excluded'])],
[('exclusion blocks a matching rule',
[{'included': ['k2'], 'excluded': ['k1'], 'rules': [{'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[False, 'excluded']),
('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 33',
[{'included': ['k1', 'k2'], 'excluded': [], 'rules': [{'clauses': []}, {'clauses': []}]},
{'key': 'k9', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 42',
[{'included': [],
'excluded': ['k4'],
'rules': [{'clauses': [['region', ['gold', 'eu']], ['region', ['staff', '']]]},
{'clauses': [['tier', [None, 'eu']]]}]},
{'key': 'k3', 'groups': ['x'], 'region': ''}],
[False, 'none'])],
[('empty clause list never matches',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('segment sample 11',
[{'included': ['k1'], 'excluded': ['k3'], 'rules': [{'clauses': []}]},
{'key': 'k2', 'groups': ['staff', 'eu'], 'tier': 'gold'}],
[False, 'none']),
('segment sample 12',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['staff', '']]]}, {'clauses': []}]},
{'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 34',
[{'included': [],
'excluded': ['k3'],
'rules': [{'clauses': [['tier', ['beta', None]], ['groups', ['staff', 'gold']]]},
{'clauses': [['groups', ['eu', '']], ['groups', ['', 'eu']]]}]},
{'key': 'k2', 'groups': ['x'], 'tier': None}],
[False, 'none'])],
[('absent attribute does not match a null value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['tier', [None, 'gold']]]}]}, {'key': 'k3'}],
[False, 'none']),
('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('segment sample 16',
[{'included': ['k3', 'k1'], 'excluded': [], 'rules': [{'clauses': [['groups', ['gold', 'staff']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff'], 'region': 'eu'}],
[True, 'rule:0']),
('segment sample 19',
[{'included': ['k3', 'k1'],
'excluded': ['k4'],
'rules': [{'clauses': [['groups', ['staff', None]], ['groups', ['gold', '']]]}]},
{'key': 'k2', 'groups': ['beta', 'staff']}],
[False, 'none']),
('segment sample 59',
[{'included': [], 'excluded': [], 'rules': [{'clauses': []}, {'clauses': [['tier', ['staff', 'beta']]]}]},
{'key': 'k1', 'groups': ['x']}],
[False, 'none'])],
[('absent attribute does not match an empty string value',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['']]]}]}, {'key': 'k4'}],
[False, 'none']),
('list attribute matches through any element',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': ['staff', 'beta']}],
[True, 'rule:0']),
('empty list attribute is not a member',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['groups', ['beta']]]}]},
{'key': 'k2', 'groups': []}],
[False, 'none']),
('all clauses must match',
[{'included': [], 'excluded': [], 'rules': [{'clauses': [['region', ['eu']], ['groups', ['beta']]]}]},
{'key': 'k1', 'region': 'eu', 'groups': ['x']}],
[False, 'none']),
('second rule index',
[{'included': [],
'excluded': [],
'rules': [{'clauses': [['region', ['us']]]}, {'clauses': [['region', ['eu']]]}]},
{'key': 'k1', 'region': 'eu'}],
[True, 'rule:1']),
('segment sample 21',
[{'included': ['k3'], 'excluded': [], 'rules': []}, {'key': 'k9', 'groups': 'beta'}],
[False, 'none']),
('segment sample 22',
[{'included': [], 'excluded': ['k1'], 'rules': []}, {'key': 'k2', 'region': 'us'}],
[False, 'none']),
('segment sample 30',
[{'included': ['k1', 'k2'], 'excluded': ['k2', 'k4'], 'rules': [{'clauses': []}]},
{'key': 'k3', 'tier': 'gold'}],
[False, 'none'])]]
for label, args, expected in fixtures[N - 1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| explicit inclusion beats exclusion | [True, 'included'] | [True, 'included'] | Passed |
| exclusion blocks a matching rule | [False, 'excluded'] | [False, 'excluded'] | Passed |
| empty clause list never matches | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match a null value | [False, 'none'] | [False, 'none'] | Passed |
| absent attribute does not match an empty string value | [False, 'none'] | [False, 'none'] | Passed |
| all clauses must match | [False, 'none'] | [False, 'none'] | Passed |
| segment sample 1 | [False, 'excluded'] | [False, 'excluded'] | Passed |
| segment sample 2 | [False, 'excluded'] | [False, 'excluded'] | Passed |
SHA-256 / ddc538384086b9a4399338b0c837900967500f764f00801b6fc72a713b7f9aea
Verification & scope
A deterministic toy flag-evaluation model with a stipulated contract; it does not reproduce any vendor SDK byte for byte. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:48:52.099353+00:00.
Case digest / 1af9ce15f274465edabb97e3a849c51d3924d170efdf12cc06dc79baa7dbfdae