FAILURE MAP
← Case archive

FA-9681 / Configuration / Open access

Configuration change plan: Added settings are mistaken for removals · case 01

Added settings are mistaken for removals.

Verified by executionVariant 1 · 7 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

The implementation substitutes added = set(before) - set(after) for added = set(after) - set(before), so added settings are mistaken for removals.

THE FAILURE

The implementation substitutes added = set(before) - set(after) for added = set(after) - set(before), so added settings are mistaken for removals.

Unsuccessful approach: The attempted repair substitutes added = set(after). Fixture 4 still yields {'added': ['a'], 'removed': [], 'changed': ['a'], 'restart': ['a'], 'unchanged': []} instead of {'added': [], 'removed': [], 'changed': ['a'], 'restart': ['a'], 'unchanged': []}.

Case contract

Produce sorted added, removed, changed, restart-required, and unchanged key lists. Restart applies only to added/removed/changed keys in the restart set.

Why this case matters

An offline model of configuration change plan, suitable for testing build and release tooling without external services.

1 / The failure

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(before, after, restart):
    added = set(before) - set(after)
    removed = set(before) - set(after)
    common = set(before) & set(after)
    changed = {k for k in common if before[k] != after[k]}
    return {'added': sorted(added), 'removed': sorted(removed), 'changed': sorted(changed), 'restart': sorted((added | removed | changed) & set(restart)), 'unchanged': sorted(common - changed)}
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({}, {}, []), {'added': [], 'removed': [], 'changed': [], 'restart': [], 'unchanged': []})
check('fixture 2', solve({}, {'a': 1}, ['a']), {'added': ['a'], 'removed': [], 'changed': [], 'restart': ['a'], 'unchanged': []})
check('fixture 3', solve({'a': 1}, {}, ['a']), {'added': [], 'removed': ['a'], 'changed': [], 'restart': ['a'], 'unchanged': []})
check('fixture 4', solve({'a': 1}, {'a': 2}, ['a']), {'added': [], 'removed': [], 'changed': ['a'], 'restart': ['a'], 'unchanged': []})
check('fixture 5', solve({'a': 1}, {'a': 1}, ['a']), {'added': [], 'removed': [], 'changed': [], 'restart': [], 'unchanged': ['a']})
check('fixture 6', solve({'a': 1}, {'a': 2}, []), {'added': [], 'removed': [], 'changed': ['a'], 'restart': [], 'unchanged': []})
check('fixture 7', solve({'a': 1, 'b': 2}, {'a': 1, 'c': 3}, ['b', 'c']), {'added': ['c'], 'removed': ['b'], 'changed': [], 'restart': ['b', 'c'], 'unchanged': ['a']})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
fixture 1{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': []}{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': []}Passed
fixture 2{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': []}{'added': ['a'], 'changed': [], 'removed': [], 'restart': ['a'], 'unchanged': []}Failed
fixture 3{'added': ['a'], 'changed': [], 'removed': ['a'], 'restart': ['a'], 'unchanged': []}{'added': [], 'changed': [], 'removed': ['a'], 'restart': ['a'], 'unchanged': []}Failed
fixture 4{'added': [], 'changed': ['a'], 'removed': [], 'restart': ['a'], 'unchanged': []}{'added': [], 'changed': ['a'], 'removed': [], 'restart': ['a'], 'unchanged': []}Passed
fixture 5{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': ['a']}{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': ['a']}Passed
fixture 6{'added': [], 'changed': ['a'], 'removed': [], 'restart': [], 'unchanged': []}{'added': [], 'changed': ['a'], 'removed': [], 'restart': [], 'unchanged': []}Passed
fixture 7{'added': ['b'], 'changed': [], 'removed': ['b'], 'restart': ['b'], 'unchanged': ['a']}{'added': ['c'], 'changed': [], 'removed': ['b'], 'restart': ['b', 'c'], 'unchanged': ['a']}Failed

SHA-256 / 6861ecf90b7f0847d79db26f03b2dc5681168203abdb6c293423f53fc3a42a92

2 / The unsuccessful fix

Exit 1
"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(before, after, restart):
    added = set(after)
    removed = set(before) - set(after)
    common = set(before) & set(after)
    changed = {k for k in common if before[k] != after[k]}
    return {'added': sorted(added), 'removed': sorted(removed), 'changed': sorted(changed), 'restart': sorted((added | removed | changed) & set(restart)), 'unchanged': sorted(common - changed)}
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({}, {}, []), {'added': [], 'removed': [], 'changed': [], 'restart': [], 'unchanged': []})
check('fixture 2', solve({}, {'a': 1}, ['a']), {'added': ['a'], 'removed': [], 'changed': [], 'restart': ['a'], 'unchanged': []})
check('fixture 3', solve({'a': 1}, {}, ['a']), {'added': [], 'removed': ['a'], 'changed': [], 'restart': ['a'], 'unchanged': []})
check('fixture 4', solve({'a': 1}, {'a': 2}, ['a']), {'added': [], 'removed': [], 'changed': ['a'], 'restart': ['a'], 'unchanged': []})
check('fixture 5', solve({'a': 1}, {'a': 1}, ['a']), {'added': [], 'removed': [], 'changed': [], 'restart': [], 'unchanged': ['a']})
check('fixture 6', solve({'a': 1}, {'a': 2}, []), {'added': [], 'removed': [], 'changed': ['a'], 'restart': [], 'unchanged': []})
check('fixture 7', solve({'a': 1, 'b': 2}, {'a': 1, 'c': 3}, ['b', 'c']), {'added': ['c'], 'removed': ['b'], 'changed': [], 'restart': ['b', 'c'], 'unchanged': ['a']})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
Boundary fixtureActualExpectedOutcome
fixture 1{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': []}{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': []}Passed
fixture 2{'added': ['a'], 'changed': [], 'removed': [], 'restart': ['a'], 'unchanged': []}{'added': ['a'], 'changed': [], 'removed': [], 'restart': ['a'], 'unchanged': []}Passed
fixture 3{'added': [], 'changed': [], 'removed': ['a'], 'restart': ['a'], 'unchanged': []}{'added': [], 'changed': [], 'removed': ['a'], 'restart': ['a'], 'unchanged': []}Passed
fixture 4{'added': ['a'], 'changed': ['a'], 'removed': [], 'restart': ['a'], 'unchanged': []}{'added': [], 'changed': ['a'], 'removed': [], 'restart': ['a'], 'unchanged': []}Failed
fixture 5{'added': ['a'], 'changed': [], 'removed': [], 'restart': ['a'], 'unchanged': ['a']}{'added': [], 'changed': [], 'removed': [], 'restart': [], 'unchanged': ['a']}Failed
fixture 6{'added': ['a'], 'changed': ['a'], 'removed': [], 'restart': [], 'unchanged': []}{'added': [], 'changed': ['a'], 'removed': [], 'restart': [], 'unchanged': []}Failed
fixture 7{'added': ['a', 'c'], 'changed': [], 'removed': ['b'], 'restart': ['b', 'c'], 'unchanged': ['a']}{'added': ['c'], 'changed': [], 'removed': ['b'], 'restart': ['b', 'c'], 'unchanged': ['a']}Failed

SHA-256 / e5a16a0cf8fed34fd942d18e1987a55dff53b00a3736fce495d35600376ce2a7

HELD IN THE MEMBER ARCHIVE

The verified repair and its recorded checks are member-only.

This mechanism has 7 recorded checks per implementation. The open-access tier publishes the failure and the unsuccessful fix; the repaired source that passes every check, and the observations that prove it, are available to members.

Every case sharing this mechanism uses the same contract and the same repair, so this one record is held back for all of them.

Member access is invitation-based. Sign in with your invited account to inspect the repair.

Sign in to the archive ↗

Verification & scope

This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:38:32.260579+00:00.

Case digest / f9053a73f4422715844899c0d373ffadbc46204a855f07b9b3d6a69447ab22b2