FA-10221 / Deployment models / Open access
Environment promotion plan: Untested artifacts reach the target · case 01
Untested artifacts reach the target.
ROOT CAUSE
The implementation substitutes if False: for if not tested:, so untested artifacts reach the target.
VERIFIED REPAIR
Require test evidence for an actual promotion.
Unsuccessful approach: The attempted repair substitutes if tested:. Fixture 3 still yields 'untested' instead of {'prod': (1, 'a')}.
Case contract
Reject unknown targets, reject downgrade unless allowed, skip identical digests, reject missing test evidence, otherwise update target to candidate digest and version while preserving other environments.
Why this case matters
An offline model of environment promotion plan, suitable for testing build and release tooling without external services.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(environments, target, version, digest, tested, allow_downgrade):
if target not in environments: return 'unknown'
old_version, old_digest = environments[target]
if version < old_version and not allow_downgrade: return 'downgrade'
if digest == old_digest: return 'unchanged'
if False: return 'untested'
result = dict(environments)
result[target] = (version, digest)
return result
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({}, 'prod', 1, 'a', True, False), 'unknown')
check('fixture 2', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, False), 'downgrade')
check('fixture 3', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, True), {'prod': (1, 'a')})
check('fixture 4', solve({'prod': (1, 'a')}, 'prod', 1, 'a', False, False), 'unchanged')
check('fixture 5', solve({'prod': (1, 'a')}, 'prod', 2, 'b', False, False), 'untested')
check('fixture 6', solve({'prod': (1, 'a'), 'stage': (2, 'b')}, 'prod', 2, 'b', True, False), {'prod': (2, 'b'), 'stage': (2, 'b')})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | unknown | unknown | Passed |
| fixture 2 | downgrade | downgrade | Passed |
| fixture 3 | {'prod': [1, 'a']} | {'prod': [1, 'a']} | Passed |
| fixture 4 | unchanged | unchanged | Passed |
| fixture 5 | {'prod': [2, 'b']} | untested | Failed |
| fixture 6 | {'prod': [2, 'b'], 'stage': [2, 'b']} | {'prod': [2, 'b'], 'stage': [2, 'b']} | Passed |
SHA-256 / 38837464f5552fdf12edf54b1cdc9d0a39982f7e2664c7ec3f6719e1272f03ba
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(environments, target, version, digest, tested, allow_downgrade):
if target not in environments: return 'unknown'
old_version, old_digest = environments[target]
if version < old_version and not allow_downgrade: return 'downgrade'
if digest == old_digest: return 'unchanged'
if tested: return 'untested'
result = dict(environments)
result[target] = (version, digest)
return result
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({}, 'prod', 1, 'a', True, False), 'unknown')
check('fixture 2', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, False), 'downgrade')
check('fixture 3', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, True), {'prod': (1, 'a')})
check('fixture 4', solve({'prod': (1, 'a')}, 'prod', 1, 'a', False, False), 'unchanged')
check('fixture 5', solve({'prod': (1, 'a')}, 'prod', 2, 'b', False, False), 'untested')
check('fixture 6', solve({'prod': (1, 'a'), 'stage': (2, 'b')}, 'prod', 2, 'b', True, False), {'prod': (2, 'b'), 'stage': (2, 'b')})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | unknown | unknown | Passed |
| fixture 2 | downgrade | downgrade | Passed |
| fixture 3 | untested | {'prod': [1, 'a']} | Failed |
| fixture 4 | unchanged | unchanged | Passed |
| fixture 5 | {'prod': [2, 'b']} | untested | Failed |
| fixture 6 | untested | {'prod': [2, 'b'], 'stage': [2, 'b']} | Failed |
SHA-256 / 2169019d3c93bddfb679f5bd89135fa33f3b2e2006103478601879ffaf79828d
3 / The verified repair
Exit 0"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(environments, target, version, digest, tested, allow_downgrade):
if target not in environments: return 'unknown'
old_version, old_digest = environments[target]
if version < old_version and not allow_downgrade: return 'downgrade'
if digest == old_digest: return 'unchanged'
if not tested: return 'untested'
result = dict(environments)
result[target] = (version, digest)
return result
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({}, 'prod', 1, 'a', True, False), 'unknown')
check('fixture 2', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, False), 'downgrade')
check('fixture 3', solve({'prod': (2, 'b')}, 'prod', 1, 'a', True, True), {'prod': (1, 'a')})
check('fixture 4', solve({'prod': (1, 'a')}, 'prod', 1, 'a', False, False), 'unchanged')
check('fixture 5', solve({'prod': (1, 'a')}, 'prod', 2, 'b', False, False), 'untested')
check('fixture 6', solve({'prod': (1, 'a'), 'stage': (2, 'b')}, 'prod', 2, 'b', True, False), {'prod': (2, 'b'), 'stage': (2, 'b')})
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | unknown | unknown | Passed |
| fixture 2 | downgrade | downgrade | Passed |
| fixture 3 | {'prod': [1, 'a']} | {'prod': [1, 'a']} | Passed |
| fixture 4 | unchanged | unchanged | Passed |
| fixture 5 | untested | untested | Passed |
| fixture 6 | {'prod': [2, 'b'], 'stage': [2, 'b']} | {'prod': [2, 'b'], 'stage': [2, 'b']} | Passed |
SHA-256 / da9ffb36334f677e30b5cece004ddbd130b619c2077b96c8e4b30fa9ea92394c
Verification & scope
This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:38:36.984364+00:00.
Case digest / 34606f4d1fbc934b243faa0f1947d1bbcc948848328627647e1cbbf70c350399