FA-10086 / Deployment models / Open access

Deployment promotion gate: One passing check masks failing required checks · case 01

One passing check masks failing required checks.

Verified by executionVariant 1 · 9 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

The implementation substitutes any(state['checks']) for all(state['checks']), so one passing check masks failing required checks.

VERIFIED REPAIR

Require every listed check to pass; an empty required set passes.

Unsuccessful approach: The attempted repair substitutes True. Fixture 3 still yields True instead of False.

Case contract

Promote only if desired revision matches tested revision, all required checks pass, minimum healthy replicas is reached, approval is present when required, and no freeze is active.

Why this case matters

An offline model of deployment promotion gate, suitable for testing build and release tooling without external services.

1 / The failure

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(state):
    return state['revision'] == state['tested'] and any(state['checks']) and state['healthy'] >= state['minimum'] and (not state['approval_required'] or state['approved']) and not state['frozen']
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 2', solve({'revision': 'r2', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 3', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True, False], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 4', solve({'revision': 'r1', 'tested': 'r1', 'checks': [], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 5', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 1, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 6', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 3, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 7', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': True, 'approved': False, 'frozen': False}), False)
check('fixture 8', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': True, 'approved': True, 'frozen': False}), True)
check('fixture 9', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': True}), False)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
fixture 1	`True`	`True`	Passed
fixture 2	`False`	`False`	Passed
fixture 3	`True`	`False`	Failed
fixture 4	`False`	`True`	Failed
fixture 5	`False`	`False`	Passed
fixture 6	`True`	`True`	Passed
fixture 7	`False`	`False`	Passed
fixture 8	`True`	`True`	Passed
fixture 9	`False`	`False`	Passed

SHA-256 / 2d8e0531a96a09e74acde6f2519f4bded4da67b7ce6240a651600559952760eb

2 / The unsuccessful fix

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(state):
    return state['revision'] == state['tested'] and True and state['healthy'] >= state['minimum'] and (not state['approval_required'] or state['approved']) and not state['frozen']
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 2', solve({'revision': 'r2', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 3', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True, False], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 4', solve({'revision': 'r1', 'tested': 'r1', 'checks': [], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 5', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 1, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 6', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 3, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 7', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': True, 'approved': False, 'frozen': False}), False)
check('fixture 8', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': True, 'approved': True, 'frozen': False}), True)
check('fixture 9', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': True}), False)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
fixture 1	`True`	`True`	Passed
fixture 2	`False`	`False`	Passed
fixture 3	`True`	`False`	Failed
fixture 4	`True`	`True`	Passed
fixture 5	`False`	`False`	Passed
fixture 6	`True`	`True`	Passed
fixture 7	`False`	`False`	Passed
fixture 8	`True`	`True`	Passed
fixture 9	`False`	`False`	Passed

SHA-256 / 143cd33f2e0d960b285dc03ae5d77c90908f350af446c1deb56c05da25f31067

3 / The verified repair

Exit 0

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(state):
    return state['revision'] == state['tested'] and all(state['checks']) and state['healthy'] >= state['minimum'] and (not state['approval_required'] or state['approved']) and not state['frozen']
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 2', solve({'revision': 'r2', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 3', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True, False], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 4', solve({'revision': 'r1', 'tested': 'r1', 'checks': [], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 5', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 1, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), False)
check('fixture 6', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 3, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': False}), True)
check('fixture 7', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': True, 'approved': False, 'frozen': False}), False)
check('fixture 8', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': True, 'approved': True, 'frozen': False}), True)
check('fixture 9', solve({'revision': 'r1', 'tested': 'r1', 'checks': [True], 'healthy': 2, 'minimum': 2, 'approval_required': False, 'approved': False, 'frozen': True}), False)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
fixture 1	`True`	`True`	Passed
fixture 2	`False`	`False`	Passed
fixture 3	`False`	`False`	Passed
fixture 4	`True`	`True`	Passed
fixture 5	`False`	`False`	Passed
fixture 6	`True`	`True`	Passed
fixture 7	`False`	`False`	Passed
fixture 8	`True`	`True`	Passed
fixture 9	`False`	`False`	Passed

SHA-256 / 3664f0d1adc68aa507cf1b921a46a9ecbb8c2b8b471495d0defcd72b1f7e6d41

Verification & scope

This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:38:35.746600+00:00.

Case digest / 0e09f46cfaa80d70269d7787a0e63ed3f19bcda779f10b9a04bd9ad96529392d