FA-9211 / Build systems / Open access
Build status reduction: Required failures report success · case 01
Required failures report success.
ROOT CAUSE
The implementation substitutes if 'failed' in states: return 'passed' for if 'failed' in states: return 'failed', so required failures report success.
VERIFIED REPAIR
A required failed job dominates all later statuses.
Unsuccessful approach: The attempted repair substitutes if 'failed' in states: return 'running'. Fixture 3 still yields 'running' instead of 'failed'.
Case contract
Return failed if any required job fails, cancelled if any required job cancels, waiting if required work is pending, running if required work runs, otherwise passed. Optional jobs never block.
Why this case matters
An offline model of build status reduction, suitable for testing build and release tooling without external services.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(jobs):
states = [state for required, state in jobs if required]
if 'failed' in states: return 'passed'
if 'cancelled' in states: return 'cancelled'
if 'pending' in states: return 'waiting'
if 'running' in states: return 'running'
return 'passed'
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve([]), 'passed')
check('fixture 2', solve([(False, 'failed')]), 'passed')
check('fixture 3', solve([(True, 'failed'), (True, 'running')]), 'failed')
check('fixture 4', solve([(True, 'cancelled')]), 'cancelled')
check('fixture 5', solve([(True, 'pending')]), 'waiting')
check('fixture 6', solve([(True, 'running')]), 'running')
check('fixture 7', solve([(True, 'passed')]), 'passed')
check('fixture 8', solve([(True, 'pending'), (True, 'running')]), 'waiting')
check('fixture 9', solve([(False, 'pending'), (True, 'passed')]), 'passed')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | passed | passed | Passed |
| fixture 2 | passed | passed | Passed |
| fixture 3 | passed | failed | Failed |
| fixture 4 | cancelled | cancelled | Passed |
| fixture 5 | waiting | waiting | Passed |
| fixture 6 | running | running | Passed |
| fixture 7 | passed | passed | Passed |
| fixture 8 | waiting | waiting | Passed |
| fixture 9 | passed | passed | Passed |
SHA-256 / 18f6e5a142acb0ea93ddf354dd5d8dcd8c1287f02bd15c428fbb240a1f872ddd
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(jobs):
states = [state for required, state in jobs if required]
if 'failed' in states: return 'running'
if 'cancelled' in states: return 'cancelled'
if 'pending' in states: return 'waiting'
if 'running' in states: return 'running'
return 'passed'
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve([]), 'passed')
check('fixture 2', solve([(False, 'failed')]), 'passed')
check('fixture 3', solve([(True, 'failed'), (True, 'running')]), 'failed')
check('fixture 4', solve([(True, 'cancelled')]), 'cancelled')
check('fixture 5', solve([(True, 'pending')]), 'waiting')
check('fixture 6', solve([(True, 'running')]), 'running')
check('fixture 7', solve([(True, 'passed')]), 'passed')
check('fixture 8', solve([(True, 'pending'), (True, 'running')]), 'waiting')
check('fixture 9', solve([(False, 'pending'), (True, 'passed')]), 'passed')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | passed | passed | Passed |
| fixture 2 | passed | passed | Passed |
| fixture 3 | running | failed | Failed |
| fixture 4 | cancelled | cancelled | Passed |
| fixture 5 | waiting | waiting | Passed |
| fixture 6 | running | running | Passed |
| fixture 7 | passed | passed | Passed |
| fixture 8 | waiting | waiting | Passed |
| fixture 9 | passed | passed | Passed |
SHA-256 / e610f0f2a2b38da192dfefe94810e60c01ea666118307a80dae2416333631538
3 / The verified repair
Exit 0"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(jobs):
states = [state for required, state in jobs if required]
if 'failed' in states: return 'failed'
if 'cancelled' in states: return 'cancelled'
if 'pending' in states: return 'waiting'
if 'running' in states: return 'running'
return 'passed'
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve([]), 'passed')
check('fixture 2', solve([(False, 'failed')]), 'passed')
check('fixture 3', solve([(True, 'failed'), (True, 'running')]), 'failed')
check('fixture 4', solve([(True, 'cancelled')]), 'cancelled')
check('fixture 5', solve([(True, 'pending')]), 'waiting')
check('fixture 6', solve([(True, 'running')]), 'running')
check('fixture 7', solve([(True, 'passed')]), 'passed')
check('fixture 8', solve([(True, 'pending'), (True, 'running')]), 'waiting')
check('fixture 9', solve([(False, 'pending'), (True, 'passed')]), 'passed')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | passed | passed | Passed |
| fixture 2 | passed | passed | Passed |
| fixture 3 | failed | failed | Passed |
| fixture 4 | cancelled | cancelled | Passed |
| fixture 5 | waiting | waiting | Passed |
| fixture 6 | running | running | Passed |
| fixture 7 | passed | passed | Passed |
| fixture 8 | waiting | waiting | Passed |
| fixture 9 | passed | passed | Passed |
SHA-256 / ebdb6ace53bde76a1b24aa4ce3a9450fc8734382229ce22896a61a15303645cf
Verification & scope
This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:38:28.006400+00:00.
Case digest / 37430422d41e7fbcb94a34b5f0c872d145891acfb4d3c2d5327b4a9086eda5a6