FA-9206 / Build systems / Open access
Build status reduction: Optional job failures block the build · case 01
Optional job failures block the build.
ROOT CAUSE
The implementation substitutes if True for if required, so optional job failures block the build.
VERIFIED REPAIR
Reduce required jobs only.
Unsuccessful approach: The attempted repair substitutes if not required. Fixture 2 still yields 'failed' instead of 'passed'.
Case contract
Return failed if any required job fails, cancelled if any required job cancels, waiting if required work is pending, running if required work runs, otherwise passed. Optional jobs never block.
Why this case matters
An offline model of build status reduction, suitable for testing build and release tooling without external services.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(jobs):
states = [state for required, state in jobs if True]
if 'failed' in states: return 'failed'
if 'cancelled' in states: return 'cancelled'
if 'pending' in states: return 'waiting'
if 'running' in states: return 'running'
return 'passed'
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve([]), 'passed')
check('fixture 2', solve([(False, 'failed')]), 'passed')
check('fixture 3', solve([(True, 'failed'), (True, 'running')]), 'failed')
check('fixture 4', solve([(True, 'cancelled')]), 'cancelled')
check('fixture 5', solve([(True, 'pending')]), 'waiting')
check('fixture 6', solve([(True, 'running')]), 'running')
check('fixture 7', solve([(True, 'passed')]), 'passed')
check('fixture 8', solve([(True, 'pending'), (True, 'running')]), 'waiting')
check('fixture 9', solve([(False, 'pending'), (True, 'passed')]), 'passed')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | passed | passed | Passed |
| fixture 2 | failed | passed | Failed |
| fixture 3 | failed | failed | Passed |
| fixture 4 | cancelled | cancelled | Passed |
| fixture 5 | waiting | waiting | Passed |
| fixture 6 | running | running | Passed |
| fixture 7 | passed | passed | Passed |
| fixture 8 | waiting | waiting | Passed |
| fixture 9 | waiting | passed | Failed |
SHA-256 / a20fcb7d43ab3a788acbc561946d9f48e7b6c394878261005e77806df623b8ff
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(jobs):
states = [state for required, state in jobs if not required]
if 'failed' in states: return 'failed'
if 'cancelled' in states: return 'cancelled'
if 'pending' in states: return 'waiting'
if 'running' in states: return 'running'
return 'passed'
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve([]), 'passed')
check('fixture 2', solve([(False, 'failed')]), 'passed')
check('fixture 3', solve([(True, 'failed'), (True, 'running')]), 'failed')
check('fixture 4', solve([(True, 'cancelled')]), 'cancelled')
check('fixture 5', solve([(True, 'pending')]), 'waiting')
check('fixture 6', solve([(True, 'running')]), 'running')
check('fixture 7', solve([(True, 'passed')]), 'passed')
check('fixture 8', solve([(True, 'pending'), (True, 'running')]), 'waiting')
check('fixture 9', solve([(False, 'pending'), (True, 'passed')]), 'passed')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | passed | passed | Passed |
| fixture 2 | failed | passed | Failed |
| fixture 3 | passed | failed | Failed |
| fixture 4 | passed | cancelled | Failed |
| fixture 5 | passed | waiting | Failed |
| fixture 6 | passed | running | Failed |
| fixture 7 | passed | passed | Passed |
| fixture 8 | passed | waiting | Failed |
| fixture 9 | waiting | passed | Failed |
SHA-256 / cb26298840361a9658272c484e12dc20b90aec83c7302d60afaec9ebb876d76b
3 / The verified repair
Exit 0"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(jobs):
states = [state for required, state in jobs if required]
if 'failed' in states: return 'failed'
if 'cancelled' in states: return 'cancelled'
if 'pending' in states: return 'waiting'
if 'running' in states: return 'running'
return 'passed'
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('fixture 1', solve([]), 'passed')
check('fixture 2', solve([(False, 'failed')]), 'passed')
check('fixture 3', solve([(True, 'failed'), (True, 'running')]), 'failed')
check('fixture 4', solve([(True, 'cancelled')]), 'cancelled')
check('fixture 5', solve([(True, 'pending')]), 'waiting')
check('fixture 6', solve([(True, 'running')]), 'running')
check('fixture 7', solve([(True, 'passed')]), 'passed')
check('fixture 8', solve([(True, 'pending'), (True, 'running')]), 'waiting')
check('fixture 9', solve([(False, 'pending'), (True, 'passed')]), 'passed')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| fixture 1 | passed | passed | Passed |
| fixture 2 | passed | passed | Passed |
| fixture 3 | failed | failed | Passed |
| fixture 4 | cancelled | cancelled | Passed |
| fixture 5 | waiting | waiting | Passed |
| fixture 6 | running | running | Passed |
| fixture 7 | passed | passed | Passed |
| fixture 8 | waiting | waiting | Passed |
| fixture 9 | passed | passed | Passed |
SHA-256 / ebdb6ace53bde76a1b24aa4ce3a9450fc8734382229ce22896a61a15303645cf
Verification & scope
This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:38:28.005059+00:00.
Case digest / a85457676357cc38aee101f951d45d7d914d2d0ee0032baa4cbe5c1f88b1a7f4