FA-85081 / Fantasy sports scoring / Open access
Exactly six innings denied a quality start · case 01
A 6.0 inning, 3 earned run start earns no quality-start bonus.
ROOT CAUSE
The quality start requires strictly more than 18 outs.
THE FAILURE
The quality start requires strictly more than 18 outs.
Unsuccessful approach: Tightening the earned-run bound instead removes the bonus for 3-run starts.
Case contract
Score a pitching line in hundredths. Innings pitched use baseball notation: "6.2" means six innings and two outs; each out is worth 1 point. Strikeout +1, hit -1, walk -1, earned run -2, win +5, loss -3, save +5, hold +3 (ignored when the line also has a save), blown save -3, quality start (at least 18 outs and at most 3 earned runs) +3. Return outs and points.
Why this case matters
Innings-pitched notation and quality-start edges are recurring baseball fantasy scoring bugs.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(line):
whole, _, part = line['ip'].partition('.')
outs = int(whole) * 3 + int(part or 0)
pts = outs * 100
pts += line['k'] * 100 - line['h'] * 100 - line['bb'] * 100 - line['er'] * 200
if line['w']:
pts += 500
if line['l']:
pts -= 300
if line['sv']:
pts += 500
elif line['hld']:
pts += 300
if line['bs']:
pts -= 300
if outs > 18 and line['er'] <= 3:
pts += 300
return {'outs': outs, 'points': pts}
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('regression: quality start boundary',
[{'bb': 0,
'bs': False,
'er': 0,
'h': 9,
'hld': False,
'ip': '6.0',
'k': 10,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 2200}),
('partial repair probe: quality start boundary',
[{'bb': 2,
'bs': False,
'er': 3,
'h': 6,
'hld': False,
'ip': '8.1',
'k': 10,
'l': False,
'sv': False,
'w': False}],
{'outs': 25, 'points': 2400}),
('second regression',
[{'bb': 3,
'bs': False,
'er': 0,
'h': 4,
'hld': False,
'ip': '6.0',
'k': 8,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 2200}),
('normal control 1',
[{'bb': 2,
'bs': True,
'er': 0,
'h': 2,
'hld': False,
'ip': '7',
'k': 0,
'l': False,
'sv': False,
'w': False}],
{'outs': 21, 'points': 1700}),
('normal control 2',
[{'bb': 3,
'bs': False,
'er': 0,
'h': 3,
'hld': False,
'ip': '6.2',
'k': 5,
'l': False,
'sv': False,
'w': True}],
{'outs': 20, 'points': 2700}),
('normal control 3',
[{'bb': 3,
'bs': False,
'er': 3,
'h': 8,
'hld': True,
'ip': '5.2',
'k': 5,
'l': True,
'sv': False,
'w': False}],
{'outs': 17, 'points': 500}),
('normal control 4',
[{'bb': 3,
'bs': True,
'er': 4,
'h': 1,
'hld': True,
'ip': '2.2',
'k': 7,
'l': False,
'sv': False,
'w': False}],
{'outs': 8, 'points': 300})],
[('regression: quality start boundary',
[{'bb': 4,
'bs': False,
'er': 3,
'h': 7,
'hld': True,
'ip': '6.0',
'k': 1,
'l': False,
'sv': True,
'w': True}],
{'outs': 18, 'points': 1500}),
('partial repair probe: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 5,
'hld': True,
'ip': '8.1',
'k': 8,
'l': False,
'sv': False,
'w': False}],
{'outs': 25, 'points': 2700}),
('second regression',
[{'bb': 0,
'bs': False,
'er': 3,
'h': 8,
'hld': True,
'ip': '7',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 21, 'points': 1800}),
('normal control 1',
[{'bb': 4,
'bs': False,
'er': 5,
'h': 3,
'hld': False,
'ip': '6.2',
'k': 6,
'l': False,
'sv': False,
'w': False}],
{'outs': 20, 'points': 900}),
('normal control 2',
[{'bb': 2,
'bs': False,
'er': 3,
'h': 7,
'hld': False,
'ip': '2.2',
'k': 3,
'l': False,
'sv': True,
'w': False}],
{'outs': 8, 'points': 100}),
('normal control 3',
[{'bb': 2,
'bs': False,
'er': 0,
'h': 4,
'hld': False,
'ip': '6.2',
'k': 0,
'l': True,
'sv': False,
'w': True}],
{'outs': 20, 'points': 1900}),
('normal control 4',
[{'bb': 4,
'bs': False,
'er': 5,
'h': 0,
'hld': False,
'ip': '6.0',
'k': 11,
'l': False,
'sv': True,
'w': False}],
{'outs': 18, 'points': 2000})],
[('regression: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 4,
'hld': False,
'ip': '6.0',
'k': 7,
'l': False,
'sv': False,
'w': True}],
{'outs': 18, 'points': 2200}),
('partial repair probe: quality start boundary',
[{'bb': 0,
'bs': False,
'er': 3,
'h': 1,
'hld': False,
'ip': '6.0',
'k': 4,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 1800}),
('second regression',
[{'bb': 3,
'bs': True,
'er': 3,
'h': 8,
'hld': True,
'ip': '7',
'k': 9,
'l': False,
'sv': True,
'w': False}],
{'outs': 21, 'points': 1800}),
('normal control 1',
[{'bb': 3,
'bs': False,
'er': 5,
'h': 3,
'hld': True,
'ip': '1.0',
'k': 2,
'l': True,
'sv': False,
'w': False}],
{'outs': 3, 'points': -1100}),
('normal control 2',
[{'bb': 0,
'bs': False,
'er': 0,
'h': 5,
'hld': False,
'ip': '6.1',
'k': 11,
'l': False,
'sv': False,
'w': False}],
{'outs': 19, 'points': 2800}),
('normal control 3',
[{'bb': 4,
'bs': False,
'er': 4,
'h': 4,
'hld': False,
'ip': '6.2',
'k': 9,
'l': False,
'sv': False,
'w': True}],
{'outs': 20, 'points': 1800}),
('normal control 4',
[{'bb': 4,
'bs': False,
'er': 5,
'h': 4,
'hld': True,
'ip': '1.0',
'k': 2,
'l': False,
'sv': False,
'w': False}],
{'outs': 3, 'points': -1000})],
[('regression: quality start boundary',
[{'bb': 0,
'bs': False,
'er': 3,
'h': 4,
'hld': False,
'ip': '6.0',
'k': 8,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 1900}),
('partial repair probe: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 5,
'hld': True,
'ip': '8.1',
'k': 3,
'l': False,
'sv': False,
'w': False}],
{'outs': 25, 'points': 2200}),
('second regression',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 0,
'hld': False,
'ip': '7',
'k': 9,
'l': False,
'sv': False,
'w': False}],
{'outs': 21, 'points': 2600}),
('normal control 1',
[{'bb': 2,
'bs': False,
'er': 0,
'h': 4,
'hld': False,
'ip': '5.0',
'k': 9,
'l': False,
'sv': False,
'w': False}],
{'outs': 15, 'points': 1800}),
('normal control 2',
[{'bb': 1,
'bs': True,
'er': 0,
'h': 2,
'hld': False,
'ip': '7',
'k': 1,
'l': False,
'sv': False,
'w': False}],
{'outs': 21, 'points': 1900}),
('normal control 3',
[{'bb': 1,
'bs': False,
'er': 4,
'h': 0,
'hld': True,
'ip': '6.2',
'k': 8,
'l': False,
'sv': True,
'w': False}],
{'outs': 20, 'points': 2400}),
('normal control 4',
[{'bb': 0,
'bs': True,
'er': 0,
'h': 4,
'hld': False,
'ip': '6.2',
'k': 10,
'l': False,
'sv': False,
'w': True}],
{'outs': 20, 'points': 3100})],
[('regression: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 7,
'hld': True,
'ip': '6.0',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 18, 'points': 1500}),
('partial repair probe: quality start boundary',
[{'bb': 3,
'bs': False,
'er': 3,
'h': 7,
'hld': False,
'ip': '6.1',
'k': 5,
'l': False,
'sv': True,
'w': True}],
{'outs': 19, 'points': 2100}),
('second regression',
[{'bb': 3,
'bs': True,
'er': 3,
'h': 7,
'hld': True,
'ip': '7',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 21, 'points': 1300}),
('normal control 1',
[{'bb': 3,
'bs': False,
'er': 0,
'h': 2,
'hld': False,
'ip': '1.0',
'k': 11,
'l': False,
'sv': False,
'w': False}],
{'outs': 3, 'points': 900}),
('normal control 2',
[{'bb': 4,
'bs': False,
'er': 0,
'h': 3,
'hld': False,
'ip': '1.0',
'k': 11,
'l': False,
'sv': False,
'w': True}],
{'outs': 3, 'points': 1200}),
('normal control 3',
[{'bb': 2,
'bs': False,
'er': 0,
'h': 6,
'hld': True,
'ip': '6.1',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 19, 'points': 2200}),
('normal control 4',
[{'bb': 2,
'bs': False,
'er': 3,
'h': 2,
'hld': False,
'ip': '5.2',
'k': 2,
'l': False,
'sv': False,
'w': True}],
{'outs': 17, 'points': 1400})]]
for label, args, expected in fixtures[N-1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| regression: quality start boundary | {'outs': 18, 'points': 1900} | {'outs': 18, 'points': 2200} | Failed |
| partial repair probe: quality start boundary | {'outs': 25, 'points': 2400} | {'outs': 25, 'points': 2400} | Passed |
| second regression | {'outs': 18, 'points': 1900} | {'outs': 18, 'points': 2200} | Failed |
| normal control 1 | {'outs': 21, 'points': 1700} | {'outs': 21, 'points': 1700} | Passed |
| normal control 2 | {'outs': 20, 'points': 2700} | {'outs': 20, 'points': 2700} | Passed |
| normal control 3 | {'outs': 17, 'points': 500} | {'outs': 17, 'points': 500} | Passed |
| normal control 4 | {'outs': 8, 'points': 300} | {'outs': 8, 'points': 300} | Passed |
SHA-256 / 866be7f0cd1edceee388c5e9ab57f7df6b6fe002e953e37fce6881e0de6bf68d
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(line):
whole, _, part = line['ip'].partition('.')
outs = int(whole) * 3 + int(part or 0)
pts = outs * 100
pts += line['k'] * 100 - line['h'] * 100 - line['bb'] * 100 - line['er'] * 200
if line['w']:
pts += 500
if line['l']:
pts -= 300
if line['sv']:
pts += 500
elif line['hld']:
pts += 300
if line['bs']:
pts -= 300
if outs >= 18 and line['er'] < 3:
pts += 300
return {'outs': outs, 'points': pts}
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [[('regression: quality start boundary',
[{'bb': 0,
'bs': False,
'er': 0,
'h': 9,
'hld': False,
'ip': '6.0',
'k': 10,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 2200}),
('partial repair probe: quality start boundary',
[{'bb': 2,
'bs': False,
'er': 3,
'h': 6,
'hld': False,
'ip': '8.1',
'k': 10,
'l': False,
'sv': False,
'w': False}],
{'outs': 25, 'points': 2400}),
('second regression',
[{'bb': 3,
'bs': False,
'er': 0,
'h': 4,
'hld': False,
'ip': '6.0',
'k': 8,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 2200}),
('normal control 1',
[{'bb': 2,
'bs': True,
'er': 0,
'h': 2,
'hld': False,
'ip': '7',
'k': 0,
'l': False,
'sv': False,
'w': False}],
{'outs': 21, 'points': 1700}),
('normal control 2',
[{'bb': 3,
'bs': False,
'er': 0,
'h': 3,
'hld': False,
'ip': '6.2',
'k': 5,
'l': False,
'sv': False,
'w': True}],
{'outs': 20, 'points': 2700}),
('normal control 3',
[{'bb': 3,
'bs': False,
'er': 3,
'h': 8,
'hld': True,
'ip': '5.2',
'k': 5,
'l': True,
'sv': False,
'w': False}],
{'outs': 17, 'points': 500}),
('normal control 4',
[{'bb': 3,
'bs': True,
'er': 4,
'h': 1,
'hld': True,
'ip': '2.2',
'k': 7,
'l': False,
'sv': False,
'w': False}],
{'outs': 8, 'points': 300})],
[('regression: quality start boundary',
[{'bb': 4,
'bs': False,
'er': 3,
'h': 7,
'hld': True,
'ip': '6.0',
'k': 1,
'l': False,
'sv': True,
'w': True}],
{'outs': 18, 'points': 1500}),
('partial repair probe: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 5,
'hld': True,
'ip': '8.1',
'k': 8,
'l': False,
'sv': False,
'w': False}],
{'outs': 25, 'points': 2700}),
('second regression',
[{'bb': 0,
'bs': False,
'er': 3,
'h': 8,
'hld': True,
'ip': '7',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 21, 'points': 1800}),
('normal control 1',
[{'bb': 4,
'bs': False,
'er': 5,
'h': 3,
'hld': False,
'ip': '6.2',
'k': 6,
'l': False,
'sv': False,
'w': False}],
{'outs': 20, 'points': 900}),
('normal control 2',
[{'bb': 2,
'bs': False,
'er': 3,
'h': 7,
'hld': False,
'ip': '2.2',
'k': 3,
'l': False,
'sv': True,
'w': False}],
{'outs': 8, 'points': 100}),
('normal control 3',
[{'bb': 2,
'bs': False,
'er': 0,
'h': 4,
'hld': False,
'ip': '6.2',
'k': 0,
'l': True,
'sv': False,
'w': True}],
{'outs': 20, 'points': 1900}),
('normal control 4',
[{'bb': 4,
'bs': False,
'er': 5,
'h': 0,
'hld': False,
'ip': '6.0',
'k': 11,
'l': False,
'sv': True,
'w': False}],
{'outs': 18, 'points': 2000})],
[('regression: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 4,
'hld': False,
'ip': '6.0',
'k': 7,
'l': False,
'sv': False,
'w': True}],
{'outs': 18, 'points': 2200}),
('partial repair probe: quality start boundary',
[{'bb': 0,
'bs': False,
'er': 3,
'h': 1,
'hld': False,
'ip': '6.0',
'k': 4,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 1800}),
('second regression',
[{'bb': 3,
'bs': True,
'er': 3,
'h': 8,
'hld': True,
'ip': '7',
'k': 9,
'l': False,
'sv': True,
'w': False}],
{'outs': 21, 'points': 1800}),
('normal control 1',
[{'bb': 3,
'bs': False,
'er': 5,
'h': 3,
'hld': True,
'ip': '1.0',
'k': 2,
'l': True,
'sv': False,
'w': False}],
{'outs': 3, 'points': -1100}),
('normal control 2',
[{'bb': 0,
'bs': False,
'er': 0,
'h': 5,
'hld': False,
'ip': '6.1',
'k': 11,
'l': False,
'sv': False,
'w': False}],
{'outs': 19, 'points': 2800}),
('normal control 3',
[{'bb': 4,
'bs': False,
'er': 4,
'h': 4,
'hld': False,
'ip': '6.2',
'k': 9,
'l': False,
'sv': False,
'w': True}],
{'outs': 20, 'points': 1800}),
('normal control 4',
[{'bb': 4,
'bs': False,
'er': 5,
'h': 4,
'hld': True,
'ip': '1.0',
'k': 2,
'l': False,
'sv': False,
'w': False}],
{'outs': 3, 'points': -1000})],
[('regression: quality start boundary',
[{'bb': 0,
'bs': False,
'er': 3,
'h': 4,
'hld': False,
'ip': '6.0',
'k': 8,
'l': False,
'sv': False,
'w': False}],
{'outs': 18, 'points': 1900}),
('partial repair probe: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 5,
'hld': True,
'ip': '8.1',
'k': 3,
'l': False,
'sv': False,
'w': False}],
{'outs': 25, 'points': 2200}),
('second regression',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 0,
'hld': False,
'ip': '7',
'k': 9,
'l': False,
'sv': False,
'w': False}],
{'outs': 21, 'points': 2600}),
('normal control 1',
[{'bb': 2,
'bs': False,
'er': 0,
'h': 4,
'hld': False,
'ip': '5.0',
'k': 9,
'l': False,
'sv': False,
'w': False}],
{'outs': 15, 'points': 1800}),
('normal control 2',
[{'bb': 1,
'bs': True,
'er': 0,
'h': 2,
'hld': False,
'ip': '7',
'k': 1,
'l': False,
'sv': False,
'w': False}],
{'outs': 21, 'points': 1900}),
('normal control 3',
[{'bb': 1,
'bs': False,
'er': 4,
'h': 0,
'hld': True,
'ip': '6.2',
'k': 8,
'l': False,
'sv': True,
'w': False}],
{'outs': 20, 'points': 2400}),
('normal control 4',
[{'bb': 0,
'bs': True,
'er': 0,
'h': 4,
'hld': False,
'ip': '6.2',
'k': 10,
'l': False,
'sv': False,
'w': True}],
{'outs': 20, 'points': 3100})],
[('regression: quality start boundary',
[{'bb': 1,
'bs': False,
'er': 3,
'h': 7,
'hld': True,
'ip': '6.0',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 18, 'points': 1500}),
('partial repair probe: quality start boundary',
[{'bb': 3,
'bs': False,
'er': 3,
'h': 7,
'hld': False,
'ip': '6.1',
'k': 5,
'l': False,
'sv': True,
'w': True}],
{'outs': 19, 'points': 2100}),
('second regression',
[{'bb': 3,
'bs': True,
'er': 3,
'h': 7,
'hld': True,
'ip': '7',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 21, 'points': 1300}),
('normal control 1',
[{'bb': 3,
'bs': False,
'er': 0,
'h': 2,
'hld': False,
'ip': '1.0',
'k': 11,
'l': False,
'sv': False,
'w': False}],
{'outs': 3, 'points': 900}),
('normal control 2',
[{'bb': 4,
'bs': False,
'er': 0,
'h': 3,
'hld': False,
'ip': '1.0',
'k': 11,
'l': False,
'sv': False,
'w': True}],
{'outs': 3, 'points': 1200}),
('normal control 3',
[{'bb': 2,
'bs': False,
'er': 0,
'h': 6,
'hld': True,
'ip': '6.1',
'k': 0,
'l': False,
'sv': False,
'w': True}],
{'outs': 19, 'points': 2200}),
('normal control 4',
[{'bb': 2,
'bs': False,
'er': 3,
'h': 2,
'hld': False,
'ip': '5.2',
'k': 2,
'l': False,
'sv': False,
'w': True}],
{'outs': 17, 'points': 1400})]]
for label, args, expected in fixtures[N-1]:
check(label, solve(*args), expected)
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| regression: quality start boundary | {'outs': 18, 'points': 2200} | {'outs': 18, 'points': 2200} | Passed |
| partial repair probe: quality start boundary | {'outs': 25, 'points': 2100} | {'outs': 25, 'points': 2400} | Failed |
| second regression | {'outs': 18, 'points': 2200} | {'outs': 18, 'points': 2200} | Passed |
| normal control 1 | {'outs': 21, 'points': 1700} | {'outs': 21, 'points': 1700} | Passed |
| normal control 2 | {'outs': 20, 'points': 2700} | {'outs': 20, 'points': 2700} | Passed |
| normal control 3 | {'outs': 17, 'points': 500} | {'outs': 17, 'points': 500} | Passed |
| normal control 4 | {'outs': 8, 'points': 300} | {'outs': 8, 'points': 300} | Passed |
SHA-256 / 349df48a0214b672e0478768138fe90b70cb27eb5c56bb6efa912d779678f276
HELD IN THE MEMBER ARCHIVE
The verified repair and its recorded checks are member-only.
This mechanism has 7 recorded checks per implementation. The open-access tier publishes the failure and the unsuccessful fix; the repaired source that passes every check, and the observations that prove it, are available to members.
Every case sharing this mechanism uses the same contract and the same repair, so this one record is held back for all of them.
Member access is invitation-based. Sign in with your invited account to inspect the repair.
Sign in to the archive ↗Verification & scope
A deterministic toy scoring contract stipulated for this example; it is not the rulebook of any real fantasy platform. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:50:37.182683+00:00.
Case digest / 75e61162fa170eef5a6e12cae12f5854bca244b11e117a2ba7a6c91a7b27addf