FA-57391 / Auction allocation rules / Open access
Qualification stages: submitted is not approved · case 01
Uploaded qualification evidence is treated as reviewed approval.
ROOT CAUSE
Uploaded qualification evidence is treated as reviewed approval.
VERIFIED REPAIR
For submitted is not approved, apply the stipulated decision set(x["required"])<=set(x["approved"]).
Unsuccessful approach: The attempted repair uses bool(x["approved"]); the explicit regression cases demonstrate that this still violates the stipulated auction rule.
Case contract
A staged toy auction prequalification uses submitted evidence, reviewer decisions, category-specific certification and bounded award volume. A qualification suspension freezes new offers but preserves previously earned appeal rights. Evidence identifiers distinguish revisions. Named decision submitted-is-not-approved: For submitted is not approved, apply the stipulated decision set(x["required"])<=set(x["approved"]).
Why this case matters
Offline administrative auction model for software failure analysis.
1 / The failure
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(x):
v0 = set(x["required"])<=set(x["submitted"])
v1 = not set(x["required"])&set(x["rejected"])
v2 = x["requested_category"] in x["certified"]
v3 = min(x["volume"],x["qualified_volume"])
v4 = x["now"]<x["expires"]
v5 = not x["suspended"] and x["now"]<x["expires"]
v6 = x["appeal"]
v7 = all(s in x["completed"] for s in x["sequence"][:x["sequence"].index(x["stage"])])
v8 = x["evidence_revision"]==x["reviewed_revision"]
v9 = not x["conditional"] or x["conditions_met"]
return {'submitted-is-not-approved':v0,'rejected-required-evidence':v1,'certified-award-category':v2,'qualified-volume':v3,'qualification-validity':v4,'suspension-bid-gate':v5,'appeal-during-suspension':v6,'preceding-stage-certification':v7,'reviewed-evidence-revision':v8,'conditional-admission':v9}
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [('all evidence', {'required': ['identity', 'capacity'], 'submitted': ['identity', 'capacity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('all approved', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity', 'capacity'], 'rejected': [], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [True, True, True, True, True]), ('normal contract', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('unrelated rejection', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['optional'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('missing prior stage', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'admission', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('red category', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'red', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('small award', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 3, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('qualification expired', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 9, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('suspended bidder', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': True, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False])]
def vary(value):
if type(value) is int: return value*N
if isinstance(value,list): return [vary(v) for v in value]
if isinstance(value,dict): return {k:(v if k in ['count', 'delivery_index', 'disputed', 'maximum_set', 'minimum_set', 'stage', 'threshold', 'waived'] else vary(v)) for k,v in value.items()}
return value
for label, request, expected in fixtures:
check(label, solve(vary(request))['submitted-is-not-approved'], expected[N-1])
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| all evidence | True | False | Failed |
| all approved | False | True | Failed |
| normal contract | False | False | Passed |
| unrelated rejection | False | False | Passed |
| missing prior stage | False | False | Passed |
| red category | False | False | Passed |
| small award | False | False | Passed |
| qualification expired | False | False | Passed |
| suspended bidder | False | False | Passed |
SHA-256 / 246e7e3513a3149554f87611efbc06eb8c0656284c307ed548edb89bcb174936
2 / The unsuccessful fix
Exit 1"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(x):
v0 = bool(x["approved"])
v1 = not set(x["required"])&set(x["rejected"])
v2 = x["requested_category"] in x["certified"]
v3 = min(x["volume"],x["qualified_volume"])
v4 = x["now"]<x["expires"]
v5 = not x["suspended"] and x["now"]<x["expires"]
v6 = x["appeal"]
v7 = all(s in x["completed"] for s in x["sequence"][:x["sequence"].index(x["stage"])])
v8 = x["evidence_revision"]==x["reviewed_revision"]
v9 = not x["conditional"] or x["conditions_met"]
return {'submitted-is-not-approved':v0,'rejected-required-evidence':v1,'certified-award-category':v2,'qualified-volume':v3,'qualification-validity':v4,'suspension-bid-gate':v5,'appeal-during-suspension':v6,'preceding-stage-certification':v7,'reviewed-evidence-revision':v8,'conditional-admission':v9}
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [('all evidence', {'required': ['identity', 'capacity'], 'submitted': ['identity', 'capacity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('all approved', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity', 'capacity'], 'rejected': [], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [True, True, True, True, True]), ('normal contract', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('unrelated rejection', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['optional'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('missing prior stage', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'admission', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('red category', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'red', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('small award', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 3, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('qualification expired', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 9, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('suspended bidder', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': True, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False])]
def vary(value):
if type(value) is int: return value*N
if isinstance(value,list): return [vary(v) for v in value]
if isinstance(value,dict): return {k:(v if k in ['count', 'delivery_index', 'disputed', 'maximum_set', 'minimum_set', 'stage', 'threshold', 'waived'] else vary(v)) for k,v in value.items()}
return value
for label, request, expected in fixtures:
check(label, solve(vary(request))['submitted-is-not-approved'], expected[N-1])
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| all evidence | True | False | Failed |
| all approved | True | True | Passed |
| normal contract | True | False | Failed |
| unrelated rejection | True | False | Failed |
| missing prior stage | True | False | Failed |
| red category | True | False | Failed |
| small award | True | False | Failed |
| qualification expired | True | False | Failed |
| suspended bidder | True | False | Failed |
SHA-256 / a73c5207679c623365f346bb53e1e37a22fdcfebfcfa1111953f3a3d942e1f73
3 / The verified repair
Exit 0"""Failure Map reference implementation. Python standard library only."""
import json
N = 1
observations = []
def solve(x):
v0 = set(x["required"])<=set(x["approved"])
v1 = not set(x["required"])&set(x["rejected"])
v2 = x["requested_category"] in x["certified"]
v3 = min(x["volume"],x["qualified_volume"])
v4 = x["now"]<x["expires"]
v5 = not x["suspended"] and x["now"]<x["expires"]
v6 = x["appeal"]
v7 = all(s in x["completed"] for s in x["sequence"][:x["sequence"].index(x["stage"])])
v8 = x["evidence_revision"]==x["reviewed_revision"]
v9 = not x["conditional"] or x["conditions_met"]
return {'submitted-is-not-approved':v0,'rejected-required-evidence':v1,'certified-award-category':v2,'qualified-volume':v3,'qualification-validity':v4,'suspension-bid-gate':v5,'appeal-during-suspension':v6,'preceding-stage-certification':v7,'reviewed-evidence-revision':v8,'conditional-admission':v9}
def check(label, actual, expected):
observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
fixtures = [('all evidence', {'required': ['identity', 'capacity'], 'submitted': ['identity', 'capacity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('all approved', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity', 'capacity'], 'rejected': [], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [True, True, True, True, True]), ('normal contract', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('unrelated rejection', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['optional'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('missing prior stage', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'admission', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('red category', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'red', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('small award', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 3, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('qualification expired', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 9, 'suspended': False, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False]), ('suspended bidder', {'required': ['identity', 'capacity'], 'submitted': ['identity'], 'approved': ['identity'], 'rejected': ['capacity'], 'categories': ['red', 'blue'], 'certified': ['red'], 'requested_category': 'blue', 'volume': 8, 'qualified_volume': 5, 'expires': 9, 'now': 7, 'suspended': True, 'appeal': True, 'stage': 'review', 'completed': ['application'], 'sequence': ['application', 'review', 'admission'], 'evidence_revision': 2, 'reviewed_revision': 1, 'conditional': True, 'conditions_met': False}, [False, False, False, False, False])]
def vary(value):
if type(value) is int: return value*N
if isinstance(value,list): return [vary(v) for v in value]
if isinstance(value,dict): return {k:(v if k in ['count', 'delivery_index', 'disputed', 'maximum_set', 'minimum_set', 'stage', 'threshold', 'waived'] else vary(v)) for k,v in value.items()}
return value
for label, request, expected in fixtures:
check(label, solve(vary(request))['submitted-is-not-approved'], expected[N-1])
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| all evidence | False | False | Passed |
| all approved | True | True | Passed |
| normal contract | False | False | Passed |
| unrelated rejection | False | False | Passed |
| missing prior stage | False | False | Passed |
| red category | False | False | Passed |
| small award | False | False | Passed |
| qualification expired | False | False | Passed |
| suspended bidder | False | False | Passed |
SHA-256 / 4989cb78e003e946152a33b3d9ce985df3a959ac1923e21e6f5350d69dee2efd
Verification & scope
Stipulated toy auction rules, not a venue specification, financial advice, optimization claim, or live trading implementation. Nonnegative integer inputs and internally aligned list fields only. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.
Observations recorded using Python 3.12.14 at 2026-09-29T14:46:16.365156+00:00.
Case digest / bf2f95a56b033ec2da45d314e10a836ab6d2a3461cae66fc2d26ba17246f32ae