{"abstract":"An objection proceeds with only part of its required evidence.","category":"Auction allocation rules","checks":11,"contract":"A provisional award challenge has bidder standing, grounds, evidence receipt, hearing outcomes and a limited remedy. Filing preserves the award but blocks finality until all admissible objections are resolved. Dates are ticks and list entries retain filing order. Named decision evidence-completeness: For evidence completeness, apply the stipulated decision set(x[\"evidence\"])<=set(x[\"received\"]).","contract_signature":"x","evaluation_group":"s3-auction-award-objection","failed_approach":"The attempted repair uses x[\"evidence\"]==x[\"received\"]; the explicit regression cases demonstrate that this still violates the stipulated auction rule.","family":"s3-auction-allocation-rules-award-objection-evidence-completeness","id":"FA-56956","implementations":{"attempt":{"sha256":"aaa295ed0d227883d697aeef5b6d356d04606346dbbeddb78c37fcec29e035bb","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    v0 = x[\"challenger\"] in x[\"participants\"] and x[\"challenger\"]!=x[\"winner\"]\n    v1 = [g for g in x[\"grounds\"] if g in x[\"permitted\"]]\n    v2 = x[\"filed\"]<=x[\"deadline\"]\n    v3 = x[\"evidence\"]==x[\"received\"]\n    v4 = not (set(x[\"objections\"])-set(x[\"resolved\"])-set(x[\"withdrawn\"]))\n    v5 = [i for i in x[\"awarded\"] if i not in x[\"affected\"]] if x[\"upheld\"] else x[\"awarded\"]\n    v6 = [o for o in x[\"objections\"] if o not in x[\"withdrawn\"]]\n    v7 = 0 if x[\"frivolous\"] else x[\"deposit\"]\n    v8 = sorted(set(x[\"participants\"])-set(x[\"notified\"]))\n    v9 = [o for o in x[\"upheld\"] if o in x[\"objections\"] and o not in x[\"withdrawn\"]]\n    return {'challenger-standing':v0,'admissible-grounds':v1,'filing-deadline':v2,'evidence-completeness':v3,'open-objection-finality':v4,'remedy-lot-scope':v5,'withdrawn-hearing-removal':v6,'objection-deposit-disposition':v7,'hearing-notice-parties':v8,'upheld-live-objections':v9}\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [('normal contract', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('ground order', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['procedure', 'eligibility'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('out of order evidence', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e2', 'e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [True, True, True, True, True]), ('ground order / out of order evidence', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['procedure', 'eligibility'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e2', 'e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [True, True, True, True, True]), ('nonparticipant', {'challenger': 'c', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('winner challenges own award', {'challenger': 'a', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('deadline filing', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 6, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('late filing', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 7, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('all evidence received', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1', 'e2'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [True, True, True, True, True]), ('all objections resolved', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1', 'o2'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('none upheld', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': [], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False])]\ndef vary(value):\n if type(value) is int: return value*N\n if isinstance(value,list): return [vary(v) for v in value]\n if isinstance(value,dict): return {k:(v if k in ['count', 'delivery_index', 'disputed', 'maximum_set', 'minimum_set', 'stage', 'threshold', 'waived'] else vary(v)) for k,v in value.items()}\n return value\nfor label, request, expected in fixtures:\n check(label, solve(vary(request))['evidence-completeness'], expected[N-1])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"5233012bed96a9eb26ce56eed503e27c6790e89552fb846b86c8b21d2ae0f472","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(x):\n    v0 = x[\"challenger\"] in x[\"participants\"] and x[\"challenger\"]!=x[\"winner\"]\n    v1 = [g for g in x[\"grounds\"] if g in x[\"permitted\"]]\n    v2 = x[\"filed\"]<=x[\"deadline\"]\n    v3 = bool(set(x[\"evidence\"])&set(x[\"received\"]))\n    v4 = not (set(x[\"objections\"])-set(x[\"resolved\"])-set(x[\"withdrawn\"]))\n    v5 = [i for i in x[\"awarded\"] if i not in x[\"affected\"]] if x[\"upheld\"] else x[\"awarded\"]\n    v6 = [o for o in x[\"objections\"] if o not in x[\"withdrawn\"]]\n    v7 = 0 if x[\"frivolous\"] else x[\"deposit\"]\n    v8 = sorted(set(x[\"participants\"])-set(x[\"notified\"]))\n    v9 = [o for o in x[\"upheld\"] if o in x[\"objections\"] and o not in x[\"withdrawn\"]]\n    return {'challenger-standing':v0,'admissible-grounds':v1,'filing-deadline':v2,'evidence-completeness':v3,'open-objection-finality':v4,'remedy-lot-scope':v5,'withdrawn-hearing-removal':v6,'objection-deposit-disposition':v7,'hearing-notice-parties':v8,'upheld-live-objections':v9}\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nfixtures = [('normal contract', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('ground order', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['procedure', 'eligibility'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('out of order evidence', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e2', 'e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [True, True, True, True, True]), ('ground order / out of order evidence', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['procedure', 'eligibility'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e2', 'e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [True, True, True, True, True]), ('nonparticipant', {'challenger': 'c', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('winner challenges own award', {'challenger': 'a', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('deadline filing', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 6, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('late filing', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 7, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('all evidence received', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1', 'e2'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [True, True, True, True, True]), ('all objections resolved', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1', 'o2'], 'objections': ['o1', 'o2'], 'upheld': ['o2'], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False]), ('none upheld', {'challenger': 'b', 'participants': ['a', 'b'], 'winner': 'a', 'grounds': ['eligibility', 'price'], 'permitted': ['eligibility', 'procedure'], 'filed': 5, 'deadline': 6, 'evidence': ['e1', 'e2'], 'received': ['e1'], 'resolved': ['o1'], 'objections': ['o1', 'o2'], 'upheld': [], 'affected': ['L2'], 'awarded': ['L1', 'L2'], 'withdrawn': ['o1'], 'deposit': 4, 'frivolous': False, 'notified': ['a']}, [False, False, False, False, False])]\ndef vary(value):\n if type(value) is int: return value*N\n if isinstance(value,list): return [vary(v) for v in value]\n if isinstance(value,dict): return {k:(v if k in ['count', 'delivery_index', 'disputed', 'maximum_set', 'minimum_set', 'stage', 'threshold', 'waived'] else vary(v)) for k,v in value.items()}\n return value\nfor label, request, expected in fixtures:\n check(label, solve(vary(request))['evidence-completeness'], expected[N-1])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Stipulated toy auction rules, not a venue specification, financial advice, optimization claim, or live trading implementation. Nonnegative integer inputs and internally aligned list fields only. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"s3-auction-allocation-rules-award-objection-evidence-completeness","generated_at":"2026-09-29T14:46:12.168832+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"Offline administrative auction model for software failure analysis.","root_cause":"An objection proceeds with only part of its required evidence.","sha256":"497876acb94e6f22c1c14918fcd2fa06a68c2408fe4b528937a12a17187f46c0","title":"Award objection: evidence completeness · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":51.157,"exit_code":1,"observations":[{"actual":false,"check":"normal contract","expected":false,"passed":true},{"actual":false,"check":"ground order","expected":false,"passed":true},{"actual":false,"check":"out of order evidence","expected":true,"passed":false},{"actual":false,"check":"ground order / out of order evidence","expected":true,"passed":false},{"actual":false,"check":"nonparticipant","expected":false,"passed":true},{"actual":false,"check":"winner challenges own award","expected":false,"passed":true},{"actual":false,"check":"deadline filing","expected":false,"passed":true},{"actual":false,"check":"late filing","expected":false,"passed":true},{"actual":true,"check":"all evidence received","expected":true,"passed":true},{"actual":false,"check":"all objections resolved","expected":false,"passed":true},{"actual":false,"check":"none upheld","expected":false,"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"normal contract\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"ground order\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"out of order evidence\", \"actual\": false, \"expected\": true, \"passed\": false}, {\"check\": \"ground order / out of order evidence\", \"actual\": false, \"expected\": true, \"passed\": false}, {\"check\": \"nonparticipant\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"winner challenges own award\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"deadline filing\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"late filing\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"all evidence received\", \"actual\": true, \"expected\": true, \"passed\": true}, {\"check\": \"all objections resolved\", \"actual\": false, \"expected\": false, \"passed\": true}, {\"check\": \"none upheld\", \"actual\": false, \"expected\": false, \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":40.783,"exit_code":1,"observations":[{"actual":true,"check":"normal contract","expected":false,"passed":false},{"actual":true,"check":"ground order","expected":false,"passed":false},{"actual":true,"check":"out of order evidence","expected":true,"passed":true},{"actual":true,"check":"ground order / out of order evidence","expected":true,"passed":true},{"actual":true,"check":"nonparticipant","expected":false,"passed":false},{"actual":true,"check":"winner challenges own award","expected":false,"passed":false},{"actual":true,"check":"deadline filing","expected":false,"passed":false},{"actual":true,"check":"late filing","expected":false,"passed":false},{"actual":true,"check":"all evidence received","expected":true,"passed":true},{"actual":true,"check":"all objections resolved","expected":false,"passed":false},{"actual":true,"check":"none upheld","expected":false,"passed":false}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"normal contract\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"ground order\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"out of order evidence\", \"actual\": true, \"expected\": true, \"passed\": true}, {\"check\": \"ground order / out of order evidence\", \"actual\": true, \"expected\": true, \"passed\": true}, {\"check\": \"nonparticipant\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"winner challenges own award\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"deadline filing\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"late filing\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"all evidence received\", \"actual\": true, \"expected\": true, \"passed\": true}, {\"check\": \"all objections resolved\", \"actual\": true, \"expected\": false, \"passed\": false}, {\"check\": \"none upheld\", \"actual\": true, \"expected\": false, \"passed\": false}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}