{"abstract":"A run resumes after receiving a result for a different call identifier.","category":"Agent workflow termination","checks":7,"contract":"Return sorted outstanding IDs after consuming result_id if present; unmatched results change nothing.","contract_signature":"pending_ids, result_id","evaluation_group":"w3-agent-workflow-termination-tool-result-correlation","failed_approach":"Handling only the first pending ID still leaves later results uncorrelated.","family":"w3-agent-workflow-termination-tool-result-correlation","id":"FA-99851","implementations":{"attempt":{"sha256":"107368ea85333db74ab92b75741508f4a7e00afd0f75e123d06fb1cac5e609df","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(pending_ids, result_id):\n    return sorted(x for x in pending_ids if x != result_id) if pending_ids and result_id == pending_ids[0] else sorted(pending_ids)\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nids=['c'+str(N),'d']\ncheck('matching first', solve(ids,ids[0]),['d'])\ncheck('matching second', solve(ids,'d'),[ids[0]])\ncheck('unknown result', solve(ids,'x'),sorted(ids))\ncheck('empty pending', solve([],'x'),[])\ncheck('singleton match', solve(['only'],'only'),[])\ncheck('singleton unrelated', solve(['only'],'x'),['only'])\ncheck('unordered input', solve(['z','a'],'z'),['a'])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"d36049ea5a05281a341e35316c2dae816c1ff4439c22a41acbc0f2a33b0cd314","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(pending_ids, result_id):\n    return sorted(pending_ids[1:]) if pending_ids else []\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\nids=['c'+str(N),'d']\ncheck('matching first', solve(ids,ids[0]),['d'])\ncheck('matching second', solve(ids,'d'),[ids[0]])\ncheck('unknown result', solve(ids,'x'),sorted(ids))\ncheck('empty pending', solve([],'x'),[])\ncheck('singleton match', solve(['only'],'only'),[])\ncheck('singleton unrelated', solve(['only'],'x'),['only'])\ncheck('unordered input', solve(['z','a'],'z'),['a'])\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":"Call identifiers are unique strings within a run. This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"w3-agent-workflow-termination-tool-result-correlation","generated_at":"2026-09-30T16:48:28.969379+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"This toy decision rule isolates one bounded agent-loop completion contract.","root_cause":"The result handler decrements pending work without matching request identity.","sha256":"b371174171b401ed2496e02d577116b9588694503dc1ba2c7f9d3f2fff0e9046","title":"Workflow: unrelated tool result clears the outstanding request · case 01","variant":1,"variant_policy":"The fixture code references N, supplied as 1 through 5. Fixed boundary checks may repeat. These records share one mechanism and must remain together in evaluation splits.","verified":true,"visibility":"public","verification":{"attempt":{"elapsed_ms":29.304,"exit_code":1,"observations":[{"actual":["d"],"check":"matching first","expected":["d"],"passed":true},{"actual":["c1","d"],"check":"matching second","expected":["c1"],"passed":false},{"actual":["c1","d"],"check":"unknown result","expected":["c1","d"],"passed":true},{"actual":[],"check":"empty pending","expected":[],"passed":true},{"actual":[],"check":"singleton match","expected":[],"passed":true},{"actual":["only"],"check":"singleton unrelated","expected":["only"],"passed":true},{"actual":["a"],"check":"unordered input","expected":["a"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"matching first\", \"actual\": [\"d\"], \"expected\": [\"d\"], \"passed\": true}, {\"check\": \"matching second\", \"actual\": [\"c1\", \"d\"], \"expected\": [\"c1\"], \"passed\": false}, {\"check\": \"unknown result\", \"actual\": [\"c1\", \"d\"], \"expected\": [\"c1\", \"d\"], \"passed\": true}, {\"check\": \"empty pending\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"singleton match\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"singleton unrelated\", \"actual\": [\"only\"], \"expected\": [\"only\"], \"passed\": true}, {\"check\": \"unordered input\", \"actual\": [\"a\"], \"expected\": [\"a\"], \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":28.972,"exit_code":1,"observations":[{"actual":["d"],"check":"matching first","expected":["d"],"passed":true},{"actual":["d"],"check":"matching second","expected":["c1"],"passed":false},{"actual":["d"],"check":"unknown result","expected":["c1","d"],"passed":false},{"actual":[],"check":"empty pending","expected":[],"passed":true},{"actual":[],"check":"singleton match","expected":[],"passed":true},{"actual":[],"check":"singleton unrelated","expected":["only"],"passed":false},{"actual":["a"],"check":"unordered input","expected":["a"],"passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"matching first\", \"actual\": [\"d\"], \"expected\": [\"d\"], \"passed\": true}, {\"check\": \"matching second\", \"actual\": [\"d\"], \"expected\": [\"c1\"], \"passed\": false}, {\"check\": \"unknown result\", \"actual\": [\"d\"], \"expected\": [\"c1\", \"d\"], \"passed\": false}, {\"check\": \"empty pending\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"singleton match\", \"actual\": [], \"expected\": [], \"passed\": true}, {\"check\": \"singleton unrelated\", \"actual\": [], \"expected\": [\"only\"], \"passed\": false}, {\"check\": \"unordered input\", \"actual\": [\"a\"], \"expected\": [\"a\"], \"passed\": true}], \"passed\": false}\n"}},"member_only":{"stages":["fixed"],"fields":["implementations.fixed","verification.fixed","harness","repair"],"note":"The verified repair, its recorded checks, the repair description, and the scoring harness are available to members."}}