{"abstract":"Submitting fails to reveal untouched invalid fields.","category":"Form validation","checks":9,"contract":"Disabled fields hide errors; pending takes precedence; None alone means valid; errors become visible on touch or submit.","evaluation_group":"xi-validation-visibility","failed_approach":"Requiring both flags still hides untouched submit errors.","family":"xi-validation-visibility-submit","id":"FA-8021","implementations":{"attempt":{"sha256":"dc9a258d7da374a0e33a1f31d67dd1ce069b2e41c1e08015ad82d06756025515","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(error, touched, submitted, disabled, pending):\n    if disabled: return 'hidden'\n    if pending: return 'checking'\n    if error is None: return 'valid'\n    if touched and submitted: return error\n    return 'hidden'\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('disabled', solve('required', True, True, True, False), 'hidden')\ncheck('pending', solve('stale', True, True, False, True), 'checking')\ncheck('empty error', solve('', True, False, False, False), '')\ncheck('submit', solve('required', False, True, False, False), 'required')\ncheck('touched', solve('required', True, False, False, False), 'required')\ncheck('pristine', solve('required', False, False, False, False), 'hidden')\ncheck('valid', solve(None, True, True, False, False), 'valid')\ncheck('parameterized error', solve('error'+str(N), False, True, False, False), 'error'+str(N))\nfor repetition in range(N):\n    check('repeat valid', solve(None, True, True, False, False), 'valid')\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"broken":{"sha256":"9d485f70cb51478a4d99b0d3a51365b57d0b8600beaaddd895727a462884f898","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(error, touched, submitted, disabled, pending):\n    if disabled: return 'hidden'\n    if pending: return 'checking'\n    if error is None: return 'valid'\n    if touched: return error\n    return 'hidden'\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('disabled', solve('required', True, True, True, False), 'hidden')\ncheck('pending', solve('stale', True, True, False, True), 'checking')\ncheck('empty error', solve('', True, False, False, False), '')\ncheck('submit', solve('required', False, True, False, False), 'required')\ncheck('touched', solve('required', True, False, False, False), 'required')\ncheck('pristine', solve('required', False, False, False, False), 'hidden')\ncheck('valid', solve(None, True, True, False, False), 'valid')\ncheck('parameterized error', solve('error'+str(N), False, True, False, False), 'error'+str(N))\nfor repetition in range(N):\n    check('repeat valid', solve(None, True, True, False, False), 'valid')\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"},"fixed":{"sha256":"6b97df8e4e85b74b3334a8680e9d6f6b2061ecd538af350f035faf38f60982e6","source":"\"\"\"Failure Map reference implementation. Python standard library only.\"\"\"\nimport json\n\nN = 1\nobservations = []\ndef solve(error, touched, submitted, disabled, pending):\n    if disabled: return 'hidden'\n    if pending: return 'checking'\n    if error is None: return 'valid'\n    if touched or submitted: return error\n    return 'hidden'\ndef check(label, actual, expected):\n    observations.append({\"check\": label, \"actual\": actual, \"expected\": expected, \"passed\": actual == expected})\ncheck('disabled', solve('required', True, True, True, False), 'hidden')\ncheck('pending', solve('stale', True, True, False, True), 'checking')\ncheck('empty error', solve('', True, False, False, False), '')\ncheck('submit', solve('required', False, True, False, False), 'required')\ncheck('touched', solve('required', True, False, False, False), 'required')\ncheck('pristine', solve('required', False, False, False, False), 'hidden')\ncheck('valid', solve(None, True, True, False, False), 'valid')\ncheck('parameterized error', solve('error'+str(N), False, True, False, False), 'error'+str(N))\nfor repetition in range(N):\n    check('repeat valid', solve(None, True, True, False, False), 'valid')\nprint(json.dumps({\"observations\": observations, \"passed\": all(x[\"passed\"] for x in observations)}, ensure_ascii=False))\nraise SystemExit(0 if all(x[\"passed\"] for x in observations) else 1)\n"}},"limitations":" This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.","method":"Deterministic executable model with adversarial boundary fixtures.","provenance":{"created_by":"Failure Map","dependencies":"Python standard library","family":"xi-validation-visibility-submit","generated_at":"2026-09-29T14:38:17.443166+00:00","license":"CC0-1.0","python":"3.12.14","seed":1,"split":"open-access"},"relevance":"A deterministic model of validation message disclosure; this isolates one interface invariant without requiring a browser.","repair":"Implement the submit operation as `touched or submitted`.","root_cause":"The submit operation uses `touched` where the contract requires `touched or submitted`.","sha256":"0aa5c94a4796b572449650b04c4c019cb3ab2096ff57735310df90b449937ef7","title":"Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 01","variant":1,"variant_policy":"Five numbered records share a model and may reuse boundary fixtures.","verification":{"attempt":{"elapsed_ms":42.565,"exit_code":1,"observations":[{"actual":"hidden","check":"disabled","expected":"hidden","passed":true},{"actual":"checking","check":"pending","expected":"checking","passed":true},{"actual":"hidden","check":"empty error","expected":"","passed":false},{"actual":"hidden","check":"submit","expected":"required","passed":false},{"actual":"hidden","check":"touched","expected":"required","passed":false},{"actual":"hidden","check":"pristine","expected":"hidden","passed":true},{"actual":"valid","check":"valid","expected":"valid","passed":true},{"actual":"hidden","check":"parameterized error","expected":"error1","passed":false},{"actual":"valid","check":"repeat valid","expected":"valid","passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"disabled\", \"actual\": \"hidden\", \"expected\": \"hidden\", \"passed\": true}, {\"check\": \"pending\", \"actual\": \"checking\", \"expected\": \"checking\", \"passed\": true}, {\"check\": \"empty error\", \"actual\": \"hidden\", \"expected\": \"\", \"passed\": false}, {\"check\": \"submit\", \"actual\": \"hidden\", \"expected\": \"required\", \"passed\": false}, {\"check\": \"touched\", \"actual\": \"hidden\", \"expected\": \"required\", \"passed\": false}, {\"check\": \"pristine\", \"actual\": \"hidden\", \"expected\": \"hidden\", \"passed\": true}, {\"check\": \"valid\", \"actual\": \"valid\", \"expected\": \"valid\", \"passed\": true}, {\"check\": \"parameterized error\", \"actual\": \"hidden\", \"expected\": \"error1\", \"passed\": false}, {\"check\": \"repeat valid\", \"actual\": \"valid\", \"expected\": \"valid\", \"passed\": true}], \"passed\": false}\n"},"broken":{"elapsed_ms":40.018,"exit_code":1,"observations":[{"actual":"hidden","check":"disabled","expected":"hidden","passed":true},{"actual":"checking","check":"pending","expected":"checking","passed":true},{"actual":"","check":"empty error","expected":"","passed":true},{"actual":"hidden","check":"submit","expected":"required","passed":false},{"actual":"required","check":"touched","expected":"required","passed":true},{"actual":"hidden","check":"pristine","expected":"hidden","passed":true},{"actual":"valid","check":"valid","expected":"valid","passed":true},{"actual":"hidden","check":"parameterized error","expected":"error1","passed":false},{"actual":"valid","check":"repeat valid","expected":"valid","passed":true}],"passed":false,"stderr":"","stdout":"{\"observations\": [{\"check\": \"disabled\", \"actual\": \"hidden\", \"expected\": \"hidden\", \"passed\": true}, {\"check\": \"pending\", \"actual\": \"checking\", \"expected\": \"checking\", \"passed\": true}, {\"check\": \"empty error\", \"actual\": \"\", \"expected\": \"\", \"passed\": true}, {\"check\": \"submit\", \"actual\": \"hidden\", \"expected\": \"required\", \"passed\": false}, {\"check\": \"touched\", \"actual\": \"required\", \"expected\": \"required\", \"passed\": true}, {\"check\": \"pristine\", \"actual\": \"hidden\", \"expected\": \"hidden\", \"passed\": true}, {\"check\": \"valid\", \"actual\": \"valid\", \"expected\": \"valid\", \"passed\": true}, {\"check\": \"parameterized error\", \"actual\": \"hidden\", \"expected\": \"error1\", \"passed\": false}, {\"check\": \"repeat valid\", \"actual\": \"valid\", \"expected\": \"valid\", \"passed\": true}], \"passed\": false}\n"},"fixed":{"elapsed_ms":40.844,"exit_code":0,"observations":[{"actual":"hidden","check":"disabled","expected":"hidden","passed":true},{"actual":"checking","check":"pending","expected":"checking","passed":true},{"actual":"","check":"empty error","expected":"","passed":true},{"actual":"required","check":"submit","expected":"required","passed":true},{"actual":"required","check":"touched","expected":"required","passed":true},{"actual":"hidden","check":"pristine","expected":"hidden","passed":true},{"actual":"valid","check":"valid","expected":"valid","passed":true},{"actual":"error1","check":"parameterized error","expected":"error1","passed":true},{"actual":"valid","check":"repeat valid","expected":"valid","passed":true}],"passed":true,"stderr":"","stdout":"{\"observations\": [{\"check\": \"disabled\", \"actual\": \"hidden\", \"expected\": \"hidden\", \"passed\": true}, {\"check\": \"pending\", \"actual\": \"checking\", \"expected\": \"checking\", \"passed\": true}, {\"check\": \"empty error\", \"actual\": \"\", \"expected\": \"\", \"passed\": true}, {\"check\": \"submit\", \"actual\": \"required\", \"expected\": \"required\", \"passed\": true}, {\"check\": \"touched\", \"actual\": \"required\", \"expected\": \"required\", \"passed\": true}, {\"check\": \"pristine\", \"actual\": \"hidden\", \"expected\": \"hidden\", \"passed\": true}, {\"check\": \"valid\", \"actual\": \"valid\", \"expected\": \"valid\", \"passed\": true}, {\"check\": \"parameterized error\", \"actual\": \"error1\", \"expected\": \"error1\", \"passed\": true}, {\"check\": \"repeat valid\", \"actual\": \"valid\", \"expected\": \"valid\", \"passed\": true}], \"passed\": true}\n"}},"verified":true,"visibility":"public"}