FA-8021 / Form validation / Open access

Validation message disclosure: Submitting fails to reveal untouched invalid fields · case 01

Submitting fails to reveal untouched invalid fields.

Verified by executionVariant 1 · 9 checks per implementationDownload source bundle ↓JSON ↗

ROOT CAUSE

The submit operation uses `touched` where the contract requires `touched or submitted`.

VERIFIED REPAIR

Implement the submit operation as `touched or submitted`.

Unsuccessful approach: Requiring both flags still hides untouched submit errors.

Case contract

Disabled fields hide errors; pending takes precedence; None alone means valid; errors become visible on touch or submit.

Why this case matters

A deterministic model of validation message disclosure; this isolates one interface invariant without requiring a browser.

1 / The failure

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(error, touched, submitted, disabled, pending):
    if disabled: return 'hidden'
    if pending: return 'checking'
    if error is None: return 'valid'
    if touched: return error
    return 'hidden'
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('disabled', solve('required', True, True, True, False), 'hidden')
check('pending', solve('stale', True, True, False, True), 'checking')
check('empty error', solve('', True, False, False, False), '')
check('submit', solve('required', False, True, False, False), 'required')
check('touched', solve('required', True, False, False, False), 'required')
check('pristine', solve('required', False, False, False, False), 'hidden')
check('valid', solve(None, True, True, False, False), 'valid')
check('parameterized error', solve('error'+str(N), False, True, False, False), 'error'+str(N))
for repetition in range(N):
    check('repeat valid', solve(None, True, True, False, False), 'valid')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
disabled	`hidden`	`hidden`	Passed
pending	`checking`	`checking`	Passed
empty error			Passed
submit	`hidden`	`required`	Failed
touched	`required`	`required`	Passed
pristine	`hidden`	`hidden`	Passed
valid	`valid`	`valid`	Passed
parameterized error	`hidden`	`error1`	Failed
repeat valid	`valid`	`valid`	Passed

SHA-256 / 9d485f70cb51478a4d99b0d3a51365b57d0b8600beaaddd895727a462884f898

2 / The unsuccessful fix

Exit 1

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(error, touched, submitted, disabled, pending):
    if disabled: return 'hidden'
    if pending: return 'checking'
    if error is None: return 'valid'
    if touched and submitted: return error
    return 'hidden'
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('disabled', solve('required', True, True, True, False), 'hidden')
check('pending', solve('stale', True, True, False, True), 'checking')
check('empty error', solve('', True, False, False, False), '')
check('submit', solve('required', False, True, False, False), 'required')
check('touched', solve('required', True, False, False, False), 'required')
check('pristine', solve('required', False, False, False, False), 'hidden')
check('valid', solve(None, True, True, False, False), 'valid')
check('parameterized error', solve('error'+str(N), False, True, False, False), 'error'+str(N))
for repetition in range(N):
    check('repeat valid', solve(None, True, True, False, False), 'valid')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
disabled	`hidden`	`hidden`	Passed
pending	`checking`	`checking`	Passed
empty error	`hidden`		Failed
submit	`hidden`	`required`	Failed
touched	`hidden`	`required`	Failed
pristine	`hidden`	`hidden`	Passed
valid	`valid`	`valid`	Passed
parameterized error	`hidden`	`error1`	Failed
repeat valid	`valid`	`valid`	Passed

SHA-256 / dc9a258d7da374a0e33a1f31d67dd1ce069b2e41c1e08015ad82d06756025515

3 / The verified repair

Exit 0

"""Failure Map reference implementation. Python standard library only."""
import json

N = 1
observations = []
def solve(error, touched, submitted, disabled, pending):
    if disabled: return 'hidden'
    if pending: return 'checking'
    if error is None: return 'valid'
    if touched or submitted: return error
    return 'hidden'
def check(label, actual, expected):
    observations.append({"check": label, "actual": actual, "expected": expected, "passed": actual == expected})
check('disabled', solve('required', True, True, True, False), 'hidden')
check('pending', solve('stale', True, True, False, True), 'checking')
check('empty error', solve('', True, False, False, False), '')
check('submit', solve('required', False, True, False, False), 'required')
check('touched', solve('required', True, False, False, False), 'required')
check('pristine', solve('required', False, False, False, False), 'hidden')
check('valid', solve(None, True, True, False, False), 'valid')
check('parameterized error', solve('error'+str(N), False, True, False, False), 'error'+str(N))
for repetition in range(N):
    check('repeat valid', solve(None, True, True, False, False), 'valid')
print(json.dumps({"observations": observations, "passed": all(x["passed"] for x in observations)}, ensure_ascii=False))
raise SystemExit(0 if all(x["passed"] for x in observations) else 1)

Boundary fixture	Actual	Expected	Outcome
disabled	`hidden`	`hidden`	Passed
pending	`checking`	`checking`	Passed
empty error			Passed
submit	`required`	`required`	Passed
touched	`required`	`required`	Passed
pristine	`hidden`	`hidden`	Passed
valid	`valid`	`valid`	Passed
parameterized error	`error1`	`error1`	Passed
repeat valid	`valid`	`valid`	Passed

SHA-256 / 6b97df8e4e85b74b3334a8680e9d6f6b2061ecd538af350f035faf38f60982e6

Verification & scope

This reproducer isolates one failure mechanism. Results cover the supplied fixtures. Variants within a family share a test contract and should remain grouped when constructing evaluation splits. Related mechanisms with a shared evaluation_group must also remain together; these controlled models are not independent production incidents.

Observations recorded using Python 3.12.14 at 2026-09-29T14:38:17.443166+00:00.

Case digest / 0aa5c94a4796b572449650b04c4c019cb3ab2096ff57735310df90b449937ef7