FA-98389 / Token sampling filters / Member archive
Token sampling: Allowed probabilities sum below one when disallowed logits remain in the denominator · case 04
Allowed probabilities sum below one when disallowed logits remain in the denominator.
Case contract
Return normalized probabilities over only allowed tokens using a stable softmax; empty allowed support returns an empty mapping.
Why this case matters
A finite, deterministic token-selection contract isolates one decoding operation from model inference and runtime behavior.
One recorded failure
Sample boundary fixtureThis sample comes from the broken implementation of a controlled reproducer.
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| excluded mass removed | {"a": 4.539580782951091e-05, "b": 4.539580782951091e-05} | {"a": 0.5, "b": 0.5} | Failed |
MEMBER ARCHIVE
The complete case is available to members.
This record includes three runnable implementations, regression fixtures, execution results, and source hashes.
Member access is invitation-based. Sign in with your invited account to inspect the sources.
Sign in to the archive ↗