FA-98383 / Token sampling filters / Member archive
Token sampling: Frequency penalty counts only distinct history tokens · case 03
Frequency penalty counts only distinct history tokens.
Case contract
Subtract penalty times the number of occurrences of each token in history from that token score.
Why this case matters
A finite, deterministic token-selection contract isolates one decoding operation from model inference and runtime behavior.
One recorded failure
Sample boundary fixtureThis sample comes from the broken implementation of a controlled reproducer.
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| repeated token | {"a": 7.0, "b": 4.0} | {"a": 4.0, "b": 4.0} | Failed |
MEMBER ARCHIVE
The complete case is available to members.
This record includes three runnable implementations, regression fixtures, execution results, and source hashes.
Member access is invitation-based. Sign in with your invited account to inspect the sources.
Sign in to the archive ↗