FA-98987 / Optimizer update state / Member archive
AMSGrad forgets the historical maximum variance · case 02
AMSGrad forgets the historical maximum variance.
Case contract
Return [max(old_max,vhat), lr*mhat/(sqrt(maximum)+eps)].
Why this case matters
Optimizer implementations must associate each parameter with its own mathematically specified update state.
One recorded failure
Sample boundary fixtureThis sample comes from the broken implementation of a controlled reproducer.
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| retain historical | [2.0, 1.414213562373095] | [9, 0.6666666666666666] | Failed |
MEMBER ARCHIVE
The complete case is available to members.
This record includes three runnable implementations, regression fixtures, execution results, and source hashes.
Member access is invitation-based. Sign in with your invited account to inspect the sources.
Sign in to the archive ↗