FA-74728 / Experiment statistics / Member archive

O'Brien-Fleming type alpha spending: Cumulative spend is reported as incremental · case 03

Later looks appear to have almost the entire alpha available again.

Member previewVariant 3 · 3 implementations · 8 checks per implementation

Case contract

Cumulative alpha spent at information fraction t is 2 - 2 Phi(z_{1-alpha/2} / sqrt(t)) (t capped at 1). Information fractions must strictly increase from 0, otherwise return None. Return the incremental alpha spent at each look rounded to 6.

Why this case matters

Spending functions let teams peek at experiments without inflating the false positive rate.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixture	Actual	Expected	Outcome
four equally spaced looks	`[8.9e-05, 0.005575, 0.023625, 0.05]`	`[8.9e-05, 0.005486, 0.018051, 0.026375]`	Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.