FA-74614 / Experiment statistics / Member archive

Triggered effect dilution: Relative impact uses the undiluted effect · case 04

Site-wide relative lift is overstated by the inverse trigger rate.

Member previewVariant 4 · 3 implementations · 8 checks per implementation

Case contract

delta_trig is the absolute effect among triggered users. The trigger rate is pooled across arms: (trig_c + trig_t) / (n_c + n_t). The diluted site-wide effect is delta_trig * rate and the relative effect divides that by the overall control mean. No users or zero overall mean -> None. Return [rate, diluted absolute, diluted relative] rounded to 6.

Why this case matters

Triggered analyses are sensitive but must be diluted before claiming site-wide impact.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixture	Actual	Expected	Outcome
unequal arms pool the trigger rate	`[0.118182, 0.236364, 0.2]`	`[0.118182, 0.236364, 0.023636]`	Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.