FAILURE MAP
← Case archive

FA-74617 / Experiment statistics / Member archive

Triggered effect dilution: The triggered effect is scaled up instead of down · case 02

Reported site-wide gains exceed the triggered gains.

Member previewVariant 2 · 3 implementations · 8 checks per implementation

Case contract

delta_trig is the absolute effect among triggered users. The trigger rate is pooled across arms: (trig_c + trig_t) / (n_c + n_t). The diluted site-wide effect is delta_trig * rate and the relative effect divides that by the overall control mean. No users or zero overall mean -> None. Return [rate, diluted absolute, diluted relative] rounded to 6.

Why this case matters

Triggered analyses are sensitive but must be diluted before claiming site-wide impact.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixtureActualExpectedOutcome
unequal arms pool the trigger rate[0.118182, 16.923077, 1.692308][0.118182, 0.236364, 0.023636]Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.

Sign in to the archive ↗