FA-74555 / Experiment statistics / Member archive

Post-exposure metric window: Exposed users without events disappear · case 05

Metric means are inflated because inactive exposed users are excluded.

Member previewVariant 5 · 3 implementations · 8 checks per implementation

Case contract

events are [user, day, value]; exposures maps user -> first exposure day. A user's metric sums values of their events with exposure_day <= day < exposure_day + window_days. Every exposed user appears, even with no qualifying events; unexposed users are dropped. Return sorted [user, total].

Why this case matters

Counting pre-exposure activity dilutes effects; dropping silent users biases means upward.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixture	Actual	Expected	Outcome
exposed user with no events reports zero	`[["a", 1]]`	`[["a", 1], ["b", 0]]`	Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.