FA-74754 / Experiment statistics / Member archive

Pre-period balance check: Balance uses population variances · case 04

Tiny pre-period samples exaggerate imbalance.

Member previewVariant 4 · 3 implementations · 8 checks per implementation

Case contract

Standardised mean difference = (mean_t - mean_c) / sqrt((var_c + var_t) / 2) with sample (n - 1) variances; imbalance iff |SMD| > threshold. Zero pooled variance -> [0.0, False] when means are equal else [None, True]. Fewer than two values in an arm -> None. Return [round(smd, 6), imbalance].

Why this case matters

Pre-period imbalance warns that randomisation or logging went wrong before any effect is read.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixture	Actual	Expected	Outcome
treatment arm more variable	`[0.840168, true]`	`[0.685994, true]`	Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.