FA-74767 / Experiment statistics / Member archive
Team-draft interleaving credit: Team B can place a document already shown · case 02
The interleaved page shows the same result twice and B gets extra credit.
Case contract
Build an interleaved list of up to length documents. Each round both teams skip documents already placed; when both teams have the same number of picks, the next coin (cycled, consumed only on ties) chooses A on 0 and B on 1; otherwise the team with fewer picks goes. An exhausted team yields to the other. Clicks are positions; each credits the team that placed that document. Return [documents, teams, winner A/B/tie].
Why this case matters
Interleaving compares ranking algorithms with far fewer users than an A/B test, if credit is fair.
One recorded failure
Sample boundary fixtureThis sample comes from the broken implementation of a controlled reproducer.
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| coins are consumed only on ties | [["d4", "d1", "d2", "d4", "d4", "d3"], ["B", "A", "A", "B", "B", "A"], "B"] | [["d4", "d1", "d2", "d5", "d6", "d3"], ["B", "A", "A", "B", "B", "A"], "B"] | Failed |
MEMBER ARCHIVE
The complete case is available to members.
This record includes three runnable implementations, regression fixtures, execution results, and source hashes.
Member access is invitation-based. Sign in with your invited account to inspect the sources.
Sign in to the archive ↗