FAILURE MAP
← Case archive

FA-74767 / Experiment statistics / Member archive

Team-draft interleaving credit: Team B can place a document already shown · case 02

The interleaved page shows the same result twice and B gets extra credit.

Member previewVariant 2 · 3 implementations · 8 checks per implementation

Case contract

Build an interleaved list of up to length documents. Each round both teams skip documents already placed; when both teams have the same number of picks, the next coin (cycled, consumed only on ties) chooses A on 0 and B on 1; otherwise the team with fewer picks goes. An exhausted team yields to the other. Clicks are positions; each credits the team that placed that document. Return [documents, teams, winner A/B/tie].

Why this case matters

Interleaving compares ranking algorithms with far fewer users than an A/B test, if credit is fair.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixtureActualExpectedOutcome
coins are consumed only on ties[["d4", "d1", "d2", "d4", "d4", "d3"], ["B", "A", "A", "B", "B", "A"], "B"][["d4", "d1", "d2", "d5", "d6", "d3"], ["B", "A", "A", "B", "B", "A"], "B"]Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.

Sign in to the archive ↗