FA-99969 / Evaluation metric aggregation / Member archive
Macro F1 averages pooled counts instead of class scores · case 04
Macro F1 averages pooled counts instead of class scores.
Case contract
For each supplied label calculate 2TP/(2TP+FP+FN), using zero for a zero denominator, then average labels; empty labels returns 0.
Why this case matters
A small explicit evaluation contract makes aggregation behavior reproducible across labeled examples.
One recorded failure
Sample boundary fixtureThis sample comes from the broken implementation of a controlled reproducer.
| Boundary fixture | Actual | Expected | Outcome |
|---|---|---|---|
| pooled differs | 0.6 | 0.375 | Failed |
MEMBER ARCHIVE
The complete case is available to members.
This record includes three runnable implementations, regression fixtures, execution results, and source hashes.
Member access is invitation-based. Sign in with your invited account to inspect the sources.
Sign in to the archive ↗