FAILURE MAP
← Case archive

FA-100025 / Evaluation metric aggregation / Member archive

Grouped accuracy includes empty groups as zero · case 05

Grouped accuracy includes empty groups as zero.

Member previewVariant 5 · 3 implementations · 6 checks per implementation

Case contract

Rows are [group,truth,prediction]. Return the unweighted mean accuracy among requested groups represented by rows; no represented requested groups yields 0.

Why this case matters

A small explicit evaluation contract makes aggregation behavior reproducible across labeled examples.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixtureActualExpectedOutcome
empty requested group0.51Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.

Sign in to the archive ↗