FA-91619 / Digital signal filters / Member archive

Coefficient quantizer measures error before clipping · case 04

max_error understates the real error for saturated coefficients.

Member previewVariant 4 · 3 implementations · 7 checks per implementation

Case contract

Input [coeffs, f, B, mode]: quantize each decimal coefficient to a B-bit two's-complement code with f fractional bits; "nearest" rounds half away from zero, "truncate" floors. Codes saturate to [-2^(B-1), 2^(B-1)-1]. Return {"codes", "saturated": count of clipped codes, "max_error": max |code/2^f - c| after saturation as a fraction string}.

Why this case matters

Coefficient quantization decides whether a fixed-point filter still meets spec; rounding and saturation slips shift poles.

One recorded failure

Sample boundary fixture

This sample comes from the broken implementation of a controlled reproducer.

Boundary fixture	Actual	Expected	Outcome
regression: random quantize 32	`{"codes": [-8, -8, -3], "max_error": "1/25", "saturated": 2}`	`{"codes": [-8, -8, -3], "max_error": "79/100", "saturated": 2}`	Failed

MEMBER ARCHIVE

The complete case is available to members.

This record includes three runnable implementations, regression fixtures, execution results, and source hashes.

Member access is invitation-based. Sign in with your invited account to inspect the sources.