4/14/2026 at 12:55:38 PM
This is methodologically flawed, as bytes only weakly correlate with tokens.Unless you're sending identical requests, you can't expect the same token counts for any given of bytes, or that a slightly longer (but different) message will lead to more tokens than a slightly shorter one, or vice versa.
by marginalia_nu