plano/crates/common
Adil Hafeez e5f3039924 make tiktoken token counting optional via enable_token_counting override
By default, use cheap len/4 estimate for input token counting (metrics
and ratelimit). When enable_token_counting is set to true in overrides,
use tiktoken BPE for exact counts. This eliminates ~80ms of per-request
latency from tiktoken in the WASM filter while keeping metrics and
ratelimit functional.

Made-with: Cursor
2026-03-22 21:53:47 -07:00
..
src make tiktoken token counting optional via enable_token_counting override 2026-03-22 21:53:47 -07:00
Cargo.lock split wasm filter (#186) 2024-10-16 14:20:26 -07:00
Cargo.toml [ISSUE 706]: Standardize returned errors from Plano (#772) 2026-02-24 14:34:33 -08:00