Skip to content

fix: reuse one tokenizer instead of building one per countTokens call - #639

Open
kernel-oops wants to merge 1 commit into
Tarquinen:devfrom
kernel-oops:fix/reuse-tokenizer
Open

kernel-oops wants to merge 1 commit into
Tarquinen:devfrom
kernel-oops:fix/reuse-tokenizer

Commits

  1. Commits on Sep 28, 2026