Skip to content

Commit 28a00f9

Browse files
committed
feat(turbo-kv): stage 2 — activate compressed KV attention pipeline
Full TurboKV pipeline now operational: - Encode history → 3-bit PolarQuant (existing) - Truncate hot cache to hot window (new) - Decode + prepend history at every SDPA call (new) RAM savings: ~5.5x on history tokens (3-bit vs 16-bit fp16)
1 parent e141627 commit 28a00f9

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

0 commit comments

Comments
 (0)