Repository navigation
Commit 28a00f9
committed
feat(turbo-kv): stage 2 — activate compressed KV attention pipeline
Full TurboKV pipeline now operational:
- Encode history → 3-bit PolarQuant (existing)
- Truncate hot cache to hot window (new)
- Decode + prepend history at every SDPA call (new)
RAM savings: ~5.5x on history tokens (3-bit vs 16-bit fp16)1 parent e141627 commit 28a00f9
1 file changed
Lines changed: 1 addition & 1 deletion
0 commit comments