Repository navigation

[None][feat] Add ZMQ KV-cache event tee with gap replay - #8

Merged

mohammed-deepinfra merged 4 commits into

deep-main-v1.3.0rc16from

mohammed/wip-kv-cache

Jun 23, 2026

Merged

[None][feat] Add ZMQ KV-cache event tee with gap replay#8
mohammed-deepinfra merged 4 commits into
deep-main-v1.3.0rc16from
mohammed/wip-kv-cache

Commits on Jun 4, 2026
- wip: kv cache indexer work
  mohammed-deepinfra
  committed
  3be21b7
Commits on Jun 15, 2026
- added replay endpoint, owned by a separate replay thread that shares a bounded buffer of events with the main publisher loop
  mohammed-deepinfra
  committed
  93c7b06
Commits on Jun 16, 2026
- updated to reflect vllm kv events format almost exactly
  mohammed-deepinfra
  committed
  64a705c
Commits on Jun 17, 2026
- endpoint and replay endpoing changed to vllm kv_events config
  mohammed-deepinfra
  committed
  c3032bd