Skip to content

[Feat] Add kv-test tool#987

Open
Fengli5355 wants to merge 2 commits into
ModelEngine-Group:feature_26h1from
Fengli5355:asu-dht
Open

[Feat] Add kv-test tool#987
Fengli5355 wants to merge 2 commits into
ModelEngine-Group:feature_26h1from
Fengli5355:asu-dht

Conversation

@Fengli5355
Copy link
Copy Markdown
Contributor

@Fengli5355 Fengli5355 commented May 30, 2026

Purpose

kv-test command tool.

Modifications

Implementation for kv-test tool.
Use local mode to store kv-cache in local file system.

Comment thread ucm/integration/vllm/patch/v0180/vllm/pc/config/vllm.py Outdated
Comment thread ucm/integration/vllm/patch/v0180/vllm/pc/v1/worker/gpu_model_runner.py Outdated
Comment thread ucm/integration/vllm/ucm_connector.py Outdated
Comment thread ucm/integration/vllm/ucm_connector.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants