Skip to content

HaloKim/mcp_template

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

mcp_template

mcp using vllm

ax

python -m vllm.entrypoints.openai.api_server --model skt/A.X-4.0 --host 0.0.0.0 --port 8000 --tensor-parallel-size 4 --max-model-len 32000 --gpu-memory-utilization 0.8 --tool-call-parser ax --enable-auto-tool-choice --chat-template /workspace/hr_jd_mcp/vllm/resource/ax.jinja --tool-parser-plugin /workspace/hr_jd_mcp/vllm/resource/ax.py 

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors