Run FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py ERROR

[lukeewin]

Environment

• OS: Ubuntu server 24.04
• Python version: 3.12
• FunASR version: 源码编译安装的FunASR
• ModelScope version: 1.37.1
• PyTorch / torchaudio version: 2.6.0+cu124
• Install method (pip, source, Docker): pip
• Device (cuda, cpu, mps): cuda
• GPU model:
• CUDA/cuDNN version: 12.4
• Docker image tag, if used:

报错信息

执行 FunASR/examples/industrial_data_pretraining/fun_asr_nano 目录下的 serve_realtime_ws.py，执行命令如下：

python serve_realtime_ws.py     --port 10095     --model FunAudioLLM/Fun-ASR-Nano-2512     --hub hf     --device cuda:0     --decode-interval 0.48     --hotword-file 热词列表     --language 中文     --dtype bf16     --tensor-parallel-size 1     --gpu-memory-utilization 0.8     --max-model-len 2048

报错信息如下：

2026-05-25 10:57:39,765 [INFO] Loading ASR (vLLM): FunAudioLLM/Fun-ASR-Nano-2512
2026-05-25 10:57:39,875 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/revision/main "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0.00B [00:00, ?B/s]                                                                                                                                                                                2026-05-25 10:57:39,958 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 307 Temporary Redirect"         | 0/21 [00:00<?, ?it/s]
2026-05-25 10:57:39,961 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/merges.txt "HTTP/1.1 307 Temporary Redirect"
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-05-25 10:57:39,962 [WARNING] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-05-25 10:57:39,963 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 200 OK"
2026-05-25 10:57:39,964 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/generation_config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,965 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,966 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:39,967 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/tokenizer.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,968 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/tokenizer_config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,968 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B%2Fmerges.txt "HTTP/1.1 200 OK"
2026-05-25 10:57:39,970 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 200 OK"
Downloading (incomplete total...):   0%|                                                                                                                                                                   | 0.00/2.16k [00:00<?, ?B/s]2026-05-25 10:57:39,977 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 200 OK"
2026-05-25 10:57:39,987 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B%2Fmerges.txt "HTTP/1.1 200 OK"
Downloading (incomplete total...):   0%|▏                                                                                                                                                         | 2.16k/1.67M [00:00<01:25, 19.6kB/s2026-05-25 10:57:39,993 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 200 OK"      | 1/21 [00:00<00:02,  9.68it/s]
Downloading (incomplete total...):   1%|█▍                                                                                                                                                         | 15.2k/1.69M [00:00<00:12, 130kB/s]2026-05-25 10:57:40,056 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.69M/1.69M [00:00<00:00, 130kB/s]2026-05-25 10:57:40,057 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.69M/1.69M [00:00<00:00, 130kB/s]2026-05-25 10:57:40,059 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  13%|███████████████████▉                                                                                                                                       | 1.69M/13.1M [00:00<01:27, 130kB/s]2026-05-25 10:57:40,060 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  13%|███████████████████▉                                                                                                                                       | 1.69M/13.1M [00:00<01:27, 130kB/s]2026-05-25 10:57:40,063 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,069 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/vocab.json "HTTP/1.1 302 Found"
2026-05-25 10:57:40,070 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,071 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|████████████████▍                                                                                                                                          | 1.69M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,076 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 200 OK"
2026-05-25 10:57:40,079 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|████████████████▍                                                                                                                                          | 1.69M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,082 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|████████████████▌                                                                                                                                          | 1.70M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,084 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/configuration.json "HTTP/1.1 302 Found"
Downloading (incomplete total...):  11%|████████████████▌                                                                                                                                          | 1.70M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,153 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/en.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,158 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fen.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,159 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/ja.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,163 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fen.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|████████████████▉                                                                                                                                         | 1.76M/16.0M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,164 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fja.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,170 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fja.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|████████████████▉                                                                                                                                         | 1.76M/16.0M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,240 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/ko.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,246 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fko.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,249 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/yue.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,251 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fko.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|█████████████████▍                                                                                                                                        | 1.82M/16.1M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,254 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fyue.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,259 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fyue.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  11%|█████████████████▋                                                                                                                                        | 1.85M/16.1M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,326 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/zh.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,332 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fzh.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,337 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/compare_en.png "HTTP/1.1 302 Found"
2026-05-25 10:57:40,338 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fzh.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...):  12%|██████████████████                                                                                                                                        | 1.92M/16.3M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,474 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/compare_zh.png "HTTP/1.1 302 Found"
Downloading (incomplete total...):  81%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▌                             | 13.4M/16.5M [00:00<00:00, 20.1MB/s]2026-05-25 10:57:40,655 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/funasr-v2.png "HTTP/1.1 302 Found"       | 2/21 [00:00<00:07,  2.46it/s]
Downloading (incomplete total...):  94%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████         | 16.1M/17.1M [00:00<00:00, 20.1MB/s]2026-05-25 10:57:40,682 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,683 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/model.pt "HTTP/1.1 302 Found"
Downloading (incomplete total...):   1%|█▏                                                                                                                                                        | 16.1M/1.99G [00:00<01:37, 20.1MB/s]2026-05-25 10:57:40,687 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 200 OK"
2026-05-25 10:57:40,692 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 200 OK"
Fetching 21 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 21/21 [00:04<00:00,  4.64it/s]
Download complete: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [00:04<00:00, 708MB/s]INFO 05-25 10:57:44 [importing.py:53] Triton module has been replaced with a placeholder.
INFO 05-25 10:57:45 [__init__.py:239] Automatically detected platform cuda.
Download complete: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [00:06<00:00, 297MB/s]
Traceback (most recent call last):
  File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 518, in <module>
    asyncio.run(main(args))
  File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 493, in main
    load_models(args)
  File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 409, in load_models
    _vllm_engine = AutoModelVLLM(
                   ^^^^^^^^^^^^^^
  File "/usr/local/src/FunASR/funasr/auto/auto_model_vllm.py", line 242, in __init__
    self._engine = FunASRNanoVLLM(
                   ^^^^^^^^^^^^^^^
  File "/usr/local/src/FunASR/funasr/models/fun_asr_nano/inference_vllm.py", line 170, in __init__
    from vllm.inputs.data import EmbedsPrompt
ImportError: cannot import name 'EmbedsPrompt' from 'vllm.inputs.data' (/usr/local/src/.venv/lib/python3.12/site-packages/vllm/inputs/data.py). Did you mean: 'TokensPrompt'?

看报错似乎是vllm的版本问题，请问这个vllm应该使用哪个版本？或者是不是其它原因导致的？

[lukeewin]

Environment

• OS: Ubuntu server 24.04
• Python version: 3.12
• FunASR version: 源码编译安装的FunASR
• ModelScope version: 1.37.1
• PyTorch / torchaudio version: 2.6.0+cu124
• Install method (pip, source, Docker): pip
• Device (cuda, cpu, mps): cuda
• GPU model:
• CUDA/cuDNN version: 12.4
• Docker image tag, if used:

报错信息

执行 FunASR/examples/industrial_data_pretraining/fun_asr_nano 目录下的 serve_realtime_ws.py，执行命令如下：

python serve_realtime_ws.py --port 10095 --model FunAudioLLM/Fun-ASR-Nano-2512 --hub hf --device cuda:0 --decode-interval 0.48 --hotword-file 热词列表 --language 中文 --dtype bf16 --tensor-parallel-size 1 --gpu-memory-utilization 0.8 --max-model-len 2048
报错信息如下：

2026-05-25 10:57:39,765 [INFO] Loading ASR (vLLM): FunAudioLLM/Fun-ASR-Nano-2512
2026-05-25 10:57:39,875 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/revision/main "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0.00B [00:00, ?B/s] 2026-05-25 10:57:39,958 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 307 Temporary Redirect" | 0/21 [00:00<?, ?it/s]
2026-05-25 10:57:39,961 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/merges.txt "HTTP/1.1 307 Temporary Redirect"
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-05-25 10:57:39,962 [WARNING] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-05-25 10:57:39,963 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 200 OK"
2026-05-25 10:57:39,964 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/generation_config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,965 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,966 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:39,967 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/tokenizer.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,968 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/tokenizer_config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,968 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B%2Fmerges.txt "HTTP/1.1 200 OK"
2026-05-25 10:57:39,970 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%| | 0.00/2.16k [00:00<?, ?B/s]2026-05-25 10:57:39,977 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 200 OK"
2026-05-25 10:57:39,987 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B%2Fmerges.txt "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%|▏ | 2.16k/1.67M [00:00<01:25, 19.6kB/s2026-05-25 10:57:39,993 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 200 OK" | 1/21 [00:00<00:02, 9.68it/s]
Downloading (incomplete total...): 1%|█▍ | 15.2k/1.69M [00:00<00:12, 130kB/s]2026-05-25 10:57:40,056 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.69M/1.69M [00:00<00:00, 130kB/s]2026-05-25 10:57:40,057 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.69M/1.69M [00:00<00:00, 130kB/s]2026-05-25 10:57:40,059 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 13%|███████████████████▉ | 1.69M/13.1M [00:00<01:27, 130kB/s]2026-05-25 10:57:40,060 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 13%|███████████████████▉ | 1.69M/13.1M [00:00<01:27, 130kB/s]2026-05-25 10:57:40,063 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,069 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/vocab.json "HTTP/1.1 302 Found"
2026-05-25 10:57:40,070 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,071 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▍ | 1.69M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,076 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 200 OK"
2026-05-25 10:57:40,079 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▍ | 1.69M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,082 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▌ | 1.70M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,084 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/configuration.json "HTTP/1.1 302 Found"
Downloading (incomplete total...): 11%|████████████████▌ | 1.70M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,153 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/en.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,158 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fen.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,159 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/ja.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,163 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fen.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▉ | 1.76M/16.0M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,164 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fja.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,170 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fja.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▉ | 1.76M/16.0M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,240 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/ko.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,246 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fko.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,249 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/yue.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,251 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fko.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|█████████████████▍ | 1.82M/16.1M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,254 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fyue.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,259 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fyue.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|█████████████████▋ | 1.85M/16.1M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,326 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/zh.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,332 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fzh.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,337 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/compare_en.png "HTTP/1.1 302 Found"
2026-05-25 10:57:40,338 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fzh.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 12%|██████████████████ | 1.92M/16.3M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,474 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/compare_zh.png "HTTP/1.1 302 Found"
Downloading (incomplete total...): 81%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▌ | 13.4M/16.5M [00:00<00:00, 20.1MB/s]2026-05-25 10:57:40,655 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/funasr-v2.png "HTTP/1.1 302 Found" | 2/21 [00:00<00:07, 2.46it/s]
Downloading (incomplete total...): 94%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████ | 16.1M/17.1M [00:00<00:00, 20.1MB/s]2026-05-25 10:57:40,682 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,683 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/model.pt "HTTP/1.1 302 Found"
Downloading (incomplete total...): 1%|█▏ | 16.1M/1.99G [00:00<01:37, 20.1MB/s]2026-05-25 10:57:40,687 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 200 OK"
2026-05-25 10:57:40,692 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 200 OK"
Fetching 21 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 21/21 [00:04<00:00, 4.64it/s]
Download complete: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [00:04<00:00, 708MB/s]INFO 05-25 10:57:44 [importing.py:53] Triton module has been replaced with a placeholder.
INFO 05-25 10:57:45 [init.py:239] Automatically detected platform cuda.
Download complete: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [00:06<00:00, 297MB/s]
Traceback (most recent call last):
File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 518, in
asyncio.run(main(args))
File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 493, in main
load_models(args)
File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 409, in load_models
_vllm_engine = AutoModelVLLM(
^^^^^^^^^^^^^^
File "/usr/local/src/FunASR/funasr/auto/auto_model_vllm.py", line 242, in init
self._engine = FunASRNanoVLLM(
^^^^^^^^^^^^^^^
File "/usr/local/src/FunASR/funasr/models/fun_asr_nano/inference_vllm.py", line 170, in init
from vllm.inputs.data import EmbedsPrompt
ImportError: cannot import name 'EmbedsPrompt' from 'vllm.inputs.data' (/usr/local/src/.venv/lib/python3.12/site-packages/vllm/inputs/data.py). Did you mean: 'TokensPrompt'?
看报错似乎是vllm的版本问题，请问这个vllm应该使用哪个版本？或者是不是其它原因导致的？

目前的vllm版本是0.8.5.post1

[lukeewin]

Environment

• OS: Ubuntu server 24.04
• Python version: 3.12
• FunASR version: 源码编译安装的FunASR
• ModelScope version: 1.37.1
• PyTorch / torchaudio version: 2.6.0+cu124
• Install method (pip, source, Docker): pip
• Device (cuda, cpu, mps): cuda
• GPU model:
• CUDA/cuDNN version: 12.4
• Docker image tag, if used:

报错信息

执行 FunASR/examples/industrial_data_pretraining/fun_asr_nano 目录下的 serve_realtime_ws.py，执行命令如下：

python serve_realtime_ws.py --port 10095 --model FunAudioLLM/Fun-ASR-Nano-2512 --hub hf --device cuda:0 --decode-interval 0.48 --hotword-file 热词列表 --language 中文 --dtype bf16 --tensor-parallel-size 1 --gpu-memory-utilization 0.8 --max-model-len 2048
报错信息如下：

2026-05-25 10:57:39,765 [INFO] Loading ASR (vLLM): FunAudioLLM/Fun-ASR-Nano-2512
2026-05-25 10:57:39,875 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/revision/main "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0.00B [00:00, ?B/s] 2026-05-25 10:57:39,958 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 307 Temporary Redirect" | 0/21 [00:00<?, ?it/s]
2026-05-25 10:57:39,961 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/merges.txt "HTTP/1.1 307 Temporary Redirect"
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-05-25 10:57:39,962 [WARNING] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
2026-05-25 10:57:39,963 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 200 OK"
2026-05-25 10:57:39,964 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/generation_config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,965 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,966 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:39,967 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/tokenizer.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,968 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/tokenizer_config.json "HTTP/1.1 302 Found"
2026-05-25 10:57:39,968 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B%2Fmerges.txt "HTTP/1.1 200 OK"
2026-05-25 10:57:39,970 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/.gitattributes "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%| | 0.00/2.16k [00:00<?, ?B/s]2026-05-25 10:57:39,977 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 200 OK"
2026-05-25 10:57:39,987 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B%2Fmerges.txt "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%|▏ | 2.16k/1.67M [00:00<01:25, 19.6kB/s2026-05-25 10:57:39,993 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README.md "HTTP/1.1 200 OK" | 1/21 [00:00<00:02, 9.68it/s]
Downloading (incomplete total...): 1%|█▍ | 15.2k/1.69M [00:00<00:12, 130kB/s]2026-05-25 10:57:40,056 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.69M/1.69M [00:00<00:00, 130kB/s]2026-05-25 10:57:40,057 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.69M/1.69M [00:00<00:00, 130kB/s]2026-05-25 10:57:40,059 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 13%|███████████████████▉ | 1.69M/13.1M [00:00<01:27, 130kB/s]2026-05-25 10:57:40,060 [INFO] HTTP Request: GET https://huggingface.co/api/models/FunAudioLLM/Fun-ASR-Nano-2512/xet-read-token/abb99a38f83a40128cd11bf183315bfa245b69e2 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 13%|███████████████████▉ | 1.69M/13.1M [00:00<01:27, 130kB/s]2026-05-25 10:57:40,063 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,069 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/Qwen3-0.6B/vocab.json "HTTP/1.1 302 Found"
2026-05-25 10:57:40,070 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,071 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▍ | 1.69M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,076 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 200 OK"
2026-05-25 10:57:40,079 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/README_zh.md "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▍ | 1.69M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,082 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/config.yaml "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▌ | 1.70M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,084 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/configuration.json "HTTP/1.1 302 Found"
Downloading (incomplete total...): 11%|████████████████▌ | 1.70M/15.9M [00:00<01:49, 130kB/s]2026-05-25 10:57:40,153 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/en.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,158 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fen.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,159 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/ja.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,163 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fen.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▉ | 1.76M/16.0M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,164 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fja.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,170 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fja.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|████████████████▉ | 1.76M/16.0M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,240 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/ko.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,246 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fko.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,249 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/yue.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,251 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fko.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|█████████████████▍ | 1.82M/16.1M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,254 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fyue.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,259 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fyue.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 11%|█████████████████▋ | 1.85M/16.1M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,326 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/example/zh.mp3 "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,332 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fzh.mp3 "HTTP/1.1 200 OK"
2026-05-25 10:57:40,337 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/compare_en.png "HTTP/1.1 302 Found"
2026-05-25 10:57:40,338 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/example%2Fzh.mp3 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 12%|██████████████████ | 1.92M/16.3M [00:00<00:02, 6.98MB/s]2026-05-25 10:57:40,474 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/compare_zh.png "HTTP/1.1 302 Found"
Downloading (incomplete total...): 81%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▌ | 13.4M/16.5M [00:00<00:00, 20.1MB/s]2026-05-25 10:57:40,655 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/images/funasr-v2.png "HTTP/1.1 302 Found" | 2/21 [00:00<00:07, 2.46it/s]
Downloading (incomplete total...): 94%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████ | 16.1M/17.1M [00:00<00:00, 20.1MB/s]2026-05-25 10:57:40,682 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 307 Temporary Redirect"
2026-05-25 10:57:40,683 [INFO] HTTP Request: HEAD https://huggingface.co/FunAudioLLM/Fun-ASR-Nano-2512/resolve/abb99a38f83a40128cd11bf183315bfa245b69e2/model.pt "HTTP/1.1 302 Found"
Downloading (incomplete total...): 1%|█▏ | 16.1M/1.99G [00:00<01:37, 20.1MB/s]2026-05-25 10:57:40,687 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 200 OK"
2026-05-25 10:57:40,692 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/FunAudioLLM/Fun-ASR-Nano-2512/abb99a38f83a40128cd11bf183315bfa245b69e2/multilingual.tiktoken "HTTP/1.1 200 OK"
Fetching 21 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 21/21 [00:04<00:00, 4.64it/s]
Download complete: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [00:04<00:00, 708MB/s]INFO 05-25 10:57:44 [importing.py:53] Triton module has been replaced with a placeholder.
INFO 05-25 10:57:45 [init.py:239] Automatically detected platform cuda.
Download complete: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [00:06<00:00, 297MB/s]
Traceback (most recent call last):
File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 518, in
asyncio.run(main(args))
File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 493, in main
load_models(args)
File "/usr/local/src/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 409, in load_models
_vllm_engine = AutoModelVLLM(
^^^^^^^^^^^^^^
File "/usr/local/src/FunASR/funasr/auto/auto_model_vllm.py", line 242, in init
self._engine = FunASRNanoVLLM(
^^^^^^^^^^^^^^^
File "/usr/local/src/FunASR/funasr/models/fun_asr_nano/inference_vllm.py", line 170, in init
from vllm.inputs.data import EmbedsPrompt
ImportError: cannot import name 'EmbedsPrompt' from 'vllm.inputs.data' (/usr/local/src/.venv/lib/python3.12/site-packages/vllm/inputs/data.py). Did you mean: 'TokensPrompt'?
看报错似乎是vllm的版本问题，请问这个vllm应该使用哪个版本？或者是不是其它原因导致的？

这边是使用uv pip install vllm --torch-backend=cu124命令安装的vllm

[LauraGPT]

这是 vLLM 版本不兼容的问题。EmbedsPrompt 需要 vLLM >= 0.12.0。

请升级 vLLM：

pip install "vllm>=0.12.0"

版本要求在 vLLM 推理指南 中有说明。

如果升级后仍有问题，请提供 pip show vllm 的输出。

[lukeewin]

这是 vLLM 版本不兼容的问题。EmbedsPrompt 需要 vLLM >= 0.12.0。

请升级 vLLM：

pip install "vllm>=0.12.0"
版本要求在 vLLM 推理指南 中有说明。

如果升级后仍有问题，请提供 pip show vllm 的输出。

升级了vllm版本为0.21版本，还是会报错，似乎还是vllm版本问题。报错信息如下：

(asr) root@autodl-container-nhlkvm5e5b-924c9eb0:~/autodl-tmp/asr/FunASR/examples/industrial_data_pretraining/fun_asr_nano# uv run  python serve_realtime_ws.py --port 10095 --model FunAudioLLM/Fun-ASR-Nano-2512 --hub ms --device cuda:0 --decode-interval 0.48 --hotword-file 热词列表 --language 中文 --dtype bf16 --tensor-parallel-size 1 --gpu-memory-utilization 0.8 --max-model-len 2048
2026-05-26 05:32:22,916 [INFO] Loading ASR (vLLM): FunAudioLLM/Fun-ASR-Nano-2512
Downloading Model from https://www.modelscope.cn to directory: /root/.cache/modelscope/hub/models/FunAudioLLM/Fun-ASR-Nano-2512
2026-05-26 05:32:23,874 - modelscope - INFO - Got 20 files, start to download ...
Downloading [example/en.mp3]: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 56.1k/56.1k [00:00<00:00, 154kB/s]
Downloading [Qwen3-0.6B/config.json]: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 726/726 [00:00<00:00, 1.54kB/s]
Downloading [Qwen3-0.6B/generation_config.json]: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 239/239 [00:00<00:00, 503B/s]
Downloading [config.yaml]: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3.07k/3.07k [00:00<00:00, 6.51kB/s]
Downloading [configuration.json]: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 398/398 [00:00<00:00, 821B/s]
Downloading [images/funasr-v2.png]: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 597k/597k [00:00<00:00, 1.17MB/s]
Downloading [example/ja.mp3]: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 56.5k/56.5k [00:00<00:00, 309kB/s]
Downloading [example/ko.mp3]: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 27.3k/27.3k [00:00<00:00, 165kB/s]
Downloading [images/compare_en.png]: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 209k/209k [00:00<00:00, 304kB/s]
Downloading [Qwen3-0.6B/merges.txt]: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.59M/1.59M [00:00<00:00, 6.04MB/s]
Downloading [images/compare_zh.png]: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 158k/158k [00:00<00:00, 202kB/s]
Downloading [README.md]: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 12.7k/12.7k [00:00<00:00, 46.1kB/s]
Downloading [README_zh.md]: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 12.0k/12.0k [00:00<00:00, 42.8kB/s]
Downloading [Qwen3-0.6B/tokenizer_config.json]: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9.50k/9.50k [00:00<00:00, 34.9kB/s]
Downloading [multilingual.tiktoken]: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 886k/886k [00:00<00:00, 1.98MB/s]
Downloading [example/yue.mp3]: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30.5k/30.5k [00:00<00:00, 35.6kB/s]
Downloading [example/zh.mp3]: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 43.9k/43.9k [00:01<00:00, 40.8kB/s]
Downloading [Qwen3-0.6B/vocab.json]: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.65M/2.65M [00:21<00:00, 130kB/s]
Downloading [Qwen3-0.6B/tokenizer.json]: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10.9M/10.9M [02:45<00:00, 69.0kB/s]
Downloading [model.pt]: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.98G/1.98G [02:59<00:00, 11.9MB/s]
Processing 20 items: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20.0/20.0 [02:59<00:00, 8.98s/it]
2026-05-26 05:35:23,521 - modelscope - INFO - Finish downloading 20 files for repo 'FunAudioLLM/Fun-ASR-Nano-2512'████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10.9M/10.9M [02:45<00:00, 61.9kB/s]
Traceback (most recent call last):██████████████████▏                                                                                                                                                                              | 238M/1.98G [00:21<02:40, 11.7MB/s]
  File "/root/autodl-tmp/asr/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 518, in <module>████████████████████████████████████████████████████████████████████████████████▉               | 1.83G/1.98G [02:45<00:13, 11.8MB/s]
    asyncio.run(main(args))%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 1.98G/1.98G [02:58<00:00, 12.0MB/s]
  File "/root/miniconda3/lib/python3.12/asyncio/runners.py", line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/root/autodl-tmp/asr/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 493, in main
    load_models(args)
  File "/root/autodl-tmp/asr/FunASR/examples/industrial_data_pretraining/fun_asr_nano/serve_realtime_ws.py", line 409, in load_models
    _vllm_engine = AutoModelVLLM(
                   ^^^^^^^^^^^^^^
  File "/root/autodl-tmp/asr/FunASR/funasr/auto/auto_model_vllm.py", line 242, in __init__
    self._engine = FunASRNanoVLLM(
                   ^^^^^^^^^^^^^^^
  File "/root/autodl-tmp/asr/FunASR/funasr/models/fun_asr_nano/inference_vllm.py", line 170, in __init__
    from vllm.inputs.data import EmbedsPrompt
ModuleNotFoundError: No module named 'vllm.inputs.data'
(asr) root@autodl-container-nhlkvm5e5b-924c9eb0:~/autodl-tmp/asr/FunASR/examples/industrial_data_pretraining/fun_asr_nano# uv pip show vllm
Using Python 3.12.3 environment at: /root/autodl-tmp/asr/.venv
Name: vllm
Version: 0.21.1rc1.dev278+gd4004455d
Location: /root/autodl-tmp/asr/.venv/lib/python3.12/site-packages
Requires: aiohttp, anthropic, apache-tvm-ffi, blake3, cachetools, cbor2, cloudpickle, compressed-tensors, depyf, diskcache, einops, fastapi, fastsafetensors, filelock, flashinfer-cubin, flashinfer-python, gguf, ijson, lark, llguidance, lm-format-enforcer, mcp, mistral-common, model-hosting-container-standards, msgspec, ninja, numba, numpy, nvidia-cudnn-frontend, nvidia-cutlass-dsl, openai, openai-harmony, opencv-python-headless, opentelemetry-api, opentelemetry-exporter-otlp, opentelemetry-sdk, opentelemetry-semantic-conventions-ai, outlines-core, partial-json-parser, pillow, prometheus-client, prometheus-fastapi-instrumentator, protobuf, psutil, py-cpuinfo, pybase64, pydantic, python-json-logger, pyyaml, pyzmq, quack-kernels, regex, requests, safetensors, sentencepiece, setproctitle, setuptools, six, tiktoken, tilelang, tokenizers, tokenspeed-mla, torch, torchaudio, torchvision, tqdm, transformers, typing-extensions, watchfiles, xgrammar
Required-by: