Traceback (most recent call last):
File "/dotsocr/dotsocr_env/bin/vllm", line 5, in <module>
from DotsOCR import modeling_dots_ocr_vllm
File "/dotsocr/weights/DotsOCR/modeling_dots_ocr_vllm.py", line 10, in <module>
from vllm.model_executor.layers.sampler import SamplerOutput, get_sampler
ModuleNotFoundError: No module named 'vllm.model_executor.layers.sampler'
在尝试运行 DotsOCR 与 vLLM 集成的脚本
dotsocr/demo/launch_model_vllm.sh时,出现模块导入错误。具体 traceback 如下:vLLM version: 0.11.0
Possible cause:
vLLM 该版本已重构或移除了 vllm.model_executor.layers.sampler 模块。
vllm/model_executor/layers