Skip to content

No module named 'vllm.model_executor.layers.sampler' #267

@tianyumyum

Description

@tianyumyum

在尝试运行 DotsOCR 与 vLLM 集成的脚本dotsocr/demo/launch_model_vllm.sh时,出现模块导入错误。具体 traceback 如下:

Traceback (most recent call last):
  File "/dotsocr/dotsocr_env/bin/vllm", line 5, in <module>
    from DotsOCR import modeling_dots_ocr_vllm
  File "/dotsocr/weights/DotsOCR/modeling_dots_ocr_vllm.py", line 10, in <module>
    from vllm.model_executor.layers.sampler import SamplerOutput, get_sampler
ModuleNotFoundError: No module named 'vllm.model_executor.layers.sampler'

vLLM version: 0.11.0

Possible cause:
vLLM 该版本已重构或移除了 vllm.model_executor.layers.sampler 模块。
vllm/model_executor/layers

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions