Skip to content

add a Dockerfile for nano-vllm#178

Open
pacoxu wants to merge 1 commit intoGeeeekExplorer:mainfrom
pacoxu:dockerfile
Open

add a Dockerfile for nano-vllm#178
pacoxu wants to merge 1 commit intoGeeeekExplorer:mainfrom
pacoxu:dockerfile

Conversation

@pacoxu
Copy link
Copy Markdown

@pacoxu pacoxu commented Mar 3, 2026

This can help users run nano-vllm using docker.

docker build -t nano-vllm:local .

docker run --gpus all --rm -it \
  --shm-size=2g \
  -v ~/huggingface/Qwen3-0.6B:/models/Qwen3-0.6B \
  nano-vllm:local \
  python example.py

Previously, this was mentioned in #56.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant