Model server Docker images (v3.1.0+, latest, craft-latest) have corrupted Python packages

[Dustpan95]

Description

The onyxdotapp/onyx-model-server Docker images for craft-latest, latest, and v3.1.0 have corrupted Python site-packages. Every .py file in /usr/local/lib/python3.11/site-packages/ appears to be 0 bytes, including critical packages like uvicorn, torch, typing_extensions, and websockets.

Reproduction

# All of these fail:
docker run --rm --entrypoint python onyxdotapp/onyx-model-server:craft-latest -c "from uvicorn.main import main"
# ImportError: cannot import name 'main' from 'uvicorn.main'

docker run --rm --entrypoint python onyxdotapp/onyx-model-server:craft-latest -c "import torch"
# ImportError: cannot import name 'ParamSpec' from 'typing_extensions'

docker run --rm --entrypoint python onyxdotapp/onyx-model-server:craft-latest -c "print(dir(uvicorn.main))"
# []  (empty module)

# v3.0.6 works fine:
docker run --rm --entrypoint python onyxdotapp/onyx-model-server:v3.0.6 -c "from uvicorn.main import main; import torch; print('OK')"
# OK

Affected tags

• craft-latest (2026-03-26)
• latest (2026-03-26)
• v3.1.0 (2026-03-26)

Working tags

• v3.0.6 (2026-03-26) — last known working image

Impact

The model server containers (inference_model_server and indexing_model_server) crash-loop immediately on startup. Users deploying with floating tags get a completely broken Onyx installation.

Environment

• Docker on Ubuntu (x86_64/amd64)
• Self-hosted deployment via docker-compose