Just gonna drop this dockerfile for anyone that wants it :)

[jnc-nj]

FROM swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pytorch/pytorch:2.5.1-cuda12.4-cudnn9-devel

RUN  sed -i s@/archive.ubuntu.com/@/mirrors.aliyun.com/@g /etc/apt/sources.list
RUN  sed -i s@/security.ubuntu.com/@/mirrors.aliyun.com/@g /etc/apt/sources.list

RUN apt-get update && apt-get install -y git

RUN git clone https://www.ghproxy.cn/https://github.com/bytedance-seed/BAGEL.git
WORKDIR BAGEL
RUN pip install -i https://pypi.tuna.tsinghua.edu.cn/simple -r requirements.txt
RUN pip install -i https://pypi.tuna.tsinghua.edu.cn/simple gradio huggingface_hub

RUN apt-get install -y libgl1-mesa-glx
RUN apt-get install -y libglib2.0-0

ENTRYPOINT ["python3", "app.py", "--server_name", "0.0.0.0"]

[Andy1621]

Cool!

[yakovkhalinsky]

Finally had some time to digest this Dockerfile and try it out for myself, here is an adjusted one without the CN proxies and URLs

FROM pytorch/pytorch:2.5.1-cuda12.4-cudnn9-devel

RUN apt-get update && apt-get install -y git

WORKDIR /app

RUN git clone https://github.com/bytedance-seed/BAGEL.git .

RUN pip install -r requirements.txt
RUN pip install gradio huggingface_hub
RUN pip install flash-attn --no-build-isolation

RUN apt-get install -y libgl1-mesa-glx
RUN apt-get install -y libglib2.0-0

ENTRYPOINT ["python3", "app.py", "--server_name", "0.0.0.0"]

Thanks to the OP @jnc-nj for the original content above, the secret here seems to be running a base image with the correct versions of pytorch and cuda.

My only addition was the line to install flash-attn