docker.io/xprobe/xinference:v2.10.0 linux/amd64

docker.io/xprobe/xinference:v2.10.0 - 国内下载镜像源 浏览次数:35
XinInference 是一个基于 Docker 的容器镜像,旨在提供一个简单、易用的机器学习推断环境。该镜像包含了 TensorFlow、PyTorch 和 scikit-learn 等常见的深度学习框架,可以用来快速 prototyping 和开发机器学习模型。
源镜像 docker.io/xprobe/xinference:v2.10.0
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0
镜像ID sha256:7fee68373d554221fe9dbd2da3967cb2cb69c95a5e2789c20924d8ab1b7f8d3c
镜像TAG v2.10.0
大小 35.21GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /bin/bash
启动入口
工作目录 /opt/inference
OS/平台 linux/amd64
浏览量 35 次
贡献者
镜像创建 2026-06-06T00:34:12.835428163Z
同步时间 2026-06-17 01:13
环境变量
PATH=/usr/local/nvm/versions/node/v14.21.1/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=13.0 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 brand=unknown,driver>=570,driver<571 brand=grid,driver>=570,driver<571 brand=tesla,driver>=570,driver<571 brand=nvidia,driver>=570,driver<571 brand=quadro,driver>=570,driver<571 brand=quadrortx,driver>=570,driver<571 brand=nvidiartx,driver>=570,driver<571 brand=vapps,driver>=570,driver<571 brand=vpc,driver>=570,driver<571 brand=vcs,driver>=570,driver<571 brand=vws,driver>=570,driver<571 brand=cloudgaming,driver>=570,driver<571 brand=unknown,driver>=575,driver<576 brand=grid,driver>=575,driver<576 brand=tesla,driver>=575,driver<576 brand=nvidia,driver>=575,driver<576 brand=quadro,driver>=575,driver<576 brand=quadrortx,driver>=575,driver<576 brand=nvidiartx,driver>=575,driver<576 brand=vapps,driver>=575,driver<576 brand=vpc,driver>=575,driver<576 brand=vcs,driver>=575,driver<576 brand=vws,driver>=575,driver<576 brand=cloudgaming,driver>=575,driver<576 NV_CUDA_CUDART_VERSION=13.0.96-1 CUDA_VERSION=13.0.2 LD_LIBRARY_PATH=/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/lib/python3.12/dist-packages/nvidia/cublas/lib NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility DEBIAN_FRONTEND=noninteractive UV_HTTP_TIMEOUT=500 UV_INDEX_STRATEGY=unsafe-best-match UV_LINK_MODE=copy VLLM_ENABLE_CUDA_COMPATIBILITY=0 TORCH_CUDA_ARCH_LIST=7.5 8.0 8.6 8.9 9.0 10.0 12.0+PTX VLLM_USAGE_SOURCE=production-docker-image VLLM_BUILD_COMMIT=ad7125a431e176d4161099480a66f0169609a690 VLLM_BUILD_PIPELINE=019d130e-464e-4ff7-b84b-492992c0c06b VLLM_BUILD_URL=https://buildkite.com/vllm/release-v2/builds/1649 VLLM_IMAGE_TAG=vllm/vllm-openai:v0.21.0 NVM_DIR=/usr/local/nvm NODE_VERSION=14.21.1
镜像标签
ad7125a431e176d4161099480a66f0169609a690: ai.vllm.build.commit 019d130e-464e-4ff7-b84b-492992c0c06b: ai.vllm.build.pipeline https://buildkite.com/vllm/release-v2/builds/1649: ai.vllm.build.url vllm/vllm-openai:v0.21.0: ai.vllm.image.tag NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer ubuntu: org.opencontainers.image.ref.name ad7125a431e176d4161099480a66f0169609a690: org.opencontainers.image.revision https://github.com/vllm-project/vllm: org.opencontainers.image.source https://buildkite.com/vllm/release-v2/builds/1649: org.opencontainers.image.url vllm/vllm-openai:v0.21.0: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0  docker.io/xprobe/xinference:v2.10.0

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0  docker.io/xprobe/xinference:v2.10.0

Shell快速替换命令

sed -i 's#xprobe/xinference:v2.10.0#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0  docker.io/xprobe/xinference:v2.10.0'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0  docker.io/xprobe/xinference:v2.10.0'

镜像构建历史


# 2026-06-06 08:34:12  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2026-06-06 08:34:12  0.00B 
/bin/sh -c #(nop)  ENTRYPOINT []
                        
# 2026-06-06 08:34:12  6.25MB 
|2 LLAMA_CPP_USE_CUDA=true PIP_INDEX=https://pypi.org/simple /bin/sh -c pip install torchcodec==0.10.0 &&     pip cache purge
                        
# 2026-06-06 08:34:06  488.09MB 
|2 LLAMA_CPP_USE_CUDA=true PIP_INDEX=https://pypi.org/simple /bin/sh -c /opt/conda/bin/conda create -n ffmpeg-env -c conda-forge 'ffmpeg<7' -y &&     ln -s /opt/conda/envs/ffmpeg-env/bin/ffmpeg /usr/local/bin/ffmpeg &&     ln -s /opt/conda/envs/ffmpeg-env/bin/ffprobe /usr/local/bin/ffprobe &&     /opt/conda/bin/conda clean --all -y
                        
# 2026-06-06 08:29:18  285.49MB 
|2 LLAMA_CPP_USE_CUDA=true PIP_INDEX=https://pypi.org/simple /bin/sh -c wget -O Miniforge3.sh "https://github.com/conda-forge/miniforge/releases/download/4.12.0-0/Miniforge3-4.12.0-0-Linux-x86_64.sh" &&     bash Miniforge3.sh -b -p /opt/conda &&     rm Miniforge3.sh
                        
# 2026-06-06 08:28:55  9.72GB 
|2 LLAMA_CPP_USE_CUDA=true PIP_INDEX=https://pypi.org/simple /bin/sh -c pip install --upgrade -i "$PIP_INDEX" pip "setuptools<82" wheel &&     apt-get -y update &&     ( wget -O openfst-1.7.2.tar.gz http://www.openslr.org/resources/2/openfst-1.7.2.tar.gz       || wget -O openfst-1.7.2.tar.gz https://www.openfst.org/twiki/pub/FST/FstDownload/openfst-1.7.2.tar.gz ) &&     tar zxvf openfst-1.7.2.tar.gz && cd openfst-1.7.2 &&     ./configure --enable-shared --enable-static && make -j$(nproc) && make install && ldconfig &&     CPLUS_INCLUDE_PATH=/usr/local/include LIBRARY_PATH=/usr/local/lib LD_LIBRARY_PATH=/usr/local/lib:$LD_LIBRARY_PATH     pip install -i "$PIP_INDEX" pynini==2.1.6.post1 &&     apt install -y wget curl procps git libgl1 rsync sqlite libpcre3 libpcre3-dev dmidecode libssl-dev perl make build-essential zlib1g-dev &&     apt-get -yq clean &&     pip install -i "$PIP_INDEX" "diskcache>=5.6.1" "jinja2>=2.11.3" &&     pip install -i "$PIP_INDEX" "cython>=0.29" &&     pip install -i "$PIP_INDEX" --upgrade-strategy only-if-needed -r /opt/inference/xinference/deploy/docker/requirements/requirements-base.txt &&     pip install -i "$PIP_INDEX" --upgrade-strategy only-if-needed -r /opt/inference/xinference/deploy/docker/requirements/requirements-ml.txt &&     pip install -i "$PIP_INDEX" --upgrade-strategy only-if-needed -r /opt/inference/xinference/deploy/docker/requirements/requirements-models.txt &&     pip install -i "$PIP_INDEX" transformers==5.5.0 &&     pip install -i "$PIP_INDEX" --no-deps sglang==0.5.6 &&     pip install -i "$PIP_INDEX" sgl-kernel==0.3.18.post2 &&     pip install -i "$PIP_INDEX" wetext &&     pip uninstall flashinfer -y &&     pip install -i "$PIP_INDEX" SQLAlchemy==1.4.54 &&     pip install https://github.com/mjun0812/flash-attention-prebuild-wheels/releases/download/v0.9.4/flash_attn-2.8.3+cu130torch2.11-cp312-cp312-linux_x86_64.whl &&     cd /opt/inference &&     python3 setup.py build_web &&     git restore . &&     pip install -i "$PIP_INDEX" --no-deps "." &&     pip uninstall xllamacpp -y &&     pip install xllamacpp --index-url https://xorbitsai.github.io/xllamacpp/whl/cu128 &&     pip cache purge
                        
# 2026-06-06 08:11:07  0.00B 
/bin/sh -c #(nop)  ARG PIP_INDEX=https://pypi.org/simple
                        
# 2026-06-06 08:11:07  0.00B 
/bin/sh -c #(nop)  ARG LLAMA_CPP_USE_CUDA=true
                        
# 2026-06-06 08:11:07  0.00B 
/bin/sh -c #(nop)  ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/lib/python3.12/dist-packages/nvidia/cublas/lib
                        
# 2026-06-06 08:11:06  0.00B 
/bin/sh -c #(nop)  ENV PATH=/usr/local/nvm/versions/node/v14.21.1/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2026-06-06 08:11:03  424.49MB 
/bin/sh -c apt-get -y update   && apt install -y wget curl procps git libgl1 libfst-dev cmake libssl-dev   && printf "\ndeb https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ jammy main restricted universe multiverse" >> /etc/apt/sources.list   && apt-get -y update   && apt-get install -y --only-upgrade libstdc++6 && apt install -y libc6   && mkdir -p $NVM_DIR   && curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.7/install.sh | bash   && . $NVM_DIR/nvm.sh   && nvm install $NODE_VERSION   && nvm alias default $NODE_VERSION   && nvm use default   && apt-get -yq clean
                        
# 2026-06-06 08:10:29  0.00B 
/bin/sh -c #(nop)  ENV NODE_VERSION=14.21.1
                        
# 2026-06-06 08:10:29  0.00B 
/bin/sh -c #(nop)  ENV NVM_DIR=/usr/local/nvm
                        
# 2026-06-06 08:10:29  0.00B 
/bin/sh -c #(nop) WORKDIR /opt/inference
                        
# 2026-06-06 08:10:22  297.28MB 
/bin/sh -c #(nop) COPY dir:ed6b5cb1f83b9c62223ba8b53e8d301d06f532531f8549286fde0c2afc54ca12 in /opt/inference 
                        
# 2026-05-15 13:00:10  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["vllm" "serve"]
                        
# 2026-05-15 13:00:10  0.00B 添加元数据标签
LABEL org.opencontainers.image.source=https://github.com/vllm-project/vllm org.opencontainers.image.revision=ad7125a431e176d4161099480a66f0169609a690 org.opencontainers.image.version=vllm/vllm-openai:v0.21.0 org.opencontainers.image.url=https://buildkite.com/vllm/release-v2/builds/1649 ai.vllm.build.commit=ad7125a431e176d4161099480a66f0169609a690 ai.vllm.build.pipeline=019d130e-464e-4ff7-b84b-492992c0c06b ai.vllm.build.url=https://buildkite.com/vllm/release-v2/builds/1649 ai.vllm.image.tag=vllm/vllm-openai:v0.21.0
                        
# 2026-05-15 13:00:10  0.00B 设置环境变量 VLLM_BUILD_COMMIT VLLM_BUILD_PIPELINE VLLM_BUILD_URL VLLM_IMAGE_TAG
ENV VLLM_BUILD_COMMIT=ad7125a431e176d4161099480a66f0169609a690 VLLM_BUILD_PIPELINE=019d130e-464e-4ff7-b84b-492992c0c06b VLLM_BUILD_URL=https://buildkite.com/vllm/release-v2/builds/1649 VLLM_IMAGE_TAG=vllm/vllm-openai:v0.21.0
                        
# 2026-05-15 13:00:10  0.00B 设置环境变量 VLLM_USAGE_SOURCE
ENV VLLM_USAGE_SOURCE=production-docker-image
                        
# 2026-05-15 13:00:10  706.91MB 执行命令并创建新的镜像层
RUN |12 TARGETPLATFORM=linux/amd64 INSTALL_KV_CONNECTORS=true CUDA_VERSION=13.0.2 VLLM_BUILD_COMMIT=ad7125a431e176d4161099480a66f0169609a690 VLLM_BUILD_PIPELINE=019d130e-464e-4ff7-b84b-492992c0c06b VLLM_BUILD_URL=https://buildkite.com/vllm/release-v2/builds/1649 VLLM_IMAGE_TAG=vllm/vllm-openai:v0.21.0 PIP_INDEX_URL= UV_INDEX_URL= PIP_EXTRA_INDEX_URL= UV_EXTRA_INDEX_URL= torch_cuda_arch_list=7.5 8.0 8.6 8.9 9.0 10.0 12.0+PTX /bin/sh -c CUDA_MAJOR="${CUDA_VERSION%%.*}";     CUDA_VERSION_DASH=$(echo $CUDA_VERSION | cut -d. -f1,2 | tr '.' '-');     CUDA_HOME=/usr/local/cuda;     BUILD_PKGS="libcusparse-dev-${CUDA_VERSION_DASH}                 libcublas-dev-${CUDA_VERSION_DASH}                 libcusolver-dev-${CUDA_VERSION_DASH}";     if [ "$INSTALL_KV_CONNECTORS" = "true" ]; then         uv pip install --system -r /tmp/kv_connectors.txt --no-build || (             apt-get update -y &&             apt-get install -y --no-install-recommends --allow-change-held-packages ${BUILD_PKGS} &&             uv pip install --system -r /tmp/kv_connectors.txt --no-build-isolation &&             apt-get purge -y ${BUILD_PKGS} &&             rm -rf /var/lib/apt/lists/*         );         uv pip install --system --force-reinstall --no-deps nixl-cu${CUDA_MAJOR};     fi # buildkit
                        
# 2026-05-15 13:00:04  0.00B 设置环境变量 TORCH_CUDA_ARCH_LIST
ENV TORCH_CUDA_ARCH_LIST=7.5 8.0 8.6 8.9 9.0 10.0 12.0+PTX
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG torch_cuda_arch_list=7.5 8.0 8.6 8.9 9.0 10.0 11.0 12.0+PTX
                        
# 2026-05-15 13:00:04  0.00B 设置环境变量 UV_HTTP_TIMEOUT
ENV UV_HTTP_TIMEOUT=500
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG PIP_EXTRA_INDEX_URL UV_EXTRA_INDEX_URL
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG PIP_INDEX_URL UV_INDEX_URL
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG VLLM_IMAGE_TAG
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG VLLM_BUILD_URL
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG VLLM_BUILD_PIPELINE
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG VLLM_BUILD_COMMIT
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG CUDA_VERSION
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG INSTALL_KV_CONNECTORS=false
                        
# 2026-05-15 13:00:04  0.00B 定义构建参数
ARG TARGETPLATFORM
                        
# 2026-05-15 13:00:04  35.09KB 复制新文件或目录到容器中
COPY ./vllm/collect_env.py . # buildkit
                        
# 2026-05-15 13:00:04  997.59KB 复制新文件或目录到容器中
COPY benchmarks benchmarks # buildkit
                        
# 2026-05-15 13:00:04  1.27MB 复制新文件或目录到容器中
COPY examples examples # buildkit
                        
# 2026-05-15 13:00:04  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64
                        
# 2026-05-15 13:00:04  1.26GB 执行命令并创建新的镜像层
RUN |22 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 GDRCOPY_CUDA_VERSION=12.8 GDRCOPY_OS_VERSION=Ubuntu22_04 TARGETPLATFORM=linux/amd64 BITSANDBYTES_VERSION_X86=0.46.1 BITSANDBYTES_VERSION_ARM64=0.42.0 TIMM_VERSION=>=1.0.17 RUNAI_MODEL_STREAMER_VERSION=>=0.15.7 PIP_INDEX_URL= UV_INDEX_URL= PIP_EXTRA_INDEX_URL= UV_EXTRA_INDEX_URL= PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl PIP_KEYRING_PROVIDER=disabled UV_KEYRING_PROVIDER=disabled PYTORCH_NIGHTLY= /bin/sh -c flashinfer show-config && flashinfer download-cubin # buildkit
                        
# 2026-05-15 12:54:34  30.38MB 执行命令并创建新的镜像层
RUN |22 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 GDRCOPY_CUDA_VERSION=12.8 GDRCOPY_OS_VERSION=Ubuntu22_04 TARGETPLATFORM=linux/amd64 BITSANDBYTES_VERSION_X86=0.46.1 BITSANDBYTES_VERSION_ARM64=0.42.0 TIMM_VERSION=>=1.0.17 RUNAI_MODEL_STREAMER_VERSION=>=0.15.7 PIP_INDEX_URL= UV_INDEX_URL= PIP_EXTRA_INDEX_URL= UV_EXTRA_INDEX_URL= PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl PIP_KEYRING_PROVIDER=disabled UV_KEYRING_PROVIDER=disabled PYTORCH_NIGHTLY= /bin/sh -c uv pip install --system ep_kernels/dist/*.whl --verbose         --extra-index-url ${PYTORCH_CUDA_INDEX_BASE_URL}/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.') # buildkit
                        
# 2026-05-15 12:54:33  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/cuda/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64
                        
# 2026-05-15 12:54:33  0.00B 执行命令并创建新的镜像层
RUN |22 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 GDRCOPY_CUDA_VERSION=12.8 GDRCOPY_OS_VERSION=Ubuntu22_04 TARGETPLATFORM=linux/amd64 BITSANDBYTES_VERSION_X86=0.46.1 BITSANDBYTES_VERSION_ARM64=0.42.0 TIMM_VERSION=>=1.0.17 RUNAI_MODEL_STREAMER_VERSION=>=0.15.7 PIP_INDEX_URL= UV_INDEX_URL= PIP_EXTRA_INDEX_URL= UV_EXTRA_INDEX_URL= PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl PIP_KEYRING_PROVIDER=disabled UV_KEYRING_PROVIDER=disabled PYTORCH_NIGHTLY= /bin/sh -c . /etc/environment && uv pip list # buildkit
                        
# 2026-05-15 12:54:33  552.88MB 执行命令并创建新的镜像层
RUN |22 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 GDRCOPY_CUDA_VERSION=12.8 GDRCOPY_OS_VERSION=Ubuntu22_04 TARGETPLATFORM=linux/amd64 BITSANDBYTES_VERSION_X86=0.46.1 BITSANDBYTES_VERSION_ARM64=0.42.0 TIMM_VERSION=>=1.0.17 RUNAI_MODEL_STREAMER_VERSION=>=0.15.7 PIP_INDEX_URL= UV_INDEX_URL= PIP_EXTRA_INDEX_URL= UV_EXTRA_INDEX_URL= PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl PIP_KEYRING_PROVIDER=disabled UV_KEYRING_PROVIDER=disabled PYTORCH_NIGHTLY= /bin/sh -c if [ "${PYTORCH_NIGHTLY}" = "1" ]; then         echo "Installing torch nightly..."         && uv pip install --system $(cat torch_lib_versions.txt | xargs) --pre         --index-url ${PYTORCH_CUDA_INDEX_BASE_URL}/nightly/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.')         && echo "Installing vLLM..."         && uv pip install --system dist/*.whl --verbose         --extra-index-url ${PYTORCH_CUDA_INDEX_BASE_URL}/nightly/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.');     else         echo "Installing vLLM..."         && uv pip install --system dist/*.whl --verbose         --extra-index-url ${PYTORCH_CUDA_INDEX_BASE_URL}/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.');     fi # buildkit
                        
# 2026-05-15 12:40:45  71.00B 复制新文件或目录到容器中
COPY /workspace/torch_lib_versions.txt torch_lib_versions.txt # buildkit
                        
# 2026-05-15 12:40:45  0.00B 定义构建参数
ARG PYTORCH_NIGHTLY
                        
# 2026-05-15 12:40:45  0.00B 定义构建参数
ARG PIP_KEYRING_PROVIDER UV_KEYRING_PROVIDER
                        
# 2026-05-15 12:40:45  0.00B 定义构建参数
ARG PYTORCH_CUDA_INDEX_BASE_URL
                        
# 2026-05-15 12:40:45  0.00B 定义构建参数
ARG PIP_EXTRA_INDEX_URL UV_EXTRA_INDEX_URL
                        
# 2026-05-15 12:40:45  0.00B 定义构建参数
ARG PIP_INDEX_URL UV_INDEX_URL
                        
# 2026-05-15 12:40:45  388.42MB 执行命令并创建新的镜像层
RUN |14 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 GDRCOPY_CUDA_VERSION=12.8 GDRCOPY_OS_VERSION=Ubuntu22_04 TARGETPLATFORM=linux/amd64 BITSANDBYTES_VERSION_X86=0.46.1 BITSANDBYTES_VERSION_ARM64=0.42.0 TIMM_VERSION=>=1.0.17 RUNAI_MODEL_STREAMER_VERSION=>=0.15.7 /bin/sh -c if [ "$TARGETPLATFORM" = "linux/arm64" ]; then         BITSANDBYTES_VERSION="${BITSANDBYTES_VERSION_ARM64}";     else         BITSANDBYTES_VERSION="${BITSANDBYTES_VERSION_X86}";     fi;     uv pip install --system accelerate modelscope         "bitsandbytes>=${BITSANDBYTES_VERSION}" "timm${TIMM_VERSION}" "runai-model-streamer[s3,gcs,azure]${RUNAI_MODEL_STREAMER_VERSION}" # buildkit
                        
# 2026-05-15 12:40:41  0.00B 定义构建参数
ARG RUNAI_MODEL_STREAMER_VERSION=>=0.15.7
                        
# 2026-05-15 12:40:41  0.00B 定义构建参数
ARG TIMM_VERSION=>=1.0.17
                        
# 2026-05-15 12:40:41  0.00B 定义构建参数
ARG BITSANDBYTES_VERSION_ARM64=0.42.0
                        
# 2026-05-15 12:40:41  0.00B 定义构建参数
ARG BITSANDBYTES_VERSION_X86=0.46.1
                        
# 2026-05-15 12:40:41  2.42MB 执行命令并创建新的镜像层
RUN |10 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 GDRCOPY_CUDA_VERSION=12.8 GDRCOPY_OS_VERSION=Ubuntu22_04 TARGETPLATFORM=linux/amd64 /bin/sh -c set -eux;     case "${TARGETPLATFORM}" in       linux/arm64) UUARCH="aarch64" ;;       linux/amd64) UUARCH="x64" ;;       *) echo "Unsupported TARGETPLATFORM: ${TARGETPLATFORM}" >&2; exit 1 ;;     esac;     /tmp/install_gdrcopy.sh "${GDRCOPY_OS_VERSION}" "${GDRCOPY_CUDA_VERSION}" "${UUARCH}" &&     rm /tmp/install_gdrcopy.sh # buildkit
                        
# 2026-05-15 12:40:36  1.44KB 复制新文件或目录到容器中
COPY tools/install_gdrcopy.sh /tmp/install_gdrcopy.sh # buildkit
                        
# 2026-05-15 12:40:35  0.00B 定义构建参数
ARG TARGETPLATFORM
                        
# 2026-05-15 12:40:35  0.00B 定义构建参数
ARG GDRCOPY_OS_VERSION=Ubuntu22_04
                        
# 2026-05-15 12:40:35  0.00B 定义构建参数
ARG GDRCOPY_CUDA_VERSION=12.8
                        
# 2026-05-15 12:40:35  9.30GB 执行命令并创建新的镜像层
RUN |7 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl FLASHINFER_VERSION=0.6.8.post1 /bin/sh -c uv pip install --system flashinfer-jit-cache==${FLASHINFER_VERSION}         --extra-index-url https://flashinfer.ai/whl/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.') # buildkit
                        
# 2026-05-15 12:39:23  0.00B 定义构建参数
ARG FLASHINFER_VERSION=0.6.8.post1
                        
# 2026-05-15 12:39:23  7.61GB 执行命令并创建新的镜像层
RUN |6 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py PYTORCH_CUDA_INDEX_BASE_URL=https://download.pytorch.org/whl /bin/sh -c if [ "$(echo $CUDA_VERSION | cut -d. -f1)" = "12" ]; then         sed -i 's/^nvidia-cutlass-dsl\[cu13\]>=/nvidia-cutlass-dsl>=/' /tmp/requirements-cuda.txt;     fi &&     uv pip install --system -r /tmp/requirements-cuda.txt         --extra-index-url ${PYTORCH_CUDA_INDEX_BASE_URL}/cu$(echo $CUDA_VERSION | cut -d. -f1,2 | tr -d '.') &&     rm /tmp/requirements-cuda.txt /tmp/common.txt # buildkit
                        
# 2026-05-15 12:39:03  892.00B 复制新文件或目录到容器中
COPY requirements/cuda.txt /tmp/requirements-cuda.txt # buildkit
                        
# 2026-05-15 12:39:03  2.94KB 复制新文件或目录到容器中
COPY requirements/common.txt /tmp/common.txt # buildkit
                        
# 2026-05-15 12:39:03  0.00B 定义构建参数
ARG PYTORCH_CUDA_INDEX_BASE_URL
                        
# 2026-05-15 12:39:03  0.00B 设置环境变量 VLLM_ENABLE_CUDA_COMPATIBILITY
ENV VLLM_ENABLE_CUDA_COMPATIBILITY=0
                        
# 2026-05-15 12:39:03  0.00B 设置环境变量 UV_LINK_MODE
ENV UV_LINK_MODE=copy
                        
# 2026-05-15 12:39:03  0.00B 设置环境变量 UV_INDEX_STRATEGY
ENV UV_INDEX_STRATEGY=unsafe-best-match
                        
# 2026-05-15 12:39:03  0.00B 设置环境变量 UV_HTTP_TIMEOUT
ENV UV_HTTP_TIMEOUT=500
                        
# 2026-05-15 12:39:03  86.21MB 执行命令并创建新的镜像层
RUN |5 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py /bin/sh -c python3 -m pip install uv # buildkit
                        
# 2026-05-15 12:38:44  2.99GB 执行命令并创建新的镜像层
RUN |5 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py /bin/sh -c CUDA_VERSION_DASH=$(echo $CUDA_VERSION | cut -d. -f1,2 | tr '.' '-') &&     CUDA_VERSION_SHORT=$(echo $CUDA_VERSION | cut -d. -f1,2) &&     apt-get update -y &&     apt-get install -y --no-install-recommends --allow-change-held-packages         cuda-nvcc-${CUDA_VERSION_DASH}         cuda-cudart-${CUDA_VERSION_DASH}         cuda-nvrtc-${CUDA_VERSION_DASH}         cuda-cuobjdump-${CUDA_VERSION_DASH}         libcurand-dev-${CUDA_VERSION_DASH}         libcublas-dev-${CUDA_VERSION_DASH}         libnuma-dev         numactl &&     NCCL_VER=$(apt-cache madison libnccl-dev | grep "+cuda${CUDA_VERSION_SHORT}" | head -1 | awk -F'|' '{gsub(/^ +| +$/, "", $2); print $2}') &&     apt-get install -y --no-install-recommends --allow-change-held-packages libnccl-dev=${NCCL_VER} libnccl2=${NCCL_VER} &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2026-05-15 12:37:40  647.26MB 执行命令并创建新的镜像层
RUN |5 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py /bin/sh -c apt-get update -y     && apt-get install -y --no-install-recommends         software-properties-common         curl         sudo         ffmpeg         libsm6         libxext6         libgl1     && if [ ! -z ${DEADSNAKES_MIRROR_URL} ] ; then         if [ ! -z "${DEADSNAKES_GPGKEY_URL}" ] ; then             mkdir -p -m 0755 /etc/apt/keyrings ;             curl -L ${DEADSNAKES_GPGKEY_URL} | gpg --dearmor > /etc/apt/keyrings/deadsnakes.gpg ;             sudo chmod 644 /etc/apt/keyrings/deadsnakes.gpg ;             echo "deb [signed-by=/etc/apt/keyrings/deadsnakes.gpg] ${DEADSNAKES_MIRROR_URL} $(lsb_release -cs) main" > /etc/apt/sources.list.d/deadsnakes.list ;         fi ;     else         for i in 1 2 3; do             add-apt-repository -y ppa:deadsnakes/ppa && break ||             { echo "Attempt $i failed, retrying in 5s..."; sleep 5; };         done ;     fi     && apt-get update -y     && apt-get install -y --no-install-recommends         python${PYTHON_VERSION}         python${PYTHON_VERSION}-dev         python${PYTHON_VERSION}-venv         libibverbs-dev     && rm -rf /var/lib/apt/lists/*     && update-alternatives --install /usr/bin/python3 python3 /usr/bin/python${PYTHON_VERSION} 1     && update-alternatives --set python3 /usr/bin/python${PYTHON_VERSION}     && ln -sf /usr/bin/python${PYTHON_VERSION}-config /usr/bin/python3-config     && rm -f /usr/lib/python${PYTHON_VERSION}/EXTERNALLY-MANAGED     && curl -sS ${GET_PIP_URL} | python${PYTHON_VERSION}     && python3 --version && python3 -m pip --version # buildkit
                        
# 2026-05-15 12:36:31  136.00B 执行命令并创建新的镜像层
RUN |5 CUDA_VERSION=13.0.2 PYTHON_VERSION=3.12 DEADSNAKES_MIRROR_URL= DEADSNAKES_GPGKEY_URL= GET_PIP_URL=https://bootstrap.pypa.io/get-pip.py /bin/sh -c PYTHON_VERSION_STR=$(echo ${PYTHON_VERSION} | sed 's/\.//g') &&     echo "export PYTHON_VERSION_STR=${PYTHON_VERSION_STR}" >> /etc/environment # buildkit
                        
# 2026-05-15 12:36:30  0.00B 设置工作目录为/vllm-workspace
WORKDIR /vllm-workspace
                        
# 2026-05-15 12:36:30  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2026-05-15 12:36:30  0.00B 定义构建参数
ARG GET_PIP_URL
                        
# 2026-05-15 12:36:30  0.00B 定义构建参数
ARG DEADSNAKES_GPGKEY_URL
                        
# 2026-05-15 12:36:30  0.00B 定义构建参数
ARG DEADSNAKES_MIRROR_URL
                        
# 2026-05-15 12:36:30  0.00B 定义构建参数
ARG PYTHON_VERSION
                        
# 2026-05-15 12:36:30  0.00B 定义构建参数
ARG CUDA_VERSION
                        
# 2025-10-11 00:48:27  0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
                        
# 2025-10-11 00:48:27  0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
                        
# 2025-10-11 00:48:27  17.29KB 复制新文件或目录到容器中
COPY NGC-DL-CONTAINER-LICENSE / # buildkit
                        
# 2025-10-11 00:48:27  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64
                        
# 2025-10-11 00:48:27  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-10-11 00:48:27  22.00B 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/cuda/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2025-10-11 00:48:27  322.88MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-13-0=${NV_CUDA_CUDART_VERSION}     cuda-compat-13-0     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-10-11 00:48:05  0.00B 设置环境变量 CUDA_VERSION
ENV CUDA_VERSION=13.0.2
                        
# 2025-10-11 00:48:05  10.60MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     gnupg2 curl ca-certificates &&     curl -fsSLO https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/${NVARCH}/cuda-keyring_1.1-1_all.deb &&     dpkg -i cuda-keyring_1.1-1_all.deb &&     apt-get purge --autoremove -y curl     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-10-11 00:48:05  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-10-11 00:48:05  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-10-11 00:48:05  0.00B 设置环境变量 NV_CUDA_CUDART_VERSION
ENV NV_CUDA_CUDART_VERSION=13.0.96-1
                        
# 2025-10-11 00:48:05  0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand
ENV NVIDIA_REQUIRE_CUDA=cuda>=13.0 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 brand=unknown,driver>=570,driver<571 brand=grid,driver>=570,driver<571 brand=tesla,driver>=570,driver<571 brand=nvidia,driver>=570,driver<571 brand=quadro,driver>=570,driver<571 brand=quadrortx,driver>=570,driver<571 brand=nvidiartx,driver>=570,driver<571 brand=vapps,driver>=570,driver<571 brand=vpc,driver>=570,driver<571 brand=vcs,driver>=570,driver<571 brand=vws,driver>=570,driver<571 brand=cloudgaming,driver>=570,driver<571 brand=unknown,driver>=575,driver<576 brand=grid,driver>=575,driver<576 brand=tesla,driver>=575,driver<576 brand=nvidia,driver>=575,driver<576 brand=quadro,driver>=575,driver<576 brand=quadrortx,driver>=575,driver<576 brand=nvidiartx,driver>=575,driver<576 brand=vapps,driver>=575,driver<576 brand=vpc,driver>=575,driver<576 brand=vcs,driver>=575,driver<576 brand=vws,driver>=575,driver<576 brand=cloudgaming,driver>=575,driver<576
                        
# 2025-10-11 00:48:05  0.00B 设置环境变量 NVARCH
ENV NVARCH=x86_64
                        
# 2025-10-01 15:05:10  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-10-01 15:05:09  77.87MB 
/bin/sh -c #(nop) ADD file:32d41b6329e8f89fa4ac92ef97c04b7cfd5e90fb74e1509c3e27d7c91195b7c7 in / 
                        
# 2025-10-01 15:05:07  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2025-10-01 15:05:07  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-10-01 15:05:07  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-10-01 15:05:07  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:7fee68373d554221fe9dbd2da3967cb2cb69c95a5e2789c20924d8ab1b7f8d3c",
    "RepoTags": [
        "xprobe/xinference:v2.10.0",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference:v2.10.0"
    ],
    "RepoDigests": [
        "xprobe/xinference@sha256:557db53596f67b261112188e8f27b4dcb107324212e6d2ea1df24a18d1715f46",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/xprobe/xinference@sha256:557db53596f67b261112188e8f27b4dcb107324212e6d2ea1df24a18d1715f46"
    ],
    "Parent": "",
    "Comment": "",
    "Created": "2026-06-06T00:34:12.835428163Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "20.10.17",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/nvm/versions/node/v14.21.1/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=13.0 brand=unknown,driver\u003e=535,driver\u003c536 brand=grid,driver\u003e=535,driver\u003c536 brand=tesla,driver\u003e=535,driver\u003c536 brand=nvidia,driver\u003e=535,driver\u003c536 brand=quadro,driver\u003e=535,driver\u003c536 brand=quadrortx,driver\u003e=535,driver\u003c536 brand=nvidiartx,driver\u003e=535,driver\u003c536 brand=vapps,driver\u003e=535,driver\u003c536 brand=vpc,driver\u003e=535,driver\u003c536 brand=vcs,driver\u003e=535,driver\u003c536 brand=vws,driver\u003e=535,driver\u003c536 brand=cloudgaming,driver\u003e=535,driver\u003c536 brand=unknown,driver\u003e=550,driver\u003c551 brand=grid,driver\u003e=550,driver\u003c551 brand=tesla,driver\u003e=550,driver\u003c551 brand=nvidia,driver\u003e=550,driver\u003c551 brand=quadro,driver\u003e=550,driver\u003c551 brand=quadrortx,driver\u003e=550,driver\u003c551 brand=nvidiartx,driver\u003e=550,driver\u003c551 brand=vapps,driver\u003e=550,driver\u003c551 brand=vpc,driver\u003e=550,driver\u003c551 brand=vcs,driver\u003e=550,driver\u003c551 brand=vws,driver\u003e=550,driver\u003c551 brand=cloudgaming,driver\u003e=550,driver\u003c551 brand=unknown,driver\u003e=565,driver\u003c566 brand=grid,driver\u003e=565,driver\u003c566 brand=tesla,driver\u003e=565,driver\u003c566 brand=nvidia,driver\u003e=565,driver\u003c566 brand=quadro,driver\u003e=565,driver\u003c566 brand=quadrortx,driver\u003e=565,driver\u003c566 brand=nvidiartx,driver\u003e=565,driver\u003c566 brand=vapps,driver\u003e=565,driver\u003c566 brand=vpc,driver\u003e=565,driver\u003c566 brand=vcs,driver\u003e=565,driver\u003c566 brand=vws,driver\u003e=565,driver\u003c566 brand=cloudgaming,driver\u003e=565,driver\u003c566 brand=unknown,driver\u003e=570,driver\u003c571 brand=grid,driver\u003e=570,driver\u003c571 brand=tesla,driver\u003e=570,driver\u003c571 brand=nvidia,driver\u003e=570,driver\u003c571 brand=quadro,driver\u003e=570,driver\u003c571 brand=quadrortx,driver\u003e=570,driver\u003c571 brand=nvidiartx,driver\u003e=570,driver\u003c571 brand=vapps,driver\u003e=570,driver\u003c571 brand=vpc,driver\u003e=570,driver\u003c571 brand=vcs,driver\u003e=570,driver\u003c571 brand=vws,driver\u003e=570,driver\u003c571 brand=cloudgaming,driver\u003e=570,driver\u003c571 brand=unknown,driver\u003e=575,driver\u003c576 brand=grid,driver\u003e=575,driver\u003c576 brand=tesla,driver\u003e=575,driver\u003c576 brand=nvidia,driver\u003e=575,driver\u003c576 brand=quadro,driver\u003e=575,driver\u003c576 brand=quadrortx,driver\u003e=575,driver\u003c576 brand=nvidiartx,driver\u003e=575,driver\u003c576 brand=vapps,driver\u003e=575,driver\u003c576 brand=vpc,driver\u003e=575,driver\u003c576 brand=vcs,driver\u003e=575,driver\u003c576 brand=vws,driver\u003e=575,driver\u003c576 brand=cloudgaming,driver\u003e=575,driver\u003c576",
            "NV_CUDA_CUDART_VERSION=13.0.96-1",
            "CUDA_VERSION=13.0.2",
            "LD_LIBRARY_PATH=/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/lib/python3.12/dist-packages/nvidia/cublas/lib",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "DEBIAN_FRONTEND=noninteractive",
            "UV_HTTP_TIMEOUT=500",
            "UV_INDEX_STRATEGY=unsafe-best-match",
            "UV_LINK_MODE=copy",
            "VLLM_ENABLE_CUDA_COMPATIBILITY=0",
            "TORCH_CUDA_ARCH_LIST=7.5 8.0 8.6 8.9 9.0 10.0 12.0+PTX",
            "VLLM_USAGE_SOURCE=production-docker-image",
            "VLLM_BUILD_COMMIT=ad7125a431e176d4161099480a66f0169609a690",
            "VLLM_BUILD_PIPELINE=019d130e-464e-4ff7-b84b-492992c0c06b",
            "VLLM_BUILD_URL=https://buildkite.com/vllm/release-v2/builds/1649",
            "VLLM_IMAGE_TAG=vllm/vllm-openai:v0.21.0",
            "NVM_DIR=/usr/local/nvm",
            "NODE_VERSION=14.21.1"
        ],
        "Cmd": [
            "/bin/bash"
        ],
        "Image": "sha256:394ea840965e608c845c7e04b1624e0cfb2119a1794b87e90e276b3195501814",
        "Volumes": null,
        "WorkingDir": "/opt/inference",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": {
            "ai.vllm.build.commit": "ad7125a431e176d4161099480a66f0169609a690",
            "ai.vllm.build.pipeline": "019d130e-464e-4ff7-b84b-492992c0c06b",
            "ai.vllm.build.url": "https://buildkite.com/vllm/release-v2/builds/1649",
            "ai.vllm.image.tag": "vllm/vllm-openai:v0.21.0",
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "ad7125a431e176d4161099480a66f0169609a690",
            "org.opencontainers.image.source": "https://github.com/vllm-project/vllm",
            "org.opencontainers.image.url": "https://buildkite.com/vllm/release-v2/builds/1649",
            "org.opencontainers.image.version": "vllm/vllm-openai:v0.21.0"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 35207650983,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/a768c4140068223e1cc150c379e6b4ef165425a1055a77a1be6cdd01dfc5485a/diff:/var/lib/docker/overlay2/ef68c76088fe201043809625b0d451c8eb758ac58fc9aafdeb115a9c7a29f301/diff:/var/lib/docker/overlay2/060cf67070d0c160d9ac92e39503d4c2cefe482746cfee419670f613f540879d/diff:/var/lib/docker/overlay2/adbd01c6a08e1ae9f615598980e16eed341665ccc883755c632229f0dbf9bbb3/diff:/var/lib/docker/overlay2/5f852575cc2d2a02c70dc1b4bb4a36249e10fbd827755b1633b9637da104f590/diff:/var/lib/docker/overlay2/fdb50b063457901ed360f2aff44b3e38e3222e286eab483d29705a8f34a1520b/diff:/var/lib/docker/overlay2/14a1a3a397610263be81e2348a4bb88aab16d7ef66c8d628bded4ad4f72e2499/diff:/var/lib/docker/overlay2/9ccd49b5de1d8a01a9a0a6fd0eff9c22c78bf82702ad7922b32771aea745711c/diff:/var/lib/docker/overlay2/7e2537cda37a83bce52d0c5292cf8c8eeae805f3a7918e85c3cc5dc637c8140b/diff:/var/lib/docker/overlay2/e82c51b4a133aff739975f666a570d38c3ba17e66a61db6b0d4d9cada8f87144/diff:/var/lib/docker/overlay2/ec700b595b20ebf6da988e19e02b88f9a25172cdc43ec2adb62c956be4f76448/diff:/var/lib/docker/overlay2/826c19cf6f8c2aade574732c2d676e46f37595b8b12462590bd8b610a1f7e79a/diff:/var/lib/docker/overlay2/af79073ce7113a77b182446d63339c399b110f290c329b11b1567e5dc0f41887/diff:/var/lib/docker/overlay2/702899c877abb3cb36a1aba37d6295269448acbaf9dcf36d5910c19a113bf9fa/diff:/var/lib/docker/overlay2/77091dd02790c36d0d5458c54786ef9bddb1b23cd49edc032f7e1eed21df02d4/diff:/var/lib/docker/overlay2/85c10f448b1e938ac0128f61f12b73d433a2f61a8aab80d35412b5d962bd710f/diff:/var/lib/docker/overlay2/f9f31e17aeb098a3c7bff2e7cbc3f56b64a37fed1681661ceedf27d0a0b98938/diff:/var/lib/docker/overlay2/5e166c002e204d4bab005a6e3d23f242c9f30e428a47624b06da91c3d27859f9/diff:/var/lib/docker/overlay2/a9e47f0dd871017b2462b3a162736c9446a698ddcadaf52b69cfaf045ddd78cb/diff:/var/lib/docker/overlay2/d129b0b539821301d73406c263870675b912a2d4c7c0769873cc1c7529cb095b/diff:/var/lib/docker/overlay2/a4114f7499f2c065bbd6b7575b5a71d53404afb1587059de8e47d1deadcb6e00/diff:/var/lib/docker/overlay2/9912e81a430a1560ea9d8187913db57e76c9d62ed769123f9aba6615c08e5e76/diff:/var/lib/docker/overlay2/67325f149988c7f0fa2e0adb0aecec738c5b903ed1ba4a87280b181c76048ab8/diff:/var/lib/docker/overlay2/650d09b7659af4af1e1b34c6966421832b2856a71b598dd4db98d40dc9859018/diff:/var/lib/docker/overlay2/18f03ddf389a79a94a1375f7143f5d391fc4b4b6def3d7c2b828e86bf0471fed/diff:/var/lib/docker/overlay2/52d89c0bae9ea1be5921c86c6266badf2ea787a5e7e783c3b428b18e733fb5ef/diff:/var/lib/docker/overlay2/67b177de7ba54977e6a4c15837fe76d53f34ab660f30de9d03abcae6c09839fd/diff:/var/lib/docker/overlay2/0c6245adf25df525ce2bd8e838709a5a8245fe09c44aa5ec4957821a5ad39daa/diff:/var/lib/docker/overlay2/bbb374fb384dc7fd4090357fe3290a609a535fec93c87126a61d452506aafb70/diff:/var/lib/docker/overlay2/bb5f30a1e7de10313b15093df0cb6eaffdb7443b4e50c398b0349cfd4d9a0f5b/diff:/var/lib/docker/overlay2/99a8a7af45ffa1dc430375fde8c3084ee85be5839f687d98d2857fb82cd37c67/diff",
            "MergedDir": "/var/lib/docker/overlay2/c23567ebf7855aecb47b223c7282e78fc1a288cf4d57f56e573f73b64a4c99b2/merged",
            "UpperDir": "/var/lib/docker/overlay2/c23567ebf7855aecb47b223c7282e78fc1a288cf4d57f56e573f73b64a4c99b2/diff",
            "WorkDir": "/var/lib/docker/overlay2/c23567ebf7855aecb47b223c7282e78fc1a288cf4d57f56e573f73b64a4c99b2/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:767e56ba346ae714b6e6b816baa839051145ed78cfa0e4524a86cc287b0c4b00",
            "sha256:a34bd8b26cb282b40938915d45732d898d4d09459cd3be508617c2b02e5f9b39",
            "sha256:0f09a2d797f7f8a8a702ccc542c861cf6bc25831172c34974865c8387e1d9a20",
            "sha256:50a43a0352744fd68e68cb9fafee74db9b087024b86ebbc29ba287f40672c319",
            "sha256:b7ec8fd7c485bbedbe64cbc5a7a810ceabb9156e95c83ba60596ddb9b4955d48",
            "sha256:039b35b2fe8d910020bdc689920f54112d084d9d359507a1af3bd959909c8540",
            "sha256:af440dbdd4ab7b93cb1a34f28cd076aea125f1bec94b37402992da8061692cd8",
            "sha256:0b54669319ce44a7a0120b6c1c68340a40ac4f5faf8e33ef4d9bec6fe2a4298f",
            "sha256:66c6a70f569399293ebddf1c31e46166568d8bc04a2b8308d96f70547a75a427",
            "sha256:d5d19ffd483a0f60093d3f1f124485201648efee310ad04ebcc6d67a5542b811",
            "sha256:118bd518c2d10747f87440c690b29f7dbdf46eee1f35169c737740028eb82f45",
            "sha256:57631c9cd02673f2ed59537b89dd57fa7423b371977f0bc950258e73cad17dad",
            "sha256:a2519c9d6a17e2550fb589b87360e123f60e659c8310d9437eb65ef119f7d85d",
            "sha256:bba4c520384f1861cb5a56962648459db7cf38edf256b8f8b7e6f7c892cbe38b",
            "sha256:9573c18d2d7b8052ac7c5c6bf952ad03c96c30fe057bc5639b3bf2663ccef47f",
            "sha256:c752f4741c371cc977168a1acb8553b73004eb244b721cceaf90cec42e585a77",
            "sha256:1c52269989eadc9499c6ceb7238a9650a3cc3d49ef3ed788e7c0894bf7270b94",
            "sha256:2903b737b3d77435d3336b4f5de7fec744cbbc6d4224f8a4d802509cea5d030b",
            "sha256:20d2d89ca59a58b00ceaf8f64e3f766cc42b9922af9879855fa795c41ffbc5ee",
            "sha256:c00df543d19da0861294d65f3cb41cf6ee325425c20b7515a0c42b8d3d524f71",
            "sha256:cca1ac45bc0f88ac432cedb5b3871a971798e45f5fdebcb74aab614fd83faf68",
            "sha256:fcf3b27e5e28dcba71080764eb29134cb9825d0cc3d3e168e0a096eb2d5c7b40",
            "sha256:6820e258126b688cf1c84994bd93bf2aa9b5380a7069a0db9eddf6de9ba2eb37",
            "sha256:279f9dc2b086f5f1c5c9ffd9bc88947d8a348512f4f48925f994f4153241e1ce",
            "sha256:3188f577a8682ead524ffdabb036feb8bf4156a22c6ed98a26d21215636e4079",
            "sha256:0ed63cce3edbff74c347a063847970445d43aa028d8e996bed2a21b08e1f5812",
            "sha256:7596dd75052c4a57088192d09055419a34562eeb3c3d795b488ef85c1715bc8b",
            "sha256:460b8d92371a6b6b0d17af71484c2618d625b372be8568de8261898bdfef5140",
            "sha256:8c93d7e9c1c27c41d260093e349433b645676600d88ef60c7e5380938b9ba112",
            "sha256:268b45b51861779fc10434fd5e43ca6afbd9964da8aa34e2361bb640a3ec1057",
            "sha256:7b1f9f109974f96f7de606d177c891492638b9897435890288ac237b6d6a0729",
            "sha256:347c9294278abd9b7b30eea72ba75a55133e3778f8dfb368a06873da55bf7a1a"
        ]
    },
    "Metadata": {
        "LastTagTime": "2026-06-17T01:02:22.855016083+08:00"
    }
}

更多版本

docker.io/xprobe/xinference:v0.13.3

linux/amd64 docker.io15.44GB2024-08-03 22:15
1842

docker.io/xprobe/xinference:v0.14.0

linux/amd64 docker.io15.53GB2024-08-05 11:11
1360

docker.io/xprobe/xinference:latest-cpu

linux/amd64 docker.io6.75GB2024-09-07 01:27
1579

docker.io/xprobe/xinference:v0.12.1

linux/amd64 docker.io26.68GB2024-09-07 03:07
713

docker.io/xprobe/xinference:v0.15.0-cpu

linux/amd64 docker.io6.75GB2024-09-19 22:49
751

docker.io/xprobe/xinference:v0.12.0

linux/amd64 docker.io27.66GB2024-09-25 04:01
898

docker.io/xprobe/xinference:v0.15.2

linux/amd64 docker.io17.55GB2024-09-30 13:35
557

docker.io/xprobe/xinference:v0.15.4

linux/amd64 docker.io17.54GB2024-10-16 01:44
650

docker.io/xprobe/xinference:v0.16.3

linux/amd64 docker.io17.59GB2024-11-13 00:44
515

docker.io/xprobe/xinference:v1.0.0

linux/amd64 docker.io17.62GB2024-11-19 00:15
592

docker.io/xprobe/xinference:v1.0.1

linux/amd64 docker.io17.60GB2024-12-04 00:49
561

docker.io/xprobe/xinference:v1.1.0

linux/amd64 docker.io18.25GB2024-12-18 00:16
918

docker.io/xprobe/xinference:v1.2.0

linux/amd64 docker.io17.01GB2025-01-15 00:31
469

docker.io/xprobe/xinference:v1.2.1

linux/amd64 docker.io23.34GB2025-01-27 00:55
602

docker.io/xprobe/xinference:v1.2.2

linux/amd64 docker.io23.55GB2025-02-13 01:30
649

docker.io/xprobe/xinference:v1.3.0

linux/amd64 docker.io23.65GB2025-03-03 01:51
698

docker.io/xprobe/xinference:v1.3.1.post1

linux/amd64 docker.io25.86GB2025-03-13 01:23
624

docker.io/xprobe/xinference:v1.3.1

linux/amd64 docker.io25.83GB2025-03-19 01:04
1099

docker.io/xprobe/xinference:v1.4.0

linux/amd64 docker.io26.27GB2025-03-22 01:34
1046

docker.io/xprobe/xinference:v0.15.4-cpu

linux/amd64 docker.io6.78GB2025-04-01 20:33
483

docker.io/xprobe/xinference:v1.4.0-cpu

linux/amd64 docker.io8.82GB2025-04-02 00:33
641

docker.io/xprobe/xinference:latest

linux/amd64 docker.io27.44GB2025-04-06 00:40
1690

docker.io/xprobe/xinference:v1.4.1

linux/amd64 docker.io27.44GB2025-04-06 13:27
788

docker.io/xprobe/xinference:nightly-main

linux/amd64 docker.io26.91GB2025-04-12 01:26
777

docker.io/xprobe/xinference:v1.5.0

linux/amd64 docker.io26.63GB2025-04-22 01:22
617

docker.io/xprobe/xinference:v1.5.0.post2

linux/amd64 docker.io27.24GB2025-04-25 05:27
598

docker.io/xprobe/xinference:v1.4.1-cpu

linux/amd64 docker.io8.66GB2025-04-30 00:55
470

docker.io/xprobe/xinference:v1.5.1

linux/amd64 docker.io27.95GB2025-05-02 01:16
1240

docker.io/xprobe/xinference:v1.6.0

linux/amd64 docker.io26.72GB2025-05-17 01:24
877

docker.io/xprobe/xinference:v1.6.0.post1

linux/amd64 docker.io26.63GB2025-05-18 00:44
618

docker.io/xprobe/xinference:v1.6.0.post1-cpu

linux/amd64 docker.io8.94GB2025-05-26 01:53
809

docker.io/xprobe/xinference:v1.6.1

linux/amd64 docker.io26.94GB2025-06-02 03:37
1206

docker.io/xprobe/xinference:v1.7.0.post1

linux/amd64 docker.io27.01GB2025-06-15 03:42
1765

docker.io/xprobe/xinference:v2.2.0-cpu

linux/amd64 docker.io9.51GB2026-03-27 01:23
286

docker.io/xprobe/xinference:v2.7.0-cpu

linux/amd64 docker.io9.58GB2026-04-30 01:29
215

docker.io/xprobe/xinference:v2.10.0

linux/amd64 docker.io35.21GB2026-06-17 01:13
34