docker.io/gpustack/runner:cuda12.9-vllm0.11.2 linux/amd64

docker.io/gpustack/runner:cuda12.9-vllm0.11.2 - 国内下载镜像源 浏览次数:4
源镜像 docker.io/gpustack/runner:cuda12.9-vllm0.11.2
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2
镜像ID sha256:2e0019442f2ae84b1975dc2e712f0c429096680d09192ad1059fc9a2f4f11440
镜像TAG cuda12.9-vllm0.11.2
大小 33.62GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 tini --
工作目录 /
OS/平台 linux/amd64
浏览量 4 次
贡献者 35******9@qq.com
镜像创建 2025-12-01T05:26:25.336207966Z
同步时间 2025-12-03 00:42
更新时间 2025-12-03 01:20
环境变量
PATH=/usr/local/mpi/bin:/usr/local/ucx/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/amazon/efa/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=12.9 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 brand=unknown,driver>=570,driver<571 brand=grid,driver>=570,driver<571 brand=tesla,driver>=570,driver<571 brand=nvidia,driver>=570,driver<571 brand=quadro,driver>=570,driver<571 brand=quadrortx,driver>=570,driver<571 brand=nvidiartx,driver>=570,driver<571 brand=vapps,driver>=570,driver<571 brand=vpc,driver>=570,driver<571 brand=vcs,driver>=570,driver<571 brand=vws,driver>=570,driver<571 brand=cloudgaming,driver>=570,driver<571 NV_CUDA_CUDART_VERSION=12.9.79-1 CUDA_VERSION=12.9.1 LD_LIBRARY_PATH=/usr/local/cuda/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility NV_CUDA_LIB_VERSION=12.9.1-1 NV_NVTX_VERSION=12.9.79-1 NV_LIBNPP_VERSION=12.4.1.87-1 NV_LIBNPP_PACKAGE=libnpp-12-9=12.4.1.87-1 NV_LIBCUSPARSE_VERSION=12.5.10.65-1 NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-9 NV_LIBCUBLAS_VERSION=12.9.1.4-1 NV_LIBCUBLAS_PACKAGE=libcublas-12-9=12.9.1.4-1 NV_LIBNCCL_PACKAGE_NAME=libnccl2 NV_LIBNCCL_PACKAGE_VERSION=2.27.3-1 NCCL_VERSION=2.27.3-1 NV_LIBNCCL_PACKAGE=libnccl2=2.27.3-1+cuda12.9 NVIDIA_PRODUCT_NAME=CUDA NV_CUDA_CUDART_DEV_VERSION=12.9.79-1 NV_NVML_DEV_VERSION=12.9.79-1 NV_LIBCUSPARSE_DEV_VERSION=12.5.10.65-1 NV_LIBNPP_DEV_VERSION=12.4.1.87-1 NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-9=12.4.1.87-1 NV_LIBCUBLAS_DEV_VERSION=12.9.1.4-1 NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-9 NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-9=12.9.1.4-1 NV_CUDA_NSIGHT_COMPUTE_VERSION=12.9.1-1 NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-9=12.9.1-1 NV_NVPROF_VERSION=12.9.79-1 NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-9=12.9.79-1 NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev NV_LIBNCCL_DEV_PACKAGE_VERSION=2.27.3-1 NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.27.3-1+cuda12.9 LIBRARY_PATH=/usr/local/cuda/lib64/stubs NV_CUDNN_VERSION=9.10.2.21-1 NV_CUDNN_PACKAGE_NAME=libcudnn9-cuda-12 NV_CUDNN_PACKAGE=libcudnn9-cuda-12=9.10.2.21-1 NV_CUDNN_PACKAGE_DEV=libcudnn9-dev-cuda-12=9.10.2.21-1 NV_CUDNN_PACKAGE_DEV_HEADERS=libcudnn9-headers-cuda-12=9.10.2.21-1 DEBIAN_FRONTEND=noninteractive LANG=en_US.UTF-8 LANGUAGE=en_US:en LC_ALL=en_US.UTF-8 PYTHON_VERSION=3.12 PIP_NO_CACHE_DIR=1 PIP_DISABLE_PIP_VERSION_CHECK=1 PIP_ROOT_USER_ACTION=ignore PIPX_HOME=/root/.local/share/pipx PIPX_LOCAL_VENVS=/root/.local/share/pipx/venvs UV_NO_CACHE=1 UV_HTTP_TIMEOUT=500 UV_INDEX_STRATEGY=unsafe-best-match CUDA_HOME=/usr/local/cuda CUDA_ARCHS= UV_SYSTEM_PYTHON=1 UV_PRERELEASE=allow VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 OPAL_PREFIX=/opt/hpcx/ompi OMPI_MCA_coll_hcoll_enable=0 VLLM_AWS_EFA_VERSION=1.44.0 VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_NVIDIA_NVSHMEM_DIR=/usr/local/nvshmem VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 RAY_EXPERIMENTAL_NOSET_CUDA_VISIBLE_DEVICES=1
镜像标签
9.10.2.21-1: com.nvidia.cudnn.version NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer ubuntu: org.opencontainers.image.ref.name 22.04: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2  docker.io/gpustack/runner:cuda12.9-vllm0.11.2

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2  docker.io/gpustack/runner:cuda12.9-vllm0.11.2

Shell快速替换命令

sed -i 's#gpustack/runner:cuda12.9-vllm0.11.2#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2  docker.io/gpustack/runner:cuda12.9-vllm0.11.2'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2  docker.io/gpustack/runner:cuda12.9-vllm0.11.2'

镜像构建历史


# 2025-12-01 13:26:25  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["tini" "--"]
                        
# 2025-12-01 13:26:25  0.00B 设置工作目录为/
WORKDIR /
                        
# 2025-12-01 13:26:25  58.20KB 执行命令并创建新的镜像层
RUN |3 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 /bin/bash -eo pipefail -c     # Patch

    pushd $(pip show vllm | grep Location: | cut -d" " -f 2) \
        && patch -p1 < /workspace/patches/*.patch
 # buildkit
                        
# 2025-12-01 13:26:25  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-12-01 13:26:25  0.00B 定义构建参数
ARG TARGETOS=linux
                        
# 2025-12-01 13:26:25  0.00B 定义构建参数
ARG TARGETPLATFORM=linux/amd64
                        
# 2025-12-01 13:26:25  0.00B 
SHELL [/bin/bash -eo pipefail -c]
                        
# 2025-11-22 01:18:23  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["tini" "--"]
                        
# 2025-11-22 01:18:23  0.00B 设置工作目录为/
WORKDIR /
                        
# 2025-11-22 01:18:23  0.00B 设置环境变量 RAY_EXPERIMENTAL_NOSET_CUDA_VISIBLE_DEVICES
ENV RAY_EXPERIMENTAL_NOSET_CUDA_VISIBLE_DEVICES=1
                        
# 2025-11-22 01:18:23  0.00B 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # Postprocess

    # Review
    uv pip tree \
        --package vllm \
        --package flashinfer-python \
        --package flash-attn \
        --package torch \
        --package triton \
        --package pplx-kernels \
        --package deep-gemm \
        --package deep-ep \
        --package lmcache
 # buildkit
                        
# 2025-11-22 01:18:23  275.06MB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # Dependencies

    # Install
    BITSANDBYTES_VERSION="0.46.1"
    if [[ "${TARGETARCH}" == "arm64" ]]; then
        BITSANDBYTES_VERSION="0.42.0"
    fi
    cat <<EOT >/tmp/requirements.txt
accelerate
hf_transfer
modelscope
bitsandbytes>=${BITSANDBYTES_VERSION}
timm>=1.0.17
boto3
nixl>=0.6.0
EOT
    uv pip install \
        -r /tmp/requirements.txt

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:18:06  37.57MB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # Ray

    # Install Ray Client and Default
    RAY_VERSION=$(pip show ray | grep Version: | cut -d' ' -f 2)
    cat <<EOT >/tmp/requirements.txt
ray[client]==${RAY_VERSION}
ray[default]==${RAY_VERSION}
EOT
    uv pip install \
        -r /tmp/requirements.txt

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:17:58  271.78MB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # LMCache

    # Install
    uv pip install --no-build-isolation \
        /lmcache/workspace/*.whl

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:16:54  4.38GB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # FlashInfer

    # Install
    uv pip install --no-build-isolation \
        /flashinfer/workspace/*.whl

    CMAKE_MAX_JOBS="${CMAKE_MAX_JOBS}"
    if [[ -z "${CMAKE_MAX_JOBS}" ]]; then
        CMAKE_MAX_JOBS="$(( $(nproc) / 2 ))"
    fi
    if (( $(echo "${CMAKE_MAX_JOBS} > 8" | bc -l) )); then
        CMAKE_MAX_JOBS="8"
    fi

    # Download pre-compiled cubins
    FLASHINFER_CUBIN_DOWNLOAD_THREADS="${CMAKE_MAX_JOBS}" \
    FLASHINFER_LOGGING_LEVEL=warning \
        python -m flashinfer --download-cubin

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:13:21  1.00GB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # FlashAttention

    if [[ ! -d /flashattention/workspace ]]; then
        echo "Skipping FlashAttention installation for ${TARGETARCH}..."
        exit 0
    fi

    # Install
    uv pip install --no-build-isolation \
        /flashattention/workspace/*.whl

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:13:19  43.59MB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # DeepGEMM

    # Install
    uv pip install --no-build-isolation \
        /deepgemm/workspace/*.whl

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:13:18  45.89MB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # DeepEP

    # Install
    uv pip install --no-build-isolation \
        /deepep/workspace/*.whl

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:13:18  122.52MB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # PPLX Kernels

    # Install
    uv pip install --no-build-isolation \
        /pplx-kernels/workspace/*.whl

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-22 01:13:17  4.59GB 执行命令并创建新的镜像层
RUN |10 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 VLLM_VERSION=0.11.2 /bin/bash -eo pipefail -c     # vLLM

    # Install
    uv pip install \
        /vllm/workspace/*.whl

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-17 22:08:56  0.00B 设置环境变量 VLLM_VERSION
ENV VLLM_VERSION=0.11.2
                        
# 2025-11-17 22:08:56  0.00B 定义构建参数
ARG VLLM_VERSION=0.11.2
                        
# 2025-11-17 22:08:56  0.00B 定义构建参数
ARG CMAKE_MAX_JOBS
                        
# 2025-11-17 22:08:56  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-11-17 22:08:56  0.00B 定义构建参数
ARG TARGETOS=linux
                        
# 2025-11-17 22:08:56  0.00B 定义构建参数
ARG TARGETPLATFORM=linux/amd64
                        
# 2025-11-17 22:08:56  0.00B 
SHELL [/bin/bash -eo pipefail -c]
                        
# 2025-11-17 22:08:56  116.02MB 执行命令并创建新的镜像层
RUN |9 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 /bin/bash -eo pipefail -c     # Dependencies

    IFS="." read -r CUDA_MAJOR CUDA_MINOR CUDA_PATCH <<< "${VLLM_TORCH_CUDA_VERSION}"

    # Install
    cat <<EOT >/tmp/requirements.txt
requests
pyyaml
einops
cuda-python==${CUDA_MAJOR}.${CUDA_MINOR}
pynvml==${CUDA_MAJOR}
nvidia-nvshmem-cu${CUDA_MAJOR}
EOT
    uv pip install \
        -r /tmp/requirements.txt

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-17 22:08:55  7.88GB 执行命令并创建新的镜像层
RUN |9 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1 /bin/bash -eo pipefail -c     # Torch

    # Install
    cat <<EOT >/tmp/requirements.txt
torch==${VLLM_TORCH_VERSION}
torchvision
torchaudio
EOT
    IFS="." read -r CUDA_MAJOR CUDA_MINOR CUDA_PATCH <<< "${VLLM_TORCH_CUDA_VERSION}"
    uv pip install --index-url https://download.pytorch.org/whl/cu${CUDA_MAJOR}${CUDA_MINOR} \
        -r /tmp/requirements.txt
    uv pip install \
        numpy scipy

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-17 21:58:12  0.00B 设置环境变量 VLLM_TORCH_VERSION VLLM_TORCH_CUDA_VERSION
ENV VLLM_TORCH_VERSION=2.9.0 VLLM_TORCH_CUDA_VERSION=12.9.1
                        
# 2025-11-17 21:58:12  0.00B 定义构建参数
ARG VLLM_TORCH_CUDA_VERSION=12.9.1
                        
# 2025-11-17 21:58:12  0.00B 定义构建参数
ARG VLLM_TORCH_VERSION=2.9.0
                        
# 2025-11-17 21:58:12  457.07MB 执行命令并创建新的镜像层
RUN |7 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 CMAKE_MAX_JOBS= VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 /bin/bash -eo pipefail -c     # NVIDIA NVSHMEM

    IFS="." read -r CUDA_MAJOR CUDA_MINOR CUDA_PATCH <<< "${CUDA_VERSION}"

    # Download
    mkdir -p /tmp/nvshmem
    if (( $(echo "${CUDA_MAJOR} > 12" | bc -l) )); then
        curl --retry 3 --retry-connrefused -fL "https://github.com/NVIDIA/nvshmem/releases/download/v${VLLM_NVIDIA_NVSHMEM_VERSION}-0/nvshmem_src_cuda-all-all-${VLLM_NVIDIA_NVSHMEM_VERSION}.tar.gz" | tar -zxv -C /tmp
    else
        curl --retry 3 --retry-connrefused -fL "https://developer.download.nvidia.com/compute/redist/nvshmem/${VLLM_NVIDIA_NVSHMEM_VERSION}/source/nvshmem_src_cuda12-all-all-${VLLM_NVIDIA_NVSHMEM_VERSION}.tar.gz" | tar -zxv -C /tmp
    fi

    # Build
    CMAKE_MAX_JOBS="${CMAKE_MAX_JOBS}"
    if [[ -z "${CMAKE_MAX_JOBS}" ]]; then
        CMAKE_MAX_JOBS="$(( $(nproc) / 2 ))"
    fi
    if (( $(echo "${CMAKE_MAX_JOBS} > 4" | bc -l) )); then
        CMAKE_MAX_JOBS="4"
    fi
    NS_CUDA_ARCHS="${CUDA_ARCHS}"
    if [[ -z "${NS_CUDA_ARCHS}" ]]; then
        if (( $(echo "${CUDA_MAJOR}.${CUDA_MINOR} < 12.9" | bc -l) )); then
            NS_CUDA_ARCHS="7.5 8.0 8.9 9.0 10.0 12.0"
        else
            NS_CUDA_ARCHS="7.5 8.0 8.9 9.0 10.0 10.3 12.0 12.1"
        fi
    fi
    export MAX_JOBS="${CMAKE_MAX_JOBS}"
    export CUDA_ARCH="${NS_CUDA_ARCHS}"
    export NVSHMEM_IBGDA_SUPPORT=1
    export NVSHMEM_USE_GDRCOPY=1
    export NVSHMEM_SHMEM_SUPPORT=0
    export NVSHMEM_UCX_SUPPORT=0
    export NVSHMEM_USE_NCCL=0
    export NVSHMEM_PMIX_SUPPORT=0
    export NVSHMEM_TIMEOUT_DEVICE_POLLING=0
    export NVSHMEM_IBRC_SUPPORT=0
    export NVSHMEM_BUILD_TESTS=0
    export NVSHMEM_BUILD_EXAMPLES=0
    export NVSHMEM_MPI_SUPPORT=0
    export NVSHMEM_BUILD_HYDRA_LAUNCHER=0
    export NVSHMEM_BUILD_TXZ_PACKAGE=0
    export NVSHMEM_TIMEOUT_DEVICE_POLLING=0
    export NVCC_THREADS=1
    echo "Building NVSHMEM with the following environment variables:"
    env
    # FIX: Hide Python3.10 to avoid issues with Python version mismatch.
    PYTHON3_10_BIN=$(which python3.10 || true)
    if [[ -n "${PYTHON3_10_BIN}" ]]; then
        mv "${PYTHON3_10_BIN}" /tmp/python3.10
    fi
    pushd /tmp/nvshmem_src \
        && cmake -G Ninja -S . -B build -DCMAKE_INSTALL_PREFIX=${VLLM_NVIDIA_NVSHMEM_DIR} \
        && cmake --build build --target install -j${MAX_JOBS}
    if [[ -n "${PYTHON3_10_BIN}" ]]; then
        mv /tmp/python3.10 "${PYTHON3_10_BIN}"
    fi

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-17 21:45:21  0.00B 设置环境变量 VLLM_NVIDIA_NVSHMEM_VERSION VLLM_NVIDIA_NVSHMEM_DIR
ENV VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5 VLLM_NVIDIA_NVSHMEM_DIR=/usr/local/nvshmem
                        
# 2025-11-17 21:45:21  0.00B 定义构建参数
ARG VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5
                        
# 2025-11-17 21:45:21  0.00B 定义构建参数
ARG CMAKE_MAX_JOBS
                        
# 2025-11-17 21:45:21  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/mpi/bin:/usr/local/ucx/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/amazon/efa/bin
                        
# 2025-11-17 21:45:21  46.83MB 执行命令并创建新的镜像层
RUN |5 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 VLLM_AWS_EFA_VERSION=1.44.0 /bin/bash -eo pipefail -c     # AWS EFA

    # Download
    curl --retry 3 --retry-connrefused -fL "https://efa-installer.amazonaws.com/aws-efa-installer-${VLLM_AWS_EFA_VERSION}.tar.gz" | tar -zxv -C /tmp

    # Install
    pushd /tmp/aws-efa-installer && \
        ./efa_installer.sh -y --skip-kmod

    # Prepare
    rm /opt/amazon/efa/lib/libfabric.a || true

    # Review
    ldconfig -v

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-17 21:43:11  0.00B 设置环境变量 VLLM_AWS_EFA_VERSION
ENV VLLM_AWS_EFA_VERSION=1.44.0
                        
# 2025-11-17 21:43:11  0.00B 定义构建参数
ARG VLLM_AWS_EFA_VERSION=1.44.0
                        
# 2025-11-17 21:43:11  0.00B 设置环境变量 PATH OPAL_PREFIX OMPI_MCA_coll_hcoll_enable
ENV PATH=/usr/local/mpi/bin:/usr/local/ucx/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin OPAL_PREFIX=/opt/hpcx/ompi OMPI_MCA_coll_hcoll_enable=0
                        
# 2025-11-17 21:43:11  1.53GB 执行命令并创建新的镜像层
RUN |4 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12 /bin/bash -eo pipefail -c     # NVIDIA HPC-X

    # Prepare
    rm -f $(dpkg-query -L libibverbs-dev librdmacm-dev libibumad-dev | grep "\(\.so\|\.a\)$") || true
    IFS="." read -r CUDA_MAJOR CUDA_MINOR CUDA_PATCH <<< "${CUDA_VERSION}"
    source /etc/os-release

    # Get Download Version
    # If VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda13, VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD=2.24.1
    # If VLLM_NVIDIA_HPCX_VERSION=2.22.1rc4, VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD=2.22.1
    # If VLLM_NVIDIA_HPCX_VERSION=2.21.3, VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD=2.21.3
    if [[ "${VLLM_NVIDIA_HPCX_VERSION}" == *"_cuda"* ]]; then
        VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD=$(echo "${VLLM_NVIDIA_HPCX_VERSION}" | sed 's/_cuda.*//')
    elif [[ "${VLLM_NVIDIA_HPCX_VERSION}" == *"rc"* ]]; then
        VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD=$(echo "${VLLM_NVIDIA_HPCX_VERSION}" | sed 's/rc.*//')
    else
        VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD=${VLLM_NVIDIA_HPCX_VERSION}
    fi

    # Download
    mkdir -p /opt/hpcx
    curl --retry 3 --retry-connrefused -fL "https://content.mellanox.com/hpc/hpc-x/v${VLLM_NVIDIA_HPCX_VERSION}/hpcx-v${VLLM_NVIDIA_HPCX_VERSION_DOWNLOAD}-gcc-inbox-${ID}${VERSION_ID}-cuda${CUDA_MAJOR}-$(uname -m).tbz" | tar -jxv -C /opt/hpcx --strip-components 1

    # Install
    ln -sf /opt/hpcx/ompi /usr/local/mpi
    ln -sf /opt/hpcx/ucx /usr/local/ucx
    sed -i 's/^\(hwloc_base_binding_policy\) = core$/\1 = none/' /opt/hpcx/ompi/etc/openmpi-mca-params.conf
    sed -i 's/^\(btl = self\)$/#\1/' /opt/hpcx/ompi/etc/openmpi-mca-params.conf
    cat <<EOT > /etc/ld.so.conf.d/hpcx.conf
/opt/hpcx/clusterkit/lib
/opt/hpcx/hcoll/lib
/opt/hpcx/nccl_rdma_sharp_plugin/lib
/opt/hpcx/ncclnet_plugin/lib
/opt/hpcx/ompi/lib
/opt/hpcx/sharp/lib
/opt/hpcx/ucc/lib
/opt/hpcx/ucx/lib
EOT

    # Fix DeepEP IBGDA symlink
    ln -sf /usr/lib/$(uname -m)-linux-gnu/libmlx5.so.1 /usr/lib/$(uname -m)-linux-gnu/libmlx5.so || true

    # Review
    ldconfig -v

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-17 21:42:40  0.00B 设置环境变量 VLLM_NVIDIA_HPCX_VERSION
ENV VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12
                        
# 2025-11-17 21:42:40  0.00B 定义构建参数
ARG VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12
                        
# 2025-11-17 21:42:40  1.89MB 执行命令并创建新的镜像层
RUN |3 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 /bin/bash -eo pipefail -c     # GDRCopy

    # Install
    dpkg -i /gdrcopy/workspace/libgdrapi_*.deb && \
        ldconfig -v

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-17 21:42:40  0.00B 设置环境变量 UV_SYSTEM_PYTHON UV_PRERELEASE
ENV UV_SYSTEM_PYTHON=1 UV_PRERELEASE=allow
                        
# 2025-11-17 21:42:40  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-11-17 21:42:40  0.00B 定义构建参数
ARG TARGETOS=linux
                        
# 2025-11-17 21:42:40  0.00B 定义构建参数
ARG TARGETPLATFORM=linux/amd64
                        
# 2025-11-17 21:42:40  0.00B 
SHELL [/bin/bash -eo pipefail -c]
                        
# 2025-11-12 16:22:51  0.00B 设置环境变量 CUDA_HOME CUDA_VERSION CUDA_ARCHS
ENV CUDA_HOME=/usr/local/cuda CUDA_VERSION=12.9.1 CUDA_ARCHS=
                        
# 2025-11-12 16:22:51  0.00B 定义构建参数
ARG CUDA_ARCHS
                        
# 2025-11-12 16:22:51  0.00B 定义构建参数
ARG CUDA_VERSION=12.9.1
                        
# 2025-11-12 16:22:51  151.88MB 执行命令并创建新的镜像层
RUN |4 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 PYTHON_VERSION=3.12 /bin/bash -eo pipefail -c     # Buildkit

    cat <<EOT >/tmp/requirements.txt
build
cmake<4
ninja<1.11
setuptools<80
setuptools-scm
packaging<25
wheel==0.45.1
pybind11<3
Cython
psutil
pipx
uv
EOT
    pip install -r /tmp/requirements.txt

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/*
 # buildkit
                        
# 2025-11-12 16:22:46  0.00B 设置环境变量 PIP_NO_CACHE_DIR PIP_DISABLE_PIP_VERSION_CHECK PIP_ROOT_USER_ACTION PIPX_HOME PIPX_LOCAL_VENVS UV_NO_CACHE UV_HTTP_TIMEOUT UV_INDEX_STRATEGY
ENV PIP_NO_CACHE_DIR=1 PIP_DISABLE_PIP_VERSION_CHECK=1 PIP_ROOT_USER_ACTION=ignore PIPX_HOME=/root/.local/share/pipx PIPX_LOCAL_VENVS=/root/.local/share/pipx/venvs UV_NO_CACHE=1 UV_HTTP_TIMEOUT=500 UV_INDEX_STRATEGY=unsafe-best-match
                        
# 2025-11-12 16:22:46  90.35MB 执行命令并创建新的镜像层
RUN |4 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 PYTHON_VERSION=3.12 /bin/bash -eo pipefail -c     # Python

    if (( $(echo "$(python3 --version | cut -d' ' -f2 | cut -d'.' -f1,2) == ${PYTHON_VERSION}" | bc -l) )); then
        echo "Skipping Python upgrade for ${PYTHON_VERSION}..."
        if [[ -z "$(ldconfig -v 2>/dev/null | grep libpython${PYTHON_VERSION})" ]]; then
            PYTHON_LIB_PREFIX=$(python3 -c "import sys; print(sys.base_prefix);")
            echo "${PYTHON_LIB_PREFIX}/lib" >> /etc/ld.so.conf.d/python3.conf
            echo "${PYTHON_LIB_PREFIX}/lib64" >> /etc/ld.so.conf.d/python3.conf
            ldconfig -v
        fi
        exit 0
    fi

    # Add deadsnakes PPA for Python versions
    for i in 1 2 3; do
        add-apt-repository -y ppa:deadsnakes/ppa && break || { echo "Attempt $i failed, retrying in 5s..."; sleep 5; }
    done
    apt-get update -y

    # Install
    apt-get install -y --no-install-recommends \
        python${PYTHON_VERSION} \
        python${PYTHON_VERSION}-dev \
        python${PYTHON_VERSION}-venv \
        python${PYTHON_VERSION}-lib2to3 \
        python${PYTHON_VERSION}-gdbm \
        python${PYTHON_VERSION}-tk
    if (( $(echo "${PYTHON_VERSION} <= 3.11" | bc -l) )); then
        apt-get install -y --no-install-recommends \
            python${PYTHON_VERSION}-distutils
    fi

    # Update alternatives
    if [[ -f /etc/alternatives/python3 ]]; then update-alternatives --remove-all python3; fi; update-alternatives --install /usr/bin/python3 python3 /usr/bin/python${PYTHON_VERSION} 1
    if [[ -f /etc/alternatives/python ]]; then update-alternatives --remove-all python; fi; update-alternatives --install /usr/bin/python python /usr/bin/python${PYTHON_VERSION} 1
    curl -sS "https://bootstrap.pypa.io/get-pip.py" | python${PYTHON_VERSION}
    if [[ -f /etc/alternatives/2to3 ]]; then update-alternatives --remove-all 2to3; fi; update-alternatives --install /usr/bin/2to3 2to3 /usr/bin/2to3${PYTHON_VERSION} 1 || true
    if [[ -f /etc/alternatives/pydoc3 ]]; then update-alternatives --remove-all pydoc3; fi; update-alternatives --install /usr/bin/pydoc3 pydoc3 /usr/bin/pydoc${PYTHON_VERSION} 1 || true
    if [[ -f /etc/alternatives/idle3 ]]; then update-alternatives --remove-all idle3; fi; update-alternatives --install /usr/bin/idle3 idle3 /usr/bin/idle${PYTHON_VERSION} 1 || true
    if [[ -f /etc/alternatives/python3-config ]]; then update-alternatives --remove-all python3-config; fi; update-alternatives --install /usr/bin/python3-config python3-config /usr/bin/python${PYTHON_VERSION}-config 1 || true

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-12 16:22:04  0.00B 设置环境变量 PYTHON_VERSION
ENV PYTHON_VERSION=3.12
                        
# 2025-11-12 16:22:04  0.00B 定义构建参数
ARG PYTHON_VERSION=3.12
                        
# 2025-11-12 16:22:04  1.01GB 执行命令并创建新的镜像层
RUN |3 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 /bin/bash -eo pipefail -c     # C buildkit

    # Install
    apt-get install -y --no-install-recommends \
        make ninja-build pkg-config ccache
    curl --retry 3 --retry-connrefused -fL "https://github.com/Kitware/CMake/releases/download/v3.31.7/cmake-3.31.7-linux-$(uname -m).tar.gz" | tar -zx -C /usr --strip-components 1

    # Install dependencies
    apt-get install -y --no-install-recommends \
        perl-openssl-defaults perl yasm \
        zlib1g zlib1g-dev libbz2-dev libffi-dev libgdbm-dev libgdbm-compat-dev \
        openssl libssl-dev libsqlite3-dev lcov libomp-dev \
        libblas-dev liblapack-dev libopenblas-dev libblas3 liblapack3 libhdf5-dev \
        libxml2 libxslt1-dev libgl1-mesa-glx libgmpxx4ldbl \
        libncurses5-dev libreadline6-dev libsqlite3-dev \
        liblzma-dev lzma lzma-dev tk-dev uuid-dev libmpdec-dev \
        ffmpeg libjpeg-dev libpng-dev libtiff-dev libwebp-dev \
        libnuma1 libnuma-dev libjemalloc-dev \
        libgrpc-dev libgrpc++-dev libprotobuf-dev protobuf-compiler protobuf-compiler-grpc \
        libnl-route-3-200 libnl-3-200 libnl-3-dev  libnl-route-3-dev \
        libibverbs1 libibverbs-dev \
        librdmacm1 librdmacm-dev \
        libibumad3 libibumad-dev \
        libtool \
        ibverbs-utils ibverbs-providers libibverbs-dev

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-12 16:21:28  0.00B 执行命令并创建新的镜像层
RUN |3 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 /bin/bash -eo pipefail -c     # GCC

    # Upgrade GCC if the Ubuntu version is lower than 21.04.
    source /etc/os-release
    if (( $(echo "${VERSION_ID} >= 21.04" | bc -l) )); then
        echo "Skipping GCC upgrade for ${VERSION_ID}..."
        exit 0
    fi

    # Install
    apt-get install -y --no-install-recommends \
        gcc-11 g++-11 gfortran-11 gfortran

    # Update alternatives
    if [[ -f /etc/alternatives/gcov-dump ]]; then update-alternatives --remove-all gcov-dump; fi; update-alternatives --install /usr/bin/gcov-dump gcov-dump /usr/bin/gcov-dump-11 10
    if [[ -f /etc/alternatives/lto-dump ]]; then update-alternatives --remove-all lto-dump; fi; update-alternatives --install /usr/bin/lto-dump lto-dump /usr/bin/lto-dump-11 10
    if [[ -f /etc/alternatives/gcov ]]; then update-alternatives --remove-all gcov; fi; update-alternatives --install /usr/bin/gcov gcov /usr/bin/gcov-11 10
    if [[ -f /etc/alternatives/gcc ]]; then update-alternatives --remove-all gcc; fi; update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-11 10
    if [[ -f /etc/alternatives/gcc-nm ]]; then update-alternatives --remove-all gcc-nm; fi; update-alternatives --install /usr/bin/gcc-nm gcc-nm /usr/bin/gcc-nm-11 10
    if [[ -f /etc/alternatives/cpp ]]; then update-alternatives --remove-all cpp; fi; update-alternatives --install /usr/bin/cpp cpp /usr/bin/cpp-11 10
    if [[ -f /etc/alternatives/g++ ]]; then update-alternatives --remove-all g++; fi; update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-11 10
    if [[ -f /etc/alternatives/gcc-ar ]]; then update-alternatives --remove-all gcc-ar; fi; update-alternatives --install /usr/bin/gcc-ar gcc-ar /usr/bin/gcc-ar-11 10
    if [[ -f /etc/alternatives/gcov-tool ]]; then update-alternatives --remove-all gcov-tool; fi; update-alternatives --install /usr/bin/gcov-tool gcov-tool /usr/bin/gcov-tool-11 10
    if [[ -f /etc/alternatives/gcc-ranlib ]]; then update-alternatives --remove-all gcc-ranlib; fi; update-alternatives --install /usr/bin/gcc-ranlib gcc-ranlib /usr/bin/gcc-ranlib-11 10
    if [[ -f /etc/alternatives/gfortran ]]; then update-alternatives --remove-all gfortran; fi; update-alternatives --install /usr/bin/gfortran gfortran /usr/bin/gfortran-11 10

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-12 16:21:27  348.86MB 执行命令并创建新的镜像层
RUN |3 TARGETPLATFORM=linux/amd64 TARGETOS=linux TARGETARCH=amd64 /bin/bash -eo pipefail -c     # Tools

    # Refresh
    apt-get update -y && apt-get install -y --no-install-recommends \
        software-properties-common apt-transport-https \
        ca-certificates gnupg2 lsb-release gnupg-agent \
      && apt-get update -y \
      && add-apt-repository -y ppa:ubuntu-toolchain-r/test \
      && apt-get update -y

    # Install
    apt-get install -y --no-install-recommends \
        ca-certificates build-essential binutils bash openssl \
        curl wget aria2 \
        git git-lfs \
        unzip xz-utils \
        tzdata locales \
        iproute2 iputils-ping ifstat net-tools dnsutils pciutils ipmitool \
        rdma-core rdmacm-utils infiniband-diags \
        procps sysstat htop \
        tini vim jq bc tree

    # Update locale
    localedef -i en_US -c -f UTF-8 -A /usr/share/locale/locale.alias en_US.UTF-8

    # Update timezone
    rm -f /etc/localtime \
        && ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime \
        && echo "Asia/Shanghai" > /etc/timezone \
        && dpkg-reconfigure --frontend noninteractive tzdata

    # Cleanup
    rm -rf /var/tmp/* \
        && rm -rf /tmp/* \
        && rm -rf /var/cache/apt
 # buildkit
                        
# 2025-11-12 16:21:27  0.00B 设置环境变量 DEBIAN_FRONTEND LANG LANGUAGE LC_ALL
ENV DEBIAN_FRONTEND=noninteractive LANG=en_US.UTF-8 LANGUAGE=en_US:en LC_ALL=en_US.UTF-8
                        
# 2025-11-12 16:21:27  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-11-12 16:21:27  0.00B 定义构建参数
ARG TARGETOS=linux
                        
# 2025-11-12 16:21:27  0.00B 定义构建参数
ARG TARGETPLATFORM=linux/amd64
                        
# 2025-11-12 16:21:27  0.00B 
SHELL [/bin/bash -eo pipefail -c]
                        
# 2025-07-25 23:15:09  1.05GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     ${NV_CUDNN_PACKAGE}     ${NV_CUDNN_PACKAGE_DEV}     ${NV_CUDNN_PACKAGE_DEV_HEADERS}     && apt-mark hold ${NV_CUDNN_PACKAGE_NAME}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-07-25 23:15:09  0.00B 添加元数据标签
LABEL com.nvidia.cudnn.version=9.10.2.21-1
                        
# 2025-07-25 23:15:09  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-07-25 23:15:09  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-07-25 23:15:09  0.00B 设置环境变量 NV_CUDNN_PACKAGE_DEV_HEADERS
ENV NV_CUDNN_PACKAGE_DEV_HEADERS=libcudnn9-headers-cuda-12=9.10.2.21-1
                        
# 2025-07-25 23:15:09  0.00B 设置环境变量 NV_CUDNN_PACKAGE_DEV
ENV NV_CUDNN_PACKAGE_DEV=libcudnn9-dev-cuda-12=9.10.2.21-1
                        
# 2025-07-25 23:15:09  0.00B 设置环境变量 NV_CUDNN_PACKAGE
ENV NV_CUDNN_PACKAGE=libcudnn9-cuda-12=9.10.2.21-1
                        
# 2025-07-25 23:15:09  0.00B 设置环境变量 NV_CUDNN_PACKAGE_NAME
ENV NV_CUDNN_PACKAGE_NAME=libcudnn9-cuda-12
                        
# 2025-07-25 23:15:09  0.00B 设置环境变量 NV_CUDNN_VERSION
ENV NV_CUDNN_VERSION=9.10.2.21-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 LIBRARY_PATH
ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs
                        
# 2025-07-19 04:30:19  389.48KB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_DEV_PACKAGE_NAME} ${NV_LIBNCCL_DEV_PACKAGE_NAME} # buildkit
                        
# 2025-07-19 04:30:19  6.32GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-dev-12-9=${NV_CUDA_CUDART_DEV_VERSION}     cuda-command-line-tools-12-9=${NV_CUDA_LIB_VERSION}     cuda-minimal-build-12-9=${NV_CUDA_LIB_VERSION}     cuda-libraries-dev-12-9=${NV_CUDA_LIB_VERSION}     cuda-nvml-dev-12-9=${NV_NVML_DEV_VERSION}     ${NV_NVPROF_DEV_PACKAGE}     ${NV_LIBNPP_DEV_PACKAGE}     libcusparse-dev-12-9=${NV_LIBCUSPARSE_DEV_VERSION}     ${NV_LIBCUBLAS_DEV_PACKAGE}     ${NV_LIBNCCL_DEV_PACKAGE}     ${NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-07-19 04:30:19  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-07-19 04:30:19  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBNCCL_DEV_PACKAGE
ENV NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.27.3-1+cuda12.9
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NCCL_VERSION
ENV NCCL_VERSION=2.27.3-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBNCCL_DEV_PACKAGE_VERSION
ENV NV_LIBNCCL_DEV_PACKAGE_VERSION=2.27.3-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBNCCL_DEV_PACKAGE_NAME
ENV NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_NVPROF_DEV_PACKAGE
ENV NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-9=12.9.79-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_NVPROF_VERSION
ENV NV_NVPROF_VERSION=12.9.79-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE
ENV NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-9=12.9.1-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_CUDA_NSIGHT_COMPUTE_VERSION
ENV NV_CUDA_NSIGHT_COMPUTE_VERSION=12.9.1-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBCUBLAS_DEV_PACKAGE
ENV NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-9=12.9.1.4-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBCUBLAS_DEV_PACKAGE_NAME
ENV NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-9
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBCUBLAS_DEV_VERSION
ENV NV_LIBCUBLAS_DEV_VERSION=12.9.1.4-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBNPP_DEV_PACKAGE
ENV NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-9=12.4.1.87-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBNPP_DEV_VERSION
ENV NV_LIBNPP_DEV_VERSION=12.4.1.87-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_LIBCUSPARSE_DEV_VERSION
ENV NV_LIBCUSPARSE_DEV_VERSION=12.5.10.65-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_NVML_DEV_VERSION
ENV NV_NVML_DEV_VERSION=12.9.79-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_CUDA_CUDART_DEV_VERSION
ENV NV_CUDA_CUDART_DEV_VERSION=12.9.79-1
                        
# 2025-07-19 04:30:19  0.00B 设置环境变量 NV_CUDA_LIB_VERSION
ENV NV_CUDA_LIB_VERSION=12.9.1-1
                        
# 2025-07-19 04:16:43  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2025-07-19 04:16:43  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2025-07-19 04:16:43  2.53KB 复制新文件或目录到容器中
COPY nvidia_entrypoint.sh /opt/nvidia/ # buildkit
                        
# 2025-07-19 04:16:43  3.06KB 复制新文件或目录到容器中
COPY entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2025-07-19 04:16:43  263.08KB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_PACKAGE_NAME} ${NV_LIBNCCL_PACKAGE_NAME} # buildkit
                        
# 2025-07-19 04:16:42  3.46GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-libraries-12-9=${NV_CUDA_LIB_VERSION}     ${NV_LIBNPP_PACKAGE}     cuda-nvtx-12-9=${NV_NVTX_VERSION}     libcusparse-12-9=${NV_LIBCUSPARSE_VERSION}     ${NV_LIBCUBLAS_PACKAGE}     ${NV_LIBNCCL_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-07-19 04:16:42  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-07-19 04:16:42  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE
ENV NV_LIBNCCL_PACKAGE=libnccl2=2.27.3-1+cuda12.9
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NCCL_VERSION
ENV NCCL_VERSION=2.27.3-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE_VERSION
ENV NV_LIBNCCL_PACKAGE_VERSION=2.27.3-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE_NAME
ENV NV_LIBNCCL_PACKAGE_NAME=libnccl2
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBCUBLAS_PACKAGE
ENV NV_LIBCUBLAS_PACKAGE=libcublas-12-9=12.9.1.4-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBCUBLAS_VERSION
ENV NV_LIBCUBLAS_VERSION=12.9.1.4-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBCUBLAS_PACKAGE_NAME
ENV NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-9
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBCUSPARSE_VERSION
ENV NV_LIBCUSPARSE_VERSION=12.5.10.65-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBNPP_PACKAGE
ENV NV_LIBNPP_PACKAGE=libnpp-12-9=12.4.1.87-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_LIBNPP_VERSION
ENV NV_LIBNPP_VERSION=12.4.1.87-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_NVTX_VERSION
ENV NV_NVTX_VERSION=12.9.79-1
                        
# 2025-07-19 04:16:42  0.00B 设置环境变量 NV_CUDA_LIB_VERSION
ENV NV_CUDA_LIB_VERSION=12.9.1-1
                        
# 2025-07-19 04:11:19  0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
                        
# 2025-07-19 04:11:19  0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
                        
# 2025-07-19 04:11:19  17.29KB 复制新文件或目录到容器中
COPY NGC-DL-CONTAINER-LICENSE / # buildkit
                        
# 2025-07-19 04:11:19  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/cuda/lib64
                        
# 2025-07-19 04:11:19  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-07-19 04:11:19  22.00B 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/cuda/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2025-07-19 04:11:19  315.65MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-12-9=${NV_CUDA_CUDART_VERSION}     cuda-compat-12-9     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-07-19 04:11:02  0.00B 设置环境变量 CUDA_VERSION
ENV CUDA_VERSION=12.9.1
                        
# 2025-07-19 04:11:02  10.60MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     gnupg2 curl ca-certificates &&     curl -fsSLO https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/${NVARCH}/cuda-keyring_1.1-1_all.deb &&     dpkg -i cuda-keyring_1.1-1_all.deb &&     apt-get purge --autoremove -y curl     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-07-19 04:11:02  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-07-19 04:11:02  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-07-19 04:11:02  0.00B 设置环境变量 NV_CUDA_CUDART_VERSION
ENV NV_CUDA_CUDART_VERSION=12.9.79-1
                        
# 2025-07-19 04:11:02  0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand
ENV NVIDIA_REQUIRE_CUDA=cuda>=12.9 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 brand=unknown,driver>=570,driver<571 brand=grid,driver>=570,driver<571 brand=tesla,driver>=570,driver<571 brand=nvidia,driver>=570,driver<571 brand=quadro,driver>=570,driver<571 brand=quadrortx,driver>=570,driver<571 brand=nvidiartx,driver>=570,driver<571 brand=vapps,driver>=570,driver<571 brand=vpc,driver>=570,driver<571 brand=vcs,driver>=570,driver<571 brand=vws,driver>=570,driver<571 brand=cloudgaming,driver>=570,driver<571
                        
# 2025-07-19 04:11:02  0.00B 设置环境变量 NVARCH
ENV NVARCH=x86_64
                        
# 2025-07-15 00:33:32  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-07-15 00:33:31  77.87MB 
/bin/sh -c #(nop) ADD file:415bbc01dfb447d002e2d8173e113ef025d2bbfa20f1205823fa699dc87a2019 in / 
                        
# 2025-07-15 00:33:29  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2025-07-15 00:33:29  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-07-15 00:33:29  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-07-15 00:33:29  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:2e0019442f2ae84b1975dc2e712f0c429096680d09192ad1059fc9a2f4f11440",
    "RepoTags": [
        "gpustack/runner:cuda12.9-vllm0.11.2",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner:cuda12.9-vllm0.11.2"
    ],
    "RepoDigests": [
        "gpustack/runner@sha256:02ed03f02433f7339ebe1bdd4b8407bbdc36e92e5ae39dce3ca4b4aaa892324a",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/gpustack/runner@sha256:b537ec3c5ec54123faed1e3552d67e20478a81eac026cd2aa6b96d3fda594166"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-12-01T05:26:25.336207966Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/mpi/bin:/usr/local/ucx/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/amazon/efa/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.9 brand=unknown,driver\u003e=535,driver\u003c536 brand=grid,driver\u003e=535,driver\u003c536 brand=tesla,driver\u003e=535,driver\u003c536 brand=nvidia,driver\u003e=535,driver\u003c536 brand=quadro,driver\u003e=535,driver\u003c536 brand=quadrortx,driver\u003e=535,driver\u003c536 brand=nvidiartx,driver\u003e=535,driver\u003c536 brand=vapps,driver\u003e=535,driver\u003c536 brand=vpc,driver\u003e=535,driver\u003c536 brand=vcs,driver\u003e=535,driver\u003c536 brand=vws,driver\u003e=535,driver\u003c536 brand=cloudgaming,driver\u003e=535,driver\u003c536 brand=unknown,driver\u003e=550,driver\u003c551 brand=grid,driver\u003e=550,driver\u003c551 brand=tesla,driver\u003e=550,driver\u003c551 brand=nvidia,driver\u003e=550,driver\u003c551 brand=quadro,driver\u003e=550,driver\u003c551 brand=quadrortx,driver\u003e=550,driver\u003c551 brand=nvidiartx,driver\u003e=550,driver\u003c551 brand=vapps,driver\u003e=550,driver\u003c551 brand=vpc,driver\u003e=550,driver\u003c551 brand=vcs,driver\u003e=550,driver\u003c551 brand=vws,driver\u003e=550,driver\u003c551 brand=cloudgaming,driver\u003e=550,driver\u003c551 brand=unknown,driver\u003e=560,driver\u003c561 brand=grid,driver\u003e=560,driver\u003c561 brand=tesla,driver\u003e=560,driver\u003c561 brand=nvidia,driver\u003e=560,driver\u003c561 brand=quadro,driver\u003e=560,driver\u003c561 brand=quadrortx,driver\u003e=560,driver\u003c561 brand=nvidiartx,driver\u003e=560,driver\u003c561 brand=vapps,driver\u003e=560,driver\u003c561 brand=vpc,driver\u003e=560,driver\u003c561 brand=vcs,driver\u003e=560,driver\u003c561 brand=vws,driver\u003e=560,driver\u003c561 brand=cloudgaming,driver\u003e=560,driver\u003c561 brand=unknown,driver\u003e=565,driver\u003c566 brand=grid,driver\u003e=565,driver\u003c566 brand=tesla,driver\u003e=565,driver\u003c566 brand=nvidia,driver\u003e=565,driver\u003c566 brand=quadro,driver\u003e=565,driver\u003c566 brand=quadrortx,driver\u003e=565,driver\u003c566 brand=nvidiartx,driver\u003e=565,driver\u003c566 brand=vapps,driver\u003e=565,driver\u003c566 brand=vpc,driver\u003e=565,driver\u003c566 brand=vcs,driver\u003e=565,driver\u003c566 brand=vws,driver\u003e=565,driver\u003c566 brand=cloudgaming,driver\u003e=565,driver\u003c566 brand=unknown,driver\u003e=570,driver\u003c571 brand=grid,driver\u003e=570,driver\u003c571 brand=tesla,driver\u003e=570,driver\u003c571 brand=nvidia,driver\u003e=570,driver\u003c571 brand=quadro,driver\u003e=570,driver\u003c571 brand=quadrortx,driver\u003e=570,driver\u003c571 brand=nvidiartx,driver\u003e=570,driver\u003c571 brand=vapps,driver\u003e=570,driver\u003c571 brand=vpc,driver\u003e=570,driver\u003c571 brand=vcs,driver\u003e=570,driver\u003c571 brand=vws,driver\u003e=570,driver\u003c571 brand=cloudgaming,driver\u003e=570,driver\u003c571",
            "NV_CUDA_CUDART_VERSION=12.9.79-1",
            "CUDA_VERSION=12.9.1",
            "LD_LIBRARY_PATH=/usr/local/cuda/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "NV_CUDA_LIB_VERSION=12.9.1-1",
            "NV_NVTX_VERSION=12.9.79-1",
            "NV_LIBNPP_VERSION=12.4.1.87-1",
            "NV_LIBNPP_PACKAGE=libnpp-12-9=12.4.1.87-1",
            "NV_LIBCUSPARSE_VERSION=12.5.10.65-1",
            "NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-9",
            "NV_LIBCUBLAS_VERSION=12.9.1.4-1",
            "NV_LIBCUBLAS_PACKAGE=libcublas-12-9=12.9.1.4-1",
            "NV_LIBNCCL_PACKAGE_NAME=libnccl2",
            "NV_LIBNCCL_PACKAGE_VERSION=2.27.3-1",
            "NCCL_VERSION=2.27.3-1",
            "NV_LIBNCCL_PACKAGE=libnccl2=2.27.3-1+cuda12.9",
            "NVIDIA_PRODUCT_NAME=CUDA",
            "NV_CUDA_CUDART_DEV_VERSION=12.9.79-1",
            "NV_NVML_DEV_VERSION=12.9.79-1",
            "NV_LIBCUSPARSE_DEV_VERSION=12.5.10.65-1",
            "NV_LIBNPP_DEV_VERSION=12.4.1.87-1",
            "NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-9=12.4.1.87-1",
            "NV_LIBCUBLAS_DEV_VERSION=12.9.1.4-1",
            "NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-9",
            "NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-9=12.9.1.4-1",
            "NV_CUDA_NSIGHT_COMPUTE_VERSION=12.9.1-1",
            "NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-9=12.9.1-1",
            "NV_NVPROF_VERSION=12.9.79-1",
            "NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-9=12.9.79-1",
            "NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev",
            "NV_LIBNCCL_DEV_PACKAGE_VERSION=2.27.3-1",
            "NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.27.3-1+cuda12.9",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs",
            "NV_CUDNN_VERSION=9.10.2.21-1",
            "NV_CUDNN_PACKAGE_NAME=libcudnn9-cuda-12",
            "NV_CUDNN_PACKAGE=libcudnn9-cuda-12=9.10.2.21-1",
            "NV_CUDNN_PACKAGE_DEV=libcudnn9-dev-cuda-12=9.10.2.21-1",
            "NV_CUDNN_PACKAGE_DEV_HEADERS=libcudnn9-headers-cuda-12=9.10.2.21-1",
            "DEBIAN_FRONTEND=noninteractive",
            "LANG=en_US.UTF-8",
            "LANGUAGE=en_US:en",
            "LC_ALL=en_US.UTF-8",
            "PYTHON_VERSION=3.12",
            "PIP_NO_CACHE_DIR=1",
            "PIP_DISABLE_PIP_VERSION_CHECK=1",
            "PIP_ROOT_USER_ACTION=ignore",
            "PIPX_HOME=/root/.local/share/pipx",
            "PIPX_LOCAL_VENVS=/root/.local/share/pipx/venvs",
            "UV_NO_CACHE=1",
            "UV_HTTP_TIMEOUT=500",
            "UV_INDEX_STRATEGY=unsafe-best-match",
            "CUDA_HOME=/usr/local/cuda",
            "CUDA_ARCHS=",
            "UV_SYSTEM_PYTHON=1",
            "UV_PRERELEASE=allow",
            "VLLM_NVIDIA_HPCX_VERSION=2.24.1_cuda12",
            "OPAL_PREFIX=/opt/hpcx/ompi",
            "OMPI_MCA_coll_hcoll_enable=0",
            "VLLM_AWS_EFA_VERSION=1.44.0",
            "VLLM_NVIDIA_NVSHMEM_VERSION=3.4.5",
            "VLLM_NVIDIA_NVSHMEM_DIR=/usr/local/nvshmem",
            "VLLM_TORCH_VERSION=2.9.0",
            "VLLM_TORCH_CUDA_VERSION=12.9.1",
            "VLLM_VERSION=0.11.2",
            "RAY_EXPERIMENTAL_NOSET_CUDA_VISIBLE_DEVICES=1"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/",
        "Entrypoint": [
            "tini",
            "--"
        ],
        "OnBuild": null,
        "Labels": {
            "com.nvidia.cudnn.version": "9.10.2.21-1",
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "22.04"
        },
        "Shell": [
            "/bin/bash",
            "-eo",
            "pipefail",
            "-c"
        ]
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 33621604513,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/02fc3f3276a7222a36fb50421a1a3585672ce36c25bc964ae76cb1eb86d162fb/diff:/var/lib/docker/overlay2/12649df01309862221b06c2d948e897eb186fd53b6fe3da7834a32c905f9b6b0/diff:/var/lib/docker/overlay2/a3fb705244185b409f7e2c9ecc85c85ce8a0d0237fa3899c9666cc0dd910bf96/diff:/var/lib/docker/overlay2/9fc72b2db90401c4a2ee9db3a99bee30a7d54900e8f7d9244309431aeafaca54/diff:/var/lib/docker/overlay2/b1437fc022816b4f85c23a89c84095abd98b0e86a73ac4141cab2fcc59e79552/diff:/var/lib/docker/overlay2/82a07515dd96bb91cf2194ce041456d166791238279b55b2cc56df3b6581ee33/diff:/var/lib/docker/overlay2/63c340edb89120b6c57ea0abb9c3df25bf66f04244e85d1ce2d46e9fd31b7ae2/diff:/var/lib/docker/overlay2/957f42c1ab1c7542173916a4b5e811d73f83f2df7b1d2e5119fcdc6426298e1f/diff:/var/lib/docker/overlay2/1dc7aee8a7aec5dcefa5890f9ac56e547ac0e8528cf41530dabe5e7ac578d929/diff:/var/lib/docker/overlay2/f086772b5dd9be28e98b75865df4abee094d713d5c15f5604f1bca30a2bc5ce6/diff:/var/lib/docker/overlay2/56edb4de4476225751ca6127354eba0fa4531c0fab22fa4cd5fa40226a8e1d47/diff:/var/lib/docker/overlay2/853c57c08a570d23e8b2557fd7e8a81c8ea69862b2433e21d9920b7fb214ca45/diff:/var/lib/docker/overlay2/502e3817e97b8082de259783ac11b04c0d093ae8d43b4410daf58c281f5c3c7e/diff:/var/lib/docker/overlay2/e90ac0bfab7338228876a68093fbbc763478f08eb047ea762bc2d5bc38668c50/diff:/var/lib/docker/overlay2/d0657903a9de1db8a1cb404d7ebff8f909bb1d83c7f68cb922e92c9cbf69dfc8/diff:/var/lib/docker/overlay2/6dc3f7923590f4176e49d9ea3e79ae5499f2c54137cc5a57330b2de00205367c/diff:/var/lib/docker/overlay2/83ac0131be7ca143d76a95593088157b18f277a899a35434021b6791de862a3a/diff:/var/lib/docker/overlay2/62b92e6a64db673f1702d5442904c3cc67c15de6b5b86b847df385d07c22636d/diff:/var/lib/docker/overlay2/231dee66d871313a0090a52bfe15e16643b6102c9d2de499a15dd0677fe33a82/diff:/var/lib/docker/overlay2/d59b507385b693eb0fc6751e614ee281d44c004d8a22ea70eef366e93e9de4ad/diff:/var/lib/docker/overlay2/c25a7dc0c164112d7a4dc2880fb327101dba5c818f0acd66d3ffc991291a4d42/diff:/var/lib/docker/overlay2/a68fb1013f4969af64ae70a925e3618791c2ff7da7ed4876fa5b8fb4334421dd/diff:/var/lib/docker/overlay2/61d53941917382e129de07edd5d6ba80cf78e70f1e25e7565e8dcaafec5caae2/diff:/var/lib/docker/overlay2/ef0fc3bdc59463df771db5965e698ae84bf361cd412b548149a4295eefbf9308/diff:/var/lib/docker/overlay2/f35d665dd185c561d9576270ff99526f33f4894fbd4e6c455760951ce919282d/diff:/var/lib/docker/overlay2/61a05536e06da181d0e1150394b45367e307d4b915c345da7cfec5673cc85bfd/diff:/var/lib/docker/overlay2/6b1288942a17577a27f28a6ba7772e0575d8ed07a6f4a510cefe40e1d39e16c7/diff:/var/lib/docker/overlay2/21cca6e29fb8f66e21942316d957e3319e87e6ef00163d5301a74b980b68439b/diff:/var/lib/docker/overlay2/cf5d633997461ef5aa2d0d503e98342b5da6c7670afe00e42798d49adb97a50c/diff:/var/lib/docker/overlay2/72af9f7c70cdf0d93294aec5abbe90c8928f4d14d99fb682bdf99a900028877c/diff:/var/lib/docker/overlay2/237888c05d78b17479a22742928bec54e12fc6b667eef4535cca63339920f840/diff:/var/lib/docker/overlay2/287bda005584841ee7d66825500d7cca25828f9514f128fa8b0b9dc628f85c47/diff:/var/lib/docker/overlay2/a7aeb4a4f39110a0006e9d8973298c12b83a7737fd542bffa1210dd337f4e9d3/diff",
            "MergedDir": "/var/lib/docker/overlay2/bc4773c4050cb9a9c5d5cc2c871512e2d46a3141403f8fac4ed7d111e72dfd8f/merged",
            "UpperDir": "/var/lib/docker/overlay2/bc4773c4050cb9a9c5d5cc2c871512e2d46a3141403f8fac4ed7d111e72dfd8f/diff",
            "WorkDir": "/var/lib/docker/overlay2/bc4773c4050cb9a9c5d5cc2c871512e2d46a3141403f8fac4ed7d111e72dfd8f/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:3cc982388b71ef357e0157e0b7d3059dcefa4dc9fd2e3815bde6c6ce040302f3",
            "sha256:b5e294e75ffe843434721e036fd14b2ac9323ec7e3fd6d5daa4ab18009e8f2ef",
            "sha256:2f58442919fa6fc058366388cf4cf5cac69571b9e4100715a0659dcb3f2b464f",
            "sha256:68b381704cbd81ffb973ff5841fde44df7a1e544836551e969bdde6a7d4937a0",
            "sha256:455bca42f6ec40ca42fea4bea15c6c17b97101af90413cdd25647de2b9d98960",
            "sha256:09d107956969872d9537c701548fa02208c2e2fec875264ba878a873ee189256",
            "sha256:3e8630fa613acd093e383975a2c584e2e312842cf4cd5439eaf65ab10f89bde2",
            "sha256:3d91df78a4dd6fe5f6b0000c066ccadf8c5ffcd81e33d0a671be5774be0b38da",
            "sha256:dc71cc501b40df53c83d448a2b28cf7a7a8ff0694147fc78cc2447a474bb360c",
            "sha256:c54ebdeeea2f441a09ee5989bb4b54d609dad0352292b9eec38bd809735e8b42",
            "sha256:95d756be1356cc6311a09d018a266b3732eb14565a172cbf9468ee875891ae8e",
            "sha256:d1dc2e2e2fb95fdd997bb8833b24b29c730577fe4b95c6d37c635904dbfb1128",
            "sha256:01d81cedcc7c0e70d870b29ea96ed1b7abb0402448db23c870d0acb428a315e0",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:6cfefc1c4d6cfdda56a27f4e68cd46fac8141044028428164ae763fdea707cb7",
            "sha256:d2d7d6d1ad24d8043a2c0c80a5767aaeae167c4b722eff4826ab4bb5881b3014",
            "sha256:ac51d977e01035e54091b68443cc792df069c8fb3842b1e39b5ed63bcf2d3b50",
            "sha256:1b17c60732b16f0a692c1fbabec96e43179c2ceed5763ab98e4d5310cff1f523",
            "sha256:c36138123015ff2be167d5d83996a31a5b88e98f0c5f78b2d26e5232196a0e46",
            "sha256:b59c7cbf007fcc77edb40dbfc36211df4740cb000bb573105eb45b7c1c226b09",
            "sha256:f59346f97c4b3bc20aa536cf85620292bcb728aebad8e41462d54d019a427fbd",
            "sha256:cc0b42ed64302c38064df981874aa297d321903cb17e73e2734f5d72c97a2ec8",
            "sha256:c7984c6fc91a57484a37735f48eb009736e3109fcd1e6143701f4231d0d1509e",
            "sha256:0a77f81f4c3ca8c4bd4c6e29dca5d73ca62ec95a81e49ce8a0e96287487e2d0e",
            "sha256:a2c1ce9312b0b960c0981405c659fff7bfea3788959d8db294db927142ec2705",
            "sha256:45eeafb9e975c346e46d26ab5adf63b5c6f7d93a0c2274af7c2e70e5dbc2663f",
            "sha256:f2ce35c996ca3f3c9630a7ef2ad4baa84df6dc7aeb0e95ad00999c6791c5e51a",
            "sha256:a2f505a9c267de9739790a82d7c7e825e01b31365206362d8da63b6d7157f82f",
            "sha256:e142a657247b701572ec047e13e4b75e28a514e68d068a69a7378b5b54cfa5e4",
            "sha256:22d008011370f14294d1ab6b6f2ae87ed896799d48381a400df3125940b740e6",
            "sha256:277e34b78a4cb1d0d85c494cfa9b19e604663a82f03a8870282e4bef705bc094",
            "sha256:f76f1b3ed95c4646805b26cc2b47f26057326d2a18bc4687752a2bab011418ef",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:a298f5d424b7c94d1d245c11fb15c7bd99f02306268d1219c88b7ca1b78b717f"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-12-03T00:21:35.934439346+08:00"
    }
}

更多版本

docker.io/gpustack/runner:cann8.2-910b-vllm0.11.0

linux/arm64 docker.io15.96GB2025-11-27 00:53
55

docker.io/gpustack/runner:cuda12.9-vllm0.11.2

linux/amd64 docker.io33.62GB2025-12-03 00:42
3