docker.io/lmsysorg/sglang:v0.4.2.post4-cu125 linux/amd64

docker.io/lmsysorg/sglang:v0.4.2.post4-cu125 - 国内下载镜像源 浏览次数:111
sglang 是一个基于 LMSYS 的 Shell Grammar Language 环境容器镜像。
源镜像 docker.io/lmsysorg/sglang:v0.4.2.post4-cu125
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125
镜像ID sha256:ca9b8c281001ceba5e31e45c325981446887a789b362fa9b26b23a3a8f934e5e
镜像TAG v0.4.2.post4-cu125
大小 18.37GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 /opt/nvidia/nvidia_entrypoint.sh
工作目录 /sgl-workspace
OS/平台 linux/amd64
浏览量 111 次
贡献者
镜像创建 2025-02-10T06:17:00.083941685Z
同步时间 2025-02-12 01:31
更新时间 2025-02-22 12:01
环境变量
PATH=/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 CUDA_CACHE_DISABLE=1 NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS= _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0 NCCL_VERSION=2.21.5 CUBLAS_VERSION=12.4.5.8 CUFFT_VERSION=11.2.1.3 CURAND_VERSION=10.3.5.147 CUSPARSE_VERSION=12.3.1.170 CUSOLVER_VERSION=11.6.1.9 CUTENSOR_VERSION=2.0.1.2 NPP_VERSION=12.2.5.30 NVJPEG_VERSION=12.3.1.117 CUDNN_VERSION=9.1.0.70 TRT_VERSION=8.6.3.1+cuda12.2.2.009 TRTOSS_VERSION=23.11 NSIGHT_SYSTEMS_VERSION=2024.2.1.106 NSIGHT_COMPUTE_VERSION=2024.1.1.4 DALI_VERSION=1.36.0 DALI_BUILD=13435171 POLYGRAPHY_VERSION=0.49.8 TRANSFORMER_ENGINE_VERSION=1.5 LD_LIBRARY_PATH=/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video NVIDIA_PRODUCT_NAME=Triton Server Base GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.18 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.16.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=39.0 OPAL_PREFIX=/opt/hpcx/ompi OMPI_MCA_coll_hcoll_enable=0 LIBRARY_PATH=/usr/local/cuda/lib64/stubs: NVIDIA_TRITON_SERVER_BASE_VERSION=24.04 NVIDIA_BUILD_ID=90085237 DEBIAN_FRONTEND=interactive
镜像标签
12.4.5.8: com.nvidia.cublas.version 9.0: com.nvidia.cuda.version 9.1.0.70: com.nvidia.cudnn.version 11.2.1.3: com.nvidia.cufft.version 10.3.5.147: com.nvidia.curand.version 11.6.1.9: com.nvidia.cusolver.version 12.3.1.170: com.nvidia.cusparse.version 2.0.1.2: com.nvidia.cutensor.version 2.21.5: com.nvidia.nccl.version 12.2.5.30: com.nvidia.npp.version 2024.1.1.4: com.nvidia.nsightcompute.version 2024.2.1.106: com.nvidia.nsightsystems.version 12.3.1.117: com.nvidia.nvjpeg.version 8.6.3.1+cuda12.2.2.009: com.nvidia.tensorrt.version 23.11: com.nvidia.tensorrtoss.version nvidia_driver: com.nvidia.volumes.needed ubuntu: org.opencontainers.image.ref.name 22.04: org.opencontainers.image.version
镜像安全扫描 查看Trivy扫描报告

系统OS: ubuntu 22.04 扫描引擎: Trivy 扫描时间: 2025-02-12 03:07

低危漏洞:204 中危漏洞:1899 高危漏洞:42 严重漏洞:0

Docker拉取命令 无权限下载?点我修复

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125  docker.io/lmsysorg/sglang:v0.4.2.post4-cu125

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125  docker.io/lmsysorg/sglang:v0.4.2.post4-cu125

Shell快速替换命令

sed -i 's#lmsysorg/sglang:v0.4.2.post4-cu125#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125  docker.io/lmsysorg/sglang:v0.4.2.post4-cu125'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125  docker.io/lmsysorg/sglang:v0.4.2.post4-cu125'

镜像构建历史


# 2025-02-10 14:17:00  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=interactive
                        
# 2025-02-10 14:17:00  11.47GB 执行命令并创建新的镜像层
RUN |2 BUILD_TYPE=all CUDA_VERSION=12.5.1 /bin/sh -c python3 -m pip install --upgrade pip setuptools wheel html5lib six     && git clone --depth=1 https://github.com/sgl-project/sglang.git     && if [ "$CUDA_VERSION" = "12.1.1" ]; then          python3 -m pip install torch --index-url https://download.pytorch.org/whl/cu121;        elif [ "$CUDA_VERSION" = "12.4.1" ]; then          python3 -m pip install torch --index-url https://download.pytorch.org/whl/cu124;        elif [ "$CUDA_VERSION" = "12.5.1" ]; then          python3 -m pip install torch --index-url https://download.pytorch.org/whl/cu124;        elif [ "$CUDA_VERSION" = "11.8.0" ]; then          python3 -m pip install torch --index-url https://download.pytorch.org/whl/cu118;          python3 -m pip install sgl-kernel -i https://docs.sglang.ai/whl/cu118;        else          echo "Unsupported CUDA version: $CUDA_VERSION" && exit 1;        fi     && cd sglang     && if [ "$BUILD_TYPE" = "srt" ]; then          if [ "$CUDA_VERSION" = "12.1.1" ]; then            python3 -m pip --no-cache-dir install -e "python[srt]" --find-links https://flashinfer.ai/whl/cu121/torch2.5/flashinfer/;          elif [ "$CUDA_VERSION" = "12.4.1" ]; then            python3 -m pip --no-cache-dir install -e "python[srt]" --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer/;          elif [ "$CUDA_VERSION" = "12.5.1" ]; then            python3 -m pip --no-cache-dir install -e "python[srt]" --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer/;          elif [ "$CUDA_VERSION" = "11.8.0" ]; then            python3 -m pip --no-cache-dir install -e "python[srt]" --find-links https://flashinfer.ai/whl/cu118/torch2.5/flashinfer/;            python3 -m pip install sgl-kernel -i https://docs.sglang.ai/whl/cu118;          else            echo "Unsupported CUDA version: $CUDA_VERSION" && exit 1;          fi;        else          if [ "$CUDA_VERSION" = "12.1.1" ]; then            python3 -m pip --no-cache-dir install -e "python[all]" --find-links https://flashinfer.ai/whl/cu121/torch2.5/flashinfer/;          elif [ "$CUDA_VERSION" = "12.4.1" ]; then            python3 -m pip --no-cache-dir install -e "python[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer/;          elif [ "$CUDA_VERSION" = "12.5.1" ]; then            python3 -m pip --no-cache-dir install -e "python[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer/;          elif [ "$CUDA_VERSION" = "11.8.0" ]; then            python3 -m pip --no-cache-dir install -e "python[all]" --find-links https://flashinfer.ai/whl/cu118/torch2.5/flashinfer/;            python3 -m pip install sgl-kernel -i https://docs.sglang.ai/whl/cu118;          else            echo "Unsupported CUDA version: $CUDA_VERSION" && exit 1;          fi;        fi # buildkit
                        
# 2025-02-10 14:14:27  0.00B 定义构建参数
ARG CUDA_VERSION
                        
# 2025-02-10 14:14:27  0.00B 设置工作目录为/sgl-workspace
WORKDIR /sgl-workspace
                        
# 2025-02-10 14:14:27  28.86MB 执行命令并创建新的镜像层
RUN |1 BUILD_TYPE=all /bin/sh -c pip3 install datamodel_code_generator # buildkit
                        
# 2025-02-10 14:14:25  183.82MB 执行命令并创建新的镜像层
RUN |1 BUILD_TYPE=all /bin/sh -c echo 'tzdata tzdata/Areas select America' | debconf-set-selections     && echo 'tzdata tzdata/Zones/America select Los_Angeles' | debconf-set-selections     && apt update -y     && apt install software-properties-common -y     && add-apt-repository ppa:deadsnakes/ppa -y && apt update     && apt install python3.10 python3.10-dev -y     && update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.10 1     && update-alternatives --set python3 /usr/bin/python3.10 && apt install python3.10-distutils -y     && apt install curl git sudo libibverbs-dev -y     && curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py && python3 get-pip.py     && python3 --version     && python3 -m pip --version     && rm -rf /var/lib/apt/lists/*     && apt clean # buildkit
                        
# 2025-02-10 14:14:25  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2025-02-10 14:14:25  0.00B 定义构建参数
ARG BUILD_TYPE=all
                        
# 2024-04-23 12:12:10  106.00B 执行命令并创建新的镜像层
RUN |2 NVIDIA_TRITON_SERVER_BASE_VERSION=24.04 NVIDIA_BUILD_ID=90085237 /bin/sh -c sed 's/Server/Server Base/' /opt/nvidia/entrypoint.d/10-banner.txt |     sed 's/^===/========/' > /opt/nvidia/entrypoint.d/10-banner.new &&     mv /opt/nvidia/entrypoint.d/10-banner.new /opt/nvidia/entrypoint.d/10-banner.txt # buildkit
                        
# 2024-04-23 12:12:09  733.00B 复制新文件或目录到容器中
COPY docker/entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2024-04-23 12:12:09  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=Triton Server Base
                        
# 2024-04-23 12:12:09  0.00B 设置环境变量 NVIDIA_BUILD_ID
ENV NVIDIA_BUILD_ID=90085237
                        
# 2024-04-23 12:12:09  0.00B 设置环境变量 NVIDIA_TRITON_SERVER_BASE_VERSION
ENV NVIDIA_TRITON_SERVER_BASE_VERSION=24.04
                        
# 2024-04-23 12:12:09  0.00B 定义构建参数
ARG NVIDIA_BUILD_ID
                        
# 2024-04-23 12:12:09  0.00B 定义构建参数
ARG NVIDIA_TRITON_SERVER_BASE_VERSION
                        
# 2024-04-03 09:56:12  0.00B 设置环境变量 LIBRARY_PATH
ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
                        
# 2024-04-03 09:56:12  950.50MB 执行命令并创建新的镜像层
RUN |7 GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.18 RDMACORE_VERSION=39.0 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.16.0 OPENMPI_VERSION=4.1.7 TARGETARCH=amd64 /bin/sh -c export DEVEL=1 BASE=0  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUDA.sh  && /nvidia/build-scripts/installLIBS.sh  && /nvidia/build-scripts/installNCCL.sh  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installCUTENSOR.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi  && rm -f /tmp/cuda-*.patch # buildkit
                        
# 2024-04-03 09:51:54  1.49KB 复制新文件或目录到容器中
COPY cuda-*.patch /tmp # buildkit
                        
# 2024-04-03 09:51:54  0.00B 设置环境变量 OMPI_MCA_coll_hcoll_enable
ENV OMPI_MCA_coll_hcoll_enable=0
                        
# 2024-04-03 09:51:54  0.00B 设置环境变量 OPAL_PREFIX PATH
ENV OPAL_PREFIX=/opt/hpcx/ompi PATH=/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin
                        
# 2024-04-03 09:51:54  227.13MB 执行命令并创建新的镜像层
RUN |7 GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.18 RDMACORE_VERSION=39.0 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.16.0 OPENMPI_VERSION=4.1.7 TARGETARCH=amd64 /bin/sh -c cd /nvidia  && ( export DEBIAN_FRONTEND=noninteractive        && apt-get update                            && apt-get install -y --no-install-recommends              libibverbs1                                  libibverbs-dev                               librdmacm1                                   librdmacm-dev                                libibumad3                                   libibumad-dev                                ibverbs-utils                                ibverbs-providers                     && rm -rf /var/lib/apt/lists/*               && rm $(dpkg-query -L                                    libibverbs-dev                               librdmacm-dev                                libibumad-dev                            | grep "\(\.so\|\.a\)$")          )                                            && ( cd opt/gdrcopy/                              && dpkg -i libgdrapi_*.deb                   )                                         && ( cp -r opt/hpcx /opt/                                         && cp etc/ld.so.conf.d/hpcx.conf /etc/ld.so.conf.d/          && ln -sf /opt/hpcx/ompi /usr/local/mpi                      && ln -sf /opt/hpcx/ucx  /usr/local/ucx                      && sed -i 's/^\(hwloc_base_binding_policy\) = core$/\1 = none/' /opt/hpcx/ompi/etc/openmpi-mca-params.conf         && sed -i 's/^\(btl = self\)$/#\1/'                             /opt/hpcx/ompi/etc/openmpi-mca-params.conf       )                                                         && ldconfig # buildkit
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2024-04-03 09:51:54  0.00B 设置环境变量 GDRCOPY_VERSION HPCX_VERSION MOFED_VERSION OPENUCX_VERSION OPENMPI_VERSION RDMACORE_VERSION
ENV GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.18 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.16.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=39.0
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG OPENMPI_VERSION
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG OPENUCX_VERSION
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG MOFED_VERSION=5.4-rdmacore39.0
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG RDMACORE_VERSION
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG HPCX_VERSION
                        
# 2024-04-03 09:51:54  0.00B 定义构建参数
ARG GDRCOPY_VERSION
                        
# 2024-04-03 09:51:44  84.87MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         build-essential         git         libglib2.0-0         less         libnl-route-3-200         libnl-3-dev         libnl-route-3-dev         libnuma-dev         libnuma1         libpmi2-0-dev         nano         numactl         openssh-client         vim         wget  && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-04-03 09:39:21  148.72KB 复制新文件或目录到容器中
COPY NVIDIA_Deep_Learning_Container_License.pdf /workspace/ # buildkit
                        
# 2024-04-03 09:39:21  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2024-04-03 09:39:21  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2024-04-03 09:39:21  14.85KB 复制新文件或目录到容器中
COPY entrypoint/ /opt/nvidia/ # buildkit
                        
# 2024-04-03 09:39:21  0.00B 设置环境变量 PATH LD_LIBRARY_PATH NVIDIA_VISIBLE_DEVICES NVIDIA_DRIVER_CAPABILITIES
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video
                        
# 2024-04-03 09:39:21  0.00B 定义构建参数
ARG _LIBPATH_SUFFIX
                        
# 2024-04-03 09:39:21  46.00B 执行命令并创建新的镜像层
RUN |21 CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 JETPACK_HOST_MOUNTS= NCCL_VERSION=2.21.5 CUBLAS_VERSION=12.4.5.8 CUFFT_VERSION=11.2.1.3 CURAND_VERSION=10.3.5.147 CUSPARSE_VERSION=12.3.1.170 CUSOLVER_VERSION=11.6.1.9 CUTENSOR_VERSION=2.0.1.2 NPP_VERSION=12.2.5.30 NVJPEG_VERSION=12.3.1.117 CUDNN_VERSION=9.1.0.70 TRT_VERSION=8.6.3.1+cuda12.2.2.009 TRTOSS_VERSION=23.11 NSIGHT_SYSTEMS_VERSION=2024.2.1.106 NSIGHT_COMPUTE_VERSION=2024.1.1.4 DALI_VERSION=1.36.0 DALI_BUILD=13435171 POLYGRAPHY_VERSION=0.49.8 TRANSFORMER_ENGINE_VERSION=1.5 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf  && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2024-04-03 09:39:21  13.39KB 复制文件或目录到容器中
ADD docs.tgz / # buildkit
                        
# 2024-04-03 09:39:21  0.00B 设置环境变量 DALI_VERSION DALI_BUILD POLYGRAPHY_VERSION TRANSFORMER_ENGINE_VERSION
ENV DALI_VERSION=1.36.0 DALI_BUILD=13435171 POLYGRAPHY_VERSION=0.49.8 TRANSFORMER_ENGINE_VERSION=1.5
                        
# 2024-04-03 09:39:21  0.00B 定义构建参数
ARG TRANSFORMER_ENGINE_VERSION
                        
# 2024-04-03 09:39:21  0.00B 定义构建参数
ARG POLYGRAPHY_VERSION
                        
# 2024-04-03 09:39:21  0.00B 定义构建参数
ARG DALI_BUILD
                        
# 2024-04-03 09:39:21  0.00B 定义构建参数
ARG DALI_VERSION
                        
# 2024-04-03 09:39:21  0.00B 添加元数据标签
LABEL com.nvidia.nccl.version=2.21.5 com.nvidia.cublas.version=12.4.5.8 com.nvidia.cufft.version=11.2.1.3 com.nvidia.curand.version=10.3.5.147 com.nvidia.cusparse.version=12.3.1.170 com.nvidia.cusolver.version=11.6.1.9 com.nvidia.cutensor.version=2.0.1.2 com.nvidia.npp.version=12.2.5.30 com.nvidia.nvjpeg.version=12.3.1.117 com.nvidia.cudnn.version=9.1.0.70 com.nvidia.tensorrt.version=8.6.3.1+cuda12.2.2.009 com.nvidia.tensorrtoss.version=23.11 com.nvidia.nsightsystems.version=2024.2.1.106 com.nvidia.nsightcompute.version=2024.1.1.4
                        
# 2024-04-03 09:39:21  4.56GB 执行命令并创建新的镜像层
RUN |17 CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 JETPACK_HOST_MOUNTS= NCCL_VERSION=2.21.5 CUBLAS_VERSION=12.4.5.8 CUFFT_VERSION=11.2.1.3 CURAND_VERSION=10.3.5.147 CUSPARSE_VERSION=12.3.1.170 CUSOLVER_VERSION=11.6.1.9 CUTENSOR_VERSION=2.0.1.2 NPP_VERSION=12.2.5.30 NVJPEG_VERSION=12.3.1.117 CUDNN_VERSION=9.1.0.70 TRT_VERSION=8.6.3.1+cuda12.2.2.009 TRTOSS_VERSION=23.11 NSIGHT_SYSTEMS_VERSION=2024.2.1.106 NSIGHT_COMPUTE_VERSION=2024.1.1.4 /bin/sh -c /nvidia/build-scripts/installNCCL.sh  && /nvidia/build-scripts/installLIBS.sh  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUTENSOR.sh # buildkit
                        
# 2024-04-02 09:40:07  0.00B 设置环境变量 NCCL_VERSION CUBLAS_VERSION CUFFT_VERSION CURAND_VERSION CUSPARSE_VERSION CUSOLVER_VERSION CUTENSOR_VERSION NPP_VERSION NVJPEG_VERSION CUDNN_VERSION TRT_VERSION TRTOSS_VERSION NSIGHT_SYSTEMS_VERSION NSIGHT_COMPUTE_VERSION
ENV NCCL_VERSION=2.21.5 CUBLAS_VERSION=12.4.5.8 CUFFT_VERSION=11.2.1.3 CURAND_VERSION=10.3.5.147 CUSPARSE_VERSION=12.3.1.170 CUSOLVER_VERSION=11.6.1.9 CUTENSOR_VERSION=2.0.1.2 NPP_VERSION=12.2.5.30 NVJPEG_VERSION=12.3.1.117 CUDNN_VERSION=9.1.0.70 TRT_VERSION=8.6.3.1+cuda12.2.2.009 TRTOSS_VERSION=23.11 NSIGHT_SYSTEMS_VERSION=2024.2.1.106 NSIGHT_COMPUTE_VERSION=2024.1.1.4
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG NSIGHT_COMPUTE_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG NSIGHT_SYSTEMS_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG TRTOSS_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG TRT_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CUDNN_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG NVJPEG_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG NPP_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CUTENSOR_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CUSOLVER_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CUSPARSE_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CURAND_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CUFFT_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG CUBLAS_VERSION
                        
# 2024-04-02 09:40:07  0.00B 定义构建参数
ARG NCCL_VERSION
                        
# 2024-04-02 09:40:07  0.00B 添加元数据标签
LABEL com.nvidia.volumes.needed=nvidia_driver com.nvidia.cuda.version=9.0
                        
# 2024-04-02 09:40:07  0.00B 设置环境变量 _CUDA_COMPAT_PATH ENV BASH_ENV SHELL NVIDIA_REQUIRE_CUDA
ENV _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0
                        
# 2024-04-02 09:40:07  58.91KB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 JETPACK_HOST_MOUNTS= /bin/sh -c cp -vprd /nvidia/. /  &&  patch -p0 < /etc/startup_scripts.patch  &&  rm -f /etc/startup_scripts.patch # buildkit
                        
# 2024-04-02 09:40:07  462.84MB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 JETPACK_HOST_MOUNTS= /bin/sh -c /nvidia/build-scripts/installCUDA.sh # buildkit
                        
# 2024-04-02 09:39:54  0.00B 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 JETPACK_HOST_MOUNTS= /bin/sh -c if [ -n "${JETPACK_HOST_MOUNTS}" ]; then        echo "/usr/lib/aarch64-linux-gnu/tegra" > /etc/ld.so.conf.d/nvidia-tegra.conf     && echo "/usr/lib/aarch64-linux-gnu/tegra-egl" >> /etc/ld.so.conf.d/nvidia-tegra.conf;     fi # buildkit
                        
# 2024-04-02 09:39:54  0.00B 设置环境变量 CUDA_VERSION CUDA_DRIVER_VERSION CUDA_CACHE_DISABLE NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS
ENV CUDA_VERSION=12.4.1.003 CUDA_DRIVER_VERSION=550.54.15 CUDA_CACHE_DISABLE=1 NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=
                        
# 2024-04-02 09:39:54  0.00B 定义构建参数
ARG JETPACK_HOST_MOUNTS
                        
# 2024-04-02 09:39:54  0.00B 定义构建参数
ARG CUDA_DRIVER_VERSION
                        
# 2024-04-02 09:39:54  0.00B 定义构建参数
ARG CUDA_VERSION
                        
# 2024-03-16 02:01:08  318.91MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         apt-utils         build-essential         ca-certificates         curl         libncurses5         libncursesw5         patch         wget         rsync         unzip         jq         gnupg         libtcmalloc-minimal4 # buildkit
                        
# 2024-02-28 02:52:59  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2024-02-28 02:52:58  77.86MB 
/bin/sh -c #(nop) ADD file:21c2e8d95909bec6f4acdaf4aed55b44ee13603681f93b152e423e3e6a4a207b in / 
                        
# 2024-02-28 02:52:57  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2024-02-28 02:52:57  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2024-02-28 02:52:57  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2024-02-28 02:52:57  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:ca9b8c281001ceba5e31e45c325981446887a789b362fa9b26b23a3a8f934e5e",
    "RepoTags": [
        "lmsysorg/sglang:v0.4.2.post4-cu125",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.4.2.post4-cu125"
    ],
    "RepoDigests": [
        "lmsysorg/sglang@sha256:42822b43c02273381ec04421af090aa9f5dcf4318d2523ac2822eb8225997687",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang@sha256:42822b43c02273381ec04421af090aa9f5dcf4318d2523ac2822eb8225997687"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-02-10T06:17:00.083941685Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin",
            "CUDA_VERSION=12.4.1.003",
            "CUDA_DRIVER_VERSION=550.54.15",
            "CUDA_CACHE_DISABLE=1",
            "NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=",
            "_CUDA_COMPAT_PATH=/usr/local/cuda/compat",
            "ENV=/etc/shinit_v2",
            "BASH_ENV=/etc/bash.bashrc",
            "SHELL=/bin/bash",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=9.0",
            "NCCL_VERSION=2.21.5",
            "CUBLAS_VERSION=12.4.5.8",
            "CUFFT_VERSION=11.2.1.3",
            "CURAND_VERSION=10.3.5.147",
            "CUSPARSE_VERSION=12.3.1.170",
            "CUSOLVER_VERSION=11.6.1.9",
            "CUTENSOR_VERSION=2.0.1.2",
            "NPP_VERSION=12.2.5.30",
            "NVJPEG_VERSION=12.3.1.117",
            "CUDNN_VERSION=9.1.0.70",
            "TRT_VERSION=8.6.3.1+cuda12.2.2.009",
            "TRTOSS_VERSION=23.11",
            "NSIGHT_SYSTEMS_VERSION=2024.2.1.106",
            "NSIGHT_COMPUTE_VERSION=2024.1.1.4",
            "DALI_VERSION=1.36.0",
            "DALI_BUILD=13435171",
            "POLYGRAPHY_VERSION=0.49.8",
            "TRANSFORMER_ENGINE_VERSION=1.5",
            "LD_LIBRARY_PATH=/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility,video",
            "NVIDIA_PRODUCT_NAME=Triton Server Base",
            "GDRCOPY_VERSION=2.3.1-1",
            "HPCX_VERSION=2.18",
            "MOFED_VERSION=5.4-rdmacore39.0",
            "OPENUCX_VERSION=1.16.0",
            "OPENMPI_VERSION=4.1.7",
            "RDMACORE_VERSION=39.0",
            "OPAL_PREFIX=/opt/hpcx/ompi",
            "OMPI_MCA_coll_hcoll_enable=0",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs:",
            "NVIDIA_TRITON_SERVER_BASE_VERSION=24.04",
            "NVIDIA_BUILD_ID=90085237",
            "DEBIAN_FRONTEND=interactive"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/sgl-workspace",
        "Entrypoint": [
            "/opt/nvidia/nvidia_entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.nvidia.cublas.version": "12.4.5.8",
            "com.nvidia.cuda.version": "9.0",
            "com.nvidia.cudnn.version": "9.1.0.70",
            "com.nvidia.cufft.version": "11.2.1.3",
            "com.nvidia.curand.version": "10.3.5.147",
            "com.nvidia.cusolver.version": "11.6.1.9",
            "com.nvidia.cusparse.version": "12.3.1.170",
            "com.nvidia.cutensor.version": "2.0.1.2",
            "com.nvidia.nccl.version": "2.21.5",
            "com.nvidia.npp.version": "12.2.5.30",
            "com.nvidia.nsightcompute.version": "2024.1.1.4",
            "com.nvidia.nsightsystems.version": "2024.2.1.106",
            "com.nvidia.nvjpeg.version": "12.3.1.117",
            "com.nvidia.tensorrt.version": "8.6.3.1+cuda12.2.2.009",
            "com.nvidia.tensorrtoss.version": "23.11",
            "com.nvidia.volumes.needed": "nvidia_driver",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "22.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 18365246131,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/fc8668f15f4ebee154188a1923df0b381775c7982adc52fb216053f9e9c80baf/diff:/var/lib/docker/overlay2/a262077d4cf13034760bef5124c4adf8439fcf7a2e424b910d49af7ee24d851f/diff:/var/lib/docker/overlay2/be507d75227a7a3dcce66f54801e3a9857ab358fae6003d3882bcbc964713463/diff:/var/lib/docker/overlay2/8b680d1dd4c09c5858835c638540eb834206a04004b4ca0504608dc866df211a/diff:/var/lib/docker/overlay2/091707c36e5e02479159c2a0280446d5b84c8b89e6ec0e5705a1c14d81830b9f/diff:/var/lib/docker/overlay2/4e9fd836cc3e94817cb51b629ab8d55d36322ae407f43996c02f9238763943d1/diff:/var/lib/docker/overlay2/2f200c4df721127cf00ce850ce070d7845fae2f5fae9932409d8b3e6be3bc5f5/diff:/var/lib/docker/overlay2/4b66e1aa28bf7cd5daaf3a61a2d3191f684f0a044c0278cd1c8f70c08215c2e7/diff:/var/lib/docker/overlay2/a32882eb98d360d9c9d5acbd47131671f1e537ac6c542098bec5b1a10ba7e00f/diff:/var/lib/docker/overlay2/1df17d812566c8f8b134c92a219642726ebfb8a6f714ac71c39532ebd71be31e/diff:/var/lib/docker/overlay2/6c15b3723b90b7228cdd27da4b8ea657e657579cea3826f7059644f5b70b7beb/diff:/var/lib/docker/overlay2/031e6807591679337c246dd145ca3c623499418876070ac99b28349f0b0a0233/diff:/var/lib/docker/overlay2/7997af6d6361c83eb3c500667fab2967aa87e91f09e24d750d9e2bf99b4c1c24/diff:/var/lib/docker/overlay2/c36a2d9f1831fa0d81648f7099d95ecbaec532446e22509ae73b7b8ea32955b8/diff:/var/lib/docker/overlay2/0e4a3ad7fcd9dfb3f551b6b97e8f48b1d06dae43e7435beadcc314abeab71dec/diff:/var/lib/docker/overlay2/f2433b5f19a9b438278ecd272adb7578b45d7c2cfee0d910b89313f8b95fd4c8/diff:/var/lib/docker/overlay2/cd00fbfd225b4ec950062e00b212d7a766fef8e6e3171a3e61837264fda05fb5/diff:/var/lib/docker/overlay2/9cf25f0d4e38a4c0a22ffb1e40b2979ad87345e545ffac3a3ea2e05df31058f2/diff:/var/lib/docker/overlay2/36afb5f3b33b3915eca7fc7803ea8c9687feff5bf1dafe376b931e39494e6100/diff",
            "MergedDir": "/var/lib/docker/overlay2/79397870835cca50cdbe024f7428b49d4a70f9a04e0139c79475af0ba8c5fb5c/merged",
            "UpperDir": "/var/lib/docker/overlay2/79397870835cca50cdbe024f7428b49d4a70f9a04e0139c79475af0ba8c5fb5c/diff",
            "WorkDir": "/var/lib/docker/overlay2/79397870835cca50cdbe024f7428b49d4a70f9a04e0139c79475af0ba8c5fb5c/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:5498e8c22f6996f25ef193ee58617d5b37e2a96decf22e72de13c3b34e147591",
            "sha256:28c139aca4328d0f6911b67c9699af5dff0f9765a0db3d87dac21ef01b40c81c",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:c14a8ee52db061dd013c76e696665740f360df5648c170a6a20555aafd998d33",
            "sha256:147b0872d115dc3311e306c5e557df8f2987cd928a4e668de7bf1c1d314b0b08",
            "sha256:67134b4c3ccc35293ab232be049bdc30365352891611495a3f66fd90e69e5717",
            "sha256:f1d961de7b067ab90c9993476c8857362b1679f8d282e293f4d67a4dcfe237f1",
            "sha256:f64b0221c5b91feacd2cef5c200df7301d77bbea0bb629a9c0cfd514e262d53a",
            "sha256:31204c91c9ed9faf9e61e82b9b1eec7e271e93c593c9ad4f9e6749fd8bca60c8",
            "sha256:7f23732579ecb35511e1367a0ff96397dc9e738a9f44ae60d2c0a06567987504",
            "sha256:12d4c615e1066748fc6c08021730faf9d2e13b6a1d4316f953b6fd4d0707bf20",
            "sha256:883706b219bd097161abfcf670d63d5664cfc3f5876632643a4d12e3e4b21283",
            "sha256:12d63adad6310f30514511b90b1b71d51e9ef755916f605b16a31f7acfd4756a",
            "sha256:5e76418387d068fe27ab23830a83c26ac25e0a8cb926d2da9766519c42ba9d34",
            "sha256:40b7b50a288324e0e77a4dcf0a7f6c91a3d6df7997cef221f9ecf3a0f52f9929",
            "sha256:61abc3c363440d2b58d046a5741cb780bb19ff03ec1fda327f056bbf886179b0",
            "sha256:47bc1007d51c8bfc98b202cf335ddb00b9af20ffd9127d23efaff9b48c49a0f6",
            "sha256:7dcf77152a1fde24b48b001e99de7f04719824b6780ee7891b435a9bf5abd038",
            "sha256:156ddf3bf1015839942d7278be8add93936d8cc1e0dfbaf1707389defe8f35bc",
            "sha256:89d3f34186d4044a6a766f980de05ec4e4b5827f79914a2b24926428145941c9"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-02-12T01:05:55.988582446+08:00"
    }
}

更多版本

docker.io/lmsysorg/sglang:v0.2.0-cu124

linux/amd64 docker.io16.10GB2024-07-26 19:20
638

docker.io/lmsysorg/sglang:v0.3.0-cu121

linux/amd64 docker.io15.88GB2024-09-12 00:53
207

docker.io/lmsysorg/sglang:v0.3.0-cu124

linux/amd64 docker.io16.12GB2024-09-13 01:38
155

docker.io/lmsysorg/sglang:latest

linux/amd64 docker.io15.95GB2024-10-29 01:12
310

docker.io/lmsysorg/sglang:v0.4.0.post1-cu124

linux/amd64 docker.io16.59GB2024-12-22 06:13
83

docker.io/lmsysorg/sglang:v0.4.1.post3-cu124-srt

linux/amd64 docker.io19.60GB2025-01-01 00:27
106

docker.io/lmsysorg/sglang:v0.4.1.post3-cu124

linux/amd64 docker.io19.63GB2025-01-01 00:55
90

docker.io/lmsysorg/sglang:v0.4.1.post7-cu124

linux/amd64 docker.io19.62GB2025-01-25 01:15
123

docker.io/lmsysorg/sglang:v0.4.2.post2-cu125

linux/amd64 docker.io18.94GB2025-02-08 01:46
62

docker.io/lmsysorg/sglang:v0.4.2.post3-cu125

linux/amd64 docker.io18.94GB2025-02-10 00:38
64

docker.io/lmsysorg/sglang:v0.4.2.post4-cu125

linux/amd64 docker.io18.37GB2025-02-12 01:31
110