docker.io/nvcr.io/nvidia/tritonserver:25.04-py3 linux/amd64

docker.io/nvcr.io/nvidia/tritonserver:25.04-py3 - 国内下载镜像源 浏览次数:112

这是一个 NVIDIA Triton Inference Server 的 Docker 镜像。Triton Inference Server 是一个高性能的推理服务器,用于部署各种深度学习模型,支持多种框架(例如 TensorFlow, PyTorch, TensorRT 等),并提供模型版本管理、模型部署、以及高效的推理服务。

源镜像 docker.io/nvcr.io/nvidia/tritonserver:25.04-py3
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3
镜像ID sha256:f327ff1ad9b69493a7f4f96f5feaf0a89d3f0bae411dcf9bcfe584e8656bb90a
镜像TAG 25.04-py3
大小 19.59GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 /opt/nvidia/nvidia_entrypoint.sh
工作目录 /opt/tritonserver
OS/平台 linux/amd64
浏览量 112 次
贡献者 mr********g@hotmail.com
镜像创建 2025-05-02T05:04:33.106230043Z
同步时间 2025-05-22 00:46
更新时间 2025-05-31 09:40
环境变量
PATH=/opt/tritonserver/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=50.0 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 OPAL_PREFIX=/opt/hpcx/ompi OMPI_MCA_coll_hcoll_enable=0 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0 NCCL_VERSION=2.26.3 CUBLAS_VERSION=12.9.0.2 CUFFT_VERSION=11.4.0.6 CURAND_VERSION=10.3.10.19 CUSPARSE_VERSION=12.5.9.5 CUSPARSELT_VERSION=0.7.1.0 CUSOLVER_VERSION=11.7.4.40 NPP_VERSION=12.4.0.27 NVJPEG_VERSION=12.4.0.16 CUFILE_VERSION=1.14.0.30 NVJITLINK_VERSION=12.9.41 CUBLASMP_VERSION=0.4.0.789 CAL_VERSION=0.4.4.50 NVSHMEM_VERSION=3.2.5 CUDNN_VERSION=9.9.0.52 CUDNN_FRONTEND_VERSION=1.11.0 TRT_VERSION=10.9.0.34+cuda12.8 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2025.2.1.130 NSIGHT_COMPUTE_VERSION=2025.2.0.11 DALI_VERSION=1.48.0 DALI_BUILD= DALI_URL_SUFFIX=120 POLYGRAPHY_VERSION=0.49.20 TRANSFORMER_ENGINE_VERSION=2.2 MODEL_OPT_VERSION=0.25.0 LD_LIBRARY_PATH=/opt/hpcx/ucc/lib/:/opt/hpcx/ucx/lib/:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video NVIDIA_PRODUCT_NAME=Triton Server LIBRARY_PATH=/usr/local/cuda/lib64/stubs: PIP_BREAK_SYSTEM_PACKAGES=1 TRITON_SERVER_VERSION=2.57.0 NVIDIA_TRITON_SERVER_VERSION=25.04 UCX_MEM_EVENTS=no TF_ADJUST_HUE_FUSED=1 TF_ADJUST_SATURATION_FUSED=1 TF_ENABLE_WINOGRAD_NONFUSED=1 TF_AUTOTUNE_THRESHOLD=2 TRITON_SERVER_GPU_ENABLED=1 TRITON_SERVER_USER=triton-server DEBIAN_FRONTEND=noninteractive TCMALLOC_RELEASE_RATE=200 DCGM_VERSION=3.3.6 PYTHONPATH=/opt/tritonserver/backends/dali/wheel/dali: NVIDIA_BUILD_ID=164182428
镜像标签
true: com.amazonaws.sagemaker.capabilities.accept-bind-to-port true: com.amazonaws.sagemaker.capabilities.multi-models 164182428: com.nvidia.build.id 0beb0717a0395341699ac92454c1858e91d2fe3f: com.nvidia.build.ref 0.4.4.50: com.nvidia.cal.version 12.9.0.2: com.nvidia.cublas.version 0.4.0.789: com.nvidia.cublasmp.version 9.0: com.nvidia.cuda.version 9.9.0.52: com.nvidia.cudnn.version 11.4.0.6: com.nvidia.cufft.version 10.3.10.19: com.nvidia.curand.version 11.7.4.40: com.nvidia.cusolver.version 12.5.9.5: com.nvidia.cusparse.version 0.7.1.0: com.nvidia.cusparselt.version 2.26.3: com.nvidia.nccl.version 12.4.0.27: com.nvidia.npp.version 2025.2.0.11: com.nvidia.nsightcompute.version 2025.2.1.130: com.nvidia.nsightsystems.version 12.4.0.16: com.nvidia.nvjpeg.version 10.9.0.34+cuda12.8: com.nvidia.tensorrt.version : com.nvidia.tensorrtoss.version 2.57.0: com.nvidia.tritonserver.version nvidia_driver: com.nvidia.volumes.needed ubuntu: org.opencontainers.image.ref.name 24.04: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3  docker.io/nvcr.io/nvidia/tritonserver:25.04-py3

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3  docker.io/nvcr.io/nvidia/tritonserver:25.04-py3

Shell快速替换命令

sed -i 's#nvcr.io/nvidia/tritonserver:25.04-py3#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3  docker.io/nvcr.io/nvidia/tritonserver:25.04-py3'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3  docker.io/nvcr.io/nvidia/tritonserver:25.04-py3'

镜像构建历史


# 2025-05-02 13:04:33  8.85KB 复制新文件或目录到容器中
COPY --chown=1000:1000 docker/sagemaker/serve /usr/bin/. # buildkit
                        
# 2025-05-02 13:04:33  0.00B 添加元数据标签
LABEL com.amazonaws.sagemaker.capabilities.multi-models=true
                        
# 2025-05-02 13:04:33  0.00B 添加元数据标签
LABEL com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
                        
# 2025-05-02 13:04:33  11.93MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c pip3 install -r python/openai/requirements.txt # buildkit
                        
# 2025-05-02 13:04:30  441.44MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c find /opt/tritonserver/python -maxdepth 1 -type f -name     "tritonserver-*.whl" | xargs -I {} pip install --upgrade {}[all] &&     find /opt/tritonserver/python -maxdepth 1 -type f -name     "tritonfrontend-*.whl" | xargs -I {} pip install --upgrade {}[all] # buildkit
                        
# 2025-05-02 13:04:22  3.01MB 复制新文件或目录到容器中
COPY --chown=1000:1000 NVIDIA_Deep_Learning_Container_License.pdf . # buildkit
                        
# 2025-05-02 13:04:22  0.00B 设置工作目录为/opt/tritonserver
WORKDIR /opt/tritonserver
                        
# 2025-05-02 13:04:22  6.60GB 复制新文件或目录到容器中
COPY --chown=1000:1000 build/install tritonserver # buildkit
                        
# 2025-05-02 13:04:16  0.00B 设置工作目录为/opt
WORKDIR /opt
                        
# 2025-05-02 13:04:16  0.00B 添加元数据标签
LABEL com.nvidia.build.ref=0beb0717a0395341699ac92454c1858e91d2fe3f
                        
# 2025-05-02 13:04:16  0.00B 添加元数据标签
LABEL com.nvidia.build.id=164182428
                        
# 2025-05-02 13:04:16  0.00B 设置环境变量 NVIDIA_BUILD_ID
ENV NVIDIA_BUILD_ID=164182428
                        
# 2025-05-02 13:04:16  733.00B 复制新文件或目录到容器中
COPY docker/entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2025-05-02 13:04:16  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=Triton Server
                        
# 2025-05-02 13:04:16  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c rm -fr /opt/tritonserver/* # buildkit
                        
# 2025-05-02 13:04:15  0.00B 设置工作目录为/opt/tritonserver
WORKDIR /opt/tritonserver
                        
# 2025-05-02 13:04:15  0.00B 设置环境变量 PYTHONPATH
ENV PYTHONPATH=/opt/tritonserver/backends/dali/wheel/dali:
                        
# 2025-05-02 13:04:15  199.57MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c apt-get update       && apt-get install -y --no-install-recommends             python3             libarchive-dev             python3-pip             python3-wheel             python3-setuptools             libpython3-dev       && pip3 install --upgrade             "numpy<2"             virtualenv       && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-05-02 13:04:02  50.34KB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c ln -sf ${_CUDA_COMPAT_PATH}/lib.real ${_CUDA_COMPAT_PATH}/lib     && echo ${_CUDA_COMPAT_PATH}/lib > /etc/ld.so.conf.d/00-cuda-compat.conf     && ldconfig     && rm -f ${_CUDA_COMPAT_PATH}/lib # buildkit
                        
# 2025-05-02 13:04:02  1.75GB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c curl -o /tmp/cuda-keyring.deb           https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb       && apt install /tmp/cuda-keyring.deb       && rm /tmp/cuda-keyring.deb       && apt-get update       && apt-get install -y datacenter-gpu-manager=1:3.3.6 # buildkit
                        
# 2025-05-02 13:02:35  0.00B 设置环境变量 DCGM_VERSION
ENV DCGM_VERSION=3.3.6
                        
# 2025-05-02 13:02:35  0.00B 设置环境变量 TCMALLOC_RELEASE_RATE
ENV TCMALLOC_RELEASE_RATE=200
                        
# 2025-05-02 13:02:35  384.41MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c apt-get update       && apt-get install -y --no-install-recommends               clang               curl               dirmngr               git               gperf               libb64-0d               libcurl4-openssl-dev               libgoogle-perftools-dev               libjemalloc-dev               libnuma-dev               software-properties-common               wget               libgomp1               python3-pip       && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2025-05-02 13:02:07  4.49KB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.57.0 TRITON_CONTAINER_VERSION=25.04 /bin/sh -c userdel tensorrt-server > /dev/null 2>&1 || true       && userdel ubuntu > /dev/null 2>&1 || true       && if ! id -u $TRITON_SERVER_USER > /dev/null 2>&1 ; then           useradd $TRITON_SERVER_USER;         fi       && [ `id -u $TRITON_SERVER_USER` -eq 1000 ]       && [ `id -g $TRITON_SERVER_USER` -eq 1000 ] # buildkit
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TRITON_SERVER_USER
ENV TRITON_SERVER_USER=triton-server
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TRITON_SERVER_GPU_ENABLED
ENV TRITON_SERVER_GPU_ENABLED=1
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TF_AUTOTUNE_THRESHOLD
ENV TF_AUTOTUNE_THRESHOLD=2
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TF_ENABLE_WINOGRAD_NONFUSED
ENV TF_ENABLE_WINOGRAD_NONFUSED=1
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TF_ADJUST_SATURATION_FUSED
ENV TF_ADJUST_SATURATION_FUSED=1
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TF_ADJUST_HUE_FUSED
ENV TF_ADJUST_HUE_FUSED=1
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/opt/hpcx/ucc/lib/:/opt/hpcx/ucx/lib/:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 UCX_MEM_EVENTS
ENV UCX_MEM_EVENTS=no
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 PATH
ENV PATH=/opt/tritonserver/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
                        
# 2025-05-02 13:02:07  0.00B 添加元数据标签
LABEL com.nvidia.tritonserver.version=2.57.0
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 NVIDIA_TRITON_SERVER_VERSION
ENV NVIDIA_TRITON_SERVER_VERSION=25.04
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 TRITON_SERVER_VERSION
ENV TRITON_SERVER_VERSION=2.57.0
                        
# 2025-05-02 13:02:07  0.00B 定义构建参数
ARG TRITON_CONTAINER_VERSION=25.04
                        
# 2025-05-02 13:02:07  0.00B 定义构建参数
ARG TRITON_VERSION=2.57.0
                        
# 2025-05-02 13:02:07  0.00B 设置环境变量 PIP_BREAK_SYSTEM_PACKAGES
ENV PIP_BREAK_SYSTEM_PACKAGES=1
                        
# 2025-04-16 00:59:31  0.00B 设置环境变量 LIBRARY_PATH
ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
                        
# 2025-04-16 00:59:31  1.01GB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEVEL=1 BASE=0  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUDA.sh  && /nvidia/build-scripts/installLIBS.sh  && if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installCUSPARSELT.sh  && if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi  && rm -f /tmp/cuda-*.patch # buildkit
                        
# 2025-04-16 00:56:13  1.49KB 复制新文件或目录到容器中
COPY cuda-*.patch /tmp # buildkit
                        
# 2025-04-16 00:56:13  99.01MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         build-essential         git         libglib2.0-0         less         libhwloc15         libnl-route-3-200         libnl-3-dev         libnl-route-3-dev         libnuma-dev         libnuma1         libpmi2-0-dev         nano         numactl         openssh-client         vim         wget  && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-04-16 00:49:21  467.00B 执行命令并创建新的镜像层
RUN |39 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 NCCL_VERSION=2.26.3 CUBLAS_VERSION=12.9.0.2 CUFFT_VERSION=11.4.0.6 CURAND_VERSION=10.3.10.19 CUSPARSE_VERSION=12.5.9.5 CUSOLVER_VERSION=11.7.4.40 NPP_VERSION=12.4.0.27 NVJPEG_VERSION=12.4.0.16 CUFILE_VERSION=1.14.0.30 NVJITLINK_VERSION=12.9.41 CUBLASMP_VERSION=0.4.0.789 CAL_VERSION=0.4.4.50 NVSHMEM_VERSION=3.2.5 CUDNN_VERSION=9.9.0.52 CUDNN_FRONTEND_VERSION=1.11.0 TRT_VERSION=10.9.0.34+cuda12.8 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2025.2.1.130 NSIGHT_COMPUTE_VERSION=2025.2.0.11 CUSPARSELT_VERSION=0.7.1.0 DALI_VERSION=1.48.0 DALI_BUILD= DALI_URL_SUFFIX=120 POLYGRAPHY_VERSION=0.49.20 TRANSFORMER_ENGINE_VERSION=2.2 MODEL_OPT_VERSION=0.25.0 _LIBPATH_SUFFIX= /bin/sh -c mkdir -p /workspace && cp -f -p /opt/nvidia/entrypoint.d/30-container-license.txt /workspace/license.txt # buildkit
                        
# 2025-04-16 00:49:21  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2025-04-16 00:49:21  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2025-04-16 00:49:21  16.04KB 复制新文件或目录到容器中
COPY entrypoint/ /opt/nvidia/ # buildkit
                        
# 2025-04-16 00:49:21  33.35KB 执行命令并创建新的镜像层
RUN |39 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 NCCL_VERSION=2.26.3 CUBLAS_VERSION=12.9.0.2 CUFFT_VERSION=11.4.0.6 CURAND_VERSION=10.3.10.19 CUSPARSE_VERSION=12.5.9.5 CUSOLVER_VERSION=11.7.4.40 NPP_VERSION=12.4.0.27 NVJPEG_VERSION=12.4.0.16 CUFILE_VERSION=1.14.0.30 NVJITLINK_VERSION=12.9.41 CUBLASMP_VERSION=0.4.0.789 CAL_VERSION=0.4.4.50 NVSHMEM_VERSION=3.2.5 CUDNN_VERSION=9.9.0.52 CUDNN_FRONTEND_VERSION=1.11.0 TRT_VERSION=10.9.0.34+cuda12.8 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2025.2.1.130 NSIGHT_COMPUTE_VERSION=2025.2.0.11 CUSPARSELT_VERSION=0.7.1.0 DALI_VERSION=1.48.0 DALI_BUILD= DALI_URL_SUFFIX=120 POLYGRAPHY_VERSION=0.49.20 TRANSFORMER_ENGINE_VERSION=2.2 MODEL_OPT_VERSION=0.25.0 _LIBPATH_SUFFIX= /bin/sh -c if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then            echo "/opt/amazon/aws-ofi-nccl/lib" > /etc/ld.so.conf.d/aws-ofi-nccl.conf       && ldconfig;                                                 fi # buildkit
                        
# 2025-04-16 00:49:21  5.11MB 复制新文件或目录到容器中
COPY /opt/amazon/aws-ofi-nccl /opt/amazon/aws-ofi-nccl # buildkit
                        
# 2025-04-16 00:48:01  0.00B 设置环境变量 PATH LD_LIBRARY_PATH NVIDIA_VISIBLE_DEVICES NVIDIA_DRIVER_CAPABILITIES
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin LD_LIBRARY_PATH=/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG _LIBPATH_SUFFIX=
                        
# 2025-04-16 00:48:01  46.00B 执行命令并创建新的镜像层
RUN |38 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 NCCL_VERSION=2.26.3 CUBLAS_VERSION=12.9.0.2 CUFFT_VERSION=11.4.0.6 CURAND_VERSION=10.3.10.19 CUSPARSE_VERSION=12.5.9.5 CUSOLVER_VERSION=11.7.4.40 NPP_VERSION=12.4.0.27 NVJPEG_VERSION=12.4.0.16 CUFILE_VERSION=1.14.0.30 NVJITLINK_VERSION=12.9.41 CUBLASMP_VERSION=0.4.0.789 CAL_VERSION=0.4.4.50 NVSHMEM_VERSION=3.2.5 CUDNN_VERSION=9.9.0.52 CUDNN_FRONTEND_VERSION=1.11.0 TRT_VERSION=10.9.0.34+cuda12.8 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2025.2.1.130 NSIGHT_COMPUTE_VERSION=2025.2.0.11 CUSPARSELT_VERSION=0.7.1.0 DALI_VERSION=1.48.0 DALI_BUILD= DALI_URL_SUFFIX=120 POLYGRAPHY_VERSION=0.49.20 TRANSFORMER_ENGINE_VERSION=2.2 MODEL_OPT_VERSION=0.25.0 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf  && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2025-04-16 00:48:01  13.39KB 复制文件或目录到容器中
ADD docs.tgz / # buildkit
                        
# 2025-04-16 00:48:01  0.00B 设置环境变量 DALI_VERSION DALI_BUILD DALI_URL_SUFFIX POLYGRAPHY_VERSION TRANSFORMER_ENGINE_VERSION MODEL_OPT_VERSION
ENV DALI_VERSION=1.48.0 DALI_BUILD= DALI_URL_SUFFIX=120 POLYGRAPHY_VERSION=0.49.20 TRANSFORMER_ENGINE_VERSION=2.2 MODEL_OPT_VERSION=0.25.0
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG MODEL_OPT_VERSION=0.25.0
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG TRANSFORMER_ENGINE_VERSION=2.2
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG POLYGRAPHY_VERSION=0.49.20
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG DALI_URL_SUFFIX=120
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG DALI_BUILD=
                        
# 2025-04-16 00:48:01  0.00B 定义构建参数
ARG DALI_VERSION=1.48.0
                        
# 2025-04-16 00:48:01  0.00B 添加元数据标签
LABEL com.nvidia.nccl.version=2.26.3 com.nvidia.cublas.version=12.9.0.2 com.nvidia.cufft.version=11.4.0.6 com.nvidia.curand.version=10.3.10.19 com.nvidia.cusparse.version=12.5.9.5 com.nvidia.cusparselt.version=0.7.1.0 com.nvidia.cusolver.version=11.7.4.40 com.nvidia.npp.version=12.4.0.27 com.nvidia.nvjpeg.version=12.4.0.16 com.nvidia.cublasmp.version=0.4.0.789 com.nvidia.cal.version=0.4.4.50 com.nvidia.cudnn.version=9.9.0.52 com.nvidia.tensorrt.version=10.9.0.34+cuda12.8 com.nvidia.tensorrtoss.version= com.nvidia.nsightsystems.version=2025.2.1.130 com.nvidia.nsightcompute.version=2025.2.0.11
                        
# 2025-04-16 00:48:01  7.59GB 执行命令并创建新的镜像层
RUN |32 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 NCCL_VERSION=2.26.3 CUBLAS_VERSION=12.9.0.2 CUFFT_VERSION=11.4.0.6 CURAND_VERSION=10.3.10.19 CUSPARSE_VERSION=12.5.9.5 CUSOLVER_VERSION=11.7.4.40 NPP_VERSION=12.4.0.27 NVJPEG_VERSION=12.4.0.16 CUFILE_VERSION=1.14.0.30 NVJITLINK_VERSION=12.9.41 CUBLASMP_VERSION=0.4.0.789 CAL_VERSION=0.4.4.50 NVSHMEM_VERSION=3.2.5 CUDNN_VERSION=9.9.0.52 CUDNN_FRONTEND_VERSION=1.11.0 TRT_VERSION=10.9.0.34+cuda12.8 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2025.2.1.130 NSIGHT_COMPUTE_VERSION=2025.2.0.11 CUSPARSELT_VERSION=0.7.1.0 /bin/sh -c /nvidia/build-scripts/installLIBS.sh  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUSPARSELT.sh  && if [ -z "${JETPACK_HOST_MOUNTS}" ]; then       /nvidia/build-scripts/installNCCL.sh;     fi; # buildkit
                        
# 2025-04-16 00:46:55  0.00B 设置环境变量 NCCL_VERSION CUBLAS_VERSION CUFFT_VERSION CURAND_VERSION CUSPARSE_VERSION CUSPARSELT_VERSION CUSOLVER_VERSION NPP_VERSION NVJPEG_VERSION CUFILE_VERSION NVJITLINK_VERSION CUBLASMP_VERSION CAL_VERSION NVSHMEM_VERSION CUDNN_VERSION CUDNN_FRONTEND_VERSION TRT_VERSION TRTOSS_VERSION NSIGHT_SYSTEMS_VERSION NSIGHT_COMPUTE_VERSION
ENV NCCL_VERSION=2.26.3 CUBLAS_VERSION=12.9.0.2 CUFFT_VERSION=11.4.0.6 CURAND_VERSION=10.3.10.19 CUSPARSE_VERSION=12.5.9.5 CUSPARSELT_VERSION=0.7.1.0 CUSOLVER_VERSION=11.7.4.40 NPP_VERSION=12.4.0.27 NVJPEG_VERSION=12.4.0.16 CUFILE_VERSION=1.14.0.30 NVJITLINK_VERSION=12.9.41 CUBLASMP_VERSION=0.4.0.789 CAL_VERSION=0.4.4.50 NVSHMEM_VERSION=3.2.5 CUDNN_VERSION=9.9.0.52 CUDNN_FRONTEND_VERSION=1.11.0 TRT_VERSION=10.9.0.34+cuda12.8 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2025.2.1.130 NSIGHT_COMPUTE_VERSION=2025.2.0.11
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUSPARSELT_VERSION=0.7.1.0
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NSIGHT_COMPUTE_VERSION=2025.2.0.11
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NSIGHT_SYSTEMS_VERSION=2025.2.1.130
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG TRTOSS_VERSION=
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG TRT_VERSION=10.9.0.34+cuda12.8
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUDNN_FRONTEND_VERSION=1.11.0
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUDNN_VERSION=9.9.0.52
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NVSHMEM_VERSION=3.2.5
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CAL_VERSION=0.4.4.50
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUBLASMP_VERSION=0.4.0.789
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NVJITLINK_VERSION=12.9.41
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUFILE_VERSION=1.14.0.30
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NVJPEG_VERSION=12.4.0.16
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NPP_VERSION=12.4.0.27
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUSOLVER_VERSION=11.7.4.40
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUSPARSE_VERSION=12.5.9.5
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CURAND_VERSION=10.3.10.19
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUFFT_VERSION=11.4.0.6
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG CUBLAS_VERSION=12.9.0.2
                        
# 2025-04-16 00:46:55  0.00B 定义构建参数
ARG NCCL_VERSION=2.26.3
                        
# 2025-04-16 00:46:55  0.00B 添加元数据标签
LABEL com.nvidia.volumes.needed=nvidia_driver com.nvidia.cuda.version=9.0
                        
# 2025-04-16 00:46:55  0.00B 设置环境变量 _CUDA_COMPAT_PATH ENV BASH_ENV SHELL NVIDIA_REQUIRE_CUDA
ENV _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0
                        
# 2025-04-16 00:46:55  59.18KB 执行命令并创建新的镜像层
RUN |12 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 /bin/sh -c cp -vprd /nvidia/. /  &&  patch -p0 < /etc/startup_scripts.patch  &&  rm -f /etc/startup_scripts.patch # buildkit
                        
# 2025-04-16 00:46:55  874.65MB 执行命令并创建新的镜像层
RUN |12 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02 /bin/sh -c /nvidia/build-scripts/installCUDA.sh # buildkit
                        
# 2025-04-11 09:18:54  0.00B 设置环境变量 CUDA_VERSION CUDA_DRIVER_VERSION
ENV CUDA_VERSION=12.9.0.036 CUDA_DRIVER_VERSION=575.51.02
                        
# 2025-04-11 09:18:54  0.00B 定义构建参数
ARG CUDA_DRIVER_VERSION=575.51.02
                        
# 2025-04-11 09:18:54  0.00B 定义构建参数
ARG CUDA_VERSION=12.9.0.036
                        
# 2025-04-11 09:18:54  0.00B 设置环境变量 OMPI_MCA_coll_hcoll_enable
ENV OMPI_MCA_coll_hcoll_enable=0
                        
# 2025-04-11 09:18:54  0.00B 设置环境变量 OPAL_PREFIX PATH
ENV OPAL_PREFIX=/opt/hpcx/ompi PATH=/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin
                        
# 2025-04-11 09:18:54  230.02MB 执行命令并创建新的镜像层
RUN |10 JETPACK_HOST_MOUNTS= GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 RDMACORE_VERSION=50.0 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0 TARGETARCH=amd64 /bin/sh -c cd /nvidia  && ( export DEBIAN_FRONTEND=noninteractive        && apt-get update                            && apt-get install -y --no-install-recommends              libibverbs1                                  libibverbs-dev                               librdmacm1                                   librdmacm-dev                                libibumad3                                   libibumad-dev                                ibverbs-utils                                ibverbs-providers                     && rm -rf /var/lib/apt/lists/*               && rm $(dpkg-query -L                                    libibverbs-dev                               librdmacm-dev                                libibumad-dev                            | grep "\(\.so\|\.a\)$")          )                                            && ( cd opt/gdrcopy/                              && dpkg -i libgdrapi_*.deb                   )                                         && ( cp -r opt/hpcx /opt/                                         && cp etc/ld.so.conf.d/hpcx.conf /etc/ld.so.conf.d/          && ln -sf /opt/hpcx/ompi /usr/local/mpi                      && ln -sf /opt/hpcx/ucx  /usr/local/ucx                      && sed -i 's/^\(hwloc_base_binding_policy\) = core$/\1 = none/' /opt/hpcx/ompi/etc/openmpi-mca-params.conf         && sed -i 's/^\(btl = self\)$/#\1/'                             /opt/hpcx/ompi/etc/openmpi-mca-params.conf       )                                                         && ( if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then           cd opt/amazon/efa/                                           && dpkg -i libfabric*.deb                                    && rm /opt/amazon/efa/lib/libfabric.a                        && echo "/opt/amazon/efa/lib" > /etc/ld.so.conf.d/efa.conf;         fi                                                         )                                                         && ldconfig # buildkit
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-04-11 09:18:47  0.00B 设置环境变量 GDRCOPY_VERSION HPCX_VERSION MOFED_VERSION OPENUCX_VERSION OPENMPI_VERSION RDMACORE_VERSION EFA_VERSION AWS_OFI_NCCL_VERSION
ENV GDRCOPY_VERSION=2.4.1 HPCX_VERSION=2.22.1 MOFED_VERSION=5.4-rdmacore50.0 OPENUCX_VERSION=1.18.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=50.0 EFA_VERSION=1.38.1 AWS_OFI_NCCL_VERSION=1.14.0
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG AWS_OFI_NCCL_VERSION=1.14.0
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG EFA_VERSION=1.38.1
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG OPENMPI_VERSION=4.1.7
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG OPENUCX_VERSION=1.18.0
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG MOFED_VERSION=5.4-rdmacore50.0
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG RDMACORE_VERSION=50.0
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG HPCX_VERSION=2.22.1
                        
# 2025-04-11 09:18:47  0.00B 定义构建参数
ARG GDRCOPY_VERSION=2.4.1
                        
# 2025-04-11 09:18:47  311.13MB 执行命令并创建新的镜像层
RUN |1 JETPACK_HOST_MOUNTS= /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         apt-utils         build-essential         ca-certificates         curl         libncurses6         libncursesw6         patch         wget         unzip         jq         gnupg         libtcmalloc-minimal4  && rm -rf /var/lib/apt/lists/*  && echo "hsts=0" > /root/.wgetrc # buildkit
                        
# 2025-04-11 09:18:30  0.00B 执行命令并创建新的镜像层
RUN |1 JETPACK_HOST_MOUNTS= /bin/sh -c if [ -n "${JETPACK_HOST_MOUNTS}" ]; then        echo "/usr/lib/aarch64-linux-gnu/tegra" > /etc/ld.so.conf.d/nvidia-tegra.conf     && echo "/usr/lib/aarch64-linux-gnu/tegra-egl" >> /etc/ld.so.conf.d/nvidia-tegra.conf;     fi # buildkit
                        
# 2025-04-11 09:18:30  0.00B 设置环境变量 NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS
ENV NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=
                        
# 2025-04-11 09:18:30  0.00B 定义构建参数
ARG JETPACK_HOST_MOUNTS=
                        
# 2025-04-08 18:43:15  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-04-08 18:43:14  78.10MB 
/bin/sh -c #(nop) ADD file:1d7c45546e94b90e941c5bf5c7a5d415d7b868581ad96171d4beb76caa8ab683 in / 
                        
# 2025-04-08 18:43:12  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=24.04
                        
# 2025-04-08 18:43:12  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-04-08 18:43:12  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-04-08 18:43:12  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:f327ff1ad9b69493a7f4f96f5feaf0a89d3f0bae411dcf9bcfe584e8656bb90a",
    "RepoTags": [
        "nvcr.io/nvidia/tritonserver:25.04-py3",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:25.04-py3"
    ],
    "RepoDigests": [
        "nvcr.io/nvidia/tritonserver@sha256:ca7703e3696df70d6bd9bf7b66b654a01bddbbf2c807c0a70a705082e6727de2",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver@sha256:1bf96015fb7f222e483557c9a00b7f3e29d3e7b0859c7fc2e06acbc7508c99c0"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-05-02T05:04:33.106230043Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/tritonserver/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin",
            "NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=",
            "GDRCOPY_VERSION=2.4.1",
            "HPCX_VERSION=2.22.1",
            "MOFED_VERSION=5.4-rdmacore50.0",
            "OPENUCX_VERSION=1.18.0",
            "OPENMPI_VERSION=4.1.7",
            "RDMACORE_VERSION=50.0",
            "EFA_VERSION=1.38.1",
            "AWS_OFI_NCCL_VERSION=1.14.0",
            "OPAL_PREFIX=/opt/hpcx/ompi",
            "OMPI_MCA_coll_hcoll_enable=0",
            "CUDA_VERSION=12.9.0.036",
            "CUDA_DRIVER_VERSION=575.51.02",
            "_CUDA_COMPAT_PATH=/usr/local/cuda/compat",
            "ENV=/etc/shinit_v2",
            "BASH_ENV=/etc/bash.bashrc",
            "SHELL=/bin/bash",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=9.0",
            "NCCL_VERSION=2.26.3",
            "CUBLAS_VERSION=12.9.0.2",
            "CUFFT_VERSION=11.4.0.6",
            "CURAND_VERSION=10.3.10.19",
            "CUSPARSE_VERSION=12.5.9.5",
            "CUSPARSELT_VERSION=0.7.1.0",
            "CUSOLVER_VERSION=11.7.4.40",
            "NPP_VERSION=12.4.0.27",
            "NVJPEG_VERSION=12.4.0.16",
            "CUFILE_VERSION=1.14.0.30",
            "NVJITLINK_VERSION=12.9.41",
            "CUBLASMP_VERSION=0.4.0.789",
            "CAL_VERSION=0.4.4.50",
            "NVSHMEM_VERSION=3.2.5",
            "CUDNN_VERSION=9.9.0.52",
            "CUDNN_FRONTEND_VERSION=1.11.0",
            "TRT_VERSION=10.9.0.34+cuda12.8",
            "TRTOSS_VERSION=",
            "NSIGHT_SYSTEMS_VERSION=2025.2.1.130",
            "NSIGHT_COMPUTE_VERSION=2025.2.0.11",
            "DALI_VERSION=1.48.0",
            "DALI_BUILD=",
            "DALI_URL_SUFFIX=120",
            "POLYGRAPHY_VERSION=0.49.20",
            "TRANSFORMER_ENGINE_VERSION=2.2",
            "MODEL_OPT_VERSION=0.25.0",
            "LD_LIBRARY_PATH=/opt/hpcx/ucc/lib/:/opt/hpcx/ucx/lib/:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility,video",
            "NVIDIA_PRODUCT_NAME=Triton Server",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs:",
            "PIP_BREAK_SYSTEM_PACKAGES=1",
            "TRITON_SERVER_VERSION=2.57.0",
            "NVIDIA_TRITON_SERVER_VERSION=25.04",
            "UCX_MEM_EVENTS=no",
            "TF_ADJUST_HUE_FUSED=1",
            "TF_ADJUST_SATURATION_FUSED=1",
            "TF_ENABLE_WINOGRAD_NONFUSED=1",
            "TF_AUTOTUNE_THRESHOLD=2",
            "TRITON_SERVER_GPU_ENABLED=1",
            "TRITON_SERVER_USER=triton-server",
            "DEBIAN_FRONTEND=noninteractive",
            "TCMALLOC_RELEASE_RATE=200",
            "DCGM_VERSION=3.3.6",
            "PYTHONPATH=/opt/tritonserver/backends/dali/wheel/dali:",
            "NVIDIA_BUILD_ID=164182428"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/tritonserver",
        "Entrypoint": [
            "/opt/nvidia/nvidia_entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.amazonaws.sagemaker.capabilities.accept-bind-to-port": "true",
            "com.amazonaws.sagemaker.capabilities.multi-models": "true",
            "com.nvidia.build.id": "164182428",
            "com.nvidia.build.ref": "0beb0717a0395341699ac92454c1858e91d2fe3f",
            "com.nvidia.cal.version": "0.4.4.50",
            "com.nvidia.cublas.version": "12.9.0.2",
            "com.nvidia.cublasmp.version": "0.4.0.789",
            "com.nvidia.cuda.version": "9.0",
            "com.nvidia.cudnn.version": "9.9.0.52",
            "com.nvidia.cufft.version": "11.4.0.6",
            "com.nvidia.curand.version": "10.3.10.19",
            "com.nvidia.cusolver.version": "11.7.4.40",
            "com.nvidia.cusparse.version": "12.5.9.5",
            "com.nvidia.cusparselt.version": "0.7.1.0",
            "com.nvidia.nccl.version": "2.26.3",
            "com.nvidia.npp.version": "12.4.0.27",
            "com.nvidia.nsightcompute.version": "2025.2.0.11",
            "com.nvidia.nsightsystems.version": "2025.2.1.130",
            "com.nvidia.nvjpeg.version": "12.4.0.16",
            "com.nvidia.tensorrt.version": "10.9.0.34+cuda12.8",
            "com.nvidia.tensorrtoss.version": "",
            "com.nvidia.tritonserver.version": "2.57.0",
            "com.nvidia.volumes.needed": "nvidia_driver",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "24.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 19590299607,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/12a4c3486b9ab718d36ee056ef52a78744710b5ba39b928c554e5ec543276306/diff:/var/lib/docker/overlay2/c1c1b70774e96cc411f605db5f73446d12ec8843c095972381d29e567f2a73cb/diff:/var/lib/docker/overlay2/088ad83ff6b00080205f39353a6bb42b83da588d9994877ec662ab709688a3b9/diff:/var/lib/docker/overlay2/95f62238afd1405941c0de4eb912067f51e95725cda5542c5895e3042b939f9d/diff:/var/lib/docker/overlay2/0f5649d5b1f0b434f80f62c40e73fd6922e38347e4a45fc7354192804e386089/diff:/var/lib/docker/overlay2/d53d417168669f91d4ebcf6ff823085eedfde0e4a66d6652406469c62eb2dce1/diff:/var/lib/docker/overlay2/d4c52fb1d952cbaf3db79690be92cae86a9032b672fed7903f0f89482fafb46e/diff:/var/lib/docker/overlay2/e043c709a93a8bb02a9aae305048953b2d115af76ded32d7de034e5bfe0ad54c/diff:/var/lib/docker/overlay2/a95785f47d641a65416c0afab99b9a73f75168b7afdb6998ca6009ff819971f7/diff:/var/lib/docker/overlay2/c27ee8742177630ca6514377085c939928a25d42aea022b7b110fa59218d2190/diff:/var/lib/docker/overlay2/f7cedc2e11efcd27f9cd4a9d00485d0079a45901445c849db9c4652e8e2730a1/diff:/var/lib/docker/overlay2/b553516420a27e27ecd2e378cd938accb7b50ea8dfa37d949338cf1faba1e505/diff:/var/lib/docker/overlay2/239a0d5e954d080761e87c4a93371cfc81c658bbe58ff045400487b345a26a8e/diff:/var/lib/docker/overlay2/b1a934edd40db4615fcf3ddeb510a2dbc08e3a592b2afcab3ff0c1fff6e65440/diff:/var/lib/docker/overlay2/61c12a9c49b8a129dd8a8a5531a324f4f8b71e11827ac4d18593b5c85a1966e5/diff:/var/lib/docker/overlay2/e50309a02a15dcc9c5d093565240c1db28127965b25329fa1b1b9e7b4c2caa99/diff:/var/lib/docker/overlay2/f2efb5afa88584ba9eb2055d6dd7d5403c966c9139a23fbdb8739b6a2e02962a/diff:/var/lib/docker/overlay2/f3fbcbc841291f4d9bffbcdb4eda952e7bdecbf7563dca010fdf1fb2cd0db455/diff:/var/lib/docker/overlay2/80e430544182e4232ad377885ac9c06e6fe4ae58df2fe1363a2bd08ef0dde700/diff:/var/lib/docker/overlay2/e6c8190ddcc49e760c4d4a8fead8f71274a38dd55a9902da12aaf2fc5b6a7596/diff:/var/lib/docker/overlay2/1a56e5a8e26826bcc04490632991c33e716edd9bde77d449f02567328afe5ba2/diff:/var/lib/docker/overlay2/fe79b75c27e08279e33dcbe2fc3f26d1731b8dae2e4c832722a6326176c77e9e/diff:/var/lib/docker/overlay2/6bf943126304d0ba3a75264a8f12439f2462d2427288dd2b291726a6fed74045/diff:/var/lib/docker/overlay2/512eb697cfbb46c45b37b9123c4a596a335c3142f8e271859dba94fc98e5d659/diff:/var/lib/docker/overlay2/073739d3a99d2be0e212174d8cbd25472c2e8d2f0ccf5e5642d6f0fbc278d420/diff:/var/lib/docker/overlay2/6f9c555c9fa4dafcc8dee695878e4a6abc32c3e9350144d2ebf2943c6b86b230/diff:/var/lib/docker/overlay2/0d65d7d8d7738b71dad6a97e40675728d9131efaae48f9da28d984d2da412432/diff:/var/lib/docker/overlay2/e1b3227414cc39bcd72b83afcdaad2d14869f5751facf9d65663d76a98848873/diff:/var/lib/docker/overlay2/d9eeb6640d6cd89d9f721a87a99a145f6fa7a542851833d2bab9d07955b61854/diff:/var/lib/docker/overlay2/697096b4c822b101843182ff505291800d91c80f1ac5c99f2b9cab5e17ecccf2/diff",
            "MergedDir": "/var/lib/docker/overlay2/da086d5e68cf1965d6a36122ec1a432c0e579764f05318c30707004398ef7839/merged",
            "UpperDir": "/var/lib/docker/overlay2/da086d5e68cf1965d6a36122ec1a432c0e579764f05318c30707004398ef7839/diff",
            "WorkDir": "/var/lib/docker/overlay2/da086d5e68cf1965d6a36122ec1a432c0e579764f05318c30707004398ef7839/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:3abdd8a5e7a8909e1509f1d36dcc8b85a0f95c68a69e6d86c6e9e3c1059d44b3",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:56b48a64c1a89635c37cc8eee09f44dfdd1b0bffb178c7c6e684b5602230dc86",
            "sha256:51095d499b316211c41771ac0086d35be15ddb88e250ffc16c472317f7186592",
            "sha256:382f0aacfa3721bb8e87165e2adb98f5986881bebfd195c8a39ab90b56dd923a",
            "sha256:0c5897de4ba5c763c7e50e3a44f16f87a36e6672290cfab474eb27cd313b39c6",
            "sha256:383dc5aac9d7a3d6dd11b9da9733258cc739f0b2e7fccc1fab120eaf5e04f205",
            "sha256:4ffee5b339a82e809699254d6393839780f9c85d54f2e67bbdacaf40ca3a879e",
            "sha256:9f2c7f673b63c3a31155f340149224e92b466afeb5fee5f0be73548bf803f01e",
            "sha256:6b5e4b206c8b3d4b99f76bf751d9bf52108a496529ebf673d5083023a8dea26d",
            "sha256:38566b056d73e56f9339fd3dae54d29b26713ab07773d022d807f35b5fe3a398",
            "sha256:f4bcfdcad5ed7fdcabb6fa7f3839922cda7a295b9f03fe7c0df00535631bf0ca",
            "sha256:0879c5d84b48fcfd1e9de1636ce3b171b9bd86a4a0772f5305cfe02e2781b00c",
            "sha256:bf3c7891de9351c7abd4db9910444bc818063088aff357a3033efc3c8b2a2786",
            "sha256:dd87c33ba4b2c61e7164cce127f51144776ceec66be37e2ee05926dbb20aee57",
            "sha256:ee5507ec4a0e87d3f11fc56363c27db42d182871b5355f8b7fa12e61ee679c8e",
            "sha256:baaa9dcdcc007b81199a973d8629e679270eb12855b0f14354ef100438853778",
            "sha256:8e7ad454f1f6798355440dc0969e6adb51ff93c7d9e592d073b02405af863d36",
            "sha256:0930d4bb11f5dc8967cbb045bcd029e25d496df24c28d0c6b124cd8481fcbc37",
            "sha256:ae236711e62cfa2d8a764c29cbcdacd7bc95da3b3afdfcf59189805530d27d5f",
            "sha256:53bd91d997e15da07e4bebd9772a8720274e36134ac72d441f62208bd28e330f",
            "sha256:57ec2f72d1d7960c25500324a9b1d66eaadf98648fcb0a38d28fa35d9da70aad",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:078100d204f880a1f4c0d393678817dbd30b338da6f95dfe2098bd4796afee15",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:0ce666d774e557b8c6f79d157f2aeeedaa6513578ad7c83651e219468d279526",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:da345ed77cd2d2b76fd541fac397734b393884bc7900e32af7a904059356a878",
            "sha256:c7e19837781ed76b27bb5e8a350f30a4e1750ac4fcf6920abf7157be4dff7ed7",
            "sha256:597012af35e1312d8b650d3edbeaba7e2ccc85f8ad00d87a39df5006cb2e5b6a",
            "sha256:f54995b23bdcb76682c57c99a9830404c8bd08944c4a00433a791d0d10ef3950"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-05-22T00:21:29.344529323+08:00"
    }
}

更多版本

docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

linux/amd64 docker.io24.86GB2025-02-26 02:25
341

docker.io/nvcr.io/nvidia/tritonserver:25.04-py3

linux/amd64 docker.io19.59GB2025-05-22 00:46
111

docker.io/nvcr.io/nvidia/tritonserver:25.02-trtllm-python-py3

linux/amd64 docker.io30.15GB2025-05-25 02:51
33