docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 linux/amd64

docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 - 国内下载镜像源浏览次数:10

```html

这是一个 NVIDIA Triton Inference Server 的 Docker 镜像。Triton Inference Server 是一个高性能的推理服务器，用于部署各种深度学习模型，支持多种框架（例如 TensorFlow, PyTorch, TensorRT 等），并提供模型版本管理、模型部署、以及高效的推理服务。

```

源镜像	docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
国内镜像	swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
镜像ID	sha256:5a443800c90a0ce65b94614dd79ac18af4e493e1545c93bf5dbaba26b7690934
镜像TAG	24.11-trtllm-python-py3
大小	24.86GB
镜像源	docker.io
项目信息	Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口	/opt/nvidia/nvidia_entrypoint.sh
工作目录	/opt/tritonserver
OS/平台	linux/amd64
浏览量	10 次
贡献者
镜像创建	2024-12-03T21:12:23.108068759Z
同步时间	2025-02-26 02:25
更新时间	2025-02-26 16:18

环境变量

PATH=/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 CUDA_CACHE_DISABLE=1 NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS= _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0 NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSPARSELT_VERSION=0.6.2.3 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.6.0.26 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3 DALI_VERSION=1.42.0 DALI_BUILD=18507157 POLYGRAPHY_VERSION=0.49.13 TRANSFORMER_ENGINE_VERSION=1.11 MODEL_OPT_VERSION=0.17.0 LD_LIBRARY_PATH=/usr/local/tensorrt/lib/:/opt/tritonserver/backends/tensorrtllm:/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video NVIDIA_PRODUCT_NAME=Triton Server GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=39.0 OPAL_PREFIX=/opt/hpcx/ompi OMPI_MCA_coll_hcoll_enable=0 LIBRARY_PATH=/usr/local/cuda/lib64/stubs: NVIDIA_BUILD_ID=126058417 CUDA_VER=12.6.2.004 NVRTC_VER=12.6.77-1 TRT_ROOT=/usr/local/tensorrt TRITON_SERVER_VERSION=2.52.0 NVIDIA_TRITON_SERVER_VERSION=24.11 UCX_MEM_EVENTS=no TF_ADJUST_HUE_FUSED=1 TF_ADJUST_SATURATION_FUSED=1 TF_ENABLE_WINOGRAD_NONFUSED=1 TF_AUTOTUNE_THRESHOLD=2 TRITON_SERVER_GPU_ENABLED=1 TRITON_SERVER_USER=triton-server DEBIAN_FRONTEND=noninteractive TCMALLOC_RELEASE_RATE=200 DCGM_VERSION=3.3.6 PIP_BREAK_SYSTEM_PACKAGES=1

镜像标签

true: com.amazonaws.sagemaker.capabilities.accept-bind-to-port true: com.amazonaws.sagemaker.capabilities.multi-models 126058417: com.nvidia.build.id 500dce76552ace5128a42607944640c78ff468d7: com.nvidia.build.ref 12.6.3.3: com.nvidia.cublas.version 9.0: com.nvidia.cuda.version 9.5.0.50: com.nvidia.cudnn.version 11.3.0.4: com.nvidia.cufft.version 10.3.7.77: com.nvidia.curand.version 11.7.1.2: com.nvidia.cusolver.version 12.5.4.2: com.nvidia.cusparse.version 0.6.2.3: com.nvidia.cusparselt.version 2.0.2.5: com.nvidia.cutensor.version 2.22.3: com.nvidia.nccl.version 12.3.1.54: com.nvidia.npp.version 2024.3.2.3: com.nvidia.nsightcompute.version 2024.6.1.90: com.nvidia.nsightsystems.version 12.3.3.54: com.nvidia.nvjpeg.version 10.5.0.18: com.nvidia.tensorrt.version : com.nvidia.tensorrtoss.version 2.52.0: com.nvidia.tritonserver.version nvidia_driver: com.nvidia.volumes.needed ubuntu: org.opencontainers.image.ref.name 22.04: org.opencontainers.image.version

镜像安全扫描查看Trivy扫描报告

系统OS: ubuntu 22.04 扫描引擎: Trivy 扫描时间: 2025-02-26 02:34

低危漏洞:171

中危漏洞:1138

高危漏洞:15

严重漏洞:1

docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 (ubuntu 22.04) (ubuntu)

Python (python-pkg)

usr/local/cuda-12.6/NsightSystems-cli-2024.6.1/target-linux-x64/plugins/efa_metrics/nic_sampler (gobinary)

阿里云高校计划(￥300代金券)领取

阿里云2核2G高性能云服务器 99元/年❤️

华为云2核4G2M云服务器，惊爆价99元1年

腾讯云2核2G云服务器，惊爆价99元1年

Ucloud 2核2G4M 59元/年❤️ 香港专线400G流量/月服务器 93元/年❤️

GPU创意AI画图炼丹服务器

GPT人工智能60G学习资料❤️

Docker拉取命令无权限下载?点我修复

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

Shell快速替换命令

sed -i 's#nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3'

镜像构建历史


# 2024-12-04 05:12:23  75.93MB 复制新文件或目录到容器中
COPY /opt/hpcx/ompi /opt/hpcx/ompi # buildkit
                        
# 2024-12-04 05:12:17  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c rm -fr /opt/hpcx/ompi # buildkit
                        
# 2024-12-04 05:12:17  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/tensorrt/lib/:/opt/tritonserver/backends/tensorrtllm:/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2024-12-04 05:12:17  22.11MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c ldconfig &&     ARCH="$(uname -i)" &&     rm -fr ${TRT_ROOT}/bin ${TRT_ROOT}/targets/${ARCH}-linux-gnu/bin ${TRT_ROOT}/data &&     rm -fr ${TRT_ROOT}/doc ${TRT_ROOT}/onnx_graphsurgeon ${TRT_ROOT}/python &&     rm -fr ${TRT_ROOT}/samples ${TRT_ROOT}/targets/${ARCH}-linux-gnu/samples &&     pip3 install --no-cache-dir transformers &&     find /usr -name libtensorrt_llm.so -exec dirname {} \; > /etc/ld.so.conf.d/tensorrt-llm.conf &&     find /opt/tritonserver -name libtritonserver.so -exec dirname {} \; > /etc/ld.so.conf.d/triton-tensorrtllm-worker.conf &&     pip3 install --no-cache-dir  grpcio-tools==1.64.0 &&     pip3 uninstall -y setuptools # buildkit
                        
# 2024-12-04 05:12:07  8.37KB 复制新文件或目录到容器中
COPY docker/sagemaker/serve /usr/bin/. # buildkit
                        
# 2024-12-04 05:12:07  0.00B 添加元数据标签
LABEL com.amazonaws.sagemaker.capabilities.multi-models=true
                        
# 2024-12-04 05:12:07  0.00B 添加元数据标签
LABEL com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
                        
# 2024-12-04 05:12:07  310.79MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c find /opt/tritonserver/python -maxdepth 1 -type f -name     "tritonserver-*.whl" | xargs -I {} pip install --upgrade {}[all] &&     find /opt/tritonserver/python -maxdepth 1 -type f -name     "tritonfrontend-*.whl" | xargs -I {} pip install --upgrade {}[all] # buildkit
                        
# 2024-12-04 05:11:59  3.01MB 复制新文件或目录到容器中
COPY NVIDIA_Deep_Learning_Container_License.pdf . # buildkit
                        
# 2024-12-04 05:11:59  0.00B 设置工作目录为/opt/tritonserver
WORKDIR /opt/tritonserver
                        
# 2024-12-04 05:11:59  542.40MB 复制新文件或目录到容器中
COPY build/install tritonserver # buildkit
                        
# 2024-12-04 05:11:59  0.00B 设置工作目录为/opt
WORKDIR /opt
                        
# 2024-12-04 05:11:59  0.00B 添加元数据标签
LABEL com.nvidia.build.ref=500dce76552ace5128a42607944640c78ff468d7
                        
# 2024-12-04 05:11:59  0.00B 添加元数据标签
LABEL com.nvidia.build.id=126058417
                        
# 2024-12-04 05:11:59  0.00B 设置环境变量 NVIDIA_BUILD_ID
ENV NVIDIA_BUILD_ID=126058417
                        
# 2024-12-04 05:11:59  733.00B 复制新文件或目录到容器中
COPY docker/entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2024-12-04 05:11:59  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=Triton Server
                        
# 2024-12-04 05:11:59  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c rm -fr /opt/tritonserver/* # buildkit
                        
# 2024-12-04 05:11:58  0.00B 设置工作目录为/opt/tritonserver
WORKDIR /opt/tritonserver
                        
# 2024-12-04 05:11:58  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c apt-get update     && apt-get install -y --no-install-recommends         openssh-client     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 05:11:53  16.28MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c apt-get update       && apt-get install -y --no-install-recommends             python3             libarchive-dev             python3-pip             python3-wheel             python3-setuptools             libpython3-dev       && pip3 install --upgrade             "numpy<2"             virtualenv       && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 05:11:44  0.00B 设置环境变量 PIP_BREAK_SYSTEM_PACKAGES
ENV PIP_BREAK_SYSTEM_PACKAGES=1
                        
# 2024-12-04 05:11:44  62.49KB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c ln -sf ${_CUDA_COMPAT_PATH}/lib.real ${_CUDA_COMPAT_PATH}/lib     && echo ${_CUDA_COMPAT_PATH}/lib > /etc/ld.so.conf.d/00-cuda-compat.conf     && ldconfig     && rm -f ${_CUDA_COMPAT_PATH}/lib # buildkit
                        
# 2024-12-04 05:11:44  1.76GB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c curl -o /tmp/cuda-keyring.deb           https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb       && apt install /tmp/cuda-keyring.deb       && rm /tmp/cuda-keyring.deb       && apt-get update       && apt-get install -y datacenter-gpu-manager=1:3.3.6 # buildkit
                        
# 2024-12-04 05:10:55  0.00B 设置环境变量 DCGM_VERSION
ENV DCGM_VERSION=3.3.6
                        
# 2024-12-04 05:10:55  0.00B 设置环境变量 TCMALLOC_RELEASE_RATE
ENV TCMALLOC_RELEASE_RATE=200
                        
# 2024-12-04 05:10:55  396.02MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c apt-get update       && apt-get install -y --no-install-recommends               clang               curl               dirmngr               git               gperf               libb64-0d               libcurl4-openssl-dev               libgoogle-perftools-dev               libjemalloc-dev               libnuma-dev               software-properties-common               wget                              python3-pip       && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2024-12-04 05:10:25  329.08KB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c userdel tensorrt-server > /dev/null 2>&1 || true       && userdel ubuntu > /dev/null 2>&1 || true       && if ! id -u $TRITON_SERVER_USER > /dev/null 2>&1 ; then           useradd $TRITON_SERVER_USER;         fi       && [ `id -u $TRITON_SERVER_USER` -eq 1000 ]       && [ `id -g $TRITON_SERVER_USER` -eq 1000 ] # buildkit
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TRITON_SERVER_USER
ENV TRITON_SERVER_USER=triton-server
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TRITON_SERVER_GPU_ENABLED
ENV TRITON_SERVER_GPU_ENABLED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_AUTOTUNE_THRESHOLD
ENV TF_AUTOTUNE_THRESHOLD=2
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_ENABLE_WINOGRAD_NONFUSED
ENV TF_ENABLE_WINOGRAD_NONFUSED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_ADJUST_SATURATION_FUSED
ENV TF_ADJUST_SATURATION_FUSED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_ADJUST_HUE_FUSED
ENV TF_ADJUST_HUE_FUSED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 UCX_MEM_EVENTS
ENV UCX_MEM_EVENTS=no
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 PATH
ENV PATH=/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin
                        
# 2024-12-04 05:10:25  0.00B 添加元数据标签
LABEL com.nvidia.tritonserver.version=2.52.0
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 NVIDIA_TRITON_SERVER_VERSION
ENV NVIDIA_TRITON_SERVER_VERSION=24.11
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TRITON_SERVER_VERSION
ENV TRITON_SERVER_VERSION=2.52.0
                        
# 2024-12-04 05:10:25  0.00B 定义构建参数
ARG TRITON_CONTAINER_VERSION
                        
# 2024-12-04 05:10:25  0.00B 定义构建参数
ARG TRITON_VERSION
                        
# 2024-12-04 04:00:50  4.81GB 执行命令并创建新的镜像层
RUN |2 NVRTC_VER=12.6.77-1 TRT_VER=10.6.0.26 /bin/sh -c pip3 install --no-cache-dir --extra-index-url https://pypi.nvidia.com tensorrt_llm*.whl &&     rm -f tensorrt_llm*.whl # buildkit
                        
# 2024-12-04 03:55:59  1.95GB 复制新文件或目录到容器中
COPY /workspace/tensorrt_llm/build/tensorrt_llm*whl . # buildkit
                        
# 2024-12-04 03:22:31  0.00B 设置工作目录为/tmp
WORKDIR /tmp
                        
# 2024-12-04 03:22:31  0.00B 设置环境变量 TRT_ROOT
ENV TRT_ROOT=/usr/local/tensorrt
                        
# 2024-12-04 03:22:31  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2024-12-04 03:22:31  0.00B 设置环境变量 TRT_VERSION
ENV TRT_VERSION=10.6.0.26
                        
# 2024-12-04 03:22:31  0.00B 定义构建参数
ARG TRT_VER=10.6.0.26
                        
# 2024-12-04 03:22:31  5.05MB 执行命令并创建新的镜像层
RUN |1 NVRTC_VER=12.6.77-1 /bin/sh -c pip3 install /usr/local/tensorrt/python/tensorrt-*-cp$( python3 -c "import sys; print(str(sys.version_info.major) + str(sys.version_info.minor))" )* # buildkit
                        
# 2024-12-04 03:22:31  1.96GB 复制新文件或目录到容器中
COPY /usr/local/tensorrt /usr/local/tensorrt # buildkit
                        
# 2024-12-04 03:21:04  98.12MB 执行命令并创建新的镜像层
RUN |1 NVRTC_VER=12.6.77-1 /bin/sh -c [ "$(uname -m)" != "x86_64" ] && arch="sbsa" || arch="x86_64" &&     curl -o /tmp/cuda-keyring.deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/$arch/cuda-keyring_1.0-1_all.deb &&     apt install /tmp/cuda-keyring.deb &&     rm /tmp/cuda-keyring.deb &&     apt-get remove --purge -y --allow-change-held-packages cuda-nvrtc-dev* &&     CUDA_VER_SHORT=${CUDA_VER: 0:4} &&     NVRTC_CUDA_VERSION=${CUDA_VER_SHORT/./-} &&     apt-get update -qq &&     apt-get install -y --no-install-recommends cuda-nvrtc-dev-${NVRTC_CUDA_VERSION}=${NVRTC_VER} &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 03:20:56  95.69MB 执行命令并创建新的镜像层
RUN |1 NVRTC_VER=12.6.77-1 /bin/sh -c apt-get update -q=2 &&     apt-get install -y --no-install-recommends         python3-dev         python3-pip         git-lfs &&     apt-get remove -y tensorrt* libnvinfer* &&     rm -rf /var/lib/apt/lists/* &&     pip3 uninstall -y tensorrt &&     pip3 install --no-cache-dir polygraphy==0.49.9 mpi4py==3.1.5 # buildkit
                        
# 2024-12-04 03:20:56  0.00B 设置环境变量 CUDA_VER NVRTC_VER
ENV CUDA_VER=12.6.2.004 NVRTC_VER=12.6.77-1
                        
# 2024-12-04 03:20:56  0.00B 定义构建参数
ARG NVRTC_VER=12.6.77-1
                        
# 2024-12-04 03:20:12  420.20MB 复制新文件或目录到容器中
COPY /usr/local/cuda/lib64/libcusparseLt* /usr/local/cuda/lib64/ # buildkit
                        
# 2024-12-04 03:20:12  53.78KB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/setuptools-70.3.0.dist-info /usr/local/lib/python3.10/dist-packages/setuptools-70.3.0.dist-info # buildkit
                        
# 2024-12-04 03:20:12  4.23MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/setuptools /usr/local/lib/python3.10/dist-packages/setuptools # buildkit
                        
# 2024-12-04 03:20:12  48.38KB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torchvision-0.20.0a0.dist-info /usr/local/lib/python3.10/dist-packages/torchvision-0.20.0a0.dist-info # buildkit
                        
# 2024-12-04 03:20:12  15.12MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torchvision /usr/local/lib/python3.10/dist-packages/torchvision # buildkit
                        
# 2024-12-04 03:20:11  2.84MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torchgen /usr/local/lib/python3.10/dist-packages/torchgen # buildkit
                        
# 2024-12-04 03:20:11  1.85MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torch-2.5.0a0+e000cf0ad9.nv24.10.dist-info /usr/local/lib/python3.10/dist-packages/torch-2.5.0a0+e000cf0ad9.nv24.10.dist-info # buildkit
                        
# 2024-12-04 03:20:11  1.88GB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torch /usr/local/lib/python3.10/dist-packages/torch # buildkit
                        
# 2024-12-04 03:20:09  1.80GB 复制新文件或目录到容器中
COPY /usr/local/lib/lib* /usr/local/lib/ # buildkit
                        
# 2024-10-04 02:32:38  0.00B 添加元数据标签
LABEL com.nvidia.build.ref=bb0f0608792391d35d9686e6d86a7cb319bddadc
                        
# 2024-10-04 02:32:38  0.00B 添加元数据标签
LABEL com.nvidia.build.id=114391310
                        
# 2024-10-04 02:32:38  0.00B 设置环境变量 NVIDIA_BUILD_ID
ENV NVIDIA_BUILD_ID=114391310
                        
# 2024-10-04 02:32:38  0.00B 定义构建参数
ARG NVIDIA_BUILD_ID=114391310
                        
# 2024-10-04 02:32:38  0.00B 定义构建参数
ARG NVIDIA_BUILD_REF=bb0f0608792391d35d9686e6d86a7cb319bddadc
                        
# 2024-10-04 02:32:38  0.00B 设置环境变量 LIBRARY_PATH
ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
                        
# 2024-10-04 02:32:38  1.01GB 执行命令并创建新的镜像层
RUN |7 GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 RDMACORE_VERSION=39.0 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 TARGETARCH=amd64 /bin/sh -c export DEVEL=1 BASE=0  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUDA.sh  && /nvidia/build-scripts/installLIBS.sh  && if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installCUTENSOR.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installCUSPARSELT.sh  && if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi  && rm -f /tmp/cuda-*.patch # buildkit
                        
# 2024-10-04 02:26:58  1.49KB 复制新文件或目录到容器中
COPY cuda-*.patch /tmp # buildkit
                        
# 2024-10-04 02:26:58  0.00B 设置环境变量 OMPI_MCA_coll_hcoll_enable
ENV OMPI_MCA_coll_hcoll_enable=0
                        
# 2024-10-04 02:26:58  0.00B 设置环境变量 OPAL_PREFIX PATH
ENV OPAL_PREFIX=/opt/hpcx/ompi PATH=/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin
                        
# 2024-10-04 02:26:58  229.68MB 执行命令并创建新的镜像层
RUN |7 GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 RDMACORE_VERSION=39.0 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 TARGETARCH=amd64 /bin/sh -c cd /nvidia  && ( export DEBIAN_FRONTEND=noninteractive        && apt-get update                            && apt-get install -y --no-install-recommends              libibverbs1                                  libibverbs-dev                               librdmacm1                                   librdmacm-dev                                libibumad3                                   libibumad-dev                                ibverbs-utils                                ibverbs-providers                     && rm -rf /var/lib/apt/lists/*               && rm $(dpkg-query -L                                    libibverbs-dev                               librdmacm-dev                                libibumad-dev                            | grep "\(\.so\|\.a\)$")          )                                            && ( cd opt/gdrcopy/                              && dpkg -i libgdrapi_*.deb                   )                                         && ( cp -r opt/hpcx /opt/                                         && cp etc/ld.so.conf.d/hpcx.conf /etc/ld.so.conf.d/          && ln -sf /opt/hpcx/ompi /usr/local/mpi                      && ln -sf /opt/hpcx/ucx  /usr/local/ucx                      && sed -i 's/^\(hwloc_base_binding_policy\) = core$/\1 = none/' /opt/hpcx/ompi/etc/openmpi-mca-params.conf         && sed -i 's/^\(btl = self\)$/#\1/'                             /opt/hpcx/ompi/etc/openmpi-mca-params.conf       )                                                         && ldconfig # buildkit
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2024-10-04 02:26:58  0.00B 设置环境变量 GDRCOPY_VERSION HPCX_VERSION MOFED_VERSION OPENUCX_VERSION OPENMPI_VERSION RDMACORE_VERSION
ENV GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=39.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG OPENMPI_VERSION=4.1.7
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG OPENUCX_VERSION=1.17.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG MOFED_VERSION=5.4-rdmacore39.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG RDMACORE_VERSION=39.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG HPCX_VERSION=2.20
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG GDRCOPY_VERSION=2.3.1-1
                        
# 2024-10-04 02:26:51  84.91MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         build-essential         git         libglib2.0-0         less         libnl-route-3-200         libnl-3-dev         libnl-route-3-dev         libnuma-dev         libnuma1         libpmi2-0-dev         nano         numactl         openssh-client         vim         wget  && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-10-04 02:11:59  148.72KB 复制新文件或目录到容器中
COPY NVIDIA_Deep_Learning_Container_License.pdf /workspace/ # buildkit
                        
# 2024-10-04 02:11:59  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2024-10-04 02:11:59  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2024-10-04 02:11:59  14.85KB 复制新文件或目录到容器中
COPY entrypoint/ /opt/nvidia/ # buildkit
                        
# 2024-10-04 02:11:59  0.00B 设置环境变量 PATH LD_LIBRARY_PATH NVIDIA_VISIBLE_DEVICES NVIDIA_DRIVER_CAPABILITIES
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG _LIBPATH_SUFFIX=
                        
# 2024-10-04 02:11:59  46.00B 执行命令并创建新的镜像层
RUN |24 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.5.0.18 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3 CUSPARSELT_VERSION=0.6.2.3 DALI_VERSION=1.42.0 DALI_BUILD=18507157 POLYGRAPHY_VERSION=0.49.13 TRANSFORMER_ENGINE_VERSION=1.11 MODEL_OPT_VERSION=0.17.0 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf  && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2024-10-04 02:11:59  13.39KB 复制文件或目录到容器中
ADD docs.tgz / # buildkit
                        
# 2024-10-04 02:11:59  0.00B 设置环境变量 DALI_VERSION DALI_BUILD POLYGRAPHY_VERSION TRANSFORMER_ENGINE_VERSION MODEL_OPT_VERSION
ENV DALI_VERSION=1.42.0 DALI_BUILD=18507157 POLYGRAPHY_VERSION=0.49.13 TRANSFORMER_ENGINE_VERSION=1.11 MODEL_OPT_VERSION=0.17.0
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG MODEL_OPT_VERSION=0.17.0
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG TRANSFORMER_ENGINE_VERSION=1.11
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG POLYGRAPHY_VERSION=0.49.13
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG DALI_BUILD=18507157
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG DALI_VERSION=1.42.0
                        
# 2024-10-04 02:11:59  0.00B 添加元数据标签
LABEL com.nvidia.nccl.version=2.22.3 com.nvidia.cublas.version=12.6.3.3 com.nvidia.cufft.version=11.3.0.4 com.nvidia.curand.version=10.3.7.77 com.nvidia.cusparse.version=12.5.4.2 com.nvidia.cusparselt.version=0.6.2.3 com.nvidia.cusolver.version=11.7.1.2 com.nvidia.cutensor.version=2.0.2.5 com.nvidia.npp.version=12.3.1.54 com.nvidia.nvjpeg.version=12.3.3.54 com.nvidia.cudnn.version=9.5.0.50 com.nvidia.tensorrt.version=10.5.0.18 com.nvidia.tensorrtoss.version= com.nvidia.nsightsystems.version=2024.6.1.90 com.nvidia.nsightcompute.version=2024.3.2.3
                        
# 2024-10-04 02:11:59  6.56GB 执行命令并创建新的镜像层
RUN |19 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.5.0.18 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3 CUSPARSELT_VERSION=0.6.2.3 /bin/sh -c /nvidia/build-scripts/installLIBS.sh  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUTENSOR.sh  && /nvidia/build-scripts/installCUSPARSELT.sh  && if [ -z "${JETPACK_HOST_MOUNTS}" ]; then       /nvidia/build-scripts/installNCCL.sh;     fi; # buildkit
                        
# 2024-09-26 06:18:30  0.00B 设置环境变量 NCCL_VERSION CUBLAS_VERSION CUFFT_VERSION CURAND_VERSION CUSPARSE_VERSION CUSPARSELT_VERSION CUSOLVER_VERSION CUTENSOR_VERSION NPP_VERSION NVJPEG_VERSION CUDNN_VERSION CUDNN_FRONTEND_VERSION TRT_VERSION TRTOSS_VERSION NSIGHT_SYSTEMS_VERSION NSIGHT_COMPUTE_VERSION
ENV NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSPARSELT_VERSION=0.6.2.3 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.5.0.18 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUSPARSELT_VERSION=0.6.2.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NSIGHT_COMPUTE_VERSION=2024.3.2.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NSIGHT_SYSTEMS_VERSION=2024.6.1.90
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG TRTOSS_VERSION=
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG TRT_VERSION=10.5.0.18
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUDNN_FRONTEND_VERSION=1.7.0
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUDNN_VERSION=9.5.0.50
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NVJPEG_VERSION=12.3.3.54
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NPP_VERSION=12.3.1.54
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUTENSOR_VERSION=2.0.2.5
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUSOLVER_VERSION=11.7.1.2
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUSPARSE_VERSION=12.5.4.2
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CURAND_VERSION=10.3.7.77
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUFFT_VERSION=11.3.0.4
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUBLAS_VERSION=12.6.3.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NCCL_VERSION=2.22.3
                        
# 2024-09-26 06:18:30  0.00B 添加元数据标签
LABEL com.nvidia.volumes.needed=nvidia_driver com.nvidia.cuda.version=9.0
                        
# 2024-09-26 06:18:30  0.00B 设置环境变量 _CUDA_COMPAT_PATH ENV BASH_ENV SHELL NVIDIA_REQUIRE_CUDA
ENV _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0
                        
# 2024-09-26 06:18:30  58.91KB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= /bin/sh -c cp -vprd /nvidia/. /  &&  patch -p0 < /etc/startup_scripts.patch  &&  rm -f /etc/startup_scripts.patch # buildkit
                        
# 2024-09-26 06:18:30  459.94MB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= /bin/sh -c /nvidia/build-scripts/installCUDA.sh # buildkit
                        
# 2024-09-25 05:11:43  0.00B 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= /bin/sh -c if [ -n "${JETPACK_HOST_MOUNTS}" ]; then        echo "/usr/lib/aarch64-linux-gnu/tegra" > /etc/ld.so.conf.d/nvidia-tegra.conf     && echo "/usr/lib/aarch64-linux-gnu/tegra-egl" >> /etc/ld.so.conf.d/nvidia-tegra.conf;     fi # buildkit
                        
# 2024-09-25 05:11:43  0.00B 设置环境变量 CUDA_VERSION CUDA_DRIVER_VERSION CUDA_CACHE_DISABLE NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS
ENV CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 CUDA_CACHE_DISABLE=1 NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=
                        
# 2024-09-25 05:11:43  0.00B 定义构建参数
ARG JETPACK_HOST_MOUNTS=
                        
# 2024-09-25 05:11:43  0.00B 定义构建参数
ARG CUDA_DRIVER_VERSION=560.35.03
                        
# 2024-09-25 05:11:43  0.00B 定义构建参数
ARG CUDA_VERSION=12.6.2.004
                        
# 2024-09-25 00:13:10  269.69MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         apt-utils         build-essential         ca-certificates         curl         libncurses5         libncursesw5         patch         wget         rsync         unzip         jq         gnupg         libtcmalloc-minimal4  && rm -rf /var/lib/apt/lists/*  && echo "hsts=0" > /root/.wgetrc # buildkit
                        
# 2024-09-12 00:25:18  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2024-09-12 00:25:17  77.86MB 
/bin/sh -c #(nop) ADD file:ebe009f86035c175ba244badd298a2582914415cf62783d510eab3a311a5d4e1 in / 
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  ARG RELEASE

镜像信息

{
    "Id": "sha256:5a443800c90a0ce65b94614dd79ac18af4e493e1545c93bf5dbaba26b7690934",
    "RepoTags": [
        "nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3"
    ],
    "RepoDigests": [
        "nvcr.io/nvidia/tritonserver@sha256:72e0ea615e73dfc5c28c38bd52026aec3e7640ecc8c0cbb78c4bde830ecb2fe8",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver@sha256:bfe063c35042377a4415d9f5ff4133c0b81ae9702d347d59c7880fe324ca3d26"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2024-12-03T21:12:23.108068759Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin",
            "CUDA_VERSION=12.6.2.004",
            "CUDA_DRIVER_VERSION=560.35.03",
            "CUDA_CACHE_DISABLE=1",
            "NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=",
            "_CUDA_COMPAT_PATH=/usr/local/cuda/compat",
            "ENV=/etc/shinit_v2",
            "BASH_ENV=/etc/bash.bashrc",
            "SHELL=/bin/bash",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=9.0",
            "NCCL_VERSION=2.22.3",
            "CUBLAS_VERSION=12.6.3.3",
            "CUFFT_VERSION=11.3.0.4",
            "CURAND_VERSION=10.3.7.77",
            "CUSPARSE_VERSION=12.5.4.2",
            "CUSPARSELT_VERSION=0.6.2.3",
            "CUSOLVER_VERSION=11.7.1.2",
            "CUTENSOR_VERSION=2.0.2.5",
            "NPP_VERSION=12.3.1.54",
            "NVJPEG_VERSION=12.3.3.54",
            "CUDNN_VERSION=9.5.0.50",
            "CUDNN_FRONTEND_VERSION=1.7.0",
            "TRT_VERSION=10.6.0.26",
            "TRTOSS_VERSION=",
            "NSIGHT_SYSTEMS_VERSION=2024.6.1.90",
            "NSIGHT_COMPUTE_VERSION=2024.3.2.3",
            "DALI_VERSION=1.42.0",
            "DALI_BUILD=18507157",
            "POLYGRAPHY_VERSION=0.49.13",
            "TRANSFORMER_ENGINE_VERSION=1.11",
            "MODEL_OPT_VERSION=0.17.0",
            "LD_LIBRARY_PATH=/usr/local/tensorrt/lib/:/opt/tritonserver/backends/tensorrtllm:/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility,video",
            "NVIDIA_PRODUCT_NAME=Triton Server",
            "GDRCOPY_VERSION=2.3.1-1",
            "HPCX_VERSION=2.20",
            "MOFED_VERSION=5.4-rdmacore39.0",
            "OPENUCX_VERSION=1.17.0",
            "OPENMPI_VERSION=4.1.7",
            "RDMACORE_VERSION=39.0",
            "OPAL_PREFIX=/opt/hpcx/ompi",
            "OMPI_MCA_coll_hcoll_enable=0",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs:",
            "NVIDIA_BUILD_ID=126058417",
            "CUDA_VER=12.6.2.004",
            "NVRTC_VER=12.6.77-1",
            "TRT_ROOT=/usr/local/tensorrt",
            "TRITON_SERVER_VERSION=2.52.0",
            "NVIDIA_TRITON_SERVER_VERSION=24.11",
            "UCX_MEM_EVENTS=no",
            "TF_ADJUST_HUE_FUSED=1",
            "TF_ADJUST_SATURATION_FUSED=1",
            "TF_ENABLE_WINOGRAD_NONFUSED=1",
            "TF_AUTOTUNE_THRESHOLD=2",
            "TRITON_SERVER_GPU_ENABLED=1",
            "TRITON_SERVER_USER=triton-server",
            "DEBIAN_FRONTEND=noninteractive",
            "TCMALLOC_RELEASE_RATE=200",
            "DCGM_VERSION=3.3.6",
            "PIP_BREAK_SYSTEM_PACKAGES=1"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/tritonserver",
        "Entrypoint": [
            "/opt/nvidia/nvidia_entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.amazonaws.sagemaker.capabilities.accept-bind-to-port": "true",
            "com.amazonaws.sagemaker.capabilities.multi-models": "true",
            "com.nvidia.build.id": "126058417",
            "com.nvidia.build.ref": "500dce76552ace5128a42607944640c78ff468d7",
            "com.nvidia.cublas.version": "12.6.3.3",
            "com.nvidia.cuda.version": "9.0",
            "com.nvidia.cudnn.version": "9.5.0.50",
            "com.nvidia.cufft.version": "11.3.0.4",
            "com.nvidia.curand.version": "10.3.7.77",
            "com.nvidia.cusolver.version": "11.7.1.2",
            "com.nvidia.cusparse.version": "12.5.4.2",
            "com.nvidia.cusparselt.version": "0.6.2.3",
            "com.nvidia.cutensor.version": "2.0.2.5",
            "com.nvidia.nccl.version": "2.22.3",
            "com.nvidia.npp.version": "12.3.1.54",
            "com.nvidia.nsightcompute.version": "2024.3.2.3",
            "com.nvidia.nsightsystems.version": "2024.6.1.90",
            "com.nvidia.nvjpeg.version": "12.3.3.54",
            "com.nvidia.tensorrt.version": "10.5.0.18",
            "com.nvidia.tensorrtoss.version": "",
            "com.nvidia.tritonserver.version": "2.52.0",
            "com.nvidia.volumes.needed": "nvidia_driver",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "22.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 24859365390,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/1a97ac7d1a1760a2851360e2ccf419251f54001280421cbaac48e30c23f247d4/diff:/var/lib/docker/overlay2/b3745c2cea06257a9e98faafd82dd4a95ab30ae1fba1f894340406cf382ec5e3/diff:/var/lib/docker/overlay2/653bb197739d61b75c82e07711bfcfdb1d4e291239db2f8462035db1bc33a24f/diff:/var/lib/docker/overlay2/8c5270dcd2d5fa2f40e20bf99c40428f114eae983ea23d2a35ae4170dc860825/diff:/var/lib/docker/overlay2/68161e19c761737e9811e77169a4d06d6712d29917ff33c7142ae20fe55d7548/diff:/var/lib/docker/overlay2/4e837680ca30de0599f36e0509fcb30d18b9c6f60eb686b167d1c89534598d62/diff:/var/lib/docker/overlay2/a1b682557371f9849a801c0ad51552e0023d43beb608940e4736af674f9d8581/diff:/var/lib/docker/overlay2/bbec31fe52549c9ff7dade76b73d05c3f91595ea1c50b48c8b75dfbefadcab0e/diff:/var/lib/docker/overlay2/0a9cec6bc2c59d40f5af86d7d81b669ee17371ee3cd6d27e1915c465085339ea/diff:/var/lib/docker/overlay2/a9b6107d596686a54d79ce8bb4c474aefb3a3b125605195669580534473522af/diff:/var/lib/docker/overlay2/244200719ac84d0c4818ce44fcb022bcbcdab08f6e1e9d011fb0abd64a89c13d/diff:/var/lib/docker/overlay2/4cd949603433c56c4cfb3901321c0e04a0b071994213eeb8885065d57383d8cb/diff:/var/lib/docker/overlay2/3efc4c6e5d58fe8dd81323aecfeff2fc52f08d1b62e98acb06f2c768b386129c/diff:/var/lib/docker/overlay2/1a26e191423908744c888d92f03d9cb540cf74365426016d1dbc4c537cc85ee1/diff:/var/lib/docker/overlay2/464ad980e9a9e8b886c3404bc963798a55f1a0df09324b355478aa6613ffe28b/diff:/var/lib/docker/overlay2/f7b38908ce56335ea49e411f7ceb1a1f6af826eee1b24411ca1e9f87ca91023a/diff:/var/lib/docker/overlay2/4c5b164beeec157bb616e92992bfd7c03d8fb149be2b8fc534abe4e11141331d/diff:/var/lib/docker/overlay2/dd0fff3787d19e3cfb3aba4f8190134f2c0b655e1220e74b2df3b4c5442a1ad1/diff:/var/lib/docker/overlay2/78ccea4c2fa15e8f7fab3b185f97ad44d67a066099039b0f75a53824c4018c0e/diff:/var/lib/docker/overlay2/bfe43e11aca4d436c8ea79c56e9689f411c536153a7d8423ab2475fd9948038b/diff:/var/lib/docker/overlay2/608806265e4c4c42e1b8ed67fa4c4d40fa6004a8ab9d5fe67610a3a02f1893a4/diff:/var/lib/docker/overlay2/556f06ae5afd022739dd75f873d15d556c9ac4aa6ae039e770b1b8043cb47591/diff:/var/lib/docker/overlay2/9f75cff25cdebdf4c4978212950927b79da93c1d64f23c5ae22558d3055b81ef/diff:/var/lib/docker/overlay2/e81255ec2a09bb798d37c127e15289c173da49402ad771080525203480ee2959/diff:/var/lib/docker/overlay2/412a0616bdca3c99f6e1dba4a782d8161e817be920127a06c9ace5e705ccc419/diff:/var/lib/docker/overlay2/0ca84e844eed794083857723049fe402ccfc01d817040211637e7c5e28250955/diff:/var/lib/docker/overlay2/cbb85e21a11f200db6d022946b8a34e31827b2e508109c886294699721403e29/diff:/var/lib/docker/overlay2/5b97378a9b38b99439d1169212a8934ced191462b3ebbe6f9cc1e12bd234c254/diff:/var/lib/docker/overlay2/38d72d085b21bf4743a10992058b37344b178068f5290d473b6dfa04b311e37b/diff:/var/lib/docker/overlay2/623e3fbc77cdca31b44829e9b187bcd8886b1644ff14be37e64da9d50bcefccf/diff:/var/lib/docker/overlay2/3b01a69e843d89a25ff1b94a51cfced713df722f2229c0a1c06eca6b89f7116b/diff:/var/lib/docker/overlay2/2b925f046edbb41ecca58f695f736a2470c774365e14ccace94cd122f3d19fb7/diff:/var/lib/docker/overlay2/b8b7eebd1640b8f4e3e145338e82dcc67e3dc643292b28721de25a4da59acf46/diff:/var/lib/docker/overlay2/bd6b99bee46eff3e457ec5b391d3c6eb9cb79ce2f950ca43492233ca8a88fbd4/diff:/var/lib/docker/overlay2/e2218e776727d2feb5de0632026821d90d0f4bb9d6e67d7f11074a3dceef27f4/diff:/var/lib/docker/overlay2/cb050aa0c66750f727494d5478883e321f725879fcc25e1f97e004b1f04015c7/diff:/var/lib/docker/overlay2/c54bc937648acb4b10b9264e97345f273d8c250272a496a4b1ddd08be2e37b1d/diff:/var/lib/docker/overlay2/c1082305f633ea28fefacf25f954fca7c301a09cc66255787979bc86ef673694/diff:/var/lib/docker/overlay2/7dc5ccee0429e485debe0f3235a089b82f4b4880cbc39f0d71c084676961ae39/diff:/var/lib/docker/overlay2/4d1dd7103abb2f7baac3f8952425a4ebfda4672d57f74258a57fa217f99b8e56/diff:/var/lib/docker/overlay2/373e354ccfdd831d22e71790305500f073c12a490362fc9be0d9eea8cb027973/diff:/var/lib/docker/overlay2/e6bbc07f555c5433dabb869e73dc970cfe981ff2df301d7f4a77b8cefe0b7f12/diff:/var/lib/docker/overlay2/7b8739888706e717dca7b980e8825d202d0a3918b18a3c442adc73dd52cb65b0/diff:/var/lib/docker/overlay2/f32b9256e317d9d955c7539fb1be71441200a5d3e5c25a19355158bef5d708a8/diff:/var/lib/docker/overlay2/ce01b5a9b06d3f6862cd60c66422cbb318ad94d6154ae3c6b608f32f6196d4e1/diff:/var/lib/docker/overlay2/6534f959d87b749e2e44263f1f7544f918598eb066dd66f156bd45b5888144da/diff:/var/lib/docker/overlay2/4cfb2ff6eb670d08d805fcc326973c76acabc424b2f6ce5f1903149f34750452/diff",
            "MergedDir": "/var/lib/docker/overlay2/217aca253113a3ccaea1f73c6a4dbe399f0a121fa2b9a7622ffaeeace5057d0c/merged",
            "UpperDir": "/var/lib/docker/overlay2/217aca253113a3ccaea1f73c6a4dbe399f0a121fa2b9a7622ffaeeace5057d0c/diff",
            "WorkDir": "/var/lib/docker/overlay2/217aca253113a3ccaea1f73c6a4dbe399f0a121fa2b9a7622ffaeeace5057d0c/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:2573e0d8158209ed54ab25c87bcdcb00bd3d2539246960a3d592a1c599d70465",
            "sha256:0db37749123ed077f490b8481792ba660fc7b82b2035d2f37f540691c102e5b4",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:f805df76568cf3834df5ae477cf7fd99d22b345ab31103d96a3f138af2b6c8ec",
            "sha256:176c746bdb5ad24a387e0d855c44bd57391d7c33a2bad8e19d4aced54bea5a00",
            "sha256:8bac727098a300370c2116a8e848abea54cb4c1d5d9f3851c9467961e90748b5",
            "sha256:f5f79ac10bb874bdbe60f05aefdf89d24c8f07b24910dbd787b9ee4cfd390565",
            "sha256:caf07e7743c0eb80a8a7ac78b631cd93b73f96e2d1a1dabe4d9ae7a9b922d24b",
            "sha256:6c75d6484379aa51f50d3e6a3c1f0b7acc2364aed0b9fe643224ce3134c970f3",
            "sha256:0b6a520db613be9ef2d808547aefba361788a92f82ccaa532fa3b2895f94debc",
            "sha256:c567e58addb329a64228dad6849f96a0a7e353f59a3edb8cc11d3db0afd1fd62",
            "sha256:0c928a220a5504afdc5d09a152d728398d7e981acbc592a7a9e5f8f16f8439b5",
            "sha256:b05947e518f595236486c35a836848c01ccd7c06539a481d2084667e8288ddf4",
            "sha256:0d5982fa150d5361485513c3ff3fc8f61acd8bdb05a6b97105aa4c2dc949d7ab",
            "sha256:127242384cfc651d923908aec08b7770ee293110e528c4063231db25d7854728",
            "sha256:82402768558e58976570aee0332423fa9a7d9daab85199205ccf4427d2a428c5",
            "sha256:d926e3bdd7d50f8196d7959c5947ed092e617e13985790baf23cba409cfea793",
            "sha256:23d5f713b80726939b4319b9e992b12ec31ec3d9fd0feef45499edd4dcedf297",
            "sha256:03afc8e195eb51a9a0b389746c0e48be76b4e90a4777a9245fa0f751e65f7184",
            "sha256:fb029fa6b83d7035f20c324dd387f58c4a10048db1b88a21598e3a6cda04b659",
            "sha256:79537914ecbe57d237079548801ed40fd0747bd39a0d5921dcbed39f70b72341",
            "sha256:c14fe077213219755e0a0eef5e36739ff74b390f2091d7d38d3b13e464cef383",
            "sha256:d61e6f026e188fa1f5fa8e4d6e58c7e43e5dc77e9c6594aa46739ab29374ab61",
            "sha256:1a5610d34e8c387f6b7ab2efa6621a2a0b9354629104c703d922bc956766073b",
            "sha256:f362ce7814b17d3a0af594908d2b1232ed0cc5d0523058f0c016ac6300219ae9",
            "sha256:68192b98470e90e7b280fbd78a24776b5cf4243c5cd35bb8101b30fdc0b94698",
            "sha256:334354e12446e0b6d3059886bd85a05891239c509a6c3581aba19285e016a175",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:81bb9ebe9eaceb5aebd5e6e3504f85fc8839e04c3e94466110b0b448aa922461",
            "sha256:6cb088177c250de10d0a33b14f2d85528656f29f2ee7ee81e4458b9df2aed520",
            "sha256:6b545781a84c750d5625584330c27573c0380e39c5e821af9852e771139d36ee",
            "sha256:2c2328ddaff542af96dc4da41e513a0431473ab74eeffa9366c2388d83398206",
            "sha256:e6f28c807875b9e1a1104255cd4a90a435847e0bfec23401e5aec2f4888ecb65",
            "sha256:554c4e30baa437638d79e31943631eba568e25fbb7c4a58b46c11aa4c824d672",
            "sha256:9401e8d6ca1dcf44c7bfc954108c9257d2d33ac0916976de9947a86152797c13",
            "sha256:d8b6f3d2355e838b6ad40cc33d6d5cb201616769f4b3684ff83467c467b39905",
            "sha256:353ac3bbf6545a7d928e539f8b8976a7779e98433cdcaa4df652d4f179111793",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:67020eb36249f10b7c366d2bc12f15f30a95411b4e0548fbbcdf3e7bf0760346",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:028be19812faf6dd64644e741e7eac042803b54b353f12acb71e7b673b7d04b8",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:32ae04d41456801611fb3a2661997aa965f9a7525f6460e8096f9f2ebdfd4168",
            "sha256:0fe8e917c14f925a20a3a438b0836cbac5d1f74ef341c749b55377d1c1d71ffe",
            "sha256:08bb5e1c887cd74509eae9f20012c388b7cb7e9c925e4b9bc02f5be8eb0ad7c6",
            "sha256:446273ffd45830fffd1152938c63c37243b7735dbe638fc0ad343fca105b5f70",
            "sha256:1c8459d8f750a9c659db22f22062ed09fb06a61a8d3f458cb0577c1cf85ea976",
            "sha256:438a7f2b2e8c7ff2a955e2ef6408abe00b9ca1816bd6148a98090527e47b52b6"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-02-26T01:53:26.512790286+08:00"
    }
}

更多版本

docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

linux/amd64 docker.io24.86GB2025-02-26 02:25

docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 linux/amd64

镜像安全扫描 查看Trivy扫描报告

镜像安全扫描查看Trivy扫描报告