logo
docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
linux/amd64 docker.io

这是一个 NVIDIA Triton Inference Server 的 Docker 镜像。Triton Inference Server 是一个高性能的推理服务器，用于部署各种深度学习模型，支持多种框架（例如 TensorFlow, PyTorch, TensorRT 等），并提供模型版本管理、模型部署、以及高效的推理服务。

1560
浏览次数
24.86GB
镜像大小
源镜像
docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
国内镜像
swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
镜像ID
sha256:5a443800c90a0ce65b94614dd79ac18af4e493e1545c93bf5dbaba26b7690934
镜像 TAG
24.11-trtllm-python-py3
镜像大小
24.86GB
平台架构
linux/amd64
镜像源
docker.io
项目信息
Hub 主页 所有 TAG
CMD
启动入口
/opt/nvidia/nvidia_entrypoint.sh
工作目录
/opt/tritonserver
OS/平台
linux/amd64
镜像创建
2024-12-03T21:12:23.108068759Z
同步时间
2025-02-26 02:25
浏览量
1560 次
贡献者
⚙️ 环境变量 61
KeyValue
PATH=/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin 0
CUDA_VERSION=12.6.2.004 1
CUDA_DRIVER_VERSION=560.35.03 2
CUDA_CACHE_DISABLE=1 3
NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS= 4
_CUDA_COMPAT_PATH=/usr/local/cuda/compat 5
ENV=/etc/shinit_v2 6
BASH_ENV=/etc/bash.bashrc 7
SHELL=/bin/bash 8
NVIDIA_REQUIRE_CUDA=cuda>=9.0 9
NCCL_VERSION=2.22.3 10
CUBLAS_VERSION=12.6.3.3 11
CUFFT_VERSION=11.3.0.4 12
CURAND_VERSION=10.3.7.77 13
CUSPARSE_VERSION=12.5.4.2 14
CUSPARSELT_VERSION=0.6.2.3 15
CUSOLVER_VERSION=11.7.1.2 16
CUTENSOR_VERSION=2.0.2.5 17
NPP_VERSION=12.3.1.54 18
NVJPEG_VERSION=12.3.3.54 19
CUDNN_VERSION=9.5.0.50 20
CUDNN_FRONTEND_VERSION=1.7.0 21
TRT_VERSION=10.6.0.26 22
TRTOSS_VERSION= 23
NSIGHT_SYSTEMS_VERSION=2024.6.1.90 24
NSIGHT_COMPUTE_VERSION=2024.3.2.3 25
DALI_VERSION=1.42.0 26
DALI_BUILD=18507157 27
POLYGRAPHY_VERSION=0.49.13 28
TRANSFORMER_ENGINE_VERSION=1.11 29
MODEL_OPT_VERSION=0.17.0 30
LD_LIBRARY_PATH=/usr/local/tensorrt/lib/:/opt/tritonserver/backends/tensorrtllm:/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 31
NVIDIA_VISIBLE_DEVICES=all 32
NVIDIA_DRIVER_CAPABILITIES=compute,utility,video 33
NVIDIA_PRODUCT_NAME=Triton Server 34
GDRCOPY_VERSION=2.3.1-1 35
HPCX_VERSION=2.20 36
MOFED_VERSION=5.4-rdmacore39.0 37
OPENUCX_VERSION=1.17.0 38
OPENMPI_VERSION=4.1.7 39
RDMACORE_VERSION=39.0 40
OPAL_PREFIX=/opt/hpcx/ompi 41
OMPI_MCA_coll_hcoll_enable=0 42
LIBRARY_PATH=/usr/local/cuda/lib64/stubs: 43
NVIDIA_BUILD_ID=126058417 44
CUDA_VER=12.6.2.004 45
NVRTC_VER=12.6.77-1 46
TRT_ROOT=/usr/local/tensorrt 47
TRITON_SERVER_VERSION=2.52.0 48
NVIDIA_TRITON_SERVER_VERSION=24.11 49
UCX_MEM_EVENTS=no 50
TF_ADJUST_HUE_FUSED=1 51
TF_ADJUST_SATURATION_FUSED=1 52
TF_ENABLE_WINOGRAD_NONFUSED=1 53
TF_AUTOTUNE_THRESHOLD=2 54
TRITON_SERVER_GPU_ENABLED=1 55
TRITON_SERVER_USER=triton-server 56
DEBIAN_FRONTEND=noninteractive 57
TCMALLOC_RELEASE_RATE=200 58
DCGM_VERSION=3.3.6 59
PIP_BREAK_SYSTEM_PACKAGES=1 60
🏷️ 镜像标签 24
KeyValue
true com.amazonaws.sagemaker.capabilities.accept-bind-to-port
true com.amazonaws.sagemaker.capabilities.multi-models
126058417 com.nvidia.build.id
500dce76552ace5128a42607944640c78ff468d7 com.nvidia.build.ref
12.6.3.3 com.nvidia.cublas.version
9.0 com.nvidia.cuda.version
9.5.0.50 com.nvidia.cudnn.version
11.3.0.4 com.nvidia.cufft.version
10.3.7.77 com.nvidia.curand.version
11.7.1.2 com.nvidia.cusolver.version
12.5.4.2 com.nvidia.cusparse.version
0.6.2.3 com.nvidia.cusparselt.version
2.0.2.5 com.nvidia.cutensor.version
2.22.3 com.nvidia.nccl.version
12.3.1.54 com.nvidia.npp.version
2024.3.2.3 com.nvidia.nsightcompute.version
2024.6.1.90 com.nvidia.nsightsystems.version
12.3.3.54 com.nvidia.nvjpeg.version
10.5.0.18 com.nvidia.tensorrt.version
com.nvidia.tensorrtoss.version
2.52.0 com.nvidia.tritonserver.version
nvidia_driver com.nvidia.volumes.needed
ubuntu org.opencontainers.image.ref.name
22.04 org.opencontainers.image.version
🛡️ 镜像安全扫描
ubuntu 22.04 Trivy 2025-02-26 02:34 查看完整报告
171
低危 LOW
1138
中危 MEDIUM
15
高危 HIGH
1
严重 CRITICAL
受影响目标 (3)
docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 (ubuntu 22.04) ubuntu Python python-pkg usr/local/cuda-12.6/NsightSystems-cli-2024.6.1/target-linux-x64/plugins/efa_metrics/nic_sampler gobinary
无权限下载？点我修复 生成 Docker Run 命令 生成 Kubernetes YAML

Docker拉取命令 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

Shell快速替换命令 

sed -i 's#nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3  docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3'

镜像构建历史 


# 2024-12-04 05:12:23  75.93MB 复制新文件或目录到容器中
COPY /opt/hpcx/ompi /opt/hpcx/ompi # buildkit
                        
# 2024-12-04 05:12:17  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c rm -fr /opt/hpcx/ompi # buildkit
                        
# 2024-12-04 05:12:17  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/tensorrt/lib/:/opt/tritonserver/backends/tensorrtllm:/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2024-12-04 05:12:17  22.11MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c ldconfig &&     ARCH="$(uname -i)" &&     rm -fr ${TRT_ROOT}/bin ${TRT_ROOT}/targets/${ARCH}-linux-gnu/bin ${TRT_ROOT}/data &&     rm -fr ${TRT_ROOT}/doc ${TRT_ROOT}/onnx_graphsurgeon ${TRT_ROOT}/python &&     rm -fr ${TRT_ROOT}/samples ${TRT_ROOT}/targets/${ARCH}-linux-gnu/samples &&     pip3 install --no-cache-dir transformers &&     find /usr -name libtensorrt_llm.so -exec dirname {} \; > /etc/ld.so.conf.d/tensorrt-llm.conf &&     find /opt/tritonserver -name libtritonserver.so -exec dirname {} \; > /etc/ld.so.conf.d/triton-tensorrtllm-worker.conf &&     pip3 install --no-cache-dir  grpcio-tools==1.64.0 &&     pip3 uninstall -y setuptools # buildkit
                        
# 2024-12-04 05:12:07  8.37KB 复制新文件或目录到容器中
COPY docker/sagemaker/serve /usr/bin/. # buildkit
                        
# 2024-12-04 05:12:07  0.00B 添加元数据标签
LABEL com.amazonaws.sagemaker.capabilities.multi-models=true
                        
# 2024-12-04 05:12:07  0.00B 添加元数据标签
LABEL com.amazonaws.sagemaker.capabilities.accept-bind-to-port=true
                        
# 2024-12-04 05:12:07  310.79MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c find /opt/tritonserver/python -maxdepth 1 -type f -name     "tritonserver-*.whl" | xargs -I {} pip install --upgrade {}[all] &&     find /opt/tritonserver/python -maxdepth 1 -type f -name     "tritonfrontend-*.whl" | xargs -I {} pip install --upgrade {}[all] # buildkit
                        
# 2024-12-04 05:11:59  3.01MB 复制新文件或目录到容器中
COPY NVIDIA_Deep_Learning_Container_License.pdf . # buildkit
                        
# 2024-12-04 05:11:59  0.00B 设置工作目录为/opt/tritonserver
WORKDIR /opt/tritonserver
                        
# 2024-12-04 05:11:59  542.40MB 复制新文件或目录到容器中
COPY build/install tritonserver # buildkit
                        
# 2024-12-04 05:11:59  0.00B 设置工作目录为/opt
WORKDIR /opt
                        
# 2024-12-04 05:11:59  0.00B 添加元数据标签
LABEL com.nvidia.build.ref=500dce76552ace5128a42607944640c78ff468d7
                        
# 2024-12-04 05:11:59  0.00B 添加元数据标签
LABEL com.nvidia.build.id=126058417
                        
# 2024-12-04 05:11:59  0.00B 设置环境变量 NVIDIA_BUILD_ID
ENV NVIDIA_BUILD_ID=126058417
                        
# 2024-12-04 05:11:59  733.00B 复制新文件或目录到容器中
COPY docker/entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2024-12-04 05:11:59  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=Triton Server
                        
# 2024-12-04 05:11:59  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c rm -fr /opt/tritonserver/* # buildkit
                        
# 2024-12-04 05:11:58  0.00B 设置工作目录为/opt/tritonserver
WORKDIR /opt/tritonserver
                        
# 2024-12-04 05:11:58  0.00B 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c apt-get update     && apt-get install -y --no-install-recommends         openssh-client     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 05:11:53  16.28MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c apt-get update       && apt-get install -y --no-install-recommends             python3             libarchive-dev             python3-pip             python3-wheel             python3-setuptools             libpython3-dev       && pip3 install --upgrade             "numpy<2"             virtualenv       && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 05:11:44  0.00B 设置环境变量 PIP_BREAK_SYSTEM_PACKAGES
ENV PIP_BREAK_SYSTEM_PACKAGES=1
                        
# 2024-12-04 05:11:44  62.49KB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c ln -sf ${_CUDA_COMPAT_PATH}/lib.real ${_CUDA_COMPAT_PATH}/lib     && echo ${_CUDA_COMPAT_PATH}/lib > /etc/ld.so.conf.d/00-cuda-compat.conf     && ldconfig     && rm -f ${_CUDA_COMPAT_PATH}/lib # buildkit
                        
# 2024-12-04 05:11:44  1.76GB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c curl -o /tmp/cuda-keyring.deb           https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb       && apt install /tmp/cuda-keyring.deb       && rm /tmp/cuda-keyring.deb       && apt-get update       && apt-get install -y datacenter-gpu-manager=1:3.3.6 # buildkit
                        
# 2024-12-04 05:10:55  0.00B 设置环境变量 DCGM_VERSION
ENV DCGM_VERSION=3.3.6
                        
# 2024-12-04 05:10:55  0.00B 设置环境变量 TCMALLOC_RELEASE_RATE
ENV TCMALLOC_RELEASE_RATE=200
                        
# 2024-12-04 05:10:55  396.02MB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c apt-get update       && apt-get install -y --no-install-recommends               clang               curl               dirmngr               git               gperf               libb64-0d               libcurl4-openssl-dev               libgoogle-perftools-dev               libjemalloc-dev               libnuma-dev               software-properties-common               wget                              python3-pip       && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2024-12-04 05:10:25  329.08KB 执行命令并创建新的镜像层
RUN |2 TRITON_VERSION=2.52.0 TRITON_CONTAINER_VERSION=24.11 /bin/sh -c userdel tensorrt-server > /dev/null 2>&1 || true       && userdel ubuntu > /dev/null 2>&1 || true       && if ! id -u $TRITON_SERVER_USER > /dev/null 2>&1 ; then           useradd $TRITON_SERVER_USER;         fi       && [ `id -u $TRITON_SERVER_USER` -eq 1000 ]       && [ `id -g $TRITON_SERVER_USER` -eq 1000 ] # buildkit
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TRITON_SERVER_USER
ENV TRITON_SERVER_USER=triton-server
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TRITON_SERVER_GPU_ENABLED
ENV TRITON_SERVER_GPU_ENABLED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_AUTOTUNE_THRESHOLD
ENV TF_AUTOTUNE_THRESHOLD=2
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_ENABLE_WINOGRAD_NONFUSED
ENV TF_ENABLE_WINOGRAD_NONFUSED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_ADJUST_SATURATION_FUSED
ENV TF_ADJUST_SATURATION_FUSED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TF_ADJUST_HUE_FUSED
ENV TF_ADJUST_HUE_FUSED=1
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 UCX_MEM_EVENTS
ENV UCX_MEM_EVENTS=no
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 PATH
ENV PATH=/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin
                        
# 2024-12-04 05:10:25  0.00B 添加元数据标签
LABEL com.nvidia.tritonserver.version=2.52.0
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 NVIDIA_TRITON_SERVER_VERSION
ENV NVIDIA_TRITON_SERVER_VERSION=24.11
                        
# 2024-12-04 05:10:25  0.00B 设置环境变量 TRITON_SERVER_VERSION
ENV TRITON_SERVER_VERSION=2.52.0
                        
# 2024-12-04 05:10:25  0.00B 定义构建参数
ARG TRITON_CONTAINER_VERSION
                        
# 2024-12-04 05:10:25  0.00B 定义构建参数
ARG TRITON_VERSION
                        
# 2024-12-04 04:00:50  4.81GB 执行命令并创建新的镜像层
RUN |2 NVRTC_VER=12.6.77-1 TRT_VER=10.6.0.26 /bin/sh -c pip3 install --no-cache-dir --extra-index-url https://pypi.nvidia.com tensorrt_llm*.whl &&     rm -f tensorrt_llm*.whl # buildkit
                        
# 2024-12-04 03:55:59  1.95GB 复制新文件或目录到容器中
COPY /workspace/tensorrt_llm/build/tensorrt_llm*whl . # buildkit
                        
# 2024-12-04 03:22:31  0.00B 设置工作目录为/tmp
WORKDIR /tmp
                        
# 2024-12-04 03:22:31  0.00B 设置环境变量 TRT_ROOT
ENV TRT_ROOT=/usr/local/tensorrt
                        
# 2024-12-04 03:22:31  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2024-12-04 03:22:31  0.00B 设置环境变量 TRT_VERSION
ENV TRT_VERSION=10.6.0.26
                        
# 2024-12-04 03:22:31  0.00B 定义构建参数
ARG TRT_VER=10.6.0.26
                        
# 2024-12-04 03:22:31  5.05MB 执行命令并创建新的镜像层
RUN |1 NVRTC_VER=12.6.77-1 /bin/sh -c pip3 install /usr/local/tensorrt/python/tensorrt-*-cp$( python3 -c "import sys; print(str(sys.version_info.major) + str(sys.version_info.minor))" )* # buildkit
                        
# 2024-12-04 03:22:31  1.96GB 复制新文件或目录到容器中
COPY /usr/local/tensorrt /usr/local/tensorrt # buildkit
                        
# 2024-12-04 03:21:04  98.12MB 执行命令并创建新的镜像层
RUN |1 NVRTC_VER=12.6.77-1 /bin/sh -c [ "$(uname -m)" != "x86_64" ] && arch="sbsa" || arch="x86_64" &&     curl -o /tmp/cuda-keyring.deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/$arch/cuda-keyring_1.0-1_all.deb &&     apt install /tmp/cuda-keyring.deb &&     rm /tmp/cuda-keyring.deb &&     apt-get remove --purge -y --allow-change-held-packages cuda-nvrtc-dev* &&     CUDA_VER_SHORT=${CUDA_VER: 0:4} &&     NVRTC_CUDA_VERSION=${CUDA_VER_SHORT/./-} &&     apt-get update -qq &&     apt-get install -y --no-install-recommends cuda-nvrtc-dev-${NVRTC_CUDA_VERSION}=${NVRTC_VER} &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-12-04 03:20:56  95.69MB 执行命令并创建新的镜像层
RUN |1 NVRTC_VER=12.6.77-1 /bin/sh -c apt-get update -q=2 &&     apt-get install -y --no-install-recommends         python3-dev         python3-pip         git-lfs &&     apt-get remove -y tensorrt* libnvinfer* &&     rm -rf /var/lib/apt/lists/* &&     pip3 uninstall -y tensorrt &&     pip3 install --no-cache-dir polygraphy==0.49.9 mpi4py==3.1.5 # buildkit
                        
# 2024-12-04 03:20:56  0.00B 设置环境变量 CUDA_VER NVRTC_VER
ENV CUDA_VER=12.6.2.004 NVRTC_VER=12.6.77-1
                        
# 2024-12-04 03:20:56  0.00B 定义构建参数
ARG NVRTC_VER=12.6.77-1
                        
# 2024-12-04 03:20:12  420.20MB 复制新文件或目录到容器中
COPY /usr/local/cuda/lib64/libcusparseLt* /usr/local/cuda/lib64/ # buildkit
                        
# 2024-12-04 03:20:12  53.78KB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/setuptools-70.3.0.dist-info /usr/local/lib/python3.10/dist-packages/setuptools-70.3.0.dist-info # buildkit
                        
# 2024-12-04 03:20:12  4.23MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/setuptools /usr/local/lib/python3.10/dist-packages/setuptools # buildkit
                        
# 2024-12-04 03:20:12  48.38KB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torchvision-0.20.0a0.dist-info /usr/local/lib/python3.10/dist-packages/torchvision-0.20.0a0.dist-info # buildkit
                        
# 2024-12-04 03:20:12  15.12MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torchvision /usr/local/lib/python3.10/dist-packages/torchvision # buildkit
                        
# 2024-12-04 03:20:11  2.84MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torchgen /usr/local/lib/python3.10/dist-packages/torchgen # buildkit
                        
# 2024-12-04 03:20:11  1.85MB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torch-2.5.0a0+e000cf0ad9.nv24.10.dist-info /usr/local/lib/python3.10/dist-packages/torch-2.5.0a0+e000cf0ad9.nv24.10.dist-info # buildkit
                        
# 2024-12-04 03:20:11  1.88GB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.10/dist-packages/torch /usr/local/lib/python3.10/dist-packages/torch # buildkit
                        
# 2024-12-04 03:20:09  1.80GB 复制新文件或目录到容器中
COPY /usr/local/lib/lib* /usr/local/lib/ # buildkit
                        
# 2024-10-04 02:32:38  0.00B 添加元数据标签
LABEL com.nvidia.build.ref=bb0f0608792391d35d9686e6d86a7cb319bddadc
                        
# 2024-10-04 02:32:38  0.00B 添加元数据标签
LABEL com.nvidia.build.id=114391310
                        
# 2024-10-04 02:32:38  0.00B 设置环境变量 NVIDIA_BUILD_ID
ENV NVIDIA_BUILD_ID=114391310
                        
# 2024-10-04 02:32:38  0.00B 定义构建参数
ARG NVIDIA_BUILD_ID=114391310
                        
# 2024-10-04 02:32:38  0.00B 定义构建参数
ARG NVIDIA_BUILD_REF=bb0f0608792391d35d9686e6d86a7cb319bddadc
                        
# 2024-10-04 02:32:38  0.00B 设置环境变量 LIBRARY_PATH
ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs:
                        
# 2024-10-04 02:32:38  1.01GB 执行命令并创建新的镜像层
RUN |7 GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 RDMACORE_VERSION=39.0 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 TARGETARCH=amd64 /bin/sh -c export DEVEL=1 BASE=0  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUDA.sh  && /nvidia/build-scripts/installLIBS.sh  && if [ ! -f /etc/ld.so.conf.d/nvidia-tegra.conf ]; then /nvidia/build-scripts/installNCCL.sh; fi  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installCUTENSOR.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installCUSPARSELT.sh  && if [ -f "/tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch" ]; then patch -p0 < /tmp/cuda-${_CUDA_VERSION_MAJMIN}.patch; fi  && rm -f /tmp/cuda-*.patch # buildkit
                        
# 2024-10-04 02:26:58  1.49KB 复制新文件或目录到容器中
COPY cuda-*.patch /tmp # buildkit
                        
# 2024-10-04 02:26:58  0.00B 设置环境变量 OMPI_MCA_coll_hcoll_enable
ENV OMPI_MCA_coll_hcoll_enable=0
                        
# 2024-10-04 02:26:58  0.00B 设置环境变量 OPAL_PREFIX PATH
ENV OPAL_PREFIX=/opt/hpcx/ompi PATH=/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin
                        
# 2024-10-04 02:26:58  229.68MB 执行命令并创建新的镜像层
RUN |7 GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 RDMACORE_VERSION=39.0 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 TARGETARCH=amd64 /bin/sh -c cd /nvidia  && ( export DEBIAN_FRONTEND=noninteractive        && apt-get update                            && apt-get install -y --no-install-recommends              libibverbs1                                  libibverbs-dev                               librdmacm1                                   librdmacm-dev                                libibumad3                                   libibumad-dev                                ibverbs-utils                                ibverbs-providers                     && rm -rf /var/lib/apt/lists/*               && rm $(dpkg-query -L                                    libibverbs-dev                               librdmacm-dev                                libibumad-dev                            | grep "\(\.so\|\.a\)$")          )                                            && ( cd opt/gdrcopy/                              && dpkg -i libgdrapi_*.deb                   )                                         && ( cp -r opt/hpcx /opt/                                         && cp etc/ld.so.conf.d/hpcx.conf /etc/ld.so.conf.d/          && ln -sf /opt/hpcx/ompi /usr/local/mpi                      && ln -sf /opt/hpcx/ucx  /usr/local/ucx                      && sed -i 's/^\(hwloc_base_binding_policy\) = core$/\1 = none/' /opt/hpcx/ompi/etc/openmpi-mca-params.conf         && sed -i 's/^\(btl = self\)$/#\1/'                             /opt/hpcx/ompi/etc/openmpi-mca-params.conf       )                                                         && ldconfig # buildkit
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2024-10-04 02:26:58  0.00B 设置环境变量 GDRCOPY_VERSION HPCX_VERSION MOFED_VERSION OPENUCX_VERSION OPENMPI_VERSION RDMACORE_VERSION
ENV GDRCOPY_VERSION=2.3.1-1 HPCX_VERSION=2.20 MOFED_VERSION=5.4-rdmacore39.0 OPENUCX_VERSION=1.17.0 OPENMPI_VERSION=4.1.7 RDMACORE_VERSION=39.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG OPENMPI_VERSION=4.1.7
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG OPENUCX_VERSION=1.17.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG MOFED_VERSION=5.4-rdmacore39.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG RDMACORE_VERSION=39.0
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG HPCX_VERSION=2.20
                        
# 2024-10-04 02:26:58  0.00B 定义构建参数
ARG GDRCOPY_VERSION=2.3.1-1
                        
# 2024-10-04 02:26:51  84.91MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         build-essential         git         libglib2.0-0         less         libnl-route-3-200         libnl-3-dev         libnl-route-3-dev         libnuma-dev         libnuma1         libpmi2-0-dev         nano         numactl         openssh-client         vim         wget  && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-10-04 02:11:59  148.72KB 复制新文件或目录到容器中
COPY NVIDIA_Deep_Learning_Container_License.pdf /workspace/ # buildkit
                        
# 2024-10-04 02:11:59  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2024-10-04 02:11:59  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2024-10-04 02:11:59  14.85KB 复制新文件或目录到容器中
COPY entrypoint/ /opt/nvidia/ # buildkit
                        
# 2024-10-04 02:11:59  0.00B 设置环境变量 PATH LD_LIBRARY_PATH NVIDIA_VISIBLE_DEVICES NVIDIA_DRIVER_CAPABILITIES
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility,video
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG _LIBPATH_SUFFIX=
                        
# 2024-10-04 02:11:59  46.00B 执行命令并创建新的镜像层
RUN |24 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.5.0.18 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3 CUSPARSELT_VERSION=0.6.2.3 DALI_VERSION=1.42.0 DALI_BUILD=18507157 POLYGRAPHY_VERSION=0.49.13 TRANSFORMER_ENGINE_VERSION=1.11 MODEL_OPT_VERSION=0.17.0 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf  && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2024-10-04 02:11:59  13.39KB 复制文件或目录到容器中
ADD docs.tgz / # buildkit
                        
# 2024-10-04 02:11:59  0.00B 设置环境变量 DALI_VERSION DALI_BUILD POLYGRAPHY_VERSION TRANSFORMER_ENGINE_VERSION MODEL_OPT_VERSION
ENV DALI_VERSION=1.42.0 DALI_BUILD=18507157 POLYGRAPHY_VERSION=0.49.13 TRANSFORMER_ENGINE_VERSION=1.11 MODEL_OPT_VERSION=0.17.0
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG MODEL_OPT_VERSION=0.17.0
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG TRANSFORMER_ENGINE_VERSION=1.11
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG POLYGRAPHY_VERSION=0.49.13
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG DALI_BUILD=18507157
                        
# 2024-10-04 02:11:59  0.00B 定义构建参数
ARG DALI_VERSION=1.42.0
                        
# 2024-10-04 02:11:59  0.00B 添加元数据标签
LABEL com.nvidia.nccl.version=2.22.3 com.nvidia.cublas.version=12.6.3.3 com.nvidia.cufft.version=11.3.0.4 com.nvidia.curand.version=10.3.7.77 com.nvidia.cusparse.version=12.5.4.2 com.nvidia.cusparselt.version=0.6.2.3 com.nvidia.cusolver.version=11.7.1.2 com.nvidia.cutensor.version=2.0.2.5 com.nvidia.npp.version=12.3.1.54 com.nvidia.nvjpeg.version=12.3.3.54 com.nvidia.cudnn.version=9.5.0.50 com.nvidia.tensorrt.version=10.5.0.18 com.nvidia.tensorrtoss.version= com.nvidia.nsightsystems.version=2024.6.1.90 com.nvidia.nsightcompute.version=2024.3.2.3
                        
# 2024-10-04 02:11:59  6.56GB 执行命令并创建新的镜像层
RUN |19 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.5.0.18 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3 CUSPARSELT_VERSION=0.6.2.3 /bin/sh -c /nvidia/build-scripts/installLIBS.sh  && /nvidia/build-scripts/installCUDNN.sh  && /nvidia/build-scripts/installTRT.sh  && /nvidia/build-scripts/installNSYS.sh  && /nvidia/build-scripts/installNCU.sh  && /nvidia/build-scripts/installCUTENSOR.sh  && /nvidia/build-scripts/installCUSPARSELT.sh  && if [ -z "${JETPACK_HOST_MOUNTS}" ]; then       /nvidia/build-scripts/installNCCL.sh;     fi; # buildkit
                        
# 2024-09-26 06:18:30  0.00B 设置环境变量 NCCL_VERSION CUBLAS_VERSION CUFFT_VERSION CURAND_VERSION CUSPARSE_VERSION CUSPARSELT_VERSION CUSOLVER_VERSION CUTENSOR_VERSION NPP_VERSION NVJPEG_VERSION CUDNN_VERSION CUDNN_FRONTEND_VERSION TRT_VERSION TRTOSS_VERSION NSIGHT_SYSTEMS_VERSION NSIGHT_COMPUTE_VERSION
ENV NCCL_VERSION=2.22.3 CUBLAS_VERSION=12.6.3.3 CUFFT_VERSION=11.3.0.4 CURAND_VERSION=10.3.7.77 CUSPARSE_VERSION=12.5.4.2 CUSPARSELT_VERSION=0.6.2.3 CUSOLVER_VERSION=11.7.1.2 CUTENSOR_VERSION=2.0.2.5 NPP_VERSION=12.3.1.54 NVJPEG_VERSION=12.3.3.54 CUDNN_VERSION=9.5.0.50 CUDNN_FRONTEND_VERSION=1.7.0 TRT_VERSION=10.5.0.18 TRTOSS_VERSION= NSIGHT_SYSTEMS_VERSION=2024.6.1.90 NSIGHT_COMPUTE_VERSION=2024.3.2.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUSPARSELT_VERSION=0.6.2.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NSIGHT_COMPUTE_VERSION=2024.3.2.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NSIGHT_SYSTEMS_VERSION=2024.6.1.90
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG TRTOSS_VERSION=
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG TRT_VERSION=10.5.0.18
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUDNN_FRONTEND_VERSION=1.7.0
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUDNN_VERSION=9.5.0.50
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NVJPEG_VERSION=12.3.3.54
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NPP_VERSION=12.3.1.54
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUTENSOR_VERSION=2.0.2.5
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUSOLVER_VERSION=11.7.1.2
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUSPARSE_VERSION=12.5.4.2
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CURAND_VERSION=10.3.7.77
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUFFT_VERSION=11.3.0.4
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG CUBLAS_VERSION=12.6.3.3
                        
# 2024-09-26 06:18:30  0.00B 定义构建参数
ARG NCCL_VERSION=2.22.3
                        
# 2024-09-26 06:18:30  0.00B 添加元数据标签
LABEL com.nvidia.volumes.needed=nvidia_driver com.nvidia.cuda.version=9.0
                        
# 2024-09-26 06:18:30  0.00B 设置环境变量 _CUDA_COMPAT_PATH ENV BASH_ENV SHELL NVIDIA_REQUIRE_CUDA
ENV _CUDA_COMPAT_PATH=/usr/local/cuda/compat ENV=/etc/shinit_v2 BASH_ENV=/etc/bash.bashrc SHELL=/bin/bash NVIDIA_REQUIRE_CUDA=cuda>=9.0
                        
# 2024-09-26 06:18:30  58.91KB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= /bin/sh -c cp -vprd /nvidia/. /  &&  patch -p0 < /etc/startup_scripts.patch  &&  rm -f /etc/startup_scripts.patch # buildkit
                        
# 2024-09-26 06:18:30  459.94MB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= /bin/sh -c /nvidia/build-scripts/installCUDA.sh # buildkit
                        
# 2024-09-25 05:11:43  0.00B 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 JETPACK_HOST_MOUNTS= /bin/sh -c if [ -n "${JETPACK_HOST_MOUNTS}" ]; then        echo "/usr/lib/aarch64-linux-gnu/tegra" > /etc/ld.so.conf.d/nvidia-tegra.conf     && echo "/usr/lib/aarch64-linux-gnu/tegra-egl" >> /etc/ld.so.conf.d/nvidia-tegra.conf;     fi # buildkit
                        
# 2024-09-25 05:11:43  0.00B 设置环境变量 CUDA_VERSION CUDA_DRIVER_VERSION CUDA_CACHE_DISABLE NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS
ENV CUDA_VERSION=12.6.2.004 CUDA_DRIVER_VERSION=560.35.03 CUDA_CACHE_DISABLE=1 NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=
                        
# 2024-09-25 05:11:43  0.00B 定义构建参数
ARG JETPACK_HOST_MOUNTS=
                        
# 2024-09-25 05:11:43  0.00B 定义构建参数
ARG CUDA_DRIVER_VERSION=560.35.03
                        
# 2024-09-25 05:11:43  0.00B 定义构建参数
ARG CUDA_VERSION=12.6.2.004
                        
# 2024-09-25 00:13:10  269.69MB 执行命令并创建新的镜像层
RUN /bin/sh -c export DEBIAN_FRONTEND=noninteractive  && apt-get update  && apt-get install -y --no-install-recommends         apt-utils         build-essential         ca-certificates         curl         libncurses5         libncursesw5         patch         wget         rsync         unzip         jq         gnupg         libtcmalloc-minimal4  && rm -rf /var/lib/apt/lists/*  && echo "hsts=0" > /root/.wgetrc # buildkit
                        
# 2024-09-12 00:25:18  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2024-09-12 00:25:17  77.86MB 
/bin/sh -c #(nop) ADD file:ebe009f86035c175ba244badd298a2582914415cf62783d510eab3a311a5d4e1 in / 
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2024-09-12 00:25:16  0.00B 
/bin/sh -c #(nop)  ARG RELEASE

镜像信息 

{
    "Id": "sha256:5a443800c90a0ce65b94614dd79ac18af4e493e1545c93bf5dbaba26b7690934",
    "RepoTags": [
        "nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3"
    ],
    "RepoDigests": [
        "nvcr.io/nvidia/tritonserver@sha256:72e0ea615e73dfc5c28c38bd52026aec3e7640ecc8c0cbb78c4bde830ecb2fe8",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvcr.io/nvidia/tritonserver@sha256:bfe063c35042377a4415d9f5ff4133c0b81ae9702d347d59c7880fe324ca3d26"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2024-12-03T21:12:23.108068759Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/tritonserver/bin:/usr/local/mpi/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin",
            "CUDA_VERSION=12.6.2.004",
            "CUDA_DRIVER_VERSION=560.35.03",
            "CUDA_CACHE_DISABLE=1",
            "NVIDIA_REQUIRE_JETPACK_HOST_MOUNTS=",
            "_CUDA_COMPAT_PATH=/usr/local/cuda/compat",
            "ENV=/etc/shinit_v2",
            "BASH_ENV=/etc/bash.bashrc",
            "SHELL=/bin/bash",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=9.0",
            "NCCL_VERSION=2.22.3",
            "CUBLAS_VERSION=12.6.3.3",
            "CUFFT_VERSION=11.3.0.4",
            "CURAND_VERSION=10.3.7.77",
            "CUSPARSE_VERSION=12.5.4.2",
            "CUSPARSELT_VERSION=0.6.2.3",
            "CUSOLVER_VERSION=11.7.1.2",
            "CUTENSOR_VERSION=2.0.2.5",
            "NPP_VERSION=12.3.1.54",
            "NVJPEG_VERSION=12.3.3.54",
            "CUDNN_VERSION=9.5.0.50",
            "CUDNN_FRONTEND_VERSION=1.7.0",
            "TRT_VERSION=10.6.0.26",
            "TRTOSS_VERSION=",
            "NSIGHT_SYSTEMS_VERSION=2024.6.1.90",
            "NSIGHT_COMPUTE_VERSION=2024.3.2.3",
            "DALI_VERSION=1.42.0",
            "DALI_BUILD=18507157",
            "POLYGRAPHY_VERSION=0.49.13",
            "TRANSFORMER_ENGINE_VERSION=1.11",
            "MODEL_OPT_VERSION=0.17.0",
            "LD_LIBRARY_PATH=/usr/local/tensorrt/lib/:/opt/tritonserver/backends/tensorrtllm:/usr/local/tensorrt/lib:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility,video",
            "NVIDIA_PRODUCT_NAME=Triton Server",
            "GDRCOPY_VERSION=2.3.1-1",
            "HPCX_VERSION=2.20",
            "MOFED_VERSION=5.4-rdmacore39.0",
            "OPENUCX_VERSION=1.17.0",
            "OPENMPI_VERSION=4.1.7",
            "RDMACORE_VERSION=39.0",
            "OPAL_PREFIX=/opt/hpcx/ompi",
            "OMPI_MCA_coll_hcoll_enable=0",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs:",
            "NVIDIA_BUILD_ID=126058417",
            "CUDA_VER=12.6.2.004",
            "NVRTC_VER=12.6.77-1",
            "TRT_ROOT=/usr/local/tensorrt",
            "TRITON_SERVER_VERSION=2.52.0",
            "NVIDIA_TRITON_SERVER_VERSION=24.11",
            "UCX_MEM_EVENTS=no",
            "TF_ADJUST_HUE_FUSED=1",
            "TF_ADJUST_SATURATION_FUSED=1",
            "TF_ENABLE_WINOGRAD_NONFUSED=1",
            "TF_AUTOTUNE_THRESHOLD=2",
            "TRITON_SERVER_GPU_ENABLED=1",
            "TRITON_SERVER_USER=triton-server",
            "DEBIAN_FRONTEND=noninteractive",
            "TCMALLOC_RELEASE_RATE=200",
            "DCGM_VERSION=3.3.6",
            "PIP_BREAK_SYSTEM_PACKAGES=1"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/tritonserver",
        "Entrypoint": [
            "/opt/nvidia/nvidia_entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.amazonaws.sagemaker.capabilities.accept-bind-to-port": "true",
            "com.amazonaws.sagemaker.capabilities.multi-models": "true",
            "com.nvidia.build.id": "126058417",
            "com.nvidia.build.ref": "500dce76552ace5128a42607944640c78ff468d7",
            "com.nvidia.cublas.version": "12.6.3.3",
            "com.nvidia.cuda.version": "9.0",
            "com.nvidia.cudnn.version": "9.5.0.50",
            "com.nvidia.cufft.version": "11.3.0.4",
            "com.nvidia.curand.version": "10.3.7.77",
            "com.nvidia.cusolver.version": "11.7.1.2",
            "com.nvidia.cusparse.version": "12.5.4.2",
            "com.nvidia.cusparselt.version": "0.6.2.3",
            "com.nvidia.cutensor.version": "2.0.2.5",
            "com.nvidia.nccl.version": "2.22.3",
            "com.nvidia.npp.version": "12.3.1.54",
            "com.nvidia.nsightcompute.version": "2024.3.2.3",
            "com.nvidia.nsightsystems.version": "2024.6.1.90",
            "com.nvidia.nvjpeg.version": "12.3.3.54",
            "com.nvidia.tensorrt.version": "10.5.0.18",
            "com.nvidia.tensorrtoss.version": "",
            "com.nvidia.tritonserver.version": "2.52.0",
            "com.nvidia.volumes.needed": "nvidia_driver",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "22.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 24859365390,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/1a97ac7d1a1760a2851360e2ccf419251f54001280421cbaac48e30c23f247d4/diff:/var/lib/docker/overlay2/b3745c2cea06257a9e98faafd82dd4a95ab30ae1fba1f894340406cf382ec5e3/diff:/var/lib/docker/overlay2/653bb197739d61b75c82e07711bfcfdb1d4e291239db2f8462035db1bc33a24f/diff:/var/lib/docker/overlay2/8c5270dcd2d5fa2f40e20bf99c40428f114eae983ea23d2a35ae4170dc860825/diff:/var/lib/docker/overlay2/68161e19c761737e9811e77169a4d06d6712d29917ff33c7142ae20fe55d7548/diff:/var/lib/docker/overlay2/4e837680ca30de0599f36e0509fcb30d18b9c6f60eb686b167d1c89534598d62/diff:/var/lib/docker/overlay2/a1b682557371f9849a801c0ad51552e0023d43beb608940e4736af674f9d8581/diff:/var/lib/docker/overlay2/bbec31fe52549c9ff7dade76b73d05c3f91595ea1c50b48c8b75dfbefadcab0e/diff:/var/lib/docker/overlay2/0a9cec6bc2c59d40f5af86d7d81b669ee17371ee3cd6d27e1915c465085339ea/diff:/var/lib/docker/overlay2/a9b6107d596686a54d79ce8bb4c474aefb3a3b125605195669580534473522af/diff:/var/lib/docker/overlay2/244200719ac84d0c4818ce44fcb022bcbcdab08f6e1e9d011fb0abd64a89c13d/diff:/var/lib/docker/overlay2/4cd949603433c56c4cfb3901321c0e04a0b071994213eeb8885065d57383d8cb/diff:/var/lib/docker/overlay2/3efc4c6e5d58fe8dd81323aecfeff2fc52f08d1b62e98acb06f2c768b386129c/diff:/var/lib/docker/overlay2/1a26e191423908744c888d92f03d9cb540cf74365426016d1dbc4c537cc85ee1/diff:/var/lib/docker/overlay2/464ad980e9a9e8b886c3404bc963798a55f1a0df09324b355478aa6613ffe28b/diff:/var/lib/docker/overlay2/f7b38908ce56335ea49e411f7ceb1a1f6af826eee1b24411ca1e9f87ca91023a/diff:/var/lib/docker/overlay2/4c5b164beeec157bb616e92992bfd7c03d8fb149be2b8fc534abe4e11141331d/diff:/var/lib/docker/overlay2/dd0fff3787d19e3cfb3aba4f8190134f2c0b655e1220e74b2df3b4c5442a1ad1/diff:/var/lib/docker/overlay2/78ccea4c2fa15e8f7fab3b185f97ad44d67a066099039b0f75a53824c4018c0e/diff:/var/lib/docker/overlay2/bfe43e11aca4d436c8ea79c56e9689f411c536153a7d8423ab2475fd9948038b/diff:/var/lib/docker/overlay2/608806265e4c4c42e1b8ed67fa4c4d40fa6004a8ab9d5fe67610a3a02f1893a4/diff:/var/lib/docker/overlay2/556f06ae5afd022739dd75f873d15d556c9ac4aa6ae039e770b1b8043cb47591/diff:/var/lib/docker/overlay2/9f75cff25cdebdf4c4978212950927b79da93c1d64f23c5ae22558d3055b81ef/diff:/var/lib/docker/overlay2/e81255ec2a09bb798d37c127e15289c173da49402ad771080525203480ee2959/diff:/var/lib/docker/overlay2/412a0616bdca3c99f6e1dba4a782d8161e817be920127a06c9ace5e705ccc419/diff:/var/lib/docker/overlay2/0ca84e844eed794083857723049fe402ccfc01d817040211637e7c5e28250955/diff:/var/lib/docker/overlay2/cbb85e21a11f200db6d022946b8a34e31827b2e508109c886294699721403e29/diff:/var/lib/docker/overlay2/5b97378a9b38b99439d1169212a8934ced191462b3ebbe6f9cc1e12bd234c254/diff:/var/lib/docker/overlay2/38d72d085b21bf4743a10992058b37344b178068f5290d473b6dfa04b311e37b/diff:/var/lib/docker/overlay2/623e3fbc77cdca31b44829e9b187bcd8886b1644ff14be37e64da9d50bcefccf/diff:/var/lib/docker/overlay2/3b01a69e843d89a25ff1b94a51cfced713df722f2229c0a1c06eca6b89f7116b/diff:/var/lib/docker/overlay2/2b925f046edbb41ecca58f695f736a2470c774365e14ccace94cd122f3d19fb7/diff:/var/lib/docker/overlay2/b8b7eebd1640b8f4e3e145338e82dcc67e3dc643292b28721de25a4da59acf46/diff:/var/lib/docker/overlay2/bd6b99bee46eff3e457ec5b391d3c6eb9cb79ce2f950ca43492233ca8a88fbd4/diff:/var/lib/docker/overlay2/e2218e776727d2feb5de0632026821d90d0f4bb9d6e67d7f11074a3dceef27f4/diff:/var/lib/docker/overlay2/cb050aa0c66750f727494d5478883e321f725879fcc25e1f97e004b1f04015c7/diff:/var/lib/docker/overlay2/c54bc937648acb4b10b9264e97345f273d8c250272a496a4b1ddd08be2e37b1d/diff:/var/lib/docker/overlay2/c1082305f633ea28fefacf25f954fca7c301a09cc66255787979bc86ef673694/diff:/var/lib/docker/overlay2/7dc5ccee0429e485debe0f3235a089b82f4b4880cbc39f0d71c084676961ae39/diff:/var/lib/docker/overlay2/4d1dd7103abb2f7baac3f8952425a4ebfda4672d57f74258a57fa217f99b8e56/diff:/var/lib/docker/overlay2/373e354ccfdd831d22e71790305500f073c12a490362fc9be0d9eea8cb027973/diff:/var/lib/docker/overlay2/e6bbc07f555c5433dabb869e73dc970cfe981ff2df301d7f4a77b8cefe0b7f12/diff:/var/lib/docker/overlay2/7b8739888706e717dca7b980e8825d202d0a3918b18a3c442adc73dd52cb65b0/diff:/var/lib/docker/overlay2/f32b9256e317d9d955c7539fb1be71441200a5d3e5c25a19355158bef5d708a8/diff:/var/lib/docker/overlay2/ce01b5a9b06d3f6862cd60c66422cbb318ad94d6154ae3c6b608f32f6196d4e1/diff:/var/lib/docker/overlay2/6534f959d87b749e2e44263f1f7544f918598eb066dd66f156bd45b5888144da/diff:/var/lib/docker/overlay2/4cfb2ff6eb670d08d805fcc326973c76acabc424b2f6ce5f1903149f34750452/diff",
            "MergedDir": "/var/lib/docker/overlay2/217aca253113a3ccaea1f73c6a4dbe399f0a121fa2b9a7622ffaeeace5057d0c/merged",
            "UpperDir": "/var/lib/docker/overlay2/217aca253113a3ccaea1f73c6a4dbe399f0a121fa2b9a7622ffaeeace5057d0c/diff",
            "WorkDir": "/var/lib/docker/overlay2/217aca253113a3ccaea1f73c6a4dbe399f0a121fa2b9a7622ffaeeace5057d0c/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:2573e0d8158209ed54ab25c87bcdcb00bd3d2539246960a3d592a1c599d70465",
            "sha256:0db37749123ed077f490b8481792ba660fc7b82b2035d2f37f540691c102e5b4",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:f805df76568cf3834df5ae477cf7fd99d22b345ab31103d96a3f138af2b6c8ec",
            "sha256:176c746bdb5ad24a387e0d855c44bd57391d7c33a2bad8e19d4aced54bea5a00",
            "sha256:8bac727098a300370c2116a8e848abea54cb4c1d5d9f3851c9467961e90748b5",
            "sha256:f5f79ac10bb874bdbe60f05aefdf89d24c8f07b24910dbd787b9ee4cfd390565",
            "sha256:caf07e7743c0eb80a8a7ac78b631cd93b73f96e2d1a1dabe4d9ae7a9b922d24b",
            "sha256:6c75d6484379aa51f50d3e6a3c1f0b7acc2364aed0b9fe643224ce3134c970f3",
            "sha256:0b6a520db613be9ef2d808547aefba361788a92f82ccaa532fa3b2895f94debc",
            "sha256:c567e58addb329a64228dad6849f96a0a7e353f59a3edb8cc11d3db0afd1fd62",
            "sha256:0c928a220a5504afdc5d09a152d728398d7e981acbc592a7a9e5f8f16f8439b5",
            "sha256:b05947e518f595236486c35a836848c01ccd7c06539a481d2084667e8288ddf4",
            "sha256:0d5982fa150d5361485513c3ff3fc8f61acd8bdb05a6b97105aa4c2dc949d7ab",
            "sha256:127242384cfc651d923908aec08b7770ee293110e528c4063231db25d7854728",
            "sha256:82402768558e58976570aee0332423fa9a7d9daab85199205ccf4427d2a428c5",
            "sha256:d926e3bdd7d50f8196d7959c5947ed092e617e13985790baf23cba409cfea793",
            "sha256:23d5f713b80726939b4319b9e992b12ec31ec3d9fd0feef45499edd4dcedf297",
            "sha256:03afc8e195eb51a9a0b389746c0e48be76b4e90a4777a9245fa0f751e65f7184",
            "sha256:fb029fa6b83d7035f20c324dd387f58c4a10048db1b88a21598e3a6cda04b659",
            "sha256:79537914ecbe57d237079548801ed40fd0747bd39a0d5921dcbed39f70b72341",
            "sha256:c14fe077213219755e0a0eef5e36739ff74b390f2091d7d38d3b13e464cef383",
            "sha256:d61e6f026e188fa1f5fa8e4d6e58c7e43e5dc77e9c6594aa46739ab29374ab61",
            "sha256:1a5610d34e8c387f6b7ab2efa6621a2a0b9354629104c703d922bc956766073b",
            "sha256:f362ce7814b17d3a0af594908d2b1232ed0cc5d0523058f0c016ac6300219ae9",
            "sha256:68192b98470e90e7b280fbd78a24776b5cf4243c5cd35bb8101b30fdc0b94698",
            "sha256:334354e12446e0b6d3059886bd85a05891239c509a6c3581aba19285e016a175",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:81bb9ebe9eaceb5aebd5e6e3504f85fc8839e04c3e94466110b0b448aa922461",
            "sha256:6cb088177c250de10d0a33b14f2d85528656f29f2ee7ee81e4458b9df2aed520",
            "sha256:6b545781a84c750d5625584330c27573c0380e39c5e821af9852e771139d36ee",
            "sha256:2c2328ddaff542af96dc4da41e513a0431473ab74eeffa9366c2388d83398206",
            "sha256:e6f28c807875b9e1a1104255cd4a90a435847e0bfec23401e5aec2f4888ecb65",
            "sha256:554c4e30baa437638d79e31943631eba568e25fbb7c4a58b46c11aa4c824d672",
            "sha256:9401e8d6ca1dcf44c7bfc954108c9257d2d33ac0916976de9947a86152797c13",
            "sha256:d8b6f3d2355e838b6ad40cc33d6d5cb201616769f4b3684ff83467c467b39905",
            "sha256:353ac3bbf6545a7d928e539f8b8976a7779e98433cdcaa4df652d4f179111793",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:67020eb36249f10b7c366d2bc12f15f30a95411b4e0548fbbcdf3e7bf0760346",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:028be19812faf6dd64644e741e7eac042803b54b353f12acb71e7b673b7d04b8",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:32ae04d41456801611fb3a2661997aa965f9a7525f6460e8096f9f2ebdfd4168",
            "sha256:0fe8e917c14f925a20a3a438b0836cbac5d1f74ef341c749b55377d1c1d71ffe",
            "sha256:08bb5e1c887cd74509eae9f20012c388b7cb7e9c925e4b9bc02f5be8eb0ad7c6",
            "sha256:446273ffd45830fffd1152938c63c37243b7735dbe638fc0ad343fca105b5f70",
            "sha256:1c8459d8f750a9c659db22f22062ed09fb06a61a8d3f458cb0577c1cf85ea976",
            "sha256:438a7f2b2e8c7ff2a955e2ef6408abe00b9ca1816bd6148a98090527e47b52b6"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-02-26T01:53:26.512790286+08:00"
    }
}

更多版本

docker.io/nvcr.io/nvidia/tritonserver:24.11-trtllm-python-py3

linux/amd64 docker.io24.86GB2025-02-26 02:25
1559

docker.io/nvcr.io/nvidia/tritonserver:25.04-py3

linux/amd64 docker.io19.59GB2025-05-22 00:46
2113

docker.io/nvcr.io/nvidia/tritonserver:25.02-trtllm-python-py3

linux/amd64 docker.io30.15GB2025-05-25 02:51
1184

docker.io/nvcr.io/nvidia/tritonserver:22.12-py3

linux/amd64 docker.io14.00GB2025-06-04 06:32
864

docker.io/nvcr.io/nvidia/tritonserver:25.05-trtllm-python-py3

linux/amd64 docker.io32.90GB2025-06-09 03:41
1233

docker.io/nvcr.io/nvidia/tritonserver:25.04-vllm-python-py3

linux/amd64 docker.io23.34GB2025-06-15 02:52
797

docker.io/nvcr.io/nvidia/tritonserver:25.05-vllm-python-py3

linux/amd64 docker.io23.93GB2025-06-17 01:33
1258

docker.io/nvcr.io/nvidia/tritonserver:23.05-py3

linux/amd64 docker.io12.88GB2026-01-30 00:29
477
0 点赞 0 收藏镜像 Run 生成 Docker Run 命令 K8s 生成 Kubernetes YAML 回到顶部
检测到您正在使用广告拦截插件，本站为公益站点，依赖广告维持运转 🙏 查看如何关闭 ×