docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04 linux/arm64

docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04 - 国内下载镜像源 浏览次数:9 温馨提示: 这是一个 linux/arm64 系统架构镜像

这是一个提供LLM推理服务的Docker镜像。

它基于VLLM,一个高效的LLM推理引擎,旨在提供快速、低延迟的LLM服务。

该镜像包含了运行VLLM所需的所有依赖项,方便用户快速部署和使用。

源镜像 docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64
镜像ID sha256:fad1453b666fa0207189c1ae5e0e2dfe80029b01c44830c2eac17d3c638f9c67
镜像TAG 0.8.3-r36.4.0-cu128-24.04-linuxarm64
大小 13.24GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /bin/bash
启动入口
工作目录 /
OS/平台 linux/arm64
浏览量 9 次
贡献者
镜像创建 2025-04-02T12:03:19.10010865Z
同步时间 2025-12-05 01:28
更新时间 2025-12-05 09:13
环境变量
PATH=/root/.cargo/bin:/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin DEBIAN_FRONTEND=noninteractive LANGUAGE=en_US:en LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 TAR_INDEX_URL=https://apt.jetson-ai-lab.dev/jp6/cu128/24.04 PIP_INDEX_URL=https://pypi.jetson-ai-lab.dev/jp6/cu128 PIP_TRUSTED_HOST= TWINE_REPOSITORY_URL=http://alice:3141/jp6/cu128 TWINE_USERNAME=jp6 TWINE_PASSWORD=NvidiaJetson24 SCP_UPLOAD_URL=jao-51:/dist/jp6/cu128/24.04 SCP_UPLOAD_USER=nvidia SCP_UPLOAD_PASS=nvidia CUDA_HOME=/usr/local/cuda NVCC_PATH=/usr/local/cuda/bin/nvcc NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=all CUDAARCHS=87 CUDA_ARCHITECTURES=87 CUDNN_LIB_PATH=/usr/lib/aarch64-linux-gnu CUDNN_LIB_INCLUDE_PATH=/usr/include CMAKE_CUDA_COMPILER=/usr/local/cuda/bin/nvcc CUDA_NVCC_EXECUTABLE=/usr/local/cuda/bin/nvcc CUDACXX=/usr/local/cuda/bin/nvcc TORCH_NVCC_FLAGS=-Xfatbin -compress-all CUDA_BIN_PATH=/usr/local/cuda/bin CUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda LD_LIBRARY_PATH=/usr/local/cuda/compat:/usr/local/cuda/lib64: PYTHON_VERSION=3.12 PYTHONFAULTHANDLER=1 PYTHONUNBUFFERED=1 PYTHONIOENCODING=utf-8 PYTHONHASHSEED=random PIP_NO_CACHE_DIR=true PIP_CACHE_PURGE=true PIP_ROOT_USER_ACTION=ignore PIP_DISABLE_PIP_VERSION_CHECK=on PIP_DEFAULT_TIMEOUT=100 PIP_WHEEL_DIR=/opt/wheels PIP_VERBOSE=3 TWINE_NON_INTERACTIVE=1 OPENBLAS_CORETYPE=ARMV8 NUMPY_PACKAGE=numpy NUMPY_VERSION_MAJOR=2 TORCH_CUDA_ARCH_LIST=8.7 TORCH_HOME=/data/models/torch TRANSFORMERS_CACHE=/data/models/huggingface HUGGINGFACE_HUB_CACHE=/data/models/huggingface HF_HOME=/data/models/huggingface TRANSFORMERS_PACKAGE=transformers==4.50.3 TRANSFORMERS_VERSION=4.50.3 XFORMERS_FORCE_DISABLE_TRITON=1
镜像标签
ubuntu: org.opencontainers.image.ref.name 24.04: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64  docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64  docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04

Shell快速替换命令

sed -i 's#dustynv/vllm:0.8.3-r36.4.0-cu128-24.04#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64  docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64  docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04'

镜像构建历史


# 2025-04-02 20:03:19  93.07MB 
|4 FORCE_BUILD=off VLLM_BRANCH=v0.8.3 VLLM_VERSION=0.8.3 XGRAMMAR_VERSION=0.1.17 /bin/sh -c /tmp/transformers/install.sh
                        
# 2025-04-02 20:02:56  2.36GB 
|4 FORCE_BUILD=off VLLM_BRANCH=v0.8.3 VLLM_VERSION=0.8.3 XGRAMMAR_VERSION=0.1.17 /bin/sh -c /tmp/vllm/install.sh || /tmp/vllm/build.sh
                        
# 2025-04-02 20:01:14  19.69KB 
/bin/sh -c #(nop) COPY multi:123a0b94ad54b8a7d2cac41d94549659058a8b689169a008ec04681c0ca2ac1a in /tmp/vllm/ 
                        
# 2025-04-02 19:58:01  304.45MB 
|4 FORCE_BUILD=off VLLM_BRANCH=v0.8.3 VLLM_VERSION=0.8.3 XGRAMMAR_VERSION=0.1.17 /bin/sh -c apt-get update -y && apt-get install -y libnuma-dev     libsndfile1 libsndfile1-dev libprotobuf-dev libsm6 libxext6 libgl1
                        
# 2025-04-02 19:57:33  0.00B 
/bin/sh -c #(nop)  ARG VLLM_VERSION VLLM_BRANCH XGRAMMAR_VERSION CUDAARCHS FORCE_BUILD=off
                        
# 2025-04-02 19:57:33  12.71MB 
|2 FORCE_BUILD=off TORCHAUDIO_VERSION=2.6.0 /bin/sh -c /tmp/torchaudio/install.sh || /tmp/torchaudio/build.sh
                        
# 2025-04-02 19:57:28  1.31KB 
/bin/sh -c #(nop) COPY multi:f8e133f258d985ca365afcad1df36f4c3b6b4a102e4efb434dde75665213be69 in /tmp/torchaudio/ 
                        
# 2025-04-02 19:57:28  0.00B 
/bin/sh -c #(nop)  ARG TORCHAUDIO_VERSION FORCE_BUILD=off
                        
# 2025-04-02 19:57:27  313.68MB 
|2 FLASH_ATTENTION_VERSION=2.7.4.post1 FORCE_BUILD=off /bin/sh -c /tmp/flash-attention/install.sh || /tmp/flash-attention/build.sh
                        
# 2025-04-02 19:57:17  24.90KB 
/bin/sh -c #(nop) COPY multi:b26d34206209ecc8de95f4cafb0bbf4261438682f6bc14a1fbd34542f89aefcd in /tmp/flash-attention/ 
                        
# 2025-04-02 19:57:17  0.00B 
/bin/sh -c #(nop)  ARG FLASH_ATTENTION_VERSION FORCE_BUILD=off
                        
# 2025-04-02 19:57:16  48.32MB 
|2 FORCE_BUILD=off XFORMERS_VERSION=0.0.30 /bin/sh -c /tmp/xformers/install.sh || /tmp/xformers/build.sh
                        
# 2025-04-02 19:57:13  750.00B 
/bin/sh -c #(nop) COPY multi:e7c380e7a0cac0245ecfcb64f7532381d1d94eba41229d13ff99c342b2d21c7d in /tmp/xformers/ 
                        
# 2025-04-02 19:57:13  0.00B 
/bin/sh -c #(nop)  ENV XFORMERS_FORCE_DISABLE_TRITON=1
                        
# 2025-04-02 19:57:13  0.00B 
/bin/sh -c #(nop)  ARG XFORMERS_VERSION FORCE_BUILD=off
                        
# 2025-04-02 19:57:12  187.42MB 
|6 BITSANDBYTES_BRANCH=0.45.5 BITSANDBYTES_REPO=bitsandbytes-foundation/bitsandbytes BITSANDBYTES_VERSION=0.45.5 CUDA_INSTALLED_VERSION=128 CUDA_MAKE_LIB=cuda12x FORCE_BUILD=off /bin/sh -c /tmp/bitsandbytes/install.sh || /tmp/bitsandbytes/build.sh
                        
# 2025-04-02 19:56:58  1.69KB 
/bin/sh -c #(nop) COPY multi:5951c2795dd29e17a8adf5b4c5e2ba13ac45151435ade3826f719a40b7ec1dbe in /tmp/bitsandbytes/ 
                        
# 2025-04-02 19:56:58  0.00B 
/bin/sh -c #(nop)  ARG BITSANDBYTES_VERSION FORCE_BUILD=off BITSANDBYTES_REPO BITSANDBYTES_BRANCH CUDA_INSTALLED_VERSION CUDA_MAKE_LIB
                        
# 2025-04-02 19:56:57  512.20MB 
|3 FORCE_BUILD=off TRITON_BRANCH=release/3.1.x TRITON_VERSION=3.1.0 /bin/sh -c /tmp/triton/install.sh || /tmp/triton/build.sh
                        
# 2025-04-02 19:56:47  1.16KB 
/bin/sh -c #(nop) COPY multi:af1041759d243cdeef46ad3907f92ff027649501b6cab16c101ec58b9e0f1b96 in /tmp/triton/ 
                        
# 2025-04-02 19:56:47  0.00B 
/bin/sh -c #(nop)  ARG TRITON_VERSION TRITON_BRANCH FORCE_BUILD=off
                        
# 2025-04-02 19:56:47  62.63KB 
/bin/sh -c pip3 show transformers     && python3 -c 'import transformers; print(transformers.__version__)'
                        
# 2025-04-02 19:56:42  4.73KB 
/bin/sh -c #(nop) COPY file:d65b25d7fbe6ea1b91a3bb25e0cba28a6390cf9f83e569b2fc0c8dee08623169 in /usr/local/bin 
                        
# 2025-04-02 19:56:42  116.80MB 
/bin/sh -c /tmp/transformers/install.sh
                        
# 2025-04-02 19:56:07  801.00B 
/bin/sh -c #(nop) COPY file:f48872032ba5675c2bd11da0f4225907bdc48ec45107f81f91dd07a4b2624012 in /tmp/transformers/install.sh 
                        
# 2025-04-02 19:56:07  0.00B 
/bin/sh -c #(nop)  ENV TRANSFORMERS_PACKAGE=transformers==4.50.3 TRANSFORMERS_VERSION=4.50.3
                        
# 2025-04-02 19:56:07  0.00B 
/bin/sh -c #(nop)  ARG TRANSFORMERS_PACKAGE TRANSFORMERS_VERSION
                        
# 2025-04-02 19:56:07  361.52KB 
/bin/sh -c rustc --version &&     pip3 install setuptools-rust
                        
# 2025-04-02 19:56:04  0.00B 
/bin/sh -c #(nop)  ENV PATH=/root/.cargo/bin:/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-04-02 19:56:01  1.43GB 
/bin/sh -c curl https://sh.rustup.rs -sSf | sh -s -- -y
                        
# 2025-04-02 19:55:05  11.50MB 
/bin/sh -c set -ex     && pip3 install         huggingface_hub[cli]         dataclasses         && huggingface-cli --help     && huggingface-downloader --help     && pip3 show huggingface_hub     && python3 -c 'import huggingface_hub; print(huggingface_hub.__version__)'         && apt-get update     && rm -rf /var/lib/apt/lists/*     && apt-get clean
                        
# 2025-04-02 19:54:54  3.48KB 
/bin/sh -c #(nop) COPY file:b9e93da08167ff3d361a60be33029d9e580dcf9c5b7efa3223bc2908fbaac57d in /usr/local/bin/_huggingface-downloader.py 
                        
# 2025-04-02 19:54:54  499.00B 
/bin/sh -c #(nop) COPY file:31583bc005bc47928bcc5337891ac48bf6e3bc3d3bd525b755d487e841b21faf in /usr/local/bin/ 
                        
# 2025-04-02 19:54:54  0.00B 
/bin/sh -c #(nop)  ENV TRANSFORMERS_CACHE=/data/models/huggingface HUGGINGFACE_HUB_CACHE=/data/models/huggingface HF_HOME=/data/models/huggingface
                        
# 2025-04-02 19:54:54  26.99MB 
|2 FORCE_BUILD=off TORCHVISION_VERSION=0.21.0 /bin/sh -c /tmp/torchvision/install.sh || /tmp/torchvision/build.sh
                        
# 2025-04-02 19:54:49  4.10MB 
|2 FORCE_BUILD=off TORCHVISION_VERSION=0.21.0 /bin/sh -c apt-get update &&     apt-get install -y --no-install-recommends         libjpeg-dev         libpng-dev         zlib1g-dev 	&& rm -rf /var/lib/apt/lists/* 	&& apt-get clean
                        
# 2025-04-02 19:54:39  1.04KB 
/bin/sh -c #(nop) COPY multi:299b0132662d98e090a93431781d9c1d56418db13d28499010a50cd90368acdd in /tmp/torchvision/ 
                        
# 2025-04-02 19:54:39  0.00B 
/bin/sh -c #(nop)  ARG TORCHVISION_VERSION FORCE_BUILD=off
                        
# 2025-04-02 19:54:37  1.09GB 
|10 FORCE_BUILD=off PYTORCH_BUILD_VERSION=2.6.0 TORCH_CUDA_ARCH_ARGS=8.7 TORCH_VERSION=2.6 USE_GLOO=1 USE_MPI=0 USE_NCCL=1 USE_NNPACK=1 USE_PYTORCH_QNNPACK=1 USE_XNNPACK=0 /bin/sh -c /tmp/pytorch/install.sh || /tmp/pytorch/build.sh
                        
# 2025-04-02 19:53:24  2.69KB 
/bin/sh -c #(nop) COPY multi:07b5db74745423b3cd94a71424fea7715d036b4c0671ac59da96117a35e3bc34 in /tmp/pytorch/ 
                        
# 2025-04-02 19:53:24  0.00B 
/bin/sh -c #(nop)  ENV TORCH_CUDA_ARCH_LIST=8.7 TORCH_HOME=/data/models/torch
                        
# 2025-04-02 19:53:24  0.00B 
/bin/sh -c #(nop)  ARG TORCH_CUDA_ARCH_ARGS TORCH_VERSION PYTORCH_BUILD_VERSION USE_NCCL=0 USE_GLOO=1 USE_MPI=1 USE_NNPACK=1 USE_XNNPACK=1 USE_PYTORCH_QNNPACK=1 FORCE_BUILD=off
                        
# 2025-04-02 19:53:23  37.00MB 
|1 ONNX_VERSION=main /bin/sh -c pip3 install onnx ||     pip3 install git+https://github.com/onnx/onnx@${ONNX_VERSION} &&     pip3 show onnx &&     python3 -c 'import onnx; print(onnx.__version__)'
                        
# 2025-04-02 19:53:10  0.00B 
/bin/sh -c #(nop)  ARG ONNX_VERSION
                        
# 2025-04-02 19:53:10  63.15MB 
/bin/sh -c set -ex     && pip3 install --force-reinstall cmake     && cmake --version     && which cmake
                        
# 2025-04-02 19:53:02  60.04MB 
/bin/sh -c bash /tmp/numpy/install.sh
                        
# 2025-04-02 19:52:54  482.00B 
/bin/sh -c #(nop) COPY file:072fcadd219a626de2989993463b8ff0dd9cafdda9fb38f983ba7e9edee93314 in /tmp/numpy/ 
                        
# 2025-04-02 19:52:54  0.00B 
/bin/sh -c #(nop)  ENV NUMPY_PACKAGE=numpy NUMPY_VERSION_MAJOR=2
                        
# 2025-04-02 19:52:54  0.00B 
/bin/sh -c #(nop)  ARG NUMPY_PACKAGE=numpy NUMPY_VERSION_MAJOR=2
                        
# 2025-04-01 23:23:08  0.00B 
/bin/sh -c #(nop)  ENV OPENBLAS_CORETYPE=ARMV8
                        
# 2025-04-01 23:23:08  94.72MB 
|1 PYTHON_VERSION_ARG=3.12 /bin/sh -c /tmp/install_python.sh
                        
# 2025-04-01 23:22:14  1.88KB 
/bin/sh -c #(nop) COPY file:e63d5ffb6cc318382a6f87b379155696480c274c442d4a7554ea3f68c0ef3056 in /tmp/install_python.sh 
                        
# 2025-04-01 23:22:14  0.00B 
/bin/sh -c #(nop)  ENV PYTHON_VERSION=3.12 PYTHONFAULTHANDLER=1 PYTHONUNBUFFERED=1 PYTHONIOENCODING=utf-8 PYTHONHASHSEED=random PIP_NO_CACHE_DIR=true PIP_CACHE_PURGE=true PIP_ROOT_USER_ACTION=ignore PIP_DISABLE_PIP_VERSION_CHECK=on PIP_DEFAULT_TIMEOUT=100 PIP_WHEEL_DIR=/opt/wheels PIP_VERBOSE=3 TWINE_NON_INTERACTIVE=1 DEBIAN_FRONTEND=noninteractive PATH=/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-04-01 23:22:14  0.00B 
/bin/sh -c #(nop)  ARG PYTHON_VERSION_ARG
                        
# 2025-04-01 23:22:13  703.32KB 
|3 CUDNN_DEB=cudnn-local-tegra-repo-ubuntu2404-9.8.0 CUDNN_PACKAGES=libcudnn9-cuda-12 libcudnn9-dev-cuda-12 libcudnn9-samples CUDNN_URL=https://developer.download.nvidia.com/compute/cudnn/9.8.0/local_installers/cudnn-local-tegra-repo-ubuntu2404-9.8.0_1.0-1_arm64.deb /bin/sh -c cd /usr/src/cudnn_samples_v*/conv_sample/ &&     make -j$(nproc)
                        
# 2025-04-01 23:21:59  1.21GB 
|3 CUDNN_DEB=cudnn-local-tegra-repo-ubuntu2404-9.8.0 CUDNN_PACKAGES=libcudnn9-cuda-12 libcudnn9-dev-cuda-12 libcudnn9-samples CUDNN_URL=https://developer.download.nvidia.com/compute/cudnn/9.8.0/local_installers/cudnn-local-tegra-repo-ubuntu2404-9.8.0_1.0-1_arm64.deb /bin/sh -c echo "Downloading ${CUDNN_DEB}" &&     rm -rf /tmp/cudnn && mkdir /tmp/cudnn && cd /tmp/cudnn &&     wget --quiet --show-progress --progress=bar:force:noscroll ${CUDNN_URL} &&     dpkg -i *.deb &&     cp /var/cudnn-local-tegra-repo-*/cudnn-local-tegra-*-keyring.gpg /usr/share/keyrings/ &&     apt-get update &&     apt-cache search cudnn &&     apt list --installed | grep 'cuda\|cudnn\|cublas' &&     apt-get install -y --no-install-recommends ${CUDNN_PACKAGES} &&     rm -rf /var/lib/apt/lists/* &&     apt-get clean &&     dpkg --list | grep cudnn &&     dpkg -P ${CUDNN_DEB} &&     rm -rf /tmp/cudnn
                        
# 2025-03-12 21:12:04  45.76MB 
|3 CUDNN_DEB=cudnn-local-tegra-repo-ubuntu2404-9.8.0 CUDNN_PACKAGES=libcudnn9-cuda-12 libcudnn9-dev-cuda-12 libcudnn9-samples CUDNN_URL=https://developer.download.nvidia.com/compute/cudnn/9.8.0/local_installers/cudnn-local-tegra-repo-ubuntu2404-9.8.0_1.0-1_arm64.deb /bin/sh -c ls /etc/apt/sources.list.d/ &&     apt-get update &&     apt-cache search cudnn
                        
# 2025-03-12 21:11:57  0.00B 
/bin/sh -c #(nop)  ARG CUDNN_PACKAGES
                        
# 2025-03-12 21:11:56  0.00B 
/bin/sh -c #(nop)  ARG CUDNN_DEB
                        
# 2025-03-12 21:11:56  0.00B 
/bin/sh -c #(nop)  ARG CUDNN_URL
                        
# 2025-03-12 21:11:56  0.00B 
/bin/sh -c #(nop) WORKDIR /
                        
# 2025-03-12 21:11:55  0.00B 
/bin/sh -c #(nop)  ENV NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=all CUDAARCHS=87 CUDA_ARCHITECTURES=87 CUDA_HOME=/usr/local/cuda CUDNN_LIB_PATH=/usr/lib/aarch64-linux-gnu CUDNN_LIB_INCLUDE_PATH=/usr/include CMAKE_CUDA_COMPILER=/usr/local/cuda/bin/nvcc CUDA_NVCC_EXECUTABLE=/usr/local/cuda/bin/nvcc CUDACXX=/usr/local/cuda/bin/nvcc TORCH_NVCC_FLAGS=-Xfatbin -compress-all CUDA_BIN_PATH=/usr/local/cuda/bin CUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda PATH=/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/cuda/compat:/usr/local/cuda/lib64: DEBIAN_FRONTEND=noninteractive
                        
# 2025-03-12 21:11:55  0.00B 
/bin/sh -c #(nop)  ENV NVCC_PATH=/usr/local/cuda/bin/nvcc
                        
# 2025-03-12 21:11:55  0.00B 
/bin/sh -c #(nop)  ENV CUDA_HOME=/usr/local/cuda
                        
# 2025-03-12 21:11:53  4.33GB 
|5 CUDA_ARCH_LIST=87 CUDA_DEB=cuda-tegra-repo-ubuntu2204-12-8-local CUDA_PACKAGES=cuda-toolkit* CUDA_URL=https://developer.download.nvidia.com/compute/cuda/12.8.1/local_installers/cuda-tegra-repo-ubuntu2204-12-8-local_12.8.1-1_arm64.deb DISTRO=ubuntu2404 /bin/sh -c /tmp/install_cuda.sh
                        
# 2025-03-02 15:03:07  894.00B 
/bin/sh -c #(nop) COPY file:4688f070ce9fd499963f7be4fc8a47addb43e87261c4168cebeebf5923452502 in /tmp/install_cuda.sh 
                        
# 2025-03-02 15:03:07  0.00B 
/bin/sh -c #(nop)  ARG CUDA_URL CUDA_DEB CUDA_PACKAGES CUDA_ARCH_LIST DISTRO=ubuntu2004
                        
# 2025-03-02 15:03:07  0.00B 
/bin/sh -c #(nop)  ENV TAR_INDEX_URL=https://apt.jetson-ai-lab.dev/jp6/cu128/24.04 PIP_INDEX_URL=https://pypi.jetson-ai-lab.dev/jp6/cu128 PIP_TRUSTED_HOST= TWINE_REPOSITORY_URL=http://alice:3141/jp6/cu128 TWINE_USERNAME=jp6 TWINE_PASSWORD=NvidiaJetson24 SCP_UPLOAD_URL=jao-51:/dist/jp6/cu128/24.04 SCP_UPLOAD_USER=nvidia SCP_UPLOAD_PASS=nvidia
                        
# 2025-02-25 18:08:26  0.00B 
/bin/sh -c #(nop)  ARG PIP_INDEX_REPO PIP_UPLOAD_REPO PIP_UPLOAD_USER PIP_UPLOAD_PASS PIP_TRUSTED_HOSTS TAR_INDEX_URL SCP_UPLOAD_URL SCP_UPLOAD_USER SCP_UPLOAD_PASS
                        
# 2025-02-25 18:08:26  1.77KB 
/bin/sh -c #(nop) COPY file:c151096ecdec41c0e751df4f9131773ddaf0b0074b72388cc344129a04329635 in /usr/local/bin/ 
                        
# 2025-02-25 18:08:24  793.04MB 
/bin/sh -c set -ex     && apt-get update     && apt-get install -y --no-install-recommends         locales         locales-all         tzdata     && locale-gen en_US $LANG     && update-locale LC_ALL=$LC_ALL LANG=$LANG     && locale         && apt-get install -y --no-install-recommends         build-essential         software-properties-common         apt-transport-https         ca-certificates         lsb-release         pkg-config         gnupg         git         git-lfs         gdb         wget         wget2         curl         nano         zip         unzip         time         sshpass         ssh-client     && apt-get clean     && rm -rf /var/lib/apt/lists/*         && gcc --version     && g++ --version
                        
# 2025-02-25 18:06:43  0.00B 
/bin/sh -c #(nop)  ENV DEBIAN_FRONTEND=noninteractive LANGUAGE=en_US:en LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8
                        
# 2025-01-27 12:14:54  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-01-27 12:14:54  100.73MB 
/bin/sh -c #(nop) ADD file:68158f1ff76fd4de9f92666ad22571e6cd11df166255c2814a135773fdd6acd7 in / 
                        
# 2025-01-27 12:14:51  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=24.04
                        
# 2025-01-27 12:14:51  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-01-27 12:14:51  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-01-27 12:14:51  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:fad1453b666fa0207189c1ae5e0e2dfe80029b01c44830c2eac17d3c638f9c67",
    "RepoTags": [
        "dustynv/vllm:0.8.3-r36.4.0-cu128-24.04",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04-linuxarm64"
    ],
    "RepoDigests": [
        "dustynv/vllm@sha256:5c17f5faa018be964aedc2eba1d6c19ab05c2de9fff9a4a84b2c4c887e802420",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dustynv/vllm@sha256:8872de8f8168aa85521abd093ae13aad13f8491772ed03710b812a95bb12baa7"
    ],
    "Parent": "",
    "Comment": "",
    "Created": "2025-04-02T12:03:19.10010865Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "24.0.7",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/root/.cargo/bin:/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "DEBIAN_FRONTEND=noninteractive",
            "LANGUAGE=en_US:en",
            "LANG=en_US.UTF-8",
            "LC_ALL=en_US.UTF-8",
            "TAR_INDEX_URL=https://apt.jetson-ai-lab.dev/jp6/cu128/24.04",
            "PIP_INDEX_URL=https://pypi.jetson-ai-lab.dev/jp6/cu128",
            "PIP_TRUSTED_HOST=",
            "TWINE_REPOSITORY_URL=http://alice:3141/jp6/cu128",
            "TWINE_USERNAME=jp6",
            "TWINE_PASSWORD=NvidiaJetson24",
            "SCP_UPLOAD_URL=jao-51:/dist/jp6/cu128/24.04",
            "SCP_UPLOAD_USER=nvidia",
            "SCP_UPLOAD_PASS=nvidia",
            "CUDA_HOME=/usr/local/cuda",
            "NVCC_PATH=/usr/local/cuda/bin/nvcc",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=all",
            "CUDAARCHS=87",
            "CUDA_ARCHITECTURES=87",
            "CUDNN_LIB_PATH=/usr/lib/aarch64-linux-gnu",
            "CUDNN_LIB_INCLUDE_PATH=/usr/include",
            "CMAKE_CUDA_COMPILER=/usr/local/cuda/bin/nvcc",
            "CUDA_NVCC_EXECUTABLE=/usr/local/cuda/bin/nvcc",
            "CUDACXX=/usr/local/cuda/bin/nvcc",
            "TORCH_NVCC_FLAGS=-Xfatbin -compress-all",
            "CUDA_BIN_PATH=/usr/local/cuda/bin",
            "CUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda",
            "LD_LIBRARY_PATH=/usr/local/cuda/compat:/usr/local/cuda/lib64:",
            "PYTHON_VERSION=3.12",
            "PYTHONFAULTHANDLER=1",
            "PYTHONUNBUFFERED=1",
            "PYTHONIOENCODING=utf-8",
            "PYTHONHASHSEED=random",
            "PIP_NO_CACHE_DIR=true",
            "PIP_CACHE_PURGE=true",
            "PIP_ROOT_USER_ACTION=ignore",
            "PIP_DISABLE_PIP_VERSION_CHECK=on",
            "PIP_DEFAULT_TIMEOUT=100",
            "PIP_WHEEL_DIR=/opt/wheels",
            "PIP_VERBOSE=3",
            "TWINE_NON_INTERACTIVE=1",
            "OPENBLAS_CORETYPE=ARMV8",
            "NUMPY_PACKAGE=numpy",
            "NUMPY_VERSION_MAJOR=2",
            "TORCH_CUDA_ARCH_LIST=8.7",
            "TORCH_HOME=/data/models/torch",
            "TRANSFORMERS_CACHE=/data/models/huggingface",
            "HUGGINGFACE_HUB_CACHE=/data/models/huggingface",
            "HF_HOME=/data/models/huggingface",
            "TRANSFORMERS_PACKAGE=transformers==4.50.3",
            "TRANSFORMERS_VERSION=4.50.3",
            "XFORMERS_FORCE_DISABLE_TRITON=1"
        ],
        "Cmd": [
            "/bin/bash"
        ],
        "Image": "sha256:e2661b17013635a18101958dd169c992b2edd9d4c78f2e6497dcffdfb8cc8adc",
        "Volumes": null,
        "WorkingDir": "/",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "24.04"
        }
    },
    "Architecture": "arm64",
    "Variant": "v8",
    "Os": "linux",
    "Size": 13239878344,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/72fcbc3bf0a362afa0af2daf7b84c2024ffcf1dcb2941043e5e5f2a11e149412/diff:/var/lib/docker/overlay2/e41dfe722119d2251706b65d53cf7878b093089b8e16532816e448877b0cd322/diff:/var/lib/docker/overlay2/d35d7144eb49ee43e848ce49e3fe63cefbb7365d6b853d6e0d21c7dc22d5bdbc/diff:/var/lib/docker/overlay2/66f6cd560e3281171611d656915863b580a2173a3e8eafe5d48c0f8e5aea8665/diff:/var/lib/docker/overlay2/9861f3e6e4077809d5359bcfe73e4b5eb0ae3acca1fcc05d595e0f98bbac5aa4/diff:/var/lib/docker/overlay2/246183d7a22f4d584759dd08ad0f7a9cb9f7b6480bbcaa3701992ea300902127/diff:/var/lib/docker/overlay2/7ce1adf4373e746047afbc149b04fc42528c044cb4aeadf970ff5bc4b4d0be7d/diff:/var/lib/docker/overlay2/515c5493608a4e1945f44de544c6538faab0ebda259c7fb9a82a467947814c9f/diff:/var/lib/docker/overlay2/7031987f131e99c34220aa797383a4894b207d4f3ac2327a37d0059169c804fd/diff:/var/lib/docker/overlay2/6616f768d738e7842da1223223d0d95b6d0ce5282b6bbbaf3fb050937b116012/diff:/var/lib/docker/overlay2/795fa0d075bfb2333fe21650148e2ecf7d57f81c3fddee11757fade947ab3716/diff:/var/lib/docker/overlay2/274dabe2ffa22c426af1da30c2ccf8d1d2b7b3f8f08579d57696bfc2f9838621/diff:/var/lib/docker/overlay2/1c0d5e2b0c152a8c161c3b064c5d8a1d1867fa841991c6e0deca0d8e7cd67d00/diff:/var/lib/docker/overlay2/b6bb139c334e89787e7b88b7e588e7d0f0b06c137f631d0b68c6ba3cc22f36db/diff:/var/lib/docker/overlay2/3bb0f09ccbbf8e28a295f8b473334134f3dade5dd88278af547e8b25042544b7/diff:/var/lib/docker/overlay2/7f3e3dfdfac846d183f2cbda5fb6bfa679e4e4ed15f73c4d15e6bce5c6aa0157/diff:/var/lib/docker/overlay2/c526deaca41eb74ce198e8a670f4d2fa6d9ff2244a98eda52995e49755d12c55/diff:/var/lib/docker/overlay2/6a2edbe8d32f2c78b31b84fed08ecd8d691413b9beb9c522ba65d984fd7d0f3c/diff:/var/lib/docker/overlay2/c65245538cab1397619d3fe83a64afc4dcc648344bc2765f7b28a6a3ad07e1fa/diff:/var/lib/docker/overlay2/b5e1b32dffaff2b1dd24079fce23e6af77dde616b96e8e91fc602a808aa600fd/diff:/var/lib/docker/overlay2/308f887b47e590a0ead833377132aebf49353348131e71fc21e04cb3a55587e8/diff:/var/lib/docker/overlay2/bfe75cb29aabe8bbcef24ea18f88ebc8a8d3a865f502bcc0116ac87734dfd508/diff:/var/lib/docker/overlay2/a3b12470b0260b2a6fc6e86d8115c5dcb4641daff8b695cc8fb32eb6a991b033/diff:/var/lib/docker/overlay2/234b5e7ac9afc4556ea31b1d05da053684ee8cce6a0c035afca95a99337ec8f0/diff:/var/lib/docker/overlay2/e07d3523f9c714b0ad64e6fb68a137a9fee34f157e4f877a339a032c48b33c27/diff:/var/lib/docker/overlay2/2797d462caf823db757c265921442969892d5598c311dcfd1f69163e63b494db/diff:/var/lib/docker/overlay2/712b9c5f7411131617a5e1547c3d2e079980a29517bc92f9446dd76df7451c28/diff:/var/lib/docker/overlay2/357cd93737d194548a946ffd9faa1f5b32db0b3450927801200ec5a1ea8f7ab6/diff:/var/lib/docker/overlay2/7df3c3edab430e3251fd352c0cde04ce839827fbfcedb19d11ffef0330cf61ef/diff:/var/lib/docker/overlay2/539ce75394efe261c4ae2c7939e3d8a8ff144d5c3d6915de19eb7674053902be/diff:/var/lib/docker/overlay2/2dbe6b5dc8f94f0a2a13979bf4996344fe64617d9eea6b95b4702838bff8a476/diff:/var/lib/docker/overlay2/93278da299828cb5e26a9abcfee5c0d22787a3db5d8405242b1e423086ff84ec/diff:/var/lib/docker/overlay2/6f321bce79fdd881e1ca1cd02607409fd64afb0aaf0c05c109694a106eb4a830/diff:/var/lib/docker/overlay2/e910e8d8f4b9b53ef3ad7a866caf8c69e9d2d3d232ea4e80a87a802199510997/diff:/var/lib/docker/overlay2/98e233c3470c6d710b7ad0fa42226f324f9509d7a51a440b8dffdfcbbf910fc1/diff:/var/lib/docker/overlay2/dd68fd059d882d4c1a4fdfb9207a8f43281ce48a4bff03944b96f7fe7c0cda8f/diff:/var/lib/docker/overlay2/945eb073f4637f6efe747bee5802afbf23446e0ac19567e0ed468b68f3a03cb4/diff:/var/lib/docker/overlay2/f229c5130134acde3c22b3c2e0de5227e58f3b8d6b958468301308990d6f40ba/diff:/var/lib/docker/overlay2/3d14651860b3ddcacc0b304569dbed053ca0b6182013ae1a51afb0f67f86f206/diff:/var/lib/docker/overlay2/cc7bca317803d67d6057bd21052b3dd69235259d676b8bef6432b4cf4f2eb3fc/diff:/var/lib/docker/overlay2/d408247160fa04c092f077af206107b26d2b60f70ac79f6b8be665499ffa57f2/diff",
            "MergedDir": "/var/lib/docker/overlay2/d6eef28c99d8d0b44ba179d36dac1e987c02090f4b7e972d43bbc34ac39d3a3d/merged",
            "UpperDir": "/var/lib/docker/overlay2/d6eef28c99d8d0b44ba179d36dac1e987c02090f4b7e972d43bbc34ac39d3a3d/diff",
            "WorkDir": "/var/lib/docker/overlay2/d6eef28c99d8d0b44ba179d36dac1e987c02090f4b7e972d43bbc34ac39d3a3d/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:375990b2a90a8d8f332d9b9422d948f7068a3313bf5a1c9fbb91ff2d29046130",
            "sha256:8c1a22a88c5d70b43f35ee0a1ddf4f0b524cae6a7c8eb9d7feede3adaafc6008",
            "sha256:48584a9e90db226503224ab65bf1f920f81d9b1bfa4c27616f1563ff8f5b22c0",
            "sha256:051c06e5989b552bf91b4604ad8ca063822c3c7969256a246bb0c4ed14da9269",
            "sha256:91fdd813c021eb90ff10b7f4c725ab1d8f28aa07455d0ed10a4c293e7e86315e",
            "sha256:58a72f4979402db68f791ae0e9445f682d8a63f98615071a5e08b9b59add8f2c",
            "sha256:d151d7847126c0d34c083be94443389c51337e2177eb4c0398f7c29bf217dcd4",
            "sha256:5fabed6cf566b1d483ca80a82743aee82d95b07eb667ee7cd45e67069fbe1e01",
            "sha256:70f674f201b63daaedd6e23024f15c4de2cb21f5c6dfbf9f4fba87f29653f5c7",
            "sha256:661b33d5613f0f8dba3aa0b04741dddc1a6c2dbb703fa76a7ef589b5183b41ec",
            "sha256:61a8ada42f4d40ca90e244dfb50a9e526b5f746c17ae7fb00a4abce3345fdc45",
            "sha256:faf3744d149b446c890db3337b0009a6a3ae39de2cfeb3ed00fedc7cc59b60b4",
            "sha256:c24cd66701444672dfc34f28f6b547308c535d14ef617074ddfb97835aa257f9",
            "sha256:85973a615324d826eb272249dd1f60d15854e4bc34f44557f2964657bc6a922c",
            "sha256:b4cb308110f6af000eda7551691bcf8335e5dc46cbb1b3aabd1bdbf3b19c60c9",
            "sha256:7e252de0ee59b404fe6a0675fd53ab34500b14f0349a7000abb9bf8966d75645",
            "sha256:e2419c6c6e289f35a75308b4d2d40980a030fe02d4a2be605fdd9f9048ad22ab",
            "sha256:83e555b7191ddce263ff143444088786736fe91491ff23a5bc45688461691d6c",
            "sha256:7eba35966c328e0e2157b252f4119fa6ae602f3550e5dad61e633983953b3048",
            "sha256:0a6948e880826a02c8d5ef3233efa93b37be267ac70b12dd168951588004f5da",
            "sha256:8b9be5645f778933c5635b8e6e9094ad53204aef737d2cc55ec36223cfa82060",
            "sha256:1c529d93e28af48f3e0c0b9543551527e3e12071d1347d360a43c292db4682e7",
            "sha256:19fabaae6e2d27c8098f4477232b04a606ec6350e86def5a88383408af6610ee",
            "sha256:92ee569d96c5233314ad66a869b53cf8f736b37efa755ed6b529f12c0d5866d2",
            "sha256:f8b156be50fb1e0f5a1392cc2692396c8b58dfcf34683ed25073890d6746d4bd",
            "sha256:ebe6607c0b2c65138d0c92df14ac45598238565993ea0f625a3ec5753b36d02a",
            "sha256:1ee6df2b03d2fd3304e7807d12438db732ebfedfa95a756357c1f4afe811aeeb",
            "sha256:58f704be5bac3c795b56ed8133158d8a3923bdb88d643e4741155a4225da52ea",
            "sha256:1603aee7781ffc9e973b605b79e2a41512f3de1aa73e022322396808c82e12c7",
            "sha256:5321c520648dba9f335019b69f81c1869f43c1a260966d1aab080b84bc9640ae",
            "sha256:b7a5e1c4e56693a1eb23d77577e21bc7c55882ed8fe2c535a7655233843742c6",
            "sha256:2602185d5f30151fb5267f1696e823c06f14d1c2e022afbf6937cad1d162fb8c",
            "sha256:52de2d45f20e92dd6282a39cdce0a0bb559f781bd4221014ef63542f26a6e3a4",
            "sha256:1bb1402425bfb9ee628268fb9b589ab035d14531a9f014e094c47f1c794f9266",
            "sha256:99199a53b8216021d0a960ecc73bed9e72dae4d9ad69aab7bab5e2aa6a9d3ce4",
            "sha256:8ab11eec13af6b0d2673f3d9076b89b19b73e9ab8d0790411f734019211d496c",
            "sha256:6acdba101f1d8742d57ecf19e734e01cc3aa1be11d7629bddb691a6ba6b97318",
            "sha256:1c005ccd832c6e25f3fe308bb604bd0e9c1334e70ac8518ee636280d75dc0269",
            "sha256:7bfc2dd3664f4272ca472bdcef5e8153fe51dd4e1f7e761fa6ada6087d0e18ea",
            "sha256:8c8f1e5c6d792c73bda2d1822c4b123626dcb75cbfba124ddff77d64dc394419",
            "sha256:42abd79a8472f50cb30af0c3982cafebe5a02a3a4b1943e09e987b56d66b2540",
            "sha256:30798ba9ae358a157845c8eb8eb9b7a0b473942077bef5e322b0456d047eae7f"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-12-05T01:14:45.585957754+08:00"
    }
}

更多版本

docker.io/dustynv/vllm:0.7.4-r36.4.0-cu128-24.04

linux/arm64 docker.io13.67GB2025-04-02 11:14
1641

docker.io/dustynv/vllm:r36.4-cu129-24.04

linux/arm64 docker.io17.50GB2025-09-06 02:23
289

docker.io/dustynv/vllm:0.9.2-r36.4-cu128-24.04

linux/arm64 docker.io15.03GB2025-10-15 17:13
194

docker.io/dustynv/vllm:0.8.6-r36.4-cu128-24.04

linux/arm64 docker.io14.97GB2025-10-15 17:34
167

docker.io/dustynv/vllm:0.8.3-r36.4.0-cu128-24.04

linux/arm64 docker.io13.24GB2025-12-05 01:28
8