quay.io/ascend/vllm-ascend:v0.9.0rc2 linux/arm64

quay.io/ascend/vllm-ascend:v0.9.0rc2 - 国内下载镜像源 浏览次数:83 温馨提示: 这是一个 linux/arm64 系统架构镜像

quay.io/ascend/vllm-ascend 镜像描述

这是一个基于昇腾AI处理器的VLLM (Versatile Large Language Model) 镜像。它允许在昇腾硬件上运行大型语言模型,提供高效的推理能力。

源镜像 quay.io/ascend/vllm-ascend:v0.9.0rc2
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64
镜像ID sha256:afb81789b46028332ea98a4038260cc0b12327a7c081d29776dedf2151058ca5
镜像TAG v0.9.0rc2-linuxarm64
大小 14.31GB
镜像源 quay.io
CMD /bin/bash
启动入口 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh && source /usr/local/Ascend/nnal/atb/set_env.sh && exec "$@" --
工作目录 /workspace
OS/平台 linux/arm64
浏览量 83 次
贡献者
镜像创建 2025-06-10T15:10:39.104228276Z
同步时间 2025-06-14 04:57
更新时间 2025-06-21 20:04
环境变量
PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/usr/local/python3.10.17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ASCEND_TOOLKIT_HOME=/usr/local/Ascend/ascend-toolkit/latest LD_LIBRARY_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling:/usr/local/Ascend/driver/lib64/common/:/usr/local/Ascend/driver/lib64/driver/: PYTHONPATH=/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe: ASCEND_AICPU_PATH=/usr/local/Ascend/ascend-toolkit/latest ASCEND_OPP_PATH=/usr/local/Ascend/ascend-toolkit/latest/opp TOOLCHAIN_HOME=/usr/local/Ascend/ascend-toolkit/latest/toolkit ASCEND_HOME_PATH=/usr/local/Ascend/ascend-toolkit/latest ATB_HOME_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0 ATB_STREAM_SYNC_EVERY_KERNEL_ENABLE=0 ATB_STREAM_SYNC_EVERY_RUNNER_ENABLE=0 ATB_STREAM_SYNC_EVERY_OPERATION_ENABLE=0 ATB_OPSRUNNER_SETUP_CACHE_ENABLE=1 ATB_OPSRUNNER_KERNEL_CACHE_TYPE=3 ATB_OPSRUNNER_KERNEL_CACHE_LOCAL_COUNT=1 ATB_OPSRUNNER_KERNEL_CACHE_GLOABL_COUNT=5 ATB_OPSRUNNER_KERNEL_CACHE_TILING_SIZE=10240 ATB_WORKSPACE_MEM_ALLOC_ALG_TYPE=1 ATB_WORKSPACE_MEM_ALLOC_GLOBAL=0 ATB_COMPARE_TILING_EVERY_KERNEL=0 ATB_HOST_TILING_BUFFER_BLOCK_NUM=128 ATB_DEVICE_TILING_BUFFER_BLOCK_NUM=32 ATB_SHARE_MEMORY_NAME_SUFFIX= ATB_LAUNCH_KERNEL_WITH_TILING=1 ATB_MATMUL_SHUFFLE_K_ENABLE=1 ATB_RUNNER_POOL_SIZE=64 ASDOPS_HOME_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0 ASDOPS_MATMUL_PP_FLAG=1 ASDOPS_LOG_LEVEL=ERROR ASDOPS_LOG_TO_STDOUT=0 ASDOPS_LOG_TO_FILE=1 ASDOPS_LOG_TO_FILE_FLUSH=0 ASDOPS_LOG_TO_BOOST_TYPE=atb ASDOPS_LOG_PATH=/root ASDOPS_TILING_PARSE_CACHE_DISABLE=0 LCCL_DETERMINISTIC=0 LCCL_PARALLEL=0 DEBIAN_FRONTEND=noninteractive COMPILE_CUSTOM_KERNELS=1
镜像标签
2025-06-10T14:29:21.961Z: org.opencontainers.image.created Community maintained hardware plugin for vLLM on Ascend: org.opencontainers.image.description Apache-2.0: org.opencontainers.image.licenses ubuntu: org.opencontainers.image.ref.name 8dd686dfa20d8f577cd63fb751ce0a7a98f2f516: org.opencontainers.image.revision https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.source vllm-ascend: org.opencontainers.image.title https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.url v0.9.0rc2: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.9.0rc2

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.9.0rc2

Shell快速替换命令

sed -i 's#quay.io/ascend/vllm-ascend:v0.9.0rc2#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.9.0rc2'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.9.0rc2'

镜像构建历史


# 2025-06-10 23:10:39  0.00B 设置默认要执行的命令
CMD ["/bin/bash"]
                        
# 2025-06-10 23:10:39  220.60MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.9.0 /bin/bash -c python3 -m pip install modelscope ray &&     python3 -m pip cache purge # buildkit
                        
# 2025-06-10 23:08:22  816.14MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.9.0 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh &&     source /usr/local/Ascend/nnal/atb/set_env.sh &&     export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/Ascend/ascend-toolkit/latest/`uname -i`-linux/devlib &&     python3 -m pip install -v -e /vllm-workspace/vllm-ascend/ --extra-index https://download.pytorch.org/whl/cpu/ &&     python3 -m pip cache purge # buildkit
                        
# 2025-06-10 22:49:27  909.31MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.9.0 /bin/bash -c VLLM_TARGET_DEVICE="empty" python3 -m pip install -v -e /vllm-workspace/vllm/ --extra-index https://download.pytorch.org/whl/cpu/ &&     python3 -m pip uninstall -y triton &&     python3 -m pip cache purge # buildkit
                        
# 2025-06-10 22:36:49  35.60MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.9.0 /bin/bash -c git clone --depth 1 $VLLM_REPO --branch $VLLM_TAG /vllm-workspace/vllm # buildkit
                        
# 2025-06-10 22:36:45  0.00B 定义构建参数
ARG VLLM_TAG=v0.9.0
                        
# 2025-06-10 22:36:45  0.00B 定义构建参数
ARG VLLM_REPO=https://github.com/vllm-project/vllm.git
                        
# 2025-06-10 22:36:45  46.00B 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 /bin/bash -c pip config set global.index-url ${PIP_INDEX_URL} # buildkit
                        
# 2025-06-10 22:36:42  2.86MB 复制新文件或目录到容器中
COPY . /vllm-workspace/vllm-ascend/ # buildkit
                        
# 2025-06-10 22:36:42  0.00B 设置工作目录为/workspace
WORKDIR /workspace
                        
# 2025-06-10 22:36:41  183.08MB 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 /bin/bash -c apt-get update -y &&     apt-get install -y python3-pip git vim wget net-tools gcc g++ cmake libnuma-dev &&     rm -rf /var/cache/apt/* &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-06-10 22:36:41  0.00B 设置环境变量 COMPILE_CUSTOM_KERNELS
ENV COMPILE_CUSTOM_KERNELS=1
                        
# 2025-06-10 22:36:41  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2025-06-10 22:36:41  0.00B 定义构建参数
ARG COMPILE_CUSTOM_KERNELS=1
                        
# 2025-06-10 22:36:41  0.00B 定义构建参数
ARG PIP_INDEX_URL=https://pypi.org/simple
                        
# 2025-05-08 15:39:56  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/bin/bash" "-c" "    source /usr/local/Ascend/ascend-toolkit/set_env.sh &&     source /usr/local/Ascend/nnal/atb/set_env.sh &&     exec \"$@\"" "--"]
                        
# 2025-05-08 15:39:56  3.88KB 执行命令并创建新的镜像层
RUN /bin/bash -c CANN_TOOLKIT_ENV_FILE="/usr/local/Ascend/ascend-toolkit/set_env.sh" &&     CANN_NNAL_ENV_FILE="/usr/local/Ascend/nnal/atb/set_env.sh" &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> /etc/profile &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> ~/.bashrc &&     echo "source ${CANN_NNAL_ENV_FILE}" >> /etc/profile &&     echo "source ${CANN_NNAL_ENV_FILE}" >> ~/.bashrc # buildkit
                        
# 2025-05-08 15:39:56  84.00B 复制新文件或目录到容器中
COPY /etc/Ascend /etc/Ascend # buildkit
                        
# 2025-05-08 15:39:54  11.34GB 复制新文件或目录到容器中
COPY /usr/local/Ascend /usr/local/Ascend # buildkit
                        
# 2025-05-08 15:37:35  460.23MB 复制新文件或目录到容器中
COPY /usr/local/python3.10.17 /usr/local/python3.10.17 # buildkit
                        
# 2025-05-08 15:17:22  267.93MB 执行命令并创建新的镜像层
RUN /bin/bash -c apt-get update     && DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y         apt-transport-https         ca-certificates         bash         libc6         libsqlite3-dev         gcc         g++         make         cmake     && apt-get clean     && rm -rf /var/lib/apt/lists/*     && rm -rf /var/tmp/*     && rm -rf /tmp/* # buildkit
                        
# 2025-05-08 15:17:22  0.00B 
SHELL [/bin/bash -c]
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 LCCL_PARALLEL
ENV LCCL_PARALLEL=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 LCCL_DETERMINISTIC
ENV LCCL_DETERMINISTIC=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_TILING_PARSE_CACHE_DISABLE
ENV ASDOPS_TILING_PARSE_CACHE_DISABLE=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_LOG_PATH
ENV ASDOPS_LOG_PATH=/root
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_LOG_TO_BOOST_TYPE
ENV ASDOPS_LOG_TO_BOOST_TYPE=atb
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_LOG_TO_FILE_FLUSH
ENV ASDOPS_LOG_TO_FILE_FLUSH=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_LOG_TO_FILE
ENV ASDOPS_LOG_TO_FILE=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_LOG_TO_STDOUT
ENV ASDOPS_LOG_TO_STDOUT=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_LOG_LEVEL
ENV ASDOPS_LOG_LEVEL=ERROR
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_MATMUL_PP_FLAG
ENV ASDOPS_MATMUL_PP_FLAG=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASDOPS_HOME_PATH
ENV ASDOPS_HOME_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_RUNNER_POOL_SIZE
ENV ATB_RUNNER_POOL_SIZE=64
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_MATMUL_SHUFFLE_K_ENABLE
ENV ATB_MATMUL_SHUFFLE_K_ENABLE=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_LAUNCH_KERNEL_WITH_TILING
ENV ATB_LAUNCH_KERNEL_WITH_TILING=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_SHARE_MEMORY_NAME_SUFFIX
ENV ATB_SHARE_MEMORY_NAME_SUFFIX=
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_DEVICE_TILING_BUFFER_BLOCK_NUM
ENV ATB_DEVICE_TILING_BUFFER_BLOCK_NUM=32
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_HOST_TILING_BUFFER_BLOCK_NUM
ENV ATB_HOST_TILING_BUFFER_BLOCK_NUM=128
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_COMPARE_TILING_EVERY_KERNEL
ENV ATB_COMPARE_TILING_EVERY_KERNEL=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_WORKSPACE_MEM_ALLOC_GLOBAL
ENV ATB_WORKSPACE_MEM_ALLOC_GLOBAL=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_WORKSPACE_MEM_ALLOC_ALG_TYPE
ENV ATB_WORKSPACE_MEM_ALLOC_ALG_TYPE=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_OPSRUNNER_KERNEL_CACHE_TILING_SIZE
ENV ATB_OPSRUNNER_KERNEL_CACHE_TILING_SIZE=10240
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_OPSRUNNER_KERNEL_CACHE_GLOABL_COUNT
ENV ATB_OPSRUNNER_KERNEL_CACHE_GLOABL_COUNT=5
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_OPSRUNNER_KERNEL_CACHE_LOCAL_COUNT
ENV ATB_OPSRUNNER_KERNEL_CACHE_LOCAL_COUNT=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_OPSRUNNER_KERNEL_CACHE_TYPE
ENV ATB_OPSRUNNER_KERNEL_CACHE_TYPE=3
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_OPSRUNNER_SETUP_CACHE_ENABLE
ENV ATB_OPSRUNNER_SETUP_CACHE_ENABLE=1
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_STREAM_SYNC_EVERY_OPERATION_ENABLE
ENV ATB_STREAM_SYNC_EVERY_OPERATION_ENABLE=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_STREAM_SYNC_EVERY_RUNNER_ENABLE
ENV ATB_STREAM_SYNC_EVERY_RUNNER_ENABLE=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_STREAM_SYNC_EVERY_KERNEL_ENABLE
ENV ATB_STREAM_SYNC_EVERY_KERNEL_ENABLE=0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/usr/local/python3.10.17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling:/usr/local/Ascend/driver/lib64/common/:/usr/local/Ascend/driver/lib64/driver/:
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ATB_HOME_PATH
ENV ATB_HOME_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASCEND_HOME_PATH
ENV ASCEND_HOME_PATH=/usr/local/Ascend/ascend-toolkit/latest
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 TOOLCHAIN_HOME
ENV TOOLCHAIN_HOME=/usr/local/Ascend/ascend-toolkit/latest/toolkit
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASCEND_OPP_PATH
ENV ASCEND_OPP_PATH=/usr/local/Ascend/ascend-toolkit/latest/opp
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASCEND_AICPU_PATH
ENV ASCEND_AICPU_PATH=/usr/local/Ascend/ascend-toolkit/latest
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/usr/local/python3.10.17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 PYTHONPATH
ENV PYTHONPATH=/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe:
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling:/usr/local/Ascend/driver/lib64/common/:/usr/local/Ascend/driver/lib64/driver/:
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling:/usr/local/Ascend/driver/lib64/common/:/usr/local/Ascend/driver/lib64/driver/:
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common/:/usr/local/Ascend/driver/lib64/driver/:
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 ASCEND_TOOLKIT_HOME
ENV ASCEND_TOOLKIT_HOME=/usr/local/Ascend/ascend-toolkit/latest
                        
# 2025-05-08 15:17:22  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/python3.10.17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-04-28 17:46:30  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-04-28 17:46:30  69.22MB 
/bin/sh -c #(nop) ADD file:da80d592df77a4ddbc2c4267be13e1ead72bc1d7f4535f967c511ae736520d7a in / 
                        
# 2025-04-28 17:46:27  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2025-04-28 17:46:27  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-04-28 17:46:27  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-04-28 17:46:27  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:afb81789b46028332ea98a4038260cc0b12327a7c081d29776dedf2151058ca5",
    "RepoTags": [
        "quay.io/ascend/vllm-ascend:v0.9.0rc2",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.9.0rc2-linuxarm64"
    ],
    "RepoDigests": [
        "quay.io/ascend/vllm-ascend@sha256:3267068692259c657d057c51053794cc29c07eb889a72fc7783dc02a87940ca9",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend@sha256:5136be207b82b7bbefa9a50b56e7e23bd4e4f3de431d3b677d1cb4ba7b60d0fb"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-06-10T15:10:39.104228276Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/bin:/usr/local/Ascend/ascend-toolkit/latest/bin:/usr/local/Ascend/ascend-toolkit/latest/compiler/ccec_compiler/bin:/usr/local/Ascend/ascend-toolkit/latest/tools/ccec_compiler/bin:/usr/local/python3.10.17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "ASCEND_TOOLKIT_HOME=/usr/local/Ascend/ascend-toolkit/latest",
            "LD_LIBRARY_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/nnengine:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling:/usr/local/Ascend/driver/lib64/common/:/usr/local/Ascend/driver/lib64/driver/:",
            "PYTHONPATH=/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe:",
            "ASCEND_AICPU_PATH=/usr/local/Ascend/ascend-toolkit/latest",
            "ASCEND_OPP_PATH=/usr/local/Ascend/ascend-toolkit/latest/opp",
            "TOOLCHAIN_HOME=/usr/local/Ascend/ascend-toolkit/latest/toolkit",
            "ASCEND_HOME_PATH=/usr/local/Ascend/ascend-toolkit/latest",
            "ATB_HOME_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0",
            "ATB_STREAM_SYNC_EVERY_KERNEL_ENABLE=0",
            "ATB_STREAM_SYNC_EVERY_RUNNER_ENABLE=0",
            "ATB_STREAM_SYNC_EVERY_OPERATION_ENABLE=0",
            "ATB_OPSRUNNER_SETUP_CACHE_ENABLE=1",
            "ATB_OPSRUNNER_KERNEL_CACHE_TYPE=3",
            "ATB_OPSRUNNER_KERNEL_CACHE_LOCAL_COUNT=1",
            "ATB_OPSRUNNER_KERNEL_CACHE_GLOABL_COUNT=5",
            "ATB_OPSRUNNER_KERNEL_CACHE_TILING_SIZE=10240",
            "ATB_WORKSPACE_MEM_ALLOC_ALG_TYPE=1",
            "ATB_WORKSPACE_MEM_ALLOC_GLOBAL=0",
            "ATB_COMPARE_TILING_EVERY_KERNEL=0",
            "ATB_HOST_TILING_BUFFER_BLOCK_NUM=128",
            "ATB_DEVICE_TILING_BUFFER_BLOCK_NUM=32",
            "ATB_SHARE_MEMORY_NAME_SUFFIX=",
            "ATB_LAUNCH_KERNEL_WITH_TILING=1",
            "ATB_MATMUL_SHUFFLE_K_ENABLE=1",
            "ATB_RUNNER_POOL_SIZE=64",
            "ASDOPS_HOME_PATH=/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0",
            "ASDOPS_MATMUL_PP_FLAG=1",
            "ASDOPS_LOG_LEVEL=ERROR",
            "ASDOPS_LOG_TO_STDOUT=0",
            "ASDOPS_LOG_TO_FILE=1",
            "ASDOPS_LOG_TO_FILE_FLUSH=0",
            "ASDOPS_LOG_TO_BOOST_TYPE=atb",
            "ASDOPS_LOG_PATH=/root",
            "ASDOPS_TILING_PARSE_CACHE_DISABLE=0",
            "LCCL_DETERMINISTIC=0",
            "LCCL_PARALLEL=0",
            "DEBIAN_FRONTEND=noninteractive",
            "COMPILE_CUSTOM_KERNELS=1"
        ],
        "Cmd": [
            "/bin/bash"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/workspace",
        "Entrypoint": [
            "/bin/bash",
            "-c",
            "    source /usr/local/Ascend/ascend-toolkit/set_env.sh \u0026\u0026     source /usr/local/Ascend/nnal/atb/set_env.sh \u0026\u0026     exec \"$@\"",
            "--"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2025-06-10T14:29:21.961Z",
            "org.opencontainers.image.description": "Community maintained hardware plugin for vLLM on Ascend",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "8dd686dfa20d8f577cd63fb751ce0a7a98f2f516",
            "org.opencontainers.image.source": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.title": "vllm-ascend",
            "org.opencontainers.image.url": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.version": "v0.9.0rc2"
        },
        "Shell": [
            "/bin/bash",
            "-c"
        ]
    },
    "Architecture": "arm64",
    "Os": "linux",
    "Size": 14308247583,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/d3669d223ab18926d964dd0b1917e5ae4316b8182fd7c99a317f1efb0152ff6f/diff:/var/lib/docker/overlay2/68b5ab87205c51080d4876f8fc2442dccde5d8e29b17d6483f610052a443052d/diff:/var/lib/docker/overlay2/1bf361325b265471fe1cc5967a00c5dc7b0349d90257a73517d088a5a09708cd/diff:/var/lib/docker/overlay2/e7c0d0cb3eac319eac29e30cc5e24f8a9517020acca858fe54669ff97660253c/diff:/var/lib/docker/overlay2/dcfce3b7175c47f3b77967807d6385e63da6384a8d9e44599974f263e3ec99d8/diff:/var/lib/docker/overlay2/ec082c98bc583a7b4e53f3255109971891298e36690323e67a3a7aa611042e2e/diff:/var/lib/docker/overlay2/74decef51308319439f9d755936ba458486db81be7fb3c65905a3e126752cdfe/diff:/var/lib/docker/overlay2/5f77b57f8841431365468fb669ada3d68a7a3d3531d85509e4e4fa909d820e24/diff:/var/lib/docker/overlay2/1b0792009a6232f60f6de659ddc077aeef97ccd3ff639895b90cd4f0a62d766c/diff:/var/lib/docker/overlay2/3682fb3aca4d617a1801fb38421bf22722ee6366e55b83a8c02b928b002e13a1/diff:/var/lib/docker/overlay2/fa3803642e7752ae1fcbc33c5fa7c22e0252b3bea6867a890b8c9dcdc551eeb5/diff:/var/lib/docker/overlay2/5a0b8c391ba67569c515cb6a31cca33ef6e8968ad4be4595e5b6f52e07411d25/diff:/var/lib/docker/overlay2/8937e536250b8ed329d247d5f5d777d5ecd7d950800f879faa756b4f0372c58c/diff",
            "MergedDir": "/var/lib/docker/overlay2/5858ab5f14e5fe9b94098d7d4ffb9b895f8c4be513e251aa56b6f3fa367a9d87/merged",
            "UpperDir": "/var/lib/docker/overlay2/5858ab5f14e5fe9b94098d7d4ffb9b895f8c4be513e251aa56b6f3fa367a9d87/diff",
            "WorkDir": "/var/lib/docker/overlay2/5858ab5f14e5fe9b94098d7d4ffb9b895f8c4be513e251aa56b6f3fa367a9d87/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:ddef33168f8d117dc0fddabd486cf6f542853f3aa8cfe919c8de02871827f5aa",
            "sha256:d6cbab2f8837cc6a2fe15581701aa43ffd502ae689257303ea5cb87f9cdfb971",
            "sha256:12cc03b1589e3f99f31be4ab3ee077665efcd8073cd428df1a8023966b6dfe2e",
            "sha256:dbce487f50eb1ecfb604dac60367bc4a351a2fc056a8f517ae946523e6730aa2",
            "sha256:394e73a5573e0b79d6c5cd99021b1d03c3fe20f85258aea8d3356ab1e6dd921f",
            "sha256:f547258e38c3c4e63372be71407d9c3980ad6d660db99d5646a4967bc9f5e933",
            "sha256:db8ea043253320f6565c7caf575dd676e37903e25e53e99c53ba21c573f9d9dd",
            "sha256:450d4dfae0df730e7ad921cf00b2e4c3ffd893b983a02806f4a4cad9ace074ca",
            "sha256:9b8e74d00bd025b3d90927ce3bf8feae26165a73808aef69248991c7352774fc",
            "sha256:6e4a0798346a5373cc730c337375dee3547526d70c1d47f4894dc74ab82727b6",
            "sha256:e2d24cbc15bfea83a759d70f5ff2b5cdd55490f8ddd6496a197bf9d996093249",
            "sha256:6510e7ebfdfd030bb2f41c9c7f47d9e97626992779a1cc87bd85feed8b33e482",
            "sha256:1c3b0e0ac772b84a9c97bcdad8367cfdf0a7c2aa788fab47fc3c059483139975",
            "sha256:f64c8569656003a75d5a47001f4083565a0bd7330d3b529a9679b1cd3b2dfb42"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-06-14T04:55:49.271139358+08:00"
    }
}

更多版本

quay.io/ascend/vllm-ascend:v0.7.1rc1

linux/arm64 quay.io13.39GB2025-03-06 15:00
496

quay.io/ascend/vllm-ascend:v0.7.3rc2

linux/arm64 quay.io13.95GB2025-03-30 00:19
317

quay.io/ascend/vllm-ascend:v0.7.3rc1

linux/arm64 quay.io13.93GB2025-03-30 00:26
128

quay.io/ascend/vllm-ascend:v0.8.4rc1

linux/amd64 quay.io16.00GB2025-04-22 00:37
250

quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler

linux/arm64 quay.io14.63GB2025-04-28 00:52
155

quay.io/ascend/vllm-ascend:v0.8.4rc2-openeuler

linux/arm64 quay.io14.18GB2025-04-29 16:34
403

quay.io/ascend/vllm-ascend:v0.8.4rc2

linux/arm64 quay.io13.74GB2025-05-09 02:57
102

quay.io/ascend/vllm-ascend:v0.8.5rc1-openeuler

linux/arm64 quay.io14.89GB2025-05-09 03:16
376

quay.io/ascend/vllm-ascend:v0.7.3-openeuler

linux/arm64 quay.io14.83GB2025-05-13 01:51
69

quay.io/ascend/vllm-ascend:v0.8.5rc1

linux/amd64 quay.io15.11GB2025-05-14 00:50
208

quay.io/ascend/vllm-ascend:v0.7.3-dev-openeuler

linux/arm64 quay.io14.64GB2025-05-23 15:53
44

quay.io/ascend/vllm-ascend:v0.7.3.post1

linux/amd64 quay.io14.89GB2025-06-03 02:02
93

quay.io/ascend/vllm-ascend:v0.7.3.post1-openeuler

linux/arm64 quay.io14.66GB2025-06-09 00:35
28

quay.io/ascend/vllm-ascend:v0.7.3.post1-openeuler

linux/amd64 quay.io15.30GB2025-06-09 02:12
27

quay.io/ascend/vllm-ascend:v0.9.0rc1-openeuler

linux/arm64 quay.io14.89GB2025-06-10 17:48
135

quay.io/ascend/vllm-ascend:v0.9.0rc2

linux/arm64 quay.io14.31GB2025-06-14 04:57
82