quay.io/ascend/vllm-ascend:v0.8.4rc2 linux/arm64

quay.io/ascend/vllm-ascend:v0.8.4rc2 - 国内下载镜像源 浏览次数:47 温馨提示: 这是一个 linux/arm64 系统架构镜像

quay.io/ascend/vllm-ascend 镜像描述

这是一个基于昇腾AI处理器的VLLM (Versatile Large Language Model) 镜像。它允许在昇腾硬件上运行大型语言模型,提供高效的推理能力。

源镜像 quay.io/ascend/vllm-ascend:v0.8.4rc2
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64
镜像ID sha256:6ac53f9652eaf38b848d1895a2d851c14f5f2ce7684d968d590c64b9bbfc0d92
镜像TAG v0.8.4rc2-linuxarm64
大小 13.74GB
镜像源 quay.io
CMD /bin/bash
启动入口 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh && if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then source /usr/local/Ascend/nnal/atb/set_env.sh; fi && exec "$@" --
工作目录 /root
OS/平台 linux/arm64
浏览量 47 次
贡献者
镜像创建 2025-04-29T14:19:08.921811563Z
同步时间 2025-05-09 02:57
更新时间 2025-05-14 18:04
环境变量
PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver: DEBIAN_FRONTEND=noninteractive COMPILE_CUSTOM_KERNELS=1
镜像标签
2025-04-28T13:58:51.371Z: org.opencontainers.image.created Community maintained hardware plugin for vLLM on Ascend: org.opencontainers.image.description Apache-2.0: org.opencontainers.image.licenses ubuntu: org.opencontainers.image.ref.name 1fce70a2fb2602170781773104a69c69beb16161: org.opencontainers.image.revision https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.source vllm-ascend: org.opencontainers.image.title https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.url v0.8.4rc2: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc2

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc2

Shell快速替换命令

sed -i 's#quay.io/ascend/vllm-ascend:v0.8.4rc2#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc2'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc2'

镜像构建历史


# 2025-04-29 22:19:08  0.00B 设置工作目录为/root
WORKDIR /root
                        
# 2025-04-28 22:42:44  0.00B 设置默认要执行的命令
CMD ["/bin/bash"]
                        
# 2025-04-28 22:42:44  219.61MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c python3 -m pip install modelscope ray &&     python3 -m pip cache purge # buildkit
                        
# 2025-04-28 22:40:33  656.28MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh &&     source /usr/local/Ascend/nnal/atb/set_env.sh &&     export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/Ascend/ascend-toolkit/latest/`uname -i`-linux/devlib &&     python3 -m pip install -v -e /workspace/vllm-ascend/ --extra-index https://download.pytorch.org/whl/cpu/ &&     python3 -m pip cache purge # buildkit
                        
# 2025-04-28 22:21:49  1.15GB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c VLLM_TARGET_DEVICE="empty" python3 -m pip install -v -e /workspace/vllm/ --extra-index https://download.pytorch.org/whl/cpu/ &&     python3 -m pip uninstall -y triton &&     python3 -m pip cache purge # buildkit
                        
# 2025-04-28 22:07:55  29.43MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c git clone --depth 1 $VLLM_REPO --branch $VLLM_TAG /workspace/vllm # buildkit
                        
# 2025-04-28 22:07:51  0.00B 定义构建参数
ARG VLLM_TAG=v0.8.4
                        
# 2025-04-28 22:07:51  0.00B 定义构建参数
ARG VLLM_REPO=https://github.com/vllm-project/vllm.git
                        
# 2025-04-28 22:07:51  46.00B 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 /bin/bash -c pip config set global.index-url ${PIP_INDEX_URL} # buildkit
                        
# 2025-04-28 22:07:48  1.53MB 复制新文件或目录到容器中
COPY . /workspace/vllm-ascend/ # buildkit
                        
# 2025-04-28 22:07:48  0.00B 设置工作目录为/workspace
WORKDIR /workspace
                        
# 2025-04-28 22:07:48  435.41MB 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 /bin/bash -c apt-get update -y &&     apt-get install -y python3-pip git vim wget net-tools gcc g++ cmake libnuma-dev &&     rm -rf /var/cache/apt/* &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-04-28 22:07:48  0.00B 设置环境变量 COMPILE_CUSTOM_KERNELS
ENV COMPILE_CUSTOM_KERNELS=1
                        
# 2025-04-28 22:07:48  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2025-04-28 22:07:48  0.00B 定义构建参数
ARG COMPILE_CUSTOM_KERNELS=1
                        
# 2025-04-28 22:07:48  0.00B 定义构建参数
ARG PIP_INDEX_URL=https://pypi.org/simple
                        
# 2025-03-10 21:05:52  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/bin/bash" "-c" "  source /usr/local/Ascend/ascend-toolkit/set_env.sh &&   if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then     source /usr/local/Ascend/nnal/atb/set_env.sh;   fi &&   exec \"$@\"" "--"]
                        
# 2025-03-10 21:05:52  4.21KB 执行命令并创建新的镜像层
RUN |1 PY_VERSION=3.10 /bin/bash -c PY_PATH="PATH=/usr/local/python${PY_VERSION}/bin:\${PATH}" &&     echo "export ${PY_PATH}" >> /etc/profile &&     echo "export ${PY_PATH}" >> ~/.bashrc &&     CANN_TOOLKIT_ENV_FILE="/usr/local/Ascend/ascend-toolkit/set_env.sh" &&     DRIVER_LIBRARY_PATH="LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:\${LD_LIBRARY_PATH}" &&     echo "export ${DRIVER_LIBRARY_PATH}" >> /etc/profile &&     echo "export ${DRIVER_LIBRARY_PATH}" >> ~/.bashrc &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> /etc/profile &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> ~/.bashrc &&     CANN_NNAL_ENV_FILE="/usr/local/Ascend/nnal/atb/set_env.sh" &&     if [ -f "${CANN_NNAL_ENV_FILE}" ]; then         echo "source ${CANN_NNAL_ENV_FILE}" >> /etc/profile &&         echo "source ${CANN_NNAL_ENV_FILE}" >> ~/.bashrc;     fi # buildkit
                        
# 2025-03-10 21:05:52  84.00B 复制新文件或目录到容器中
COPY /etc/Ascend /etc/Ascend # buildkit
                        
# 2025-03-10 21:05:51  10.68GB 复制新文件或目录到容器中
COPY /usr/local/Ascend /usr/local/Ascend # buildkit
                        
# 2025-03-10 21:04:25  459.22MB 复制新文件或目录到容器中
COPY /usr/local/python3.10 /usr/local/python3.10 # buildkit
                        
# 2025-03-10 20:51:46  33.41MB 执行命令并创建新的镜像层
RUN |1 PY_VERSION=3.10 /bin/bash -c apt-get update     && DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y         apt-transport-https         ca-certificates         bash         libc6         libsqlite3-dev     && apt-get clean     && rm -rf /var/lib/apt/lists/*     && rm -rf /var/tmp/*     && rm -rf /tmp/* # buildkit
                        
# 2025-03-10 20:51:46  0.00B 
SHELL [/bin/bash -c]
                        
# 2025-03-10 20:51:46  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:
                        
# 2025-03-10 20:51:46  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-03-10 20:51:46  0.00B 定义构建参数
ARG PY_VERSION=3.10
                        
# 2025-01-26 13:32:17  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-01-26 13:32:17  69.22MB 
/bin/sh -c #(nop) ADD file:905ede4ce5ed6db0abca06b5e342a3784cd1f328e2cdc1f59f6d556f6382650d in / 
                        
# 2025-01-26 13:32:14  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2025-01-26 13:32:14  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-01-26 13:32:14  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-01-26 13:32:14  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:6ac53f9652eaf38b848d1895a2d851c14f5f2ce7684d968d590c64b9bbfc0d92",
    "RepoTags": [
        "quay.io/ascend/vllm-ascend:v0.8.4rc2",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc2-linuxarm64"
    ],
    "RepoDigests": [
        "quay.io/ascend/vllm-ascend@sha256:4ba9d752bad9060b3e9122498a53bb3a227dbb2afaf5d6e5000f0e0ebc863d2a",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend@sha256:49941de52f7022d960b83d5dfdc6c889f2791c8d0b59684fd86a5b8c234491b2"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-04-29T14:19:08.921811563Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:",
            "DEBIAN_FRONTEND=noninteractive",
            "COMPILE_CUSTOM_KERNELS=1"
        ],
        "Cmd": [
            "/bin/bash"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/root",
        "Entrypoint": [
            "/bin/bash",
            "-c",
            "  source /usr/local/Ascend/ascend-toolkit/set_env.sh \u0026\u0026   if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then     source /usr/local/Ascend/nnal/atb/set_env.sh;   fi \u0026\u0026   exec \"$@\"",
            "--"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2025-04-28T13:58:51.371Z",
            "org.opencontainers.image.description": "Community maintained hardware plugin for vLLM on Ascend",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "1fce70a2fb2602170781773104a69c69beb16161",
            "org.opencontainers.image.source": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.title": "vllm-ascend",
            "org.opencontainers.image.url": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.version": "v0.8.4rc2"
        },
        "Shell": [
            "/bin/bash",
            "-c"
        ]
    },
    "Architecture": "arm64",
    "Os": "linux",
    "Size": 13736296418,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/5248b241c6792b06bf450f5998252e14a637ab026463c2e6e26702a03d489641/diff:/var/lib/docker/overlay2/28abe5dfcae87e34ed3e73c89418cf7b4e4ae1631853e49f4f134feebb6345f8/diff:/var/lib/docker/overlay2/26d97edcc2ae0a898a7ffb62a60c80e4966cb19d28f321bbdcf56fecab03b38f/diff:/var/lib/docker/overlay2/3abb16e6e3e89694cc0796c052557983bffe074774ab747878928d17c507ad96/diff:/var/lib/docker/overlay2/612677f186eac2de4d252c2476ac746e85b33dcb62e6fe1e18ff05416f568aed/diff:/var/lib/docker/overlay2/aa03cacfc80f2e61b1e2b0543076d161017f0771561b3b0f1eb21e6dca2f71a0/diff:/var/lib/docker/overlay2/642761b4c348dba6bcbe12a66c499d54a7d33d7cd8c96a388195b357edbad97d/diff:/var/lib/docker/overlay2/1052799a65a1b7a49a27899bae1f986d732a718fd8c918a32780124ddbe00601/diff:/var/lib/docker/overlay2/b329708a22e6d42e4a95051664066b8d206b49e86126a4c58679007dcf5c9dee/diff:/var/lib/docker/overlay2/7d78b3a9c3c1eb3a860035e20e2acc993f2ccb8f9df887bad52883d4997144d2/diff:/var/lib/docker/overlay2/22ebc81a150576edba45c013966a9f973f34320eaec10cf0f63dd8baa1974e47/diff:/var/lib/docker/overlay2/110b05792c9bc0e42fa4c49834d95b7d6ac5441a9aa963dd389a068fcaf6bf33/diff:/var/lib/docker/overlay2/106c18d4fe1d31abfa3e72023ffffc38bc6e4be23645a1c0ef99f1f55e4a75b3/diff:/var/lib/docker/overlay2/74e00aa11f6d02aa5f9b08562d281e603f34c01e6ba309263adb5f605a14d3a3/diff",
            "MergedDir": "/var/lib/docker/overlay2/697dc8e0af1914bbd5e9f91c0a3742cd01d10ec721c336cf0d215cfd73f546d4/merged",
            "UpperDir": "/var/lib/docker/overlay2/697dc8e0af1914bbd5e9f91c0a3742cd01d10ec721c336cf0d215cfd73f546d4/diff",
            "WorkDir": "/var/lib/docker/overlay2/697dc8e0af1914bbd5e9f91c0a3742cd01d10ec721c336cf0d215cfd73f546d4/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:59b223680ef978509f20faf6bf069866dfc02c422159347face0a7565d698526",
            "sha256:31f811b7df9cac06cdb1c62ed120b615b626fe8988ccaece701c986106b605b8",
            "sha256:c440d5ba889713d7cdb3521703c1febd52a48e9deeccb0606c3700ce98947129",
            "sha256:49d02d975070bb84e22924ecf198b639d0fb1d41dfc11a5d3ae8c5b2af3118bf",
            "sha256:d15f446aeacafa439cda8890accc591975b7514808af61599d9fec5085342690",
            "sha256:80a1efe9fc69b1830a37e27b312f079db259cbf4b6f475010494e958c953b238",
            "sha256:92e1d0abf149ba362f135d4c3015c18f648e28423f81e11e04adc2c03d384bcc",
            "sha256:ea54e69ad7054f89417e9156dd6147f78668f7a94e4c421c22b47373113e82b5",
            "sha256:29a411f6c748c4b5ac3959af56f539563678733638a531474638ff4a5d84ef46",
            "sha256:ca89126b11d2d37955ffd3a1b8b33c6779202f27191391c9e52ab1bfdc5f6171",
            "sha256:d4cbc74e7e702e9916bdccee58106c5491f05176d0253a68394611eb59a9d552",
            "sha256:eee79fe2a5575b5692f7653839b362a044a530702b84a802a36cbb51e8289a36",
            "sha256:42d5831a0672a7bda92a4f45d1b10d50c53b9b15a65fa97bab024b0f2b78f6f5",
            "sha256:300bb3dac2a9b11ce3cb8cdc04bcc5f7c33fa7791e624dc77d84bf717b9ce5b3",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-05-09T02:55:32.899595154+08:00"
    }
}

更多版本

quay.io/ascend/vllm-ascend:v0.7.1rc1

linux/arm64 quay.io13.39GB2025-03-06 15:00
386

quay.io/ascend/vllm-ascend:v0.7.3rc2

linux/arm64 quay.io13.95GB2025-03-30 00:19
262

quay.io/ascend/vllm-ascend:v0.7.3rc1

linux/arm64 quay.io13.93GB2025-03-30 00:26
84

quay.io/ascend/vllm-ascend:v0.8.4rc1

linux/amd64 quay.io16.00GB2025-04-22 00:37
167

quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler

linux/arm64 quay.io14.63GB2025-04-28 00:52
102

quay.io/ascend/vllm-ascend:v0.8.4rc2-openeuler

linux/arm64 quay.io14.18GB2025-04-29 16:34
228

quay.io/ascend/vllm-ascend:v0.8.4rc2

linux/arm64 quay.io13.74GB2025-05-09 02:57
46

quay.io/ascend/vllm-ascend:v0.8.5rc1-openeuler

linux/arm64 quay.io14.89GB2025-05-09 03:16
117

quay.io/ascend/vllm-ascend:v0.7.3-openeuler

linux/arm64 quay.io14.83GB2025-05-13 01:51
30

quay.io/ascend/vllm-ascend:v0.8.5rc1

linux/amd64 quay.io15.11GB2025-05-14 00:50
58