quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler linux/arm64

quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler - 国内下载镜像源 浏览次数:80 温馨提示: 这是一个 linux/arm64 系统架构镜像

quay.io/ascend/vllm-ascend 镜像描述

这是一个基于昇腾AI处理器的VLLM (Versatile Large Language Model) 镜像。它允许在昇腾硬件上运行大型语言模型,提供高效的推理能力。

源镜像 quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64
镜像ID sha256:2f0255dca739763353dc199118e48ff997204b02f4d4b023f7fa48baa59a6e1d
镜像TAG v0.8.4rc1-openeuler-linuxarm64
大小 14.63GB
镜像源 quay.io
CMD /bin/bash
启动入口 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh && if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then source /usr/local/Ascend/nnal/atb/set_env.sh; fi && exec "$@" --
工作目录 /workspace
OS/平台 linux/arm64
浏览量 80 次
贡献者 li*******g@qq.com
镜像创建 2025-04-18T12:09:33.936294062Z
同步时间 2025-04-28 00:52
更新时间 2025-05-06 01:33
环境变量
PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver: COMPILE_CUSTOM_KERNELS=0
镜像标签
2025-04-18T11:31:57.467Z: org.opencontainers.image.created Community maintained hardware plugin for vLLM on Ascend: org.opencontainers.image.description Apache-2.0: org.opencontainers.image.licenses 086423dc352e393cafb54b1380eebd8391f0b365: org.opencontainers.image.revision https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.source vllm-ascend: org.opencontainers.image.title https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.url 0.8.4rc1: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler

Shell快速替换命令

sed -i 's#quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64  quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler'

镜像构建历史


# 2025-04-18 20:09:33  0.00B 设置默认要执行的命令
CMD ["/bin/bash"]
                        
# 2025-04-18 20:09:33  293.33MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=main /bin/bash -c python3 -m pip install modelscope ray # buildkit
                        
# 2025-04-18 20:07:30  327.79MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=main /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh &&     source /usr/local/Ascend/nnal/atb/set_env.sh &&     export LD_LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/latest/`uname -i`-linux/devlib:$LD_LIBRARY_PATH &&     export LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/latest/lib64:$LIBRARY_PATH &&     python3 -m pip install -v /workspace/vllm-ascend/ --extra-index https://download.pytorch.org/whl/cpu/ # buildkit
                        
# 2025-04-18 19:59:32  538.10MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=main /bin/bash -c bash /workspace/vllm-ascend/pta_install.sh # buildkit
                        
# 2025-04-18 19:56:56  0.00B 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=main /bin/bash -c python3 -m pip uninstall -y triton # buildkit
                        
# 2025-04-18 19:56:51  1.53GB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=main /bin/bash -c VLLM_TARGET_DEVICE="empty" python3 -m pip install /workspace/vllm/ --extra-index https://download.pytorch.org/whl/cpu/ # buildkit
                        
# 2025-04-18 19:42:35  30.10MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=main /bin/bash -c git clone --depth 1 $VLLM_REPO --branch $VLLM_TAG /workspace/vllm # buildkit
                        
# 2025-04-18 19:42:32  0.00B 定义构建参数
ARG VLLM_TAG=main
                        
# 2025-04-18 19:42:32  0.00B 定义构建参数
ARG VLLM_REPO=https://github.com/vllm-project/vllm.git
                        
# 2025-04-18 19:42:32  1.31MB 复制新文件或目录到容器中
COPY . /workspace/vllm-ascend/ # buildkit
                        
# 2025-04-18 19:42:32  0.00B 设置工作目录为/workspace
WORKDIR /workspace
                        
# 2025-04-18 19:42:32  46.00B 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 /bin/bash -c pip config set global.index-url ${PIP_INDEX_URL} # buildkit
                        
# 2025-04-18 19:42:29  416.78MB 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=0 /bin/bash -c yum update -y &&     yum install -y python3-pip git vim wget net-tools &&     rm -rf /var/cache/yum &&    rm -rf /tmp/* # buildkit
                        
# 2025-04-18 19:42:29  0.00B 设置环境变量 COMPILE_CUSTOM_KERNELS
ENV COMPILE_CUSTOM_KERNELS=0
                        
# 2025-04-18 19:42:29  0.00B 定义构建参数
ARG COMPILE_CUSTOM_KERNELS=0
                        
# 2025-04-18 19:42:29  0.00B 定义构建参数
ARG PIP_INDEX_URL=https://pypi.org/simple
                        
# 2025-03-10 21:08:07  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/bin/bash" "-c" "  source /usr/local/Ascend/ascend-toolkit/set_env.sh &&   if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then     source /usr/local/Ascend/nnal/atb/set_env.sh;   fi &&   exec \"$@\"" "--"]
                        
# 2025-03-10 21:08:07  2.78KB 执行命令并创建新的镜像层
RUN |1 PY_VERSION=3.10 /bin/bash -c PY_PATH="PATH=/usr/local/python${PY_VERSION}/bin:\${PATH}" &&     echo "export ${PY_PATH}" >> /etc/profile &&     echo "export ${PY_PATH}" >> ~/.bashrc &&     CANN_TOOLKIT_ENV_FILE="/usr/local/Ascend/ascend-toolkit/set_env.sh" &&     DRIVER_LIBRARY_PATH="LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:\${LD_LIBRARY_PATH}" &&     echo "export ${DRIVER_LIBRARY_PATH}" >> /etc/profile &&     echo "export ${DRIVER_LIBRARY_PATH}" >> ~/.bashrc &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> /etc/profile &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> ~/.bashrc &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> ~/.bashrc &&     CANN_NNAL_ENV_FILE="/usr/local/Ascend/nnal/atb/set_env.sh" &&     if [ -f "${CANN_NNAL_ENV_FILE}" ]; then         echo "source ${CANN_NNAL_ENV_FILE}" >> /etc/profile &&         echo "source ${CANN_NNAL_ENV_FILE}" >> ~/.bashrc;     fi # buildkit
                        
# 2025-03-10 21:08:06  84.00B 复制新文件或目录到容器中
COPY /etc/Ascend /etc/Ascend # buildkit
                        
# 2025-03-10 21:08:06  10.68GB 复制新文件或目录到容器中
COPY /usr/local/Ascend /usr/local/Ascend # buildkit
                        
# 2025-03-10 21:06:32  479.29MB 复制新文件或目录到容器中
COPY /usr/local/python3.10 /usr/local/python3.10 # buildkit
                        
# 2025-03-10 20:53:01  127.00MB 执行命令并创建新的镜像层
RUN |1 PY_VERSION=3.10 /bin/bash -c yum update -y &&     yum install -y         ca-certificates         bash         glibc         sqlite-devel     && yum clean all     && rm -rf /var/cache/yum     && rm -rf /tmp/* # buildkit
                        
# 2025-03-10 20:53:01  0.00B 
SHELL [/bin/bash -c]
                        
# 2025-03-10 20:53:01  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:
                        
# 2025-03-10 20:53:01  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-03-10 20:53:01  0.00B 定义构建参数
ARG PY_VERSION=3.10
                        
# 2025-03-01 08:01:55  0.00B 设置默认要执行的命令
CMD ["bash"]
                        
# 2025-03-01 08:01:55  2.94KB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=arm64 /bin/sh -c ln -sf /usr/share/zoneinfo/UTC /etc/localtime &&     sed -i "s/TMOUT=300/TMOUT=0/g" /etc/bashrc # buildkit
                        
# 2025-03-01 08:01:54  202.97MB 复制文件或目录到容器中
ADD openEuler-docker-rootfs.arm64.tar.xz / # buildkit
                        
# 2025-03-01 08:01:54  0.00B 定义构建参数
ARG TARGETARCH=arm64
                        
                    

镜像信息

{
    "Id": "sha256:2f0255dca739763353dc199118e48ff997204b02f4d4b023f7fa48baa59a6e1d",
    "RepoTags": [
        "quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler-linuxarm64"
    ],
    "RepoDigests": [
        "quay.io/ascend/vllm-ascend@sha256:91410cceb57bf8742cf5a403c8cf44f498db47dc466f44751cd3a2f8fe87f026",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend@sha256:d3595f157cce8844d5e819c7d533d8bd40fff6f403822fbca8e15543624d7460"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-04-18T12:09:33.936294062Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:",
            "COMPILE_CUSTOM_KERNELS=0"
        ],
        "Cmd": [
            "/bin/bash"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/workspace",
        "Entrypoint": [
            "/bin/bash",
            "-c",
            "  source /usr/local/Ascend/ascend-toolkit/set_env.sh \u0026\u0026   if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then     source /usr/local/Ascend/nnal/atb/set_env.sh;   fi \u0026\u0026   exec \"$@\"",
            "--"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2025-04-18T11:31:57.467Z",
            "org.opencontainers.image.description": "Community maintained hardware plugin for vLLM on Ascend",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.revision": "086423dc352e393cafb54b1380eebd8391f0b365",
            "org.opencontainers.image.source": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.title": "vllm-ascend",
            "org.opencontainers.image.url": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.version": "0.8.4rc1"
        },
        "Shell": [
            "/bin/bash",
            "-c"
        ]
    },
    "Architecture": "arm64",
    "Os": "linux",
    "Size": 14632013597,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/27410581e440494ab776d1d5759e1358fc741de28fc24f836e308427dd42fc66/diff:/var/lib/docker/overlay2/95d387b335f7eb4709ed92c26068f0ccb613181a24329349d77b7a6e6afed2eb/diff:/var/lib/docker/overlay2/07dfb83eb815c1dfbb1adfff80cea00e599b390ae25e5211ef09a1f895403afc/diff:/var/lib/docker/overlay2/b71e95717094cf3bb64cc87f47e8d7a0334013f854cb3fa6fbb6d00715b4f4b7/diff:/var/lib/docker/overlay2/ed9b84c41335447a9fe3a675f3414c6c81e0d5a9364e8ff09a813b7fdfcf0a71/diff:/var/lib/docker/overlay2/da756647a94010b207b0b785792be5c30ec932e10c7f8ec9703568cbee1c7589/diff:/var/lib/docker/overlay2/6a6acd530f83470ca8944d25fc04ea8c86b665a5aea2c780c608cf178dbcb986/diff:/var/lib/docker/overlay2/437e35a7119241c0388bea268e41e426192fb1d885dabe88895c862d72b13d5a/diff:/var/lib/docker/overlay2/61377fb06700a1462e735f1931a6f20cf3a42315fe83cb744bcfbc481b2bd5a9/diff:/var/lib/docker/overlay2/1bc69a1188ae17bf4e4a990347fc843d6c9cdc2c0634d2ad048fca059ad6707d/diff:/var/lib/docker/overlay2/c534f5518daae3c4a73ce009c0dbe417c91456ceb4f56a92985691999ed5bafb/diff:/var/lib/docker/overlay2/70fcea5d97b9e3258ae969d4f9daf6e8501ff3161612c53d58f794e43115bb3c/diff:/var/lib/docker/overlay2/db166e9cfb5c3d236cce335ff3911b116145444402cc2779a2b54e92881e8236/diff:/var/lib/docker/overlay2/b005b065279da26918c80061cc94e2b7d3f27046006468ceba8338075b1fc088/diff:/var/lib/docker/overlay2/379f396b3d5519922072d0046159736afbfc7eb3eecc7fdc2cbfeb455011c22e/diff:/var/lib/docker/overlay2/a5d0a1b35d3876818eb13a6b3d8e31d9f8115bf515829e7eeda1746c4c656e44/diff",
            "MergedDir": "/var/lib/docker/overlay2/95023c4bc98bfce45880341d7eb6e0e004763b0abc75c9e79682729f5972e84a/merged",
            "UpperDir": "/var/lib/docker/overlay2/95023c4bc98bfce45880341d7eb6e0e004763b0abc75c9e79682729f5972e84a/diff",
            "WorkDir": "/var/lib/docker/overlay2/95023c4bc98bfce45880341d7eb6e0e004763b0abc75c9e79682729f5972e84a/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:9e07b8fa0b86c56aee293b9210802c8eff31ce233c2d1cf4e10a3ea3ba1542c8",
            "sha256:ef7bc984c28ae6d9d5c6c447254337c83dd97dec8b128b9679cb75f6f1a14c8a",
            "sha256:f018b57c2ac2db9c903af35c02a282bbd22d607ebe0e258c1321aa1e2a4fc55b",
            "sha256:3005e98e8c17e799ffc108f234b42fb82e4dcc27a170b69ebe14b6428223c31f",
            "sha256:2b6d3a5faca584450c6a3a27ff0f60a2e278c3b4a50e3e185787403e1f7d05cf",
            "sha256:e56335897ffa7ba90a976f53ddcc1a26ad39a08e528c6939dd3b1c2d626c5556",
            "sha256:7b6168e94c2d18e6064e1bcc5bbd12f406e56a9827d6d8fa9876dc89c04fee32",
            "sha256:c2dd9c652861e0aac10a91578a30073ce1c4974d33c1889df9ddbe5bb5b43079",
            "sha256:a2cf2ddfea9f77b1fca1570c4f7137d76b364a760e79d6a87d9f5252ff69205a",
            "sha256:e074dbd5d0d47a00069683d62e63c97fa644258bf074c64f055e56f827594c18",
            "sha256:a87fc51303b7464ebd1dec7d4936a50f2af562ac18b84715441ec221508c4fe4",
            "sha256:278977c100a6cc931acf36cfdcae37203719fe35af0e012018bbd517eb39a9d1",
            "sha256:da98cb835f8e2bdc17f5b4d4caa3ea33d8d706a46da32b1e8e8fce6305d6fa83",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:410b3979bdb31928c585e3455175744b24dbef32b529f6453eeebb5d71d4ccbe",
            "sha256:42a317a674d742c8d9d7c36d8e89aa551a26f8d85ddbdea5ea394969bf843792",
            "sha256:728b9d160878910bbce9729ddd410e925ed9efc077fe1b9a32beda976bdcb831"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-04-28T00:40:32.611161796+08:00"
    }
}

更多版本

quay.io/ascend/vllm-ascend:v0.7.1rc1

linux/arm64 quay.io13.39GB2025-03-06 15:00
341

quay.io/ascend/vllm-ascend:v0.7.3rc2

linux/arm64 quay.io13.95GB2025-03-30 00:19
243

quay.io/ascend/vllm-ascend:v0.7.3rc1

linux/arm64 quay.io13.93GB2025-03-30 00:26
70

quay.io/ascend/vllm-ascend:v0.8.4rc1

linux/amd64 quay.io16.00GB2025-04-22 00:37
131

quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler

linux/arm64 quay.io14.63GB2025-04-28 00:52
79

quay.io/ascend/vllm-ascend:v0.8.4rc2-openeuler

linux/arm64 quay.io14.18GB2025-04-29 16:34
148