quay.io/ascend/vllm-ascend:v0.8.4rc1 linux/amd64

quay.io/ascend/vllm-ascend:v0.8.4rc1 - 国内下载镜像源 浏览次数:132

quay.io/ascend/vllm-ascend 镜像描述

这是一个基于昇腾AI处理器的VLLM (Versatile Large Language Model) 镜像。它允许在昇腾硬件上运行大型语言模型,提供高效的推理能力。

源镜像 quay.io/ascend/vllm-ascend:v0.8.4rc1
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1
镜像ID sha256:32026563ee234756320f6f9d342e01373169ca6e26a9755fec77e257791449c5
镜像TAG v0.8.4rc1
大小 16.00GB
镜像源 quay.io
CMD /bin/bash
启动入口 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh && if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then source /usr/local/Ascend/nnal/atb/set_env.sh; fi && exec "$@" --
工作目录 /workspace
OS/平台 linux/amd64
浏览量 132 次
贡献者
镜像创建 2025-04-18T11:41:05.011473875Z
同步时间 2025-04-22 00:37
更新时间 2025-05-06 17:33
环境变量
PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver: DEBIAN_FRONTEND=noninteractive COMPILE_CUSTOM_KERNELS=1
镜像标签
2025-04-18T11:31:57.463Z: org.opencontainers.image.created Community maintained hardware plugin for vLLM on Ascend: org.opencontainers.image.description Apache-2.0: org.opencontainers.image.licenses ubuntu: org.opencontainers.image.ref.name 086423dc352e393cafb54b1380eebd8391f0b365: org.opencontainers.image.revision https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.source vllm-ascend: org.opencontainers.image.title https://github.com/vllm-project/vllm-ascend: org.opencontainers.image.url v0.8.4rc1: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1  quay.io/ascend/vllm-ascend:v0.8.4rc1

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1  quay.io/ascend/vllm-ascend:v0.8.4rc1

Shell快速替换命令

sed -i 's#quay.io/ascend/vllm-ascend:v0.8.4rc1#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1  quay.io/ascend/vllm-ascend:v0.8.4rc1'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1  quay.io/ascend/vllm-ascend:v0.8.4rc1'

镜像构建历史


# 2025-04-18 19:41:05  0.00B 设置默认要执行的命令
CMD ["/bin/bash"]
                        
# 2025-04-18 19:41:05  293.98MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c python3 -m pip install modelscope ray # buildkit
                        
# 2025-04-18 19:40:53  241.86MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c source /usr/local/Ascend/ascend-toolkit/set_env.sh &&     source /usr/local/Ascend/nnal/atb/set_env.sh &&     export LD_LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/latest/`uname -i`-linux/devlib:$LD_LIBRARY_PATH &&     export LIBRARY_PATH=/usr/local/Ascend/ascend-toolkit/latest/lib64:$LIBRARY_PATH &&     python3 -m pip install -v /workspace/vllm-ascend/ --extra-index https://download.pytorch.org/whl/cpu/ # buildkit
                        
# 2025-04-18 19:39:33  915.15MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c bash /workspace/vllm-ascend/pta_install.sh # buildkit
                        
# 2025-04-18 19:39:03  0.00B 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c python3 -m pip uninstall -y triton # buildkit
                        
# 2025-04-18 19:39:01  2.71GB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c VLLM_TARGET_DEVICE="empty" python3 -m pip install /workspace/vllm/ --extra-index https://download.pytorch.org/whl/cpu/ # buildkit
                        
# 2025-04-18 19:37:18  29.43MB 执行命令并创建新的镜像层
RUN |4 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 VLLM_REPO=https://github.com/vllm-project/vllm.git VLLM_TAG=v0.8.4 /bin/bash -c git clone --depth 1 $VLLM_REPO --branch $VLLM_TAG /workspace/vllm # buildkit
                        
# 2025-04-18 19:37:16  0.00B 定义构建参数
ARG VLLM_TAG=v0.8.4
                        
# 2025-04-18 19:37:16  0.00B 定义构建参数
ARG VLLM_REPO=https://github.com/vllm-project/vllm.git
                        
# 2025-04-18 19:37:16  46.00B 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 /bin/bash -c pip config set global.index-url ${PIP_INDEX_URL} # buildkit
                        
# 2025-04-18 19:37:16  1.31MB 复制新文件或目录到容器中
COPY . /workspace/vllm-ascend/ # buildkit
                        
# 2025-04-18 18:19:02  0.00B 设置工作目录为/workspace
WORKDIR /workspace
                        
# 2025-04-18 18:19:02  451.08MB 执行命令并创建新的镜像层
RUN |2 PIP_INDEX_URL=https://pypi.org/simple COMPILE_CUSTOM_KERNELS=1 /bin/bash -c apt-get update -y &&     apt-get install -y python3-pip git vim wget net-tools gcc g++ cmake libnuma-dev &&     rm -rf /var/cache/apt/* &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-04-18 18:19:02  0.00B 设置环境变量 COMPILE_CUSTOM_KERNELS
ENV COMPILE_CUSTOM_KERNELS=1
                        
# 2025-04-18 18:19:02  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2025-04-18 18:19:02  0.00B 定义构建参数
ARG COMPILE_CUSTOM_KERNELS=1
                        
# 2025-04-18 18:19:02  0.00B 定义构建参数
ARG PIP_INDEX_URL=https://pypi.org/simple
                        
# 2025-03-10 22:57:09  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/bin/bash" "-c" "  source /usr/local/Ascend/ascend-toolkit/set_env.sh &&   if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then     source /usr/local/Ascend/nnal/atb/set_env.sh;   fi &&   exec \"$@\"" "--"]
                        
# 2025-03-10 22:57:09  4.21KB 执行命令并创建新的镜像层
RUN |1 PY_VERSION=3.10 /bin/bash -c PY_PATH="PATH=/usr/local/python${PY_VERSION}/bin:\${PATH}" &&     echo "export ${PY_PATH}" >> /etc/profile &&     echo "export ${PY_PATH}" >> ~/.bashrc &&     CANN_TOOLKIT_ENV_FILE="/usr/local/Ascend/ascend-toolkit/set_env.sh" &&     DRIVER_LIBRARY_PATH="LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:\${LD_LIBRARY_PATH}" &&     echo "export ${DRIVER_LIBRARY_PATH}" >> /etc/profile &&     echo "export ${DRIVER_LIBRARY_PATH}" >> ~/.bashrc &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> /etc/profile &&     echo "source ${CANN_TOOLKIT_ENV_FILE}" >> ~/.bashrc &&     CANN_NNAL_ENV_FILE="/usr/local/Ascend/nnal/atb/set_env.sh" &&     if [ -f "${CANN_NNAL_ENV_FILE}" ]; then         echo "source ${CANN_NNAL_ENV_FILE}" >> /etc/profile &&         echo "source ${CANN_NNAL_ENV_FILE}" >> ~/.bashrc;     fi # buildkit
                        
# 2025-03-10 22:57:09  84.00B 复制新文件或目录到容器中
COPY /etc/Ascend /etc/Ascend # buildkit
                        
# 2025-03-10 22:57:08  10.75GB 复制新文件或目录到容器中
COPY /usr/local/Ascend /usr/local/Ascend # buildkit
                        
# 2025-03-10 22:55:18  478.49MB 复制新文件或目录到容器中
COPY /usr/local/python3.10 /usr/local/python3.10 # buildkit
                        
# 2025-03-10 20:54:33  41.07MB 执行命令并创建新的镜像层
RUN |1 PY_VERSION=3.10 /bin/bash -c apt-get update     && DEBIAN_FRONTEND=noninteractive apt-get install --no-install-recommends -y         apt-transport-https         ca-certificates         bash         libc6         libsqlite3-dev     && apt-get clean     && rm -rf /var/lib/apt/lists/*     && rm -rf /var/tmp/*     && rm -rf /tmp/* # buildkit
                        
# 2025-03-10 20:54:33  0.00B 
SHELL [/bin/bash -c]
                        
# 2025-03-10 20:54:33  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:
                        
# 2025-03-10 20:54:33  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-03-10 20:54:33  0.00B 定义构建参数
ARG PY_VERSION=3.10
                        
# 2025-01-26 13:31:11  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-01-26 13:31:10  77.86MB 
/bin/sh -c #(nop) ADD file:1b6c8c9518be42fa2afe5e241ca31677fce58d27cdfa88baa91a65a259be3637 in / 
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:32026563ee234756320f6f9d342e01373169ca6e26a9755fec77e257791449c5",
    "RepoTags": [
        "quay.io/ascend/vllm-ascend:v0.8.4rc1",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend:v0.8.4rc1"
    ],
    "RepoDigests": [
        "quay.io/ascend/vllm-ascend@sha256:5043e8307cb6ec3f771a31a1836fafa3084a59153a6ba4f071bea12400782078",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/quay.io/ascend/vllm-ascend@sha256:be03a7f4789d5422c7d840a2de3b784ab312d5c6c08da6d82c0b0d5d9238b3ae"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-04-18T11:41:05.011473875Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/python3.10/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LD_LIBRARY_PATH=/usr/local/Ascend/driver/lib64/common:/usr/local/Ascend/driver/lib64/driver:",
            "DEBIAN_FRONTEND=noninteractive",
            "COMPILE_CUSTOM_KERNELS=1"
        ],
        "Cmd": [
            "/bin/bash"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/workspace",
        "Entrypoint": [
            "/bin/bash",
            "-c",
            "  source /usr/local/Ascend/ascend-toolkit/set_env.sh \u0026\u0026   if [ -f /usr/local/Ascend/nnal/atb/set_env.sh ]; then     source /usr/local/Ascend/nnal/atb/set_env.sh;   fi \u0026\u0026   exec \"$@\"",
            "--"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2025-04-18T11:31:57.463Z",
            "org.opencontainers.image.description": "Community maintained hardware plugin for vLLM on Ascend",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "086423dc352e393cafb54b1380eebd8391f0b365",
            "org.opencontainers.image.source": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.title": "vllm-ascend",
            "org.opencontainers.image.url": "https://github.com/vllm-project/vllm-ascend",
            "org.opencontainers.image.version": "v0.8.4rc1"
        },
        "Shell": [
            "/bin/bash",
            "-c"
        ]
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 15998822920,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/f915cf17772be1844310226a12439183e5261e0f081394a0b29a4cd38c4679c8/diff:/var/lib/docker/overlay2/3e46f7cbce3e410e9f1cb98b5c6c5cf0180a3db9509acdbc2fb78d6440249c34/diff:/var/lib/docker/overlay2/54d6c14a43929d9131e7996fa30c3e7cf22f49ccd42babac9a8a05a2a6333562/diff:/var/lib/docker/overlay2/5277dfc037d9d6b2a569a3b12a1e6081194b7ffb5efa15005aae3b1aa3365814/diff:/var/lib/docker/overlay2/436057c01ef443436135aa92e2f6b2bb08a3c9199eddcaae7abf7f7586dcac99/diff:/var/lib/docker/overlay2/884518933ea031074b4042eaaabfc4279e21513fbd384e7be30d66aa7cf79db5/diff:/var/lib/docker/overlay2/956cbc339dd18e2c9ca0318cb16f8c9ec91ef998e7821abc5e5222c85999b5e6/diff:/var/lib/docker/overlay2/484efbf3f75decf5135fa609ddeff782126ec8c961a37b6f210908e958c422fc/diff:/var/lib/docker/overlay2/3cf249ec15b05a0b24a5c1279c3e349978a99219cc1ca71be997f2f8686864c6/diff:/var/lib/docker/overlay2/761ea2e15626bd379783747b2a56eafbbfe604c5dd34b206108dfc584f754024/diff:/var/lib/docker/overlay2/b614576c18eb161f16dcf35d66b6dfd882c0e85190944720629e238141c5bd51/diff:/var/lib/docker/overlay2/44a4b0ebb3c74d88ac52c543e99a6c5ec366ee86b286ec886d00b9a089726219/diff:/var/lib/docker/overlay2/55f04e7388cc2f72ae6f0f6ca33fb097abb4dce85e58492cd20ef4494f5aac89/diff:/var/lib/docker/overlay2/ffc50f21e8fe057d83ee4255a023e713befa8be787beb605028bb763774f64b4/diff:/var/lib/docker/overlay2/ace3f972cf88bd330727fa9a25fd0df2c3fec1df161ac9102bf9f5739b40b82c/diff",
            "MergedDir": "/var/lib/docker/overlay2/95a55f5026c4e355a86d01cc9400887e759e175fe1d92be270815e9686793871/merged",
            "UpperDir": "/var/lib/docker/overlay2/95a55f5026c4e355a86d01cc9400887e759e175fe1d92be270815e9686793871/diff",
            "WorkDir": "/var/lib/docker/overlay2/95a55f5026c4e355a86d01cc9400887e759e175fe1d92be270815e9686793871/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:270a1170e7e398434ff1b31e17e233f7d7b71aa99a40473615860068e86720af",
            "sha256:c917617d6fc69ac76723ed8903faa433e81c82fb4cf5dabdd67c5e0789c7da57",
            "sha256:8211a994b2e8882db95b095d4f4b5f3c47fb416ff0cc9deec954bb1ebe9ffbb9",
            "sha256:e9243176ac09f5011ba31f0ece6e1d7d0d3835c6999a9da9394dc212a7912535",
            "sha256:65ac667f3b06c01fc2143e7ea17bbea4aa243e71c990053199454a1c9cf9c0fc",
            "sha256:11473cf93c4d9374acb31a6cdf8ab71012933c517c728379c84e96d633325d84",
            "sha256:82c0c0631bbe6cbb27a71352aec60800dd9a076fdf9f7a515da54ebe0de62219",
            "sha256:8d00c1c58aeb94973487adaeac297ab9527eddff06c341240a8f4dbf94c141ae",
            "sha256:101c9a8e24a9392bede991dac48ecbaacba44415e005db6cd70b9b9d93f22cc6",
            "sha256:78faec77f9ffc5dcb5af86e9db14220a6fbb48214b146d82945b1c3b226942a8",
            "sha256:aeedb39ae8b3e70c459a28f8637eb8bbf97eee92e18b5e6ae790ce4afb7e9150",
            "sha256:ff69260b35d023ab617773c7b01c04f3a587feee670f6d2f24fd473831ba5a76",
            "sha256:0fe7fa8fe461e6caf138d7471f73ae0dc8e6f4e77e1a65ebd8f784c86a1a06f8",
            "sha256:b5e7cba2745ec484d253189408ab7f7e51f08c3ab2aa7a2403ba6a1e2e2b2845",
            "sha256:c21ebb1949ac533d4e6950228a3de5030a3d0a342b9a72993f63ec07564ce0d5",
            "sha256:2a12d6c8785952ce63e63a3628e04ae7c2e8484caf816e7e2204f8bce67caced"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-04-22T00:23:55.589968838+08:00"
    }
}

更多版本

quay.io/ascend/vllm-ascend:v0.7.1rc1

linux/arm64 quay.io13.39GB2025-03-06 15:00
341

quay.io/ascend/vllm-ascend:v0.7.3rc2

linux/arm64 quay.io13.95GB2025-03-30 00:19
243

quay.io/ascend/vllm-ascend:v0.7.3rc1

linux/arm64 quay.io13.93GB2025-03-30 00:26
70

quay.io/ascend/vllm-ascend:v0.8.4rc1

linux/amd64 quay.io16.00GB2025-04-22 00:37
131

quay.io/ascend/vllm-ascend:v0.8.4rc1-openeuler

linux/arm64 quay.io14.63GB2025-04-28 00:52
80

quay.io/ascend/vllm-ascend:v0.8.4rc2-openeuler

linux/arm64 quay.io14.18GB2025-04-29 16:34
150