docker.io/vllm/vllm-openai:v0.2.7 linux/amd64

docker.io/vllm/vllm-openai:v0.2.7 - 国内下载镜像源浏览次数:16

这是镜像描述:

vllm/openai

基于 OpenAI 的 GPT-3 模型的 API 服务，支持自然语言处理等功能。

源镜像	docker.io/vllm/vllm-openai:v0.2.7
国内镜像	swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7
镜像ID	sha256:7ed267a8b54f4ea37269ff13a8278a59c0dc6883686169802cabe86af0e38ee0
镜像TAG	v0.2.7
大小	6.34GB
镜像源	docker.io
项目信息	Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口	python3 -m vllm.entrypoints.openai.api_server
工作目录	/workspace
OS/平台	linux/amd64
浏览量	16 次
贡献者
镜像创建	2024-01-04T02:18:10.493639523Z
同步时间	2025-10-01 01:07
更新时间	2025-10-01 18:47

环境变量

PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 NV_CUDA_CUDART_VERSION=12.1.55-1 NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 CUDA_VERSION=12.1.0 LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility

镜像标签

NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer ubuntu: org.opencontainers.image.ref.name 22.04: org.opencontainers.image.version

阿里云高校计划(￥300代金券)领取

阿里云2核2G高性能云服务器 99元/年❤️

华为云2核4G2M云服务器，惊爆价99元1年

腾讯云2核2G云服务器，惊爆价99元1年

Ucloud 2核2G4M 59元/年❤️ 香港专线400G流量/月服务器 93元/年❤️

硅基流动注册送2000万 Tokens！

GPT人工智能60G学习资料❤️

无权限下载?点我修复生成Docker Run命令生成Kubernetes YAML资源

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7  docker.io/vllm/vllm-openai:v0.2.7

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7  docker.io/vllm/vllm-openai:v0.2.7

Shell快速替换命令

sed -i 's#vllm/vllm-openai:v0.2.7#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7  docker.io/vllm/vllm-openai:v0.2.7'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7  docker.io/vllm/vllm-openai:v0.2.7'

镜像构建历史


# 2024-01-04 10:18:10  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["python3" "-m" "vllm.entrypoints.openai.api_server"]
                        
# 2024-01-04 10:18:10  1.22MB 复制新文件或目录到容器中
COPY vllm vllm # buildkit
                        
# 2024-01-04 10:18:10  40.33MB 复制新文件或目录到容器中
COPY /workspace/vllm/*.so /workspace/vllm/ # buildkit
                        
# 2024-01-04 10:06:22  1.74MB 执行命令并创建新的镜像层
RUN /bin/sh -c pip install accelerate # buildkit
                        
# 2024-01-04 10:06:18  5.65GB 执行命令并创建新的镜像层
RUN /bin/sh -c pip install -r requirements.txt # buildkit
                        
# 2024-01-04 10:04:25  318.00B 复制新文件或目录到容器中
COPY requirements.txt requirements.txt # buildkit
                        
# 2023-12-18 04:44:07  0.00B 设置工作目录为/workspace
WORKDIR /workspace
                        
# 2023-12-18 04:44:07  407.62MB 执行命令并创建新的镜像层
RUN /bin/sh -c apt-get update -y     && apt-get install -y python3-pip # buildkit
                        
# 2023-11-10 13:44:29  0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
                        
# 2023-11-10 13:44:29  0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
                        
# 2023-11-10 13:44:29  17.29KB 复制新文件或目录到容器中
COPY NGC-DL-CONTAINER-LICENSE / # buildkit
                        
# 2023-11-10 13:44:29  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2023-11-10 13:44:29  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2023-11-10 13:44:29  46.00B 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf     && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2023-11-10 13:44:29  149.59MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-12-1=${NV_CUDA_CUDART_VERSION}     ${NV_CUDA_COMPAT_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2023-11-10 13:44:18  0.00B 设置环境变量 CUDA_VERSION
ENV CUDA_VERSION=12.1.0
                        
# 2023-11-10 13:44:18  10.56MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     gnupg2 curl ca-certificates &&     curl -fsSLO https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/${NVARCH}/cuda-keyring_1.0-1_all.deb &&     dpkg -i cuda-keyring_1.0-1_all.deb &&     apt-get purge --autoremove -y curl     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2023-11-10 13:44:18  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2023-11-10 13:44:18  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2023-11-10 13:44:18  0.00B 设置环境变量 NV_CUDA_COMPAT_PACKAGE
ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1
                        
# 2023-11-10 13:44:18  0.00B 设置环境变量 NV_CUDA_CUDART_VERSION
ENV NV_CUDA_CUDART_VERSION=12.1.55-1
                        
# 2023-11-10 13:44:18  0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand
ENV NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526
                        
# 2023-11-10 13:44:18  0.00B 设置环境变量 NVARCH
ENV NVARCH=x86_64
                        
# 2023-10-05 15:33:32  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2023-10-05 15:33:32  77.82MB 
/bin/sh -c #(nop) ADD file:63d5ab3ef0aab308c0e71cb67292c5467f60deafa9b0418cbb220affcd078444 in / 
                        
# 2023-10-05 15:33:30  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2023-10-05 15:33:30  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2023-10-05 15:33:30  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2023-10-05 15:33:30  0.00B 
/bin/sh -c #(nop)  ARG RELEASE

镜像信息

{
    "Id": "sha256:7ed267a8b54f4ea37269ff13a8278a59c0dc6883686169802cabe86af0e38ee0",
    "RepoTags": [
        "vllm/vllm-openai:v0.2.7",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.2.7"
    ],
    "RepoDigests": [
        "vllm/vllm-openai@sha256:f3d407c71db2e7eded6b28b9131c5d91cf20cd495f6af3e1c6a9ce2df238c6e8",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai@sha256:faa6b2bc9b1bbe47b4129b713399aaec3bfdc207ad7ca973028285ceaa927d99"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2024-01-04T02:18:10.493639523Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.1 brand=tesla,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=geforce,driver\u003e=470,driver\u003c471 brand=geforcertx,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=titan,driver\u003e=470,driver\u003c471 brand=titanrtx,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=525,driver\u003c526 brand=unknown,driver\u003e=525,driver\u003c526 brand=nvidia,driver\u003e=525,driver\u003c526 brand=nvidiartx,driver\u003e=525,driver\u003c526 brand=geforce,driver\u003e=525,driver\u003c526 brand=geforcertx,driver\u003e=525,driver\u003c526 brand=quadro,driver\u003e=525,driver\u003c526 brand=quadrortx,driver\u003e=525,driver\u003c526 brand=titan,driver\u003e=525,driver\u003c526 brand=titanrtx,driver\u003e=525,driver\u003c526",
            "NV_CUDA_CUDART_VERSION=12.1.55-1",
            "NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1",
            "CUDA_VERSION=12.1.0",
            "LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/workspace",
        "Entrypoint": [
            "python3",
            "-m",
            "vllm.entrypoints.openai.api_server"
        ],
        "OnBuild": null,
        "Labels": {
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "22.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 6338588278,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/1c35d8817de7ecab70c7ff5ab5df845711963b58a8b3c82a5873e0d5f8753b71/diff:/var/lib/docker/overlay2/dc378d7807e950aad4585390c4e9493c0c1a4e7c43cf70e9c3d2fa0f019df996/diff:/var/lib/docker/overlay2/85b246dcc311dd915bfd39b5805fb5a17abf5bf4cbefdd3dcfd76843fd6a6ff9/diff:/var/lib/docker/overlay2/c5652602e4b884cb912128857d9282e44d53ae61d1a56975d4b210b331a335aa/diff:/var/lib/docker/overlay2/966c583808d0acc3fd27e62e654926962a530d842c1531a9d617d8366fcbace2/diff:/var/lib/docker/overlay2/b57c8b1d7e7e7399a2f59d309d6f78a89bb5fe9f09716ab8e8eafd4330eecdb6/diff:/var/lib/docker/overlay2/86c98ab0ed88b61b06cf59d67d016cbf05a2c7cea2a7a4fe53a6be12a6bb87d7/diff:/var/lib/docker/overlay2/dddcc2c36b2b15125b046f443eaf956385215dd4fe1629756f29c2e1077ee125/diff:/var/lib/docker/overlay2/7c0ec148c160c668fe5b36bcb65f7d5badb55eb5dcdea8490e826c2a41b578a9/diff:/var/lib/docker/overlay2/b213e3c8abc27592f101ffbb1d0f2c437b5effe9b384d0f550f46a4f894f180d/diff:/var/lib/docker/overlay2/f2905627b4505cda033dd62b5a5dc1676edda5a6e1bda7cd6e6e2048fcf5aee0/diff",
            "MergedDir": "/var/lib/docker/overlay2/f4e2b05794acbb19f53acee5bc7dd824acff1dfe5690920b935768896b3e685f/merged",
            "UpperDir": "/var/lib/docker/overlay2/f4e2b05794acbb19f53acee5bc7dd824acff1dfe5690920b935768896b3e685f/diff",
            "WorkDir": "/var/lib/docker/overlay2/f4e2b05794acbb19f53acee5bc7dd824acff1dfe5690920b935768896b3e685f/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:256d88da41857db513b95b50ba9a9b28491b58c954e25477d5dad8abb465430b",
            "sha256:7b9433fba79bfc9269aab8277ea9975364db1c1f775a7ee6b14b5dffa045b294",
            "sha256:765423415d690bf8ca1510e7147d5b86dba15dcf1a3b1a515f1a85cc5dd439bb",
            "sha256:e4b1bddcbe6378dfa58bf1faa040813b74938129eb4bb06cbf083240335c5c54",
            "sha256:cd77f58b80cdcfac5fcdef06b2033fedc1115073afae035a14b6692cb5cd6650",
            "sha256:3eb1360db618a4c2b5f2e775d570649fbb52f295a88a48723c75268e988f8265",
            "sha256:38608ecc0fea112a945cdb02e9f0105726ddd75866de8b8dc45ef4ae8c259524",
            "sha256:51679c87343f453185c66cee302ce5afef3b492c58c1b7c4ac9dc0885e793c6a",
            "sha256:f347f5eb21cd4c3e49c25487071cd8966c8108c0d0db5eb19c2d5cdce56ced3f",
            "sha256:5da70c009c1f547e24c91e0c57e9eac8162aed83d6947cb11b61557c226e1ce7",
            "sha256:b74c6323bc0b154f2fec4beccf515cc284c66e3406acf37dd012631e68cd7a33",
            "sha256:67282c42f0963fcc302da03324eab838c73694added46f1a06d6de39ac6a3f3c"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-10-01T01:00:10.229328704+08:00"
    }
}

更多版本

docker.io/vllm/vllm-openai:v0.5.4

linux/amd64 docker.io9.90GB2024-09-07 06:20

1319

docker.io/vllm/vllm-openai:v0.6.0

linux/amd64 docker.io9.72GB2024-09-11 01:51

1082

docker.io/vllm/vllm-openai:v0.6.1.post2

linux/amd64 docker.io9.81GB2024-09-24 01:43

710

docker.io/vllm/vllm-openai:latest

linux/amd64 docker.io10.24GB2024-10-11 00:43