docker.io/vllm/vllm-openai:v0.6.4.post1 linux/amd64

docker.io/vllm/vllm-openai:v0.6.4.post1 - 国内下载镜像源 浏览次数:32
这是镜像描述:

vllm/openai

基于 OpenAI 的 GPT-3 模型的 API 服务，支持自然语言处理等功能。

源镜像 docker.io/vllm/vllm-openai:v0.6.4.post1
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1
镜像ID sha256:698668586297dd30428a9f3bbcadb8a2034732ed13fdcd49218c8c3c9eb1cbd6
镜像TAG v0.6.4.post1
大小 10.64GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 python3 -m vllm.entrypoints.openai.api_server
工作目录 /vllm-workspace
OS/平台 linux/amd64
浏览量 32 次
贡献者 15*****2@qq.com
镜像创建 2024-11-15T10:02:00.726462716-08:00
同步时间 2024-11-19 00:42
更新时间 2024-11-21 14:07
环境变量
PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 NV_CUDA_CUDART_VERSION=12.4.127-1 NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 CUDA_VERSION=12.4.1 LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility DEBIAN_FRONTEND=noninteractive VLLM_USAGE_SOURCE=production-docker-image
镜像标签
NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer ubuntu: org.opencontainers.image.ref.name 22.04: org.opencontainers.image.version
镜像安全扫描 查看Trivy扫描报告

系统OS: ubuntu 22.04 扫描引擎: Trivy 扫描时间: 2024-11-19 00:45

低危漏洞:186 中危漏洞:1007 高危漏洞:4 严重漏洞:0
docker.io/vllm/vllm-openai:v0.6.4.post1 (ubuntu 22.04) (ubuntu) Java (jar) Python (python-pkg)

Docker拉取命令 无权限下载?点我修复 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1  docker.io/vllm/vllm-openai:v0.6.4.post1

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1  docker.io/vllm/vllm-openai:v0.6.4.post1

Shell快速替换命令 

sed -i 's#vllm/vllm-openai:v0.6.4.post1#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1  docker.io/vllm/vllm-openai:v0.6.4.post1'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1  docker.io/vllm/vllm-openai:v0.6.4.post1'

镜像历史

大小 创建时间 层信息
0.00B 2024-11-16 02:02:00 ENTRYPOINT ["python3" "-m" "vllm.entrypoints.openai.api_server"]
0.00B 2024-11-16 02:02:00 ENV VLLM_USAGE_SOURCE=production-docker-image
467.64MB 2024-11-16 02:02:00 RUN /bin/sh -c pip install accelerate hf_transfer 'modelscope!=1.15.0' 'bitsandbytes>=0.44.0' timm==0.9.10 # buildkit
283.95KB 2024-11-16 02:01:45 COPY examples examples # buildkit
1.84GB 2024-11-16 02:01:45 RUN |2 CUDA_VERSION=12.4.1 PYTHON_VERSION=3.12 /bin/sh -c . /etc/environment && python3 -m pip install https://github.com/flashinfer-ai/flashinfer/releases/download/v0.1.6/flashinfer-0.1.6+cu121torch2.4-cp${PYTHON_VERSION_STR}-cp${PYTHON_VERSION_STR}-linux_x86_64.whl # buildkit
7.00GB 2024-11-16 02:00:51 RUN |2 CUDA_VERSION=12.4.1 PYTHON_VERSION=3.12 /bin/sh -c python3 -m pip install dist/*.whl --verbose # buildkit
49.80KB 2024-10-15 05:03:28 RUN |2 CUDA_VERSION=12.4.1 PYTHON_VERSION=3.12 /bin/sh -c ldconfig /usr/local/cuda-$(echo $CUDA_VERSION | cut -d. -f1,2)/compat/ # buildkit
1.08GB 2024-10-15 05:03:27 RUN |2 CUDA_VERSION=12.4.1 PYTHON_VERSION=3.12 /bin/sh -c echo 'tzdata tzdata/Areas select America' | debconf-set-selections && echo 'tzdata tzdata/Zones/America select Los_Angeles' | debconf-set-selections && apt-get update -y && apt-get install -y ccache software-properties-common git curl sudo vim python3-pip && apt-get install -y ffmpeg libsm6 libxext6 libgl1 && add-apt-repository ppa:deadsnakes/ppa && apt-get update -y && apt-get install -y python${PYTHON_VERSION} python${PYTHON_VERSION}-dev python${PYTHON_VERSION}-venv libibverbs-dev && update-alternatives --install /usr/bin/python3 python3 /usr/bin/python${PYTHON_VERSION} 1 && update-alternatives --set python3 /usr/bin/python${PYTHON_VERSION} && ln -sf /usr/bin/python${PYTHON_VERSION}-config /usr/bin/python3-config && curl -sS https://bootstrap.pypa.io/get-pip.py | python${PYTHON_VERSION} && python3 --version && python3 -m pip --version # buildkit
136.00B 2024-10-15 04:28:06 RUN |2 CUDA_VERSION=12.4.1 PYTHON_VERSION=3.12 /bin/sh -c PYTHON_VERSION_STR=$(echo ${PYTHON_VERSION} | sed 's/\.//g') && echo "export PYTHON_VERSION_STR=${PYTHON_VERSION_STR}" >> /etc/environment # buildkit
0.00B 2024-07-06 03:52:48 ENV DEBIAN_FRONTEND=noninteractive
0.00B 2024-07-06 03:52:48 WORKDIR /vllm-workspace
0.00B 2024-07-06 03:52:48 ARG PYTHON_VERSION=3.12
0.00B 2024-07-06 03:52:48 ARG CUDA_VERSION=12.4.1
0.00B 2024-04-23 07:42:28 ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
0.00B 2024-04-23 07:42:28 ENV NVIDIA_VISIBLE_DEVICES=all
17.29KB 2024-04-23 07:42:28 COPY NGC-DL-CONTAINER-LICENSE / # buildkit
0.00B 2024-04-23 07:42:28 ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
0.00B 2024-04-23 07:42:28 ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
46.00B 2024-04-23 07:42:28 RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
155.93MB 2024-04-23 07:42:28 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends cuda-cudart-12-4=${NV_CUDA_CUDART_VERSION} ${NV_CUDA_COMPAT_PACKAGE} && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2024-04-23 07:42:16 ENV CUDA_VERSION=12.4.1
10.57MB 2024-04-23 07:42:16 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends gnupg2 curl ca-certificates && curl -fsSLO https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/${NVARCH}/cuda-keyring_1.1-1_all.deb && dpkg -i cuda-keyring_1.1-1_all.deb && apt-get purge --autoremove -y curl && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2024-04-23 07:42:16 LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
0.00B 2024-04-23 07:42:16 ARG TARGETARCH
0.00B 2024-04-23 07:42:16 ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4
0.00B 2024-04-23 07:42:16 ENV NV_CUDA_CUDART_VERSION=12.4.127-1
0.00B 2024-04-23 07:42:16 ENV NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536
0.00B 2024-04-23 07:42:16 ENV NVARCH=x86_64
0.00B 2024-04-11 02:52:04 /bin/sh -c #(nop) CMD ["/bin/bash"]
77.86MB 2024-04-11 02:52:04 /bin/sh -c #(nop) ADD file:3bd10da0673e2e72cb06a1f64a9df49a36341df39b0f762e3d1b38ee4de296fa in /
0.00B 2024-04-11 02:52:02 /bin/sh -c #(nop) LABEL org.opencontainers.image.version=22.04
0.00B 2024-04-11 02:52:02 /bin/sh -c #(nop) LABEL org.opencontainers.image.ref.name=ubuntu
0.00B 2024-04-11 02:52:02 /bin/sh -c #(nop) ARG LAUNCHPAD_BUILD_ARCH
0.00B 2024-04-11 02:52:02 /bin/sh -c #(nop) ARG RELEASE

镜像信息 

{
    "Id": "sha256:698668586297dd30428a9f3bbcadb8a2034732ed13fdcd49218c8c3c9eb1cbd6",
    "RepoTags": [
        "vllm/vllm-openai:v0.6.4.post1",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.4.post1"
    ],
    "RepoDigests": [
        "vllm/vllm-openai@sha256:55a88146a4da0b6e193431b5b1d3492dfd7bebdc16919df4d031273e85a6157c",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai@sha256:50ec0bf905ee5f103a599abc13d4f568fb3be51228eaf539b5a289dae3191a3d"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2024-11-15T10:02:00.726462716-08:00",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.4 brand=tesla,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=geforce,driver\u003e=470,driver\u003c471 brand=geforcertx,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=titan,driver\u003e=470,driver\u003c471 brand=titanrtx,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=525,driver\u003c526 brand=unknown,driver\u003e=525,driver\u003c526 brand=nvidia,driver\u003e=525,driver\u003c526 brand=nvidiartx,driver\u003e=525,driver\u003c526 brand=geforce,driver\u003e=525,driver\u003c526 brand=geforcertx,driver\u003e=525,driver\u003c526 brand=quadro,driver\u003e=525,driver\u003c526 brand=quadrortx,driver\u003e=525,driver\u003c526 brand=titan,driver\u003e=525,driver\u003c526 brand=titanrtx,driver\u003e=525,driver\u003c526 brand=tesla,driver\u003e=535,driver\u003c536 brand=unknown,driver\u003e=535,driver\u003c536 brand=nvidia,driver\u003e=535,driver\u003c536 brand=nvidiartx,driver\u003e=535,driver\u003c536 brand=geforce,driver\u003e=535,driver\u003c536 brand=geforcertx,driver\u003e=535,driver\u003c536 brand=quadro,driver\u003e=535,driver\u003c536 brand=quadrortx,driver\u003e=535,driver\u003c536 brand=titan,driver\u003e=535,driver\u003c536 brand=titanrtx,driver\u003e=535,driver\u003c536",
            "NV_CUDA_CUDART_VERSION=12.4.127-1",
            "NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4",
            "CUDA_VERSION=12.4.1",
            "LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "DEBIAN_FRONTEND=noninteractive",
            "VLLM_USAGE_SOURCE=production-docker-image"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/vllm-workspace",
        "Entrypoint": [
            "python3",
            "-m",
            "vllm.entrypoints.openai.api_server"
        ],
        "OnBuild": null,
        "Labels": {
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "22.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 10644411911,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/0bc3f1cf700771765707f5adb04d91e7b069b703faaa7ee30060f970bc718be2/diff:/var/lib/docker/overlay2/a8a1f5c949688b00c594bb9d608349c2946cd496987dc8005e2ce7ed48683797/diff:/var/lib/docker/overlay2/49dcd72263ebcc57841f685e3be44f129d19e29c3200a3250ec0690d6d7c6bd4/diff:/var/lib/docker/overlay2/94fee34df4d76d738bc00e3c296aed5693c93e11f7c1490899c13ebc3ba8ef65/diff:/var/lib/docker/overlay2/65a5a94fdda4b072b3052c966d4acca1aa119fec9c04d98392abe0b5401ff2ed/diff:/var/lib/docker/overlay2/abd4cd0fbcfe86ca6f1d873277b60628543b973d438380312f63bc99b104f7b0/diff:/var/lib/docker/overlay2/4c67546afd93a1bdc27661bdff66ec6ebf9b49eb7ae33aa8b6dda039bf2d0065/diff:/var/lib/docker/overlay2/d0a507259d74e5b5ec4da75be6517077b4e41b069bdf1cd37885253a325d817e/diff:/var/lib/docker/overlay2/c96adcef9058d31322df86df81cbd7502a196242984e59d1e04b199271c6d221/diff:/var/lib/docker/overlay2/74792e268953b4fdb260ea0804d8d312f9193ba3f2f5b0effaae5ea56fcfd80c/diff:/var/lib/docker/overlay2/d610c5cb5669b0a70624a55babbe27b4d9bcec57558962c147458ff2bf897525/diff:/var/lib/docker/overlay2/148bcc66ab70b6cb427a25a34862b3d6697911eccdb26609268f0f32a3858f97/diff",
            "MergedDir": "/var/lib/docker/overlay2/9f0a01a38dfebf866d8f8f0c2ffd118f44d1a4215736774a30eeed8bd97a7646/merged",
            "UpperDir": "/var/lib/docker/overlay2/9f0a01a38dfebf866d8f8f0c2ffd118f44d1a4215736774a30eeed8bd97a7646/diff",
            "WorkDir": "/var/lib/docker/overlay2/9f0a01a38dfebf866d8f8f0c2ffd118f44d1a4215736774a30eeed8bd97a7646/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:e0a9f5911802534ba097660206feabeb0247a81e409029167b30e2e1f2803b57",
            "sha256:47654eeadbc543f1dd44ebb41c6ca0954b9f1813efabdcd46b0e7f17ac4e9fd1",
            "sha256:efe2b79b53de08e199a2ce107d83adc0cbdff94f605e03f5ef51f3df3ae31cfd",
            "sha256:46d54736d31f4bfeb749544e22e8611dba11128bdb2cebb820a3b452b50e7d52",
            "sha256:809d3bb9c80fb3d31d4c061ba0b38ba4e83b6329e33c2cb2bbf27251a8e527c6",
            "sha256:c1773f613c662964cd11fa206779f38c92fb00e3a835e7931070285cfd68aadd",
            "sha256:e37cbea0d17fcd8906d4136f2eab993b6eef803eb8141933f596e7b6d78c6636",
            "sha256:e819f72bf6d3ec7ed9a85b73f5b1af866fe7765b1d0a7a9908cbca1fde836038",
            "sha256:0f1574f66fa6175a23113c89ce6fb60f321c30c428ccccf2f4061c42375fa766",
            "sha256:6baaa2ff364cdaf01b8c412381721568443abacace8880ea09d5695136d0d405",
            "sha256:f0d21c4c4658a1c39e188e53dd2c2b77ef993e4b11a049240e0e69c0c5de6391",
            "sha256:a4b30b276269847ea33d43802db3ae5cdfb031573e1d5b77c97a515cfa068787",
            "sha256:894d057b5d091276692c33d43d5f4f023ccd2573243ec4f543780cf7b3f8f7ad"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-11-19T00:28:48.851205146+08:00"
    }
}

更多版本

docker.io/vllm/vllm-openai:v0.5.4

linux/amd64 docker.io9.90GB2024-09-07 06:20
203

docker.io/vllm/vllm-openai:v0.6.0

linux/amd64 docker.io9.72GB2024-09-11 01:51
307

docker.io/vllm/vllm-openai:v0.6.1.post2

linux/amd64 docker.io9.81GB2024-09-24 01:43
207

docker.io/vllm/vllm-openai:latest

linux/amd64 docker.io10.24GB2024-10-11 00:43
176

docker.io/vllm/vllm-openai:v0.6.4.post1

linux/amd64 docker.io10.64GB2024-11-19 00:42
31