源镜像 |
docker.io/vllm/vllm-openai:v0.6.6 |
国内镜像 |
swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 |
镜像ID |
sha256:6a43a2dfb6fb4681fe1732d7cd1a0834590b44b7d2bc483886883655468a4591 |
镜像TAG |
v0.6.6 |
大小 |
10.23GB |
镜像源 |
docker.io |
项目信息 |
Docker-Hub主页 🚀项目TAG 🚀 |
CMD |
|
启动入口 |
python3 -m vllm.entrypoints.openai.api_server |
工作目录 |
/vllm-workspace |
OS/平台 |
linux/amd64
|
浏览量 |
81 次 |
贡献者 |
14*******7@qq.com |
镜像创建 |
2024-12-27T00:59:06.124755591Z |
同步时间 |
2025-01-04 00:37 |
更新时间 |
2025-01-17 18:25 |
PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
NVARCH=x86_64
NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526
NV_CUDA_CUDART_VERSION=12.1.55-1
NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1
CUDA_VERSION=12.1.0
LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
NVIDIA_VISIBLE_DEVICES=all
NVIDIA_DRIVER_CAPABILITIES=compute,utility
DEBIAN_FRONTEND=noninteractive
VLLM_USAGE_SOURCE=production-docker-image
NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer
ubuntu: org.opencontainers.image.ref.name
22.04: org.opencontainers.image.version
Docker拉取命令 无权限下载?点我修复
docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6
docker tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 docker.io/vllm/vllm-openai:v0.6.6
Containerd拉取命令
ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6
ctr images tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 docker.io/vllm/vllm-openai:v0.6.6
Shell快速替换命令
sed -i 's#vllm/vllm-openai:v0.6.6#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6#' deployment.yaml
Ansible快速分发-Docker
#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 && docker tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 docker.io/vllm/vllm-openai:v0.6.6'
Ansible快速分发-Containerd
#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 && ctr images tag swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6 docker.io/vllm/vllm-openai:v0.6.6'
镜像构建历史
# 2024-12-27 08:59:06 0.00B 配置容器启动时运行的命令
ENTRYPOINT ["python3" "-m" "vllm.entrypoints.openai.api_server"]
# 2024-12-27 08:59:06 0.00B 设置环境变量 VLLM_USAGE_SOURCE
ENV VLLM_USAGE_SOURCE=production-docker-image
# 2024-12-27 08:59:06 332.42MB 执行命令并创建新的镜像层
RUN /bin/sh -c if [ "$TARGETPLATFORM" = "linux/arm64" ]; then pip install accelerate hf_transfer 'modelscope!=1.15.0' 'bitsandbytes>=0.42.0' 'timm==0.9.10' boto3 runai-model-streamer runai-model-streamer[s3]; else pip install accelerate hf_transfer 'modelscope!=1.15.0' 'bitsandbytes>=0.45.0' 'timm==0.9.10' boto3 runai-model-streamer runai-model-streamer[s3]; fi # buildkit
# 2024-12-27 08:58:54 343.86KB 复制新文件或目录到容器中
COPY examples examples # buildkit
# 2024-12-27 08:58:54 1.84GB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.1.0 PYTHON_VERSION=3.12 TARGETPLATFORM=linux/amd64 /bin/sh -c . /etc/environment && if [ "$TARGETPLATFORM" != "linux/arm64" ]; then python3 -m pip install https://github.com/flashinfer-ai/flashinfer/releases/download/v0.1.6/flashinfer-0.1.6+cu121torch2.4-cp${PYTHON_VERSION_STR}-cp${PYTHON_VERSION_STR}-linux_x86_64.whl; fi # buildkit
# 2024-12-27 08:58:01 6.72GB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.1.0 PYTHON_VERSION=3.12 TARGETPLATFORM=linux/amd64 /bin/sh -c python3 -m pip install dist/*.whl --verbose # buildkit
# 2024-12-27 08:21:25 0.00B 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.1.0 PYTHON_VERSION=3.12 TARGETPLATFORM=linux/amd64 /bin/sh -c if [ "$TARGETPLATFORM" = "linux/arm64" ]; then python3 -m pip install --index-url https://download.pytorch.org/whl/nightly/cu124 "torch==2.6.0.dev20241210+cu124" "torchvision==0.22.0.dev20241215"; fi # buildkit
# 2024-12-27 08:21:23 49.46KB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.1.0 PYTHON_VERSION=3.12 TARGETPLATFORM=linux/amd64 /bin/sh -c ldconfig /usr/local/cuda-$(echo $CUDA_VERSION | cut -d. -f1,2)/compat/ # buildkit
# 2024-12-27 08:21:22 1.10GB 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.1.0 PYTHON_VERSION=3.12 TARGETPLATFORM=linux/amd64 /bin/sh -c echo 'tzdata tzdata/Areas select America' | debconf-set-selections && echo 'tzdata tzdata/Zones/America select Los_Angeles' | debconf-set-selections && apt-get update -y && apt-get install -y ccache software-properties-common git curl wget sudo vim python3-pip && apt-get install -y ffmpeg libsm6 libxext6 libgl1 && add-apt-repository ppa:deadsnakes/ppa && apt-get update -y && apt-get install -y python${PYTHON_VERSION} python${PYTHON_VERSION}-dev python${PYTHON_VERSION}-venv libibverbs-dev && update-alternatives --install /usr/bin/python3 python3 /usr/bin/python${PYTHON_VERSION} 1 && update-alternatives --set python3 /usr/bin/python${PYTHON_VERSION} && ln -sf /usr/bin/python${PYTHON_VERSION}-config /usr/bin/python3-config && curl -sS https://bootstrap.pypa.io/get-pip.py | python${PYTHON_VERSION} && python3 --version && python3 -m pip --version # buildkit
# 2024-12-27 08:19:02 136.00B 执行命令并创建新的镜像层
RUN |3 CUDA_VERSION=12.1.0 PYTHON_VERSION=3.12 TARGETPLATFORM=linux/amd64 /bin/sh -c PYTHON_VERSION_STR=$(echo ${PYTHON_VERSION} | sed 's/\.//g') && echo "export PYTHON_VERSION_STR=${PYTHON_VERSION_STR}" >> /etc/environment # buildkit
# 2024-12-27 08:18:51 0.00B 定义构建参数
ARG TARGETPLATFORM
# 2024-12-27 08:18:51 0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
# 2024-12-27 08:18:51 0.00B 设置工作目录为/vllm-workspace
WORKDIR /vllm-workspace
# 2024-12-27 08:18:51 0.00B 定义构建参数
ARG PYTHON_VERSION=3.12
# 2024-12-27 08:18:51 0.00B 定义构建参数
ARG CUDA_VERSION=12.4.1
# 2023-11-10 13:44:29 0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
# 2023-11-10 13:44:29 0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
# 2023-11-10 13:44:29 17.29KB 复制新文件或目录到容器中
COPY NGC-DL-CONTAINER-LICENSE / # buildkit
# 2023-11-10 13:44:29 0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
# 2023-11-10 13:44:29 0.00B 设置环境变量 PATH
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
# 2023-11-10 13:44:29 46.00B 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
# 2023-11-10 13:44:29 149.59MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends cuda-cudart-12-1=${NV_CUDA_CUDART_VERSION} ${NV_CUDA_COMPAT_PACKAGE} && rm -rf /var/lib/apt/lists/* # buildkit
# 2023-11-10 13:44:18 0.00B 设置环境变量 CUDA_VERSION
ENV CUDA_VERSION=12.1.0
# 2023-11-10 13:44:18 10.56MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends gnupg2 curl ca-certificates && curl -fsSLO https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/${NVARCH}/cuda-keyring_1.0-1_all.deb && dpkg -i cuda-keyring_1.0-1_all.deb && apt-get purge --autoremove -y curl && rm -rf /var/lib/apt/lists/* # buildkit
# 2023-11-10 13:44:18 0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
# 2023-11-10 13:44:18 0.00B 定义构建参数
ARG TARGETARCH
# 2023-11-10 13:44:18 0.00B 设置环境变量 NV_CUDA_COMPAT_PACKAGE
ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1
# 2023-11-10 13:44:18 0.00B 设置环境变量 NV_CUDA_CUDART_VERSION
ENV NV_CUDA_CUDART_VERSION=12.1.55-1
# 2023-11-10 13:44:18 0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand
ENV NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526
# 2023-11-10 13:44:18 0.00B 设置环境变量 NVARCH
ENV NVARCH=x86_64
# 2023-10-05 15:33:32 0.00B
/bin/sh -c #(nop) CMD ["/bin/bash"]
# 2023-10-05 15:33:32 77.82MB
/bin/sh -c #(nop) ADD file:63d5ab3ef0aab308c0e71cb67292c5467f60deafa9b0418cbb220affcd078444 in /
# 2023-10-05 15:33:30 0.00B
/bin/sh -c #(nop) LABEL org.opencontainers.image.version=22.04
# 2023-10-05 15:33:30 0.00B
/bin/sh -c #(nop) LABEL org.opencontainers.image.ref.name=ubuntu
# 2023-10-05 15:33:30 0.00B
/bin/sh -c #(nop) ARG LAUNCHPAD_BUILD_ARCH
# 2023-10-05 15:33:30 0.00B
/bin/sh -c #(nop) ARG RELEASE
镜像信息
{
"Id": "sha256:6a43a2dfb6fb4681fe1732d7cd1a0834590b44b7d2bc483886883655468a4591",
"RepoTags": [
"vllm/vllm-openai:v0.6.6",
"swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai:v0.6.6"
],
"RepoDigests": [
"vllm/vllm-openai@sha256:6956052a3491118df885b37e240abebaf839b62495c3d54e617cb8401c54717b",
"swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/vllm/vllm-openai@sha256:1b4bf81f737df524c37de8bcd1cd3119d2e4756b99c2a75324298960c0618b5f"
],
"Parent": "",
"Comment": "buildkit.dockerfile.v0",
"Created": "2024-12-27T00:59:06.124755591Z",
"Container": "",
"ContainerConfig": null,
"DockerVersion": "",
"Author": "",
"Config": {
"Hostname": "",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"Tty": false,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
"NVARCH=x86_64",
"NVIDIA_REQUIRE_CUDA=cuda\u003e=12.1 brand=tesla,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=geforce,driver\u003e=470,driver\u003c471 brand=geforcertx,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=titan,driver\u003e=470,driver\u003c471 brand=titanrtx,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=525,driver\u003c526 brand=unknown,driver\u003e=525,driver\u003c526 brand=nvidia,driver\u003e=525,driver\u003c526 brand=nvidiartx,driver\u003e=525,driver\u003c526 brand=geforce,driver\u003e=525,driver\u003c526 brand=geforcertx,driver\u003e=525,driver\u003c526 brand=quadro,driver\u003e=525,driver\u003c526 brand=quadrortx,driver\u003e=525,driver\u003c526 brand=titan,driver\u003e=525,driver\u003c526 brand=titanrtx,driver\u003e=525,driver\u003c526",
"NV_CUDA_CUDART_VERSION=12.1.55-1",
"NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1",
"CUDA_VERSION=12.1.0",
"LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
"NVIDIA_VISIBLE_DEVICES=all",
"NVIDIA_DRIVER_CAPABILITIES=compute,utility",
"DEBIAN_FRONTEND=noninteractive",
"VLLM_USAGE_SOURCE=production-docker-image"
],
"Cmd": null,
"Image": "",
"Volumes": null,
"WorkingDir": "/vllm-workspace",
"Entrypoint": [
"python3",
"-m",
"vllm.entrypoints.openai.api_server"
],
"OnBuild": null,
"Labels": {
"maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
"org.opencontainers.image.ref.name": "ubuntu",
"org.opencontainers.image.version": "22.04"
}
},
"Architecture": "amd64",
"Os": "linux",
"Size": 10234910670,
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/f130c684094b80cbf630517f95f3343c537bbda0d168835339823db46ab6dc62/diff:/var/lib/docker/overlay2/9f213832ed587f92207a954c516f3494a4e6d2aa2b6996f33fb19fbdcdf1ef07/diff:/var/lib/docker/overlay2/b2cf09f0ece4417c50d7b52c8c3d3aa57412e369826d1312c4edf9adda978405/diff:/var/lib/docker/overlay2/d78eb1581d35985f9c3030392603d0050b1a6e3318202a89efd44e5bb3073a26/diff:/var/lib/docker/overlay2/c4a03b938a17890551bd0aedbbc13d0b408cfabf4e202cfcd49a99b80f49d475/diff:/var/lib/docker/overlay2/d1f1609dc5903f953109abf219b6eae30d2dd70af5c4266a6c761b719d6d6f9e/diff:/var/lib/docker/overlay2/a61ad6a4b20764c6dcc9a4ce97f1fcfb9ff089c9943975c64b5f4e3a440a9c0a/diff:/var/lib/docker/overlay2/2deebe712f33ced5351800f31c33b146fd62ac0d361e4227e7bb8cf450b71f3d/diff:/var/lib/docker/overlay2/86c98ab0ed88b61b06cf59d67d016cbf05a2c7cea2a7a4fe53a6be12a6bb87d7/diff:/var/lib/docker/overlay2/dddcc2c36b2b15125b046f443eaf956385215dd4fe1629756f29c2e1077ee125/diff:/var/lib/docker/overlay2/7c0ec148c160c668fe5b36bcb65f7d5badb55eb5dcdea8490e826c2a41b578a9/diff:/var/lib/docker/overlay2/b213e3c8abc27592f101ffbb1d0f2c437b5effe9b384d0f550f46a4f894f180d/diff:/var/lib/docker/overlay2/f2905627b4505cda033dd62b5a5dc1676edda5a6e1bda7cd6e6e2048fcf5aee0/diff",
"MergedDir": "/var/lib/docker/overlay2/c8516a71d6ce335367e890c105bed3c49a4a4d3b143db4621f89db69ad1d8e5b/merged",
"UpperDir": "/var/lib/docker/overlay2/c8516a71d6ce335367e890c105bed3c49a4a4d3b143db4621f89db69ad1d8e5b/diff",
"WorkDir": "/var/lib/docker/overlay2/c8516a71d6ce335367e890c105bed3c49a4a4d3b143db4621f89db69ad1d8e5b/work"
},
"Name": "overlay2"
},
"RootFS": {
"Type": "layers",
"Layers": [
"sha256:256d88da41857db513b95b50ba9a9b28491b58c954e25477d5dad8abb465430b",
"sha256:7b9433fba79bfc9269aab8277ea9975364db1c1f775a7ee6b14b5dffa045b294",
"sha256:765423415d690bf8ca1510e7147d5b86dba15dcf1a3b1a515f1a85cc5dd439bb",
"sha256:e4b1bddcbe6378dfa58bf1faa040813b74938129eb4bb06cbf083240335c5c54",
"sha256:cd77f58b80cdcfac5fcdef06b2033fedc1115073afae035a14b6692cb5cd6650",
"sha256:dca99e4e1880bddd9824e2280152442303b3ed94f4b31255c565f94398f9a9bd",
"sha256:1018a23031f6a2f170650c76cf3e3ef830ceefd8a24057b2de0b549d7f3bad3f",
"sha256:3f80cf148217dc22610a2d3048881f3c3a62609cad09ac63489cf17d40cbc91f",
"sha256:9784461169ba6aa63b25d5e9c57fa2333cd2aa4e0f088dc7d28aca5b052933e4",
"sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
"sha256:1e2b0bccadc7ed62f9f2d8c5dc70ad0a8da797dc060df9d0094d1533a4dd34a7",
"sha256:5bb00ddaf89616efc0d912127ecc576983108675d2c8b619426cb532289e06d6",
"sha256:2b9022a1e59a352e7ae940d2b358bf9410c4b7e40953b7c6e780df1ed67d1cf5",
"sha256:3a5785a243cc3ab383bdc8c416af25c7db179b86917318974e0ed266ea91d986"
]
},
"Metadata": {
"LastTagTime": "2025-01-04T00:25:17.170052452+08:00"
}
}