docker.io/lmsysorg/sglang:v0.3.0-cu121 linux/amd64

docker.io/lmsysorg/sglang:v0.3.0-cu121 - 国内下载镜像源 浏览次数:125
sglang 是一个基于 LMSYS 的 Shell Grammar Language 环境容器镜像。
源镜像 docker.io/lmsysorg/sglang:v0.3.0-cu121
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121
镜像ID sha256:740797cd959f1b53aa625954fd7e5d01894fa28f0e2075b4e5ab4e826fc64efc
镜像TAG v0.3.0-cu121
大小 15.88GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 /opt/nvidia/nvidia_entrypoint.sh
工作目录 /sgl-workspace
OS/平台 linux/amd64
浏览量 125 次
贡献者
镜像创建 2024-09-03T20:41:06.731602771Z
同步时间 2024-09-12 00:53
更新时间 2024-11-22 04:45
环境变量
PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 NV_CUDA_CUDART_VERSION=12.1.105-1 NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1 CUDA_VERSION=12.1.1 LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility NV_CUDA_LIB_VERSION=12.1.1-1 NV_NVTX_VERSION=12.1.105-1 NV_LIBNPP_VERSION=12.1.0.40-1 NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1 NV_LIBCUSPARSE_VERSION=12.1.0.106-1 NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1 NV_LIBCUBLAS_VERSION=12.1.3.1-1 NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1 NV_LIBNCCL_PACKAGE_NAME=libnccl2 NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1 NCCL_VERSION=2.17.1-1 NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1 NVIDIA_PRODUCT_NAME=CUDA NV_CUDA_CUDART_DEV_VERSION=12.1.105-1 NV_NVML_DEV_VERSION=12.1.105-1 NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1 NV_LIBNPP_DEV_VERSION=12.1.0.40-1 NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1 NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1 NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1 NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1 NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1 NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1 NV_NVPROF_VERSION=12.1.105-1 NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1 NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1 NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1 LIBRARY_PATH=/usr/local/cuda/lib64/stubs DEBIAN_FRONTEND=interactive
镜像标签
NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer ubuntu: org.opencontainers.image.ref.name 20.04: org.opencontainers.image.version

Docker拉取命令 无权限下载?点我修复 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121  docker.io/lmsysorg/sglang:v0.3.0-cu121

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121  docker.io/lmsysorg/sglang:v0.3.0-cu121

Shell快速替换命令 

sed -i 's#lmsysorg/sglang:v0.3.0-cu121#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121  docker.io/lmsysorg/sglang:v0.3.0-cu121'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121  docker.io/lmsysorg/sglang:v0.3.0-cu121'

镜像历史

大小 创建时间 层信息
0.00B 2024-09-04 04:41:06 ENV DEBIAN_FRONTEND=interactive
0.00B 2024-09-04 04:41:06 RUN |2 BUILD_TYPE=all CUDA_VERSION=12.1.1 /bin/sh -c python3 -m pip cache purge # buildkit
1.84GB 2024-09-04 04:41:06 RUN |2 BUILD_TYPE=all CUDA_VERSION=12.1.1 /bin/sh -c if [ "$CUDA_VERSION" = "12.1.1" ]; then export CUDA_IDENTIFIER=cu121 && python3 -m pip --no-cache-dir install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/; elif [ "$CUDA_VERSION" = "12.4.1" ]; then export CUDA_IDENTIFIER=cu124 && python3 -m pip --no-cache-dir install flashinfer -i https://flashinfer.ai/whl/cu124/torch2.4/; elif [ "$CUDA_VERSION" = "11.8.0" ]; then export CUDA_IDENTIFIER=cu118 && python3 -m pip install torch==2.4.0 --index-url https://download.pytorch.org/whl/cu118 && python3 -m pip --no-cache-dir install flashinfer -i https://flashinfer.ai/whl/cu118/torch2.4/; else echo "Unsupported CUDA version: $CUDA_VERSION" && exit 1; fi # buildkit
0.00B 2024-09-04 04:40:40 ARG CUDA_VERSION
6.77GB 2024-09-04 04:40:40 RUN |1 BUILD_TYPE=all /bin/sh -c python3 -m pip install --upgrade pip setuptools wheel html5lib six && git clone --depth=1 https://github.com/sgl-project/sglang.git && cd sglang && if [ "$BUILD_TYPE" = "srt" ]; then python3 -m pip --no-cache-dir install -e "python[srt]"; else python3 -m pip --no-cache-dir install -e "python[all]"; fi # buildkit
0.00B 2024-09-04 04:34:28 WORKDIR /sgl-workspace
243.07MB 2024-09-04 04:34:28 RUN |1 BUILD_TYPE=all /bin/sh -c echo 'tzdata tzdata/Areas select America' | debconf-set-selections && echo 'tzdata tzdata/Zones/America select Los_Angeles' | debconf-set-selections && apt update -y && apt install software-properties-common -y && add-apt-repository ppa:deadsnakes/ppa -y && apt update && apt install python3.10 python3.10-dev -y && update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.8 1 && update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.10 2 && update-alternatives --set python3 /usr/bin/python3.10 && apt install python3.10-distutils -y && apt install curl git sudo -y && curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py && python3 get-pip.py && python3 --version && python3 -m pip --version && rm -rf /var/lib/apt/lists/* && apt clean # buildkit
0.00B 2024-09-04 04:34:28 ENV DEBIAN_FRONTEND=noninteractive
0.00B 2024-09-04 04:34:28 ARG BUILD_TYPE=all
0.00B 2023-11-10 13:25:45 ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs
379.49KB 2023-11-10 13:25:45 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_DEV_PACKAGE_NAME} ${NV_LIBNCCL_DEV_PACKAGE_NAME} # buildkit
4.77GB 2023-11-10 13:25:42 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends libtinfo5 libncursesw5 cuda-cudart-dev-12-1=${NV_CUDA_CUDART_DEV_VERSION} cuda-command-line-tools-12-1=${NV_CUDA_LIB_VERSION} cuda-minimal-build-12-1=${NV_CUDA_LIB_VERSION} cuda-libraries-dev-12-1=${NV_CUDA_LIB_VERSION} cuda-nvml-dev-12-1=${NV_NVML_DEV_VERSION} ${NV_NVPROF_DEV_PACKAGE} ${NV_LIBNPP_DEV_PACKAGE} libcusparse-dev-12-1=${NV_LIBCUSPARSE_DEV_VERSION} ${NV_LIBCUBLAS_DEV_PACKAGE} ${NV_LIBNCCL_DEV_PACKAGE} ${NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE} && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2023-11-10 13:25:42 LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
0.00B 2023-11-10 13:25:42 ARG TARGETARCH
0.00B 2023-11-10 13:25:42 ENV NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1
0.00B 2023-11-10 13:25:42 ENV NCCL_VERSION=2.17.1-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
0.00B 2023-11-10 13:25:42 ENV NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1
0.00B 2023-11-10 13:25:42 ENV NV_NVPROF_VERSION=12.1.105-1
0.00B 2023-11-10 13:25:42 ENV NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1
0.00B 2023-11-10 13:25:42 ENV NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBNPP_DEV_VERSION=12.1.0.40-1
0.00B 2023-11-10 13:25:42 ENV NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1
0.00B 2023-11-10 13:25:42 ENV NV_NVML_DEV_VERSION=12.1.105-1
0.00B 2023-11-10 13:25:42 ENV NV_CUDA_CUDART_DEV_VERSION=12.1.105-1
0.00B 2023-11-10 13:25:42 ENV NV_CUDA_LIB_VERSION=12.1.1-1
0.00B 2023-11-10 13:14:24 ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
0.00B 2023-11-10 13:14:24 ENV NVIDIA_PRODUCT_NAME=CUDA
2.53KB 2023-11-10 13:14:24 COPY nvidia_entrypoint.sh /opt/nvidia/ # buildkit
3.06KB 2023-11-10 13:14:24 COPY entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
259.50KB 2023-11-10 13:14:24 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_PACKAGE_NAME} ${NV_LIBNCCL_PACKAGE_NAME} # buildkit
2.01GB 2023-11-10 13:14:23 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends cuda-libraries-12-1=${NV_CUDA_LIB_VERSION} ${NV_LIBNPP_PACKAGE} cuda-nvtx-12-1=${NV_NVTX_VERSION} libcusparse-12-1=${NV_LIBCUSPARSE_VERSION} ${NV_LIBCUBLAS_PACKAGE} ${NV_LIBNCCL_PACKAGE} && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2023-11-10 13:14:23 LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
0.00B 2023-11-10 13:14:23 ARG TARGETARCH
0.00B 2023-11-10 13:14:23 ENV NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1
0.00B 2023-11-10 13:14:23 ENV NCCL_VERSION=2.17.1-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBNCCL_PACKAGE_NAME=libnccl2
0.00B 2023-11-10 13:14:23 ENV NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBCUBLAS_VERSION=12.1.3.1-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBCUSPARSE_VERSION=12.1.0.106-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1
0.00B 2023-11-10 13:14:23 ENV NV_LIBNPP_VERSION=12.1.0.40-1
0.00B 2023-11-10 13:14:23 ENV NV_NVTX_VERSION=12.1.105-1
0.00B 2023-11-10 13:14:23 ENV NV_CUDA_LIB_VERSION=12.1.1-1
0.00B 2023-11-10 13:07:30 ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
0.00B 2023-11-10 13:07:30 ENV NVIDIA_VISIBLE_DEVICES=all
17.29KB 2023-11-10 13:07:30 COPY NGC-DL-CONTAINER-LICENSE / # buildkit
0.00B 2023-11-10 13:07:29 ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
0.00B 2023-11-10 13:07:29 ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
46.00B 2023-11-10 13:07:29 RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
149.60MB 2023-11-10 13:07:29 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends cuda-cudart-12-1=${NV_CUDA_CUDART_VERSION} ${NV_CUDA_COMPAT_PACKAGE} && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2023-11-10 13:07:08 ENV CUDA_VERSION=12.1.1
18.32MB 2023-11-10 13:07:08 RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends gnupg2 curl ca-certificates && curl -fsSL https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/${NVARCH}/3bf863cc.pub | apt-key add - && echo "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/${NVARCH} /" > /etc/apt/sources.list.d/cuda.list && apt-get purge --autoremove -y curl && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2023-11-10 13:07:08 LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
0.00B 2023-11-10 13:07:08 ARG TARGETARCH
0.00B 2023-11-10 13:07:08 ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1
0.00B 2023-11-10 13:07:08 ENV NV_CUDA_CUDART_VERSION=12.1.105-1
0.00B 2023-11-10 13:07:08 ENV NVIDIA_REQUIRE_CUDA=cuda>=12.1 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526
0.00B 2023-11-10 13:07:08 ENV NVARCH=x86_64
0.00B 2023-10-03 18:45:52 /bin/sh -c #(nop) CMD ["/bin/bash"]
72.79MB 2023-10-03 18:45:51 /bin/sh -c #(nop) ADD file:4809da414c2d478b4d991cbdaa2df457f2b3d07d0ff6cf673f09a66f90833e81 in /
0.00B 2023-10-03 18:45:50 /bin/sh -c #(nop) LABEL org.opencontainers.image.version=20.04
0.00B 2023-10-03 18:45:50 /bin/sh -c #(nop) LABEL org.opencontainers.image.ref.name=ubuntu
0.00B 2023-10-03 18:45:50 /bin/sh -c #(nop) ARG LAUNCHPAD_BUILD_ARCH
0.00B 2023-10-03 18:45:50 /bin/sh -c #(nop) ARG RELEASE

镜像信息 

{
    "Id": "sha256:740797cd959f1b53aa625954fd7e5d01894fa28f0e2075b4e5ab4e826fc64efc",
    "RepoTags": [
        "lmsysorg/sglang:v0.3.0-cu121",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang:v0.3.0-cu121"
    ],
    "RepoDigests": [
        "lmsysorg/sglang@sha256:bbbd8eb94f25b30c4ac69d914f160b4cd39f05b0784d68aaae9c4991ad29d8a5",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/lmsysorg/sglang@sha256:c2e576c2b98e5b86272306594c4e2f4dc0a5781b64b4bb065f564aa42351dc9d"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2024-09-03T20:41:06.731602771Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.1 brand=tesla,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=geforce,driver\u003e=470,driver\u003c471 brand=geforcertx,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=titan,driver\u003e=470,driver\u003c471 brand=titanrtx,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=525,driver\u003c526 brand=unknown,driver\u003e=525,driver\u003c526 brand=nvidia,driver\u003e=525,driver\u003c526 brand=nvidiartx,driver\u003e=525,driver\u003c526 brand=geforce,driver\u003e=525,driver\u003c526 brand=geforcertx,driver\u003e=525,driver\u003c526 brand=quadro,driver\u003e=525,driver\u003c526 brand=quadrortx,driver\u003e=525,driver\u003c526 brand=titan,driver\u003e=525,driver\u003c526 brand=titanrtx,driver\u003e=525,driver\u003c526",
            "NV_CUDA_CUDART_VERSION=12.1.105-1",
            "NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-1",
            "CUDA_VERSION=12.1.1",
            "LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "NV_CUDA_LIB_VERSION=12.1.1-1",
            "NV_NVTX_VERSION=12.1.105-1",
            "NV_LIBNPP_VERSION=12.1.0.40-1",
            "NV_LIBNPP_PACKAGE=libnpp-12-1=12.1.0.40-1",
            "NV_LIBCUSPARSE_VERSION=12.1.0.106-1",
            "NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-1",
            "NV_LIBCUBLAS_VERSION=12.1.3.1-1",
            "NV_LIBCUBLAS_PACKAGE=libcublas-12-1=12.1.3.1-1",
            "NV_LIBNCCL_PACKAGE_NAME=libnccl2",
            "NV_LIBNCCL_PACKAGE_VERSION=2.17.1-1",
            "NCCL_VERSION=2.17.1-1",
            "NV_LIBNCCL_PACKAGE=libnccl2=2.17.1-1+cuda12.1",
            "NVIDIA_PRODUCT_NAME=CUDA",
            "NV_CUDA_CUDART_DEV_VERSION=12.1.105-1",
            "NV_NVML_DEV_VERSION=12.1.105-1",
            "NV_LIBCUSPARSE_DEV_VERSION=12.1.0.106-1",
            "NV_LIBNPP_DEV_VERSION=12.1.0.40-1",
            "NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-1=12.1.0.40-1",
            "NV_LIBCUBLAS_DEV_VERSION=12.1.3.1-1",
            "NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-1",
            "NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-1=12.1.3.1-1",
            "NV_CUDA_NSIGHT_COMPUTE_VERSION=12.1.1-1",
            "NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-1=12.1.1-1",
            "NV_NVPROF_VERSION=12.1.105-1",
            "NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-1=12.1.105-1",
            "NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev",
            "NV_LIBNCCL_DEV_PACKAGE_VERSION=2.17.1-1",
            "NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.17.1-1+cuda12.1",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs",
            "DEBIAN_FRONTEND=interactive"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/sgl-workspace",
        "Entrypoint": [
            "/opt/nvidia/nvidia_entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.version": "20.04"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 15877070400,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/23851c351079753cc1900c48ad456b83fb4e29eea84c60f9a9fa54acd19b3c5c/diff:/var/lib/docker/overlay2/3ee4d46ecae126c62d1b521471fb5d2eb32e3adf3a484909a6ee27e086526230/diff:/var/lib/docker/overlay2/cf8a58f513a8aa76275b6ac66fd238c247bcf14bc7d6b0e6e923ab7d4289f2a7/diff:/var/lib/docker/overlay2/c5d8dc6a615a0e9f0af628b9f8d82033754ae9f070bd15a37ae848142647ad6f/diff:/var/lib/docker/overlay2/1b03a0c74286f8fe0ac0855eb15b9a5d93317f75464159571e69e913accb394e/diff:/var/lib/docker/overlay2/66a136e84369e36d51b607e4b573e42f75d9f9fd46878abda0a002f553ed7766/diff:/var/lib/docker/overlay2/9afb989036511ed394c11ab3fd82fec3e6652b014849dc7def9d8939acab9bdc/diff:/var/lib/docker/overlay2/40a840a1949f14daecb69833618195ee3287289c15ed09670b78323591136681/diff:/var/lib/docker/overlay2/366e6b02a7d27b4b0892581e31bd999098006ccc1938c1aefdc48fa1b980e0af/diff:/var/lib/docker/overlay2/600ff8a79e3ae23fd13a2391ca34ec34982da00615776eef7f9ee26dc72bb766/diff:/var/lib/docker/overlay2/6550f7f97b3c09191e5ac133faf7b647683af3981fc0c98e0f13dd4bbb352870/diff:/var/lib/docker/overlay2/f95b0488c9d29006fae57e033811a8616138632af3c46148b4b431bc2eff4e48/diff:/var/lib/docker/overlay2/ae714000eb6f9e003039f53f94018d7fc61b484f520e6afa4380f48b15ac3385/diff:/var/lib/docker/overlay2/cd4d9bb2303bcbe935a6d553edf3330e00f79f1430417e27784e910f084879c7/diff:/var/lib/docker/overlay2/4a964ea6df838f346d50fe5e264688ffb5e9dc3ec5e32eb3276a470547785018/diff",
            "MergedDir": "/var/lib/docker/overlay2/0099435552c1f3b6c2a46cce010b9ba357274ebeaea92cdcf480454be02b6080/merged",
            "UpperDir": "/var/lib/docker/overlay2/0099435552c1f3b6c2a46cce010b9ba357274ebeaea92cdcf480454be02b6080/diff",
            "WorkDir": "/var/lib/docker/overlay2/0099435552c1f3b6c2a46cce010b9ba357274ebeaea92cdcf480454be02b6080/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:6c3e7df31590f02f10cb71fc4eb27653e9b428df2e6e5421a455b062bd2e39f9",
            "sha256:5c0359201b8f5316a9c120cc074c134e6294e6351b6ba4384a843006f6716dd0",
            "sha256:f620bf47e83df6cb9d61bf1728402f88549bca976b3047f9cb69d03be03dc21b",
            "sha256:8d78458ccbe218dba1de0b340767e15e4693d7041f6407b69b82caed09c08e0b",
            "sha256:9dbd6d766fae94f829384e71cf3ff5fedfea9f448d4069d0ce87f3d544d19ecc",
            "sha256:379cd604fb89fd203f52b15d2f09fb14f70fc08cbe9655154a4f478ab72c5d93",
            "sha256:82adc44e81b3913c7215be048da7cae287149aba6fdcaf08065662a15d8b4e85",
            "sha256:cca411d699bf4af0a4bc8f047be6f79365f026d1458f74be6a9b2d80de2514de",
            "sha256:226146661e721e03f1d7fc62bbc58adf2e8185f06c3b794624b6f5efefc28b9c",
            "sha256:0e5e6a7b15e48919ddbaf00ab643e058050d95a02f4e2f0fc84b8a1a0f56e552",
            "sha256:ad6bf06f23c6a368ade44418b3fa62a77964c45a9df1a0533434ec5ea1670a65",
            "sha256:167dd3b4386f9e96ab8a0943ba95ec550da840bd71c711ba0e42a3364afe4bf2",
            "sha256:05e59816ac3fadb1dc88cbca6fbe70e22a60f56c18cc8b2a912f55939cf01b11",
            "sha256:98cabae8e59ab7fe2491b43488300809cf379d9ba7ebefffe67977d380a534e5",
            "sha256:6f460c29dd04da03948d7fc71a8e3bd189f4b8e8480da8231a1ea02bf6ff54ba",
            "sha256:84f774291a5cc884ed35dd57ea8956988e9340324792794a8236140cc8f14169"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-09-12T00:42:04.987647538+08:00"
    }
}

更多版本

docker.io/lmsysorg/sglang:v0.2.0-cu124

linux/amd64 docker.io16.10GB2024-07-26 19:20
413

docker.io/lmsysorg/sglang:v0.3.0-cu121

linux/amd64 docker.io15.88GB2024-09-12 00:53
124

docker.io/lmsysorg/sglang:v0.3.0-cu124

linux/amd64 docker.io16.12GB2024-09-13 01:38
79

docker.io/lmsysorg/sglang:latest

linux/amd64 docker.io15.95GB2024-10-29 01:12
44