ghcr.io/theroyallab/tabbyapi:latest linux/amd64

ghcr.io/theroyallab/tabbyapi:latest - 国内下载镜像源 浏览次数:17

温馨提示:此镜像为latest tag镜像,本站无法保证此版本为最新镜像

TabbyAPI是一个为Tabby开源代码助手提供API服务的Docker镜像,允许用户通过API接口调用Tabby的代码补全、代码解释等功能,方便集成到各种开发工具或系统中。

源镜像 ghcr.io/theroyallab/tabbyapi:latest
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest
镜像ID sha256:33bb8a2c5935d7aaa1d39c15c6440a08cadeff056b6fab122615e3f50214a8a9
镜像TAG latest
大小 13.76GB
镜像源 ghcr.io
CMD main.py --host 0.0.0.0
启动入口 python3
工作目录 /app
OS/平台 linux/amd64
浏览量 17 次
贡献者
镜像创建 2026-05-26T22:36:56.616988288Z
同步时间 2026-05-29 02:54
开放端口
5000/tcp
环境变量
PATH=/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=12.8 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=vapps,driver>=470,driver<471 brand=vpc,driver>=470,driver<471 brand=vcs,driver>=470,driver<471 brand=vws,driver>=470,driver<471 brand=cloudgaming,driver>=470,driver<471 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 NV_CUDA_CUDART_VERSION=12.8.90-1 CUDA_VERSION=12.8.1 LD_LIBRARY_PATH=/usr/local/cuda/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility NV_CUDA_LIB_VERSION=12.8.1-1 NV_NVTX_VERSION=12.8.90-1 NV_LIBNPP_VERSION=12.3.3.100-1 NV_LIBNPP_PACKAGE=libnpp-12-8=12.3.3.100-1 NV_LIBCUSPARSE_VERSION=12.5.8.93-1 NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-8 NV_LIBCUBLAS_VERSION=12.8.4.1-1 NV_LIBCUBLAS_PACKAGE=libcublas-12-8=12.8.4.1-1 NV_LIBNCCL_PACKAGE_NAME=libnccl2 NV_LIBNCCL_PACKAGE_VERSION=2.25.1-1 NCCL_VERSION=2.25.1-1 NV_LIBNCCL_PACKAGE=libnccl2=2.25.1-1+cuda12.8 NVIDIA_PRODUCT_NAME=CUDA
镜像标签
NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer 2026-05-26T22:34:03.748Z: org.opencontainers.image.created The official API server for Exllama. OAI compatible, lightweight, and fast.: org.opencontainers.image.description AGPL-3.0: org.opencontainers.image.licenses ubuntu: org.opencontainers.image.ref.name 510367d1abc9b3a99a0d0afe86116db66c64ff21: org.opencontainers.image.revision https://github.com/theroyallab/tabbyAPI: org.opencontainers.image.source tabbyAPI: org.opencontainers.image.title https://github.com/theroyallab/tabbyAPI: org.opencontainers.image.url latest: org.opencontainers.image.version

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest  ghcr.io/theroyallab/tabbyapi:latest

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest  ghcr.io/theroyallab/tabbyapi:latest

Shell快速替换命令

sed -i 's#ghcr.io/theroyallab/tabbyapi:latest#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest  ghcr.io/theroyallab/tabbyapi:latest'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest  ghcr.io/theroyallab/tabbyapi:latest'

镜像构建历史


# 2026-05-27 06:36:56  0.00B 设置默认要执行的命令
CMD ["main.py" "--host" "0.0.0.0"]
                        
# 2026-05-27 06:36:56  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["python3"]
                        
# 2026-05-27 06:36:56  0.00B 声明容器运行时监听的端口
EXPOSE map[5000/tcp:{}]
                        
# 2026-05-27 06:36:56  560.78KB 复制新文件或目录到容器中
COPY . . # buildkit
                        
# 2026-05-27 06:36:56  0.00B 执行命令并创建新的镜像层
RUN /bin/sh -c rm pyproject.toml # buildkit
                        
# 2026-05-27 06:36:56  52.31KB 执行命令并创建新的镜像层
RUN /bin/sh -c pip install --no-cache-dir --no-deps .[extras] # buildkit
                        
# 2026-05-27 06:36:54  9.95GB 执行命令并创建新的镜像层
RUN /bin/sh -c pip install --no-cache-dir .[cu12] # buildkit
                        
# 2026-05-27 06:34:52  19.84KB 复制新文件或目录到容器中
COPY pyproject.toml . # buildkit
                        
# 2026-05-27 06:34:52  0.00B 设置工作目录为/app
WORKDIR /app
                        
# 2026-05-27 06:34:52  10.63MB 执行命令并创建新的镜像层
RUN /bin/sh -c pip install --no-cache-dir --upgrade pip # buildkit
                        
# 2026-05-27 06:34:52  0.00B 设置环境变量 PATH
ENV PATH=/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2026-05-27 06:34:50  13.26MB 执行命令并创建新的镜像层
RUN /bin/sh -c python3 -m venv /opt/venv # buildkit
                        
# 2026-05-27 06:34:47  384.64MB 执行命令并创建新的镜像层
RUN /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     build-essential     curl     ca-certificates     python3.12     python3-pip     python3.12-venv     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-03-11 06:30:18  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2025-03-11 06:30:18  2.53KB 复制新文件或目录到容器中
COPY nvidia_entrypoint.sh /opt/nvidia/ # buildkit
                        
# 2025-03-11 06:30:18  3.06KB 复制新文件或目录到容器中
COPY entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2025-03-11 06:30:18  239.89KB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_PACKAGE_NAME} ${NV_LIBNCCL_PACKAGE_NAME} # buildkit
                        
# 2025-03-11 06:30:18  3.11GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-libraries-12-8=${NV_CUDA_LIB_VERSION}     ${NV_LIBNPP_PACKAGE}     cuda-nvtx-12-8=${NV_NVTX_VERSION}     libcusparse-12-8=${NV_LIBCUSPARSE_VERSION}     ${NV_LIBCUBLAS_PACKAGE}     ${NV_LIBNCCL_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-03-11 06:30:18  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-03-11 06:30:18  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE
ENV NV_LIBNCCL_PACKAGE=libnccl2=2.25.1-1+cuda12.8
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NCCL_VERSION
ENV NCCL_VERSION=2.25.1-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE_VERSION
ENV NV_LIBNCCL_PACKAGE_VERSION=2.25.1-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE_NAME
ENV NV_LIBNCCL_PACKAGE_NAME=libnccl2
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBCUBLAS_PACKAGE
ENV NV_LIBCUBLAS_PACKAGE=libcublas-12-8=12.8.4.1-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBCUBLAS_VERSION
ENV NV_LIBCUBLAS_VERSION=12.8.4.1-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBCUBLAS_PACKAGE_NAME
ENV NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-8
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBCUSPARSE_VERSION
ENV NV_LIBCUSPARSE_VERSION=12.5.8.93-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBNPP_PACKAGE
ENV NV_LIBNPP_PACKAGE=libnpp-12-8=12.3.3.100-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_LIBNPP_VERSION
ENV NV_LIBNPP_VERSION=12.3.3.100-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_NVTX_VERSION
ENV NV_NVTX_VERSION=12.8.90-1
                        
# 2025-03-11 06:30:18  0.00B 设置环境变量 NV_CUDA_LIB_VERSION
ENV NV_CUDA_LIB_VERSION=12.8.1-1
                        
# 2025-03-11 06:19:21  0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
                        
# 2025-03-11 06:19:21  0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
                        
# 2025-03-11 06:19:21  17.29KB 复制新文件或目录到容器中
COPY NGC-DL-CONTAINER-LICENSE / # buildkit
                        
# 2025-03-11 06:19:21  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/cuda/lib64
                        
# 2025-03-11 06:19:21  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2025-03-11 06:19:21  22.00B 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/cuda/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2025-03-11 06:19:21  203.31MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-12-8=${NV_CUDA_CUDART_VERSION}     cuda-compat-12-8     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-03-11 06:19:07  0.00B 设置环境变量 CUDA_VERSION
ENV CUDA_VERSION=12.8.1
                        
# 2025-03-11 06:19:07  16.75MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     gnupg2 curl ca-certificates &&     curl -fsSL https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/${NVARCH}/3bf863cc.pub | apt-key add - &&     echo "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/${NVARCH} /" > /etc/apt/sources.list.d/cuda.list &&     apt-get purge --autoremove -y curl     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-03-11 06:19:07  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2025-03-11 06:19:07  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2025-03-11 06:19:07  0.00B 设置环境变量 NV_CUDA_CUDART_VERSION
ENV NV_CUDA_CUDART_VERSION=12.8.90-1
                        
# 2025-03-11 06:19:07  0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand
ENV NVIDIA_REQUIRE_CUDA=cuda>=12.8 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=vapps,driver>=470,driver<471 brand=vpc,driver>=470,driver<471 brand=vcs,driver>=470,driver<471 brand=vws,driver>=470,driver<471 brand=cloudgaming,driver>=470,driver<471 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566
                        
# 2025-03-11 06:19:07  0.00B 设置环境变量 NVARCH
ENV NVARCH=x86_64
                        
# 2025-01-27 12:14:03  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-01-27 12:14:03  78.13MB 
/bin/sh -c #(nop) ADD file:6df775300d76441aa33f31b22c1afce8dfe35c8ffbc14ef27c27009235b12a95 in / 
                        
# 2025-01-27 12:14:00  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=24.04
                        
# 2025-01-27 12:14:00  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-01-27 12:14:00  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-01-27 12:14:00  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:33bb8a2c5935d7aaa1d39c15c6440a08cadeff056b6fab122615e3f50214a8a9",
    "RepoTags": [
        "ghcr.io/theroyallab/tabbyapi:latest",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi:latest"
    ],
    "RepoDigests": [
        "ghcr.io/theroyallab/tabbyapi@sha256:3a5b38ee498b58260315e769b8277e10ba05e5ba04cdeb3a40225bb8834a5346",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/theroyallab/tabbyapi@sha256:3a5b38ee498b58260315e769b8277e10ba05e5ba04cdeb3a40225bb8834a5346"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2026-05-26T22:36:56.616988288Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "ExposedPorts": {
            "5000/tcp": {}
        },
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/venv/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.8 brand=unknown,driver\u003e=470,driver\u003c471 brand=grid,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=vapps,driver\u003e=470,driver\u003c471 brand=vpc,driver\u003e=470,driver\u003c471 brand=vcs,driver\u003e=470,driver\u003c471 brand=vws,driver\u003e=470,driver\u003c471 brand=cloudgaming,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=535,driver\u003c536 brand=grid,driver\u003e=535,driver\u003c536 brand=tesla,driver\u003e=535,driver\u003c536 brand=nvidia,driver\u003e=535,driver\u003c536 brand=quadro,driver\u003e=535,driver\u003c536 brand=quadrortx,driver\u003e=535,driver\u003c536 brand=nvidiartx,driver\u003e=535,driver\u003c536 brand=vapps,driver\u003e=535,driver\u003c536 brand=vpc,driver\u003e=535,driver\u003c536 brand=vcs,driver\u003e=535,driver\u003c536 brand=vws,driver\u003e=535,driver\u003c536 brand=cloudgaming,driver\u003e=535,driver\u003c536 brand=unknown,driver\u003e=550,driver\u003c551 brand=grid,driver\u003e=550,driver\u003c551 brand=tesla,driver\u003e=550,driver\u003c551 brand=nvidia,driver\u003e=550,driver\u003c551 brand=quadro,driver\u003e=550,driver\u003c551 brand=quadrortx,driver\u003e=550,driver\u003c551 brand=nvidiartx,driver\u003e=550,driver\u003c551 brand=vapps,driver\u003e=550,driver\u003c551 brand=vpc,driver\u003e=550,driver\u003c551 brand=vcs,driver\u003e=550,driver\u003c551 brand=vws,driver\u003e=550,driver\u003c551 brand=cloudgaming,driver\u003e=550,driver\u003c551 brand=unknown,driver\u003e=560,driver\u003c561 brand=grid,driver\u003e=560,driver\u003c561 brand=tesla,driver\u003e=560,driver\u003c561 brand=nvidia,driver\u003e=560,driver\u003c561 brand=quadro,driver\u003e=560,driver\u003c561 brand=quadrortx,driver\u003e=560,driver\u003c561 brand=nvidiartx,driver\u003e=560,driver\u003c561 brand=vapps,driver\u003e=560,driver\u003c561 brand=vpc,driver\u003e=560,driver\u003c561 brand=vcs,driver\u003e=560,driver\u003c561 brand=vws,driver\u003e=560,driver\u003c561 brand=cloudgaming,driver\u003e=560,driver\u003c561 brand=unknown,driver\u003e=565,driver\u003c566 brand=grid,driver\u003e=565,driver\u003c566 brand=tesla,driver\u003e=565,driver\u003c566 brand=nvidia,driver\u003e=565,driver\u003c566 brand=quadro,driver\u003e=565,driver\u003c566 brand=quadrortx,driver\u003e=565,driver\u003c566 brand=nvidiartx,driver\u003e=565,driver\u003c566 brand=vapps,driver\u003e=565,driver\u003c566 brand=vpc,driver\u003e=565,driver\u003c566 brand=vcs,driver\u003e=565,driver\u003c566 brand=vws,driver\u003e=565,driver\u003c566 brand=cloudgaming,driver\u003e=565,driver\u003c566",
            "NV_CUDA_CUDART_VERSION=12.8.90-1",
            "CUDA_VERSION=12.8.1",
            "LD_LIBRARY_PATH=/usr/local/cuda/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "NV_CUDA_LIB_VERSION=12.8.1-1",
            "NV_NVTX_VERSION=12.8.90-1",
            "NV_LIBNPP_VERSION=12.3.3.100-1",
            "NV_LIBNPP_PACKAGE=libnpp-12-8=12.3.3.100-1",
            "NV_LIBCUSPARSE_VERSION=12.5.8.93-1",
            "NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-8",
            "NV_LIBCUBLAS_VERSION=12.8.4.1-1",
            "NV_LIBCUBLAS_PACKAGE=libcublas-12-8=12.8.4.1-1",
            "NV_LIBNCCL_PACKAGE_NAME=libnccl2",
            "NV_LIBNCCL_PACKAGE_VERSION=2.25.1-1",
            "NCCL_VERSION=2.25.1-1",
            "NV_LIBNCCL_PACKAGE=libnccl2=2.25.1-1+cuda12.8",
            "NVIDIA_PRODUCT_NAME=CUDA"
        ],
        "Cmd": [
            "main.py",
            "--host",
            "0.0.0.0"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/app",
        "Entrypoint": [
            "python3"
        ],
        "OnBuild": null,
        "Labels": {
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.created": "2026-05-26T22:34:03.748Z",
            "org.opencontainers.image.description": "The official API server for Exllama. OAI compatible, lightweight, and fast.",
            "org.opencontainers.image.licenses": "AGPL-3.0",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "510367d1abc9b3a99a0d0afe86116db66c64ff21",
            "org.opencontainers.image.source": "https://github.com/theroyallab/tabbyAPI",
            "org.opencontainers.image.title": "tabbyAPI",
            "org.opencontainers.image.url": "https://github.com/theroyallab/tabbyAPI",
            "org.opencontainers.image.version": "latest"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 13764403273,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/da2904ec0269312d429de773117b654c97a6a023ee393c491d15cf8e8596d14c/diff:/var/lib/docker/overlay2/4591270af6b2de1688050e4b85c5b715921a05775a790f280d0bb14dbb081a1e/diff:/var/lib/docker/overlay2/132833d8456d5d24360b01b90492125c4d3d66bed4d5ff006d5a12e0c98bc1e9/diff:/var/lib/docker/overlay2/6c554f89620982f107c589f4210bab3e8875cae3de9aecc4b29553109c304e18/diff:/var/lib/docker/overlay2/e317128fa82d999b3c15fc44e7efe6255de5662bcf65f0b687880a3df1911abe/diff:/var/lib/docker/overlay2/f44221a2be785a82813d6bb62fb34984e9c1e7c23df44b4e8c981797ec3329e0/diff:/var/lib/docker/overlay2/0e1a61e1e77a4cd85e1bb00fda05c16f647af46a5ac8fb11cf749c4f9ccd89f3/diff:/var/lib/docker/overlay2/74d2d77aa002368f11f70c82a6e7fb016d5af7cb6b99823f7fe80f282e1d1a20/diff:/var/lib/docker/overlay2/98499a4998789cea9ffc24888aa212e0030ea525fdfd2168c8fb1bb1f9f7c9de/diff:/var/lib/docker/overlay2/2aac46490a6b583e8b5aa7928f6d3dc033afaf2cc52f90a150dbcce54235e5d9/diff:/var/lib/docker/overlay2/ad74e641bcb005e14a18667fe2b9b79a2fa17b21a8b12b7249c598e8dbe4104e/diff:/var/lib/docker/overlay2/c16ba3bb2d3a7db747b20180b6fbe37a7be330b432de69e383547765c004fc3c/diff:/var/lib/docker/overlay2/33c361fcb335a7b6cc4b5cabaeb5e1bd8f3f407e5bc3b66c3b3b9189906a521e/diff:/var/lib/docker/overlay2/3be78f94598f43c7be5e726c2122cda18d795b87875e01475004d805890db094/diff:/var/lib/docker/overlay2/98c60444443419fdd2bc46338091a706cc5140734413b05586b14c81d85dd7a8/diff:/var/lib/docker/overlay2/a6abf4c79c1bce4f676dd6828598ff745d1b1b3064747ad58b594a18afcdc0f8/diff:/var/lib/docker/overlay2/d5ba5778451cb9d6cd53a762324cbf17a65345e17306b42b60d69ba8f9186927/diff",
            "MergedDir": "/var/lib/docker/overlay2/d2f960d35fcab8636f485c33ea66b5a36e6b436dd398ce76e68f564941cce2fe/merged",
            "UpperDir": "/var/lib/docker/overlay2/d2f960d35fcab8636f485c33ea66b5a36e6b436dd398ce76e68f564941cce2fe/diff",
            "WorkDir": "/var/lib/docker/overlay2/d2f960d35fcab8636f485c33ea66b5a36e6b436dd398ce76e68f564941cce2fe/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:4b7c01ed0534d4f9be9cf97d068da1598c6c20b26cb6134fad066defdb6d541d",
            "sha256:5d874d849ec64ad89b8e1ff34cefc562238dfaaa6540905f0a8bac73777d4f25",
            "sha256:5ef6645238f3599acf1a7b450ae0a8e9306bea4e342a7af89d3992b804676999",
            "sha256:723554db4ba2a109baacf03b25cff50db586ce45370dfdbd21557171201992f5",
            "sha256:6020d84069cf575521faca653d2817e2195b8233b8c4e2d7bc65f3296296c2bb",
            "sha256:09d8fc1b386fa3eb8491421932e290ce3c33a55265e1d6da8cc9d720a08d3306",
            "sha256:d9ab1aaed362889c6b77ea27e8df132379e24e2a0aacdfaed8fadf3cddb3131d",
            "sha256:9004b01e4a91e9612a7374cce04c721e1e3a8f9e99619de547fb333425c79637",
            "sha256:a2dd2dc8d2b5463fe695696cc9b429d90af7bb8b1ad911859146a38b720f4963",
            "sha256:b3b362676b9e1822e76d9a41de6675eb2d4327988d578904813b22db1cdd5fdf",
            "sha256:22f16781610d5f69c305606217ca15546cdc6aa10e0d0677a7292f83139673b5",
            "sha256:48dae1883a53f613cda6a8e63f7f3264bddb86fd54d08d61294c2ce49997143a",
            "sha256:a8f08e2acb07e8d9a66bc0302b6cefe0597863684db92cfe144f1429fc80c5ec",
            "sha256:df595265fe2e6e5d3405cd1b08a39c75dfe9dc5f465204b29b19244a1efab5ae",
            "sha256:4c2ce7b02f1b4a58dea265ea4c656c195c7f132054a3c5c1b5b8d0a8187e010f",
            "sha256:e3959d65b46334e3c2f98a8bf0200bcac88c4eec72bdd3283e88c1afc5a4bad8",
            "sha256:96e85e4d3a83803ea8ccdbb15186e47fefe87519f596b1e59683c12c68e92065",
            "sha256:c4f9f860c29ba57553a29c7d0ad940de7485a41051790b5a12ae03be17ead812"
        ]
    },
    "Metadata": {
        "LastTagTime": "2026-05-29T02:40:09.856134011+08:00"
    }
}

更多版本

ghcr.io/theroyallab/tabbyapi:latest

linux/amd64 ghcr.io13.76GB2026-05-29 02:54
16