广告图片

docker.io/dimaskiddo/llama.cpp:server linux/amd64

docker.io/dimaskiddo/llama.cpp:server - 国内下载镜像源 浏览次数:38

docker.io/dimaskiddo/llama.cpp镜像封装了llama.cpp项目的运行环境，支持LLaMA系列大语言模型的C++实现，包含模型量化、推理等核心功能，可在多种平台部署，帮助用户快速启动并使用LLaMA模型完成文本生成等任务。

源镜像 docker.io/dimaskiddo/llama.cpp:server
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server
镜像ID sha256:a65ec44db00d98703b3422c6e863072b5051569a268237ba7916d98894b84b10
镜像TAG server
大小 3.65GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /app/llama-server --host 0.0.0.0 --port 8080 --log-colors off --keep 0 --predict -1 --prio 3 --prio-batch 3 --cont-batching --context-shift --escape --no-webui --no-slots --no-perf
启动入口
工作目录 /app
OS/平台 linux/amd64
浏览量 38 次
贡献者
镜像创建 2026-04-25T16:33:24.506704296Z
同步时间 2026-04-28 00:14
目录挂载
/app/models
环境变量
PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/bin:/usr/local/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=C.UTF-8 LC_ALL=C.UTF-8 TZ=Asia/Jakarta HOME=/ LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_PRODUCT_NAME=CUDA NVIDIA_REQUIRE_CUDA=cuda>=12.8 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=vapps,driver>=470,driver<471 brand=vpc,driver>=470,driver<471 brand=vcs,driver>=470,driver<471 brand=vws,driver>=470,driver<471 brand=cloudgaming,driver>=470,driver<471 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 NVIDIA_DRIVER_CAPABILITIES=compute,utility NVIDIA_VISIBLE_DEVICES=all NVIDIA_CUDA_MAJOR_VERSION=12 NVIDIA_CUDA_MINOR_VERSION=8 NVIDIA_CUDA_BUILD_VERSION=1 CUDA_VERSION=12.8.1 NV_CUDA_CUDART_VERSION=12.8.90-1 NV_CUDA_LIB_VERSION=12.8.1-1 NV_NVTX_VERSION=12.8.90-1 NV_LIBCUSPARSE_VERSION=12.5.8.93-1 NV_LIBCUBLAS_VERSION=12.8.4.1-1 NV_LIBNPP_VERSION=12.3.3.100-1
镜像标签
Dimas Restu Hidayanto <dimas.restu@student.upi.edu>: maintainer
无权限下载?点我修复 生成Docker Run命令 生成Kubernetes YAML资源

Docker拉取命令 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server  docker.io/dimaskiddo/llama.cpp:server

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server  docker.io/dimaskiddo/llama.cpp:server

Shell快速替换命令 

sed -i 's#dimaskiddo/llama.cpp:server#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server  docker.io/dimaskiddo/llama.cpp:server'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server  docker.io/dimaskiddo/llama.cpp:server'

镜像构建历史 


# 2026-04-26 00:33:24  0.00B 
/bin/sh -c #(nop)  CMD ["/app/llama-server" "--host" "0.0.0.0" "--port" "8080" "--log-colors" "off" "--keep" "0" "--predict" "-1" "--prio" "3" "--prio-batch" "3" "--cont-batching" "--context-shift" "--escape" "--no-webui" "--no-slots" "--no-perf"]
                        
# 2026-04-26 00:33:24  9.12MB 
/bin/sh -c #(nop) COPY file:ed69f1532837bc4a6b0dc7b5c9fdd3e20e92fd16791a8503c63a5adc23848fe6 in /app 
                        
# 2026-04-26 00:33:23  156.53KB 
/bin/sh -c #(nop) COPY file:6f6a738186f24a21d4d04d31e23d8f27f62890c76bb1f91caca18419a466f31c in /app 
                        
# 2026-04-26 00:19:11  0.00B 
/bin/sh -c #(nop)  LABEL maintainer=Dimas Restu Hidayanto <dimas.restu@student.upi.edu>
                        
# 2026-04-26 00:19:10  0.00B 
/bin/sh -c #(nop)  MAINTAINER Dimas Restu Hidayanto <dimas.restu@student.upi.edu>
                        
# 2026-04-26 00:19:09  0.00B 
/bin/sh -c #(nop)  VOLUME [/app/models]
                        
# 2026-04-26 00:19:08  179.64MB 
/bin/sh -c #(nop) COPY dir:b54d27bef599a59d9b968e544a65af842bb21a3b26ecb676d49e5f2e5491d803 in /app 
                        
# 2026-04-26 00:19:06  0.00B 
/bin/sh -c mkdir -p /app/models /.config /.local     && chown -R root:root /app/models /.config /.local     && chmod -R 777 /app/models /.config /.local
                        
# 2026-04-26 00:19:02  371.25MB 
/bin/sh -c apt-get -y update --allow-releaseinfo-change     && apt-get -y dist-upgrade     && apt-get -y install --no-install-recommends         curl         libjemalloc2         libnccl2         libomp5         librdmacm1         libibverbs1         ibverbs-providers     && apt-get -y purge --autoremove     && apt-get -y clean
                        
# 2026-04-26 00:17:00  0.00B 
/bin/sh -c #(nop) WORKDIR /app
                        
# 2025-05-01 22:53:14  2.73GB 执行命令并创建新的镜像层
RUN /bin/sh -c apt-get -y update --allow-releaseinfo-change     && apt-get -y install --no-install-recommends         cuda-libraries-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}=${NV_CUDA_LIB_VERSION}         cuda-nvtx-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}=${NV_NVTX_VERSION}         libcusparse-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}=${NV_LIBCUSPARSE_VERSION}         libcublas-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}=${NV_LIBCUBLAS_VERSION}         libnpp-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}=${NV_LIBNPP_VERSION}     && apt-mark hold         cuda-libraries-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}         cuda-nvtx-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}         libcusparse-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}         libcublas-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}         libnpp-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}     && apt-get -y purge --autoremove     && apt-get -y clean # buildkit
                        
# 2025-05-01 22:53:14  0.00B 设置环境变量 NV_LIBCUSPARSE_VERSION NV_LIBCUBLAS_VERSION NV_LIBNPP_VERSION
ENV NV_LIBCUSPARSE_VERSION=12.5.8.93-1 NV_LIBCUBLAS_VERSION=12.8.4.1-1 NV_LIBNPP_VERSION=12.3.3.100-1
                        
# 2025-05-01 22:53:14  0.00B 设置环境变量 NV_CUDA_LIB_VERSION NV_NVTX_VERSION
ENV NV_CUDA_LIB_VERSION=12.8.1-1 NV_NVTX_VERSION=12.8.90-1
                        
# 2025-05-01 22:49:43  205.54MB 执行命令并创建新的镜像层
RUN /bin/sh -c wget -O cuda-keyring.deb https://developer.download.nvidia.com/compute/cuda/repos/debian12/x86_64/cuda-keyring_1.1-1_all.deb     && dpkg -i cuda-keyring.deb     && rm -f cuda-keyring.deb     && apt-get -y update --allow-releaseinfo-change     && apt-get -y install --no-install-recommends         cuda-compat-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}         cuda-cudart-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}=${NV_CUDA_CUDART_VERSION}     && apt-mark hold         cuda-compat-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}         cuda-cudart-${NVIDIA_CUDA_MAJOR_VERSION}-${NVIDIA_CUDA_MINOR_VERSION}     && apt-get -y purge --autoremove     && apt-get -y clean     && wget -O ${HOME}/NGC-DL-CONTAINER-LICENSE https://gitlab.com/nvidia/container-images/cuda/-/raw/master/NGC-DL-CONTAINER-LICENSE     && echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf     && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2025-05-01 22:49:16  78.89MB 执行命令并创建新的镜像层
RUN /bin/sh -c apt-get -y update --allow-releaseinfo-change     && apt-get -y dist-upgrade     && apt-get -y install --no-install-recommends       ca-certificates       tzdata       procps       net-tools       netcat-openbsd       dnsutils       rsync       wget     && apt-get -y purge --autoremove     && apt-get -y clean # buildkit
                        
# 2025-05-01 22:49:16  0.00B 设置环境变量 CUDA_VERSION NV_CUDA_CUDART_VERSION
ENV CUDA_VERSION=12.8.1 NV_CUDA_CUDART_VERSION=12.8.90-1
                        
# 2025-05-01 22:49:16  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand NVIDIA_DRIVER_CAPABILITIES NVIDIA_VISIBLE_DEVICES NVIDIA_CUDA_MAJOR_VERSION NVIDIA_CUDA_MINOR_VERSION NVIDIA_CUDA_BUILD_VERSION
ENV NVIDIA_PRODUCT_NAME=CUDA NVIDIA_REQUIRE_CUDA=cuda>=12.8 brand=unknown,driver>=470,driver<471 brand=grid,driver>=470,driver<471 brand=tesla,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=vapps,driver>=470,driver<471 brand=vpc,driver>=470,driver<471 brand=vcs,driver>=470,driver<471 brand=vws,driver>=470,driver<471 brand=cloudgaming,driver>=470,driver<471 brand=unknown,driver>=535,driver<536 brand=grid,driver>=535,driver<536 brand=tesla,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=vapps,driver>=535,driver<536 brand=vpc,driver>=535,driver<536 brand=vcs,driver>=535,driver<536 brand=vws,driver>=535,driver<536 brand=cloudgaming,driver>=535,driver<536 brand=unknown,driver>=550,driver<551 brand=grid,driver>=550,driver<551 brand=tesla,driver>=550,driver<551 brand=nvidia,driver>=550,driver<551 brand=quadro,driver>=550,driver<551 brand=quadrortx,driver>=550,driver<551 brand=nvidiartx,driver>=550,driver<551 brand=vapps,driver>=550,driver<551 brand=vpc,driver>=550,driver<551 brand=vcs,driver>=550,driver<551 brand=vws,driver>=550,driver<551 brand=cloudgaming,driver>=550,driver<551 brand=unknown,driver>=560,driver<561 brand=grid,driver>=560,driver<561 brand=tesla,driver>=560,driver<561 brand=nvidia,driver>=560,driver<561 brand=quadro,driver>=560,driver<561 brand=quadrortx,driver>=560,driver<561 brand=nvidiartx,driver>=560,driver<561 brand=vapps,driver>=560,driver<561 brand=vpc,driver>=560,driver<561 brand=vcs,driver>=560,driver<561 brand=vws,driver>=560,driver<561 brand=cloudgaming,driver>=560,driver<561 brand=unknown,driver>=565,driver<566 brand=grid,driver>=565,driver<566 brand=tesla,driver>=565,driver<566 brand=nvidia,driver>=565,driver<566 brand=quadro,driver>=565,driver<566 brand=quadrortx,driver>=565,driver<566 brand=nvidiartx,driver>=565,driver<566 brand=vapps,driver>=565,driver<566 brand=vpc,driver>=565,driver<566 brand=vcs,driver>=565,driver<566 brand=vws,driver>=565,driver<566 brand=cloudgaming,driver>=565,driver<566 NVIDIA_DRIVER_CAPABILITIES=compute,utility NVIDIA_VISIBLE_DEVICES=all NVIDIA_CUDA_MAJOR_VERSION=12 NVIDIA_CUDA_MINOR_VERSION=8 NVIDIA_CUDA_BUILD_VERSION=1
                        
# 2025-05-01 22:49:16  0.00B 设置环境变量 PATH LD_LIBRARY_PATH
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/bin:/usr/local/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2025-05-01 22:49:16  0.00B 设置环境变量 LANG LC_ALL TZ HOME
ENV LANG=C.UTF-8 LC_ALL=C.UTF-8 TZ=Asia/Jakarta HOME=/
                        
# 2025-05-01 22:49:16  0.00B 添加元数据标签
LABEL maintainer=Dimas Restu Hidayanto <dimas.restu@student.upi.edu>
                        
# 2025-05-01 22:49:16  0.00B 
MAINTAINER Dimas Restu Hidayanto <dimas.restu@student.upi.edu>
                        
# 2025-04-28 08:00:00  74.83MB 
# debian.sh --arch 'amd64' out/ 'bookworm' '@1745798400'

镜像信息 

{
    "Id": "sha256:a65ec44db00d98703b3422c6e863072b5051569a268237ba7916d98894b84b10",
    "RepoTags": [
        "dimaskiddo/llama.cpp:server",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp:server"
    ],
    "RepoDigests": [
        "dimaskiddo/llama.cpp@sha256:00df3334c319c0c0e55045d68387d5926ab3ef48518f5d74b40fb6719b15dbc0",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/dimaskiddo/llama.cpp@sha256:f5ec2beb46c57d5adc35f2103d9be982a18df23244fd6bb4a0c617fac1d4dd19"
    ],
    "Parent": "",
    "Comment": "",
    "Created": "2026-04-25T16:33:24.506704296Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "20.10.24+dfsg1",
    "Author": "Dimas Restu Hidayanto \u003cdimas.restu@student.upi.edu\u003e",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/bin:/usr/local/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LANG=C.UTF-8",
            "LC_ALL=C.UTF-8",
            "TZ=Asia/Jakarta",
            "HOME=/",
            "LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_PRODUCT_NAME=CUDA",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.8 brand=unknown,driver\u003e=470,driver\u003c471 brand=grid,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=vapps,driver\u003e=470,driver\u003c471 brand=vpc,driver\u003e=470,driver\u003c471 brand=vcs,driver\u003e=470,driver\u003c471 brand=vws,driver\u003e=470,driver\u003c471 brand=cloudgaming,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=535,driver\u003c536 brand=grid,driver\u003e=535,driver\u003c536 brand=tesla,driver\u003e=535,driver\u003c536 brand=nvidia,driver\u003e=535,driver\u003c536 brand=quadro,driver\u003e=535,driver\u003c536 brand=quadrortx,driver\u003e=535,driver\u003c536 brand=nvidiartx,driver\u003e=535,driver\u003c536 brand=vapps,driver\u003e=535,driver\u003c536 brand=vpc,driver\u003e=535,driver\u003c536 brand=vcs,driver\u003e=535,driver\u003c536 brand=vws,driver\u003e=535,driver\u003c536 brand=cloudgaming,driver\u003e=535,driver\u003c536 brand=unknown,driver\u003e=550,driver\u003c551 brand=grid,driver\u003e=550,driver\u003c551 brand=tesla,driver\u003e=550,driver\u003c551 brand=nvidia,driver\u003e=550,driver\u003c551 brand=quadro,driver\u003e=550,driver\u003c551 brand=quadrortx,driver\u003e=550,driver\u003c551 brand=nvidiartx,driver\u003e=550,driver\u003c551 brand=vapps,driver\u003e=550,driver\u003c551 brand=vpc,driver\u003e=550,driver\u003c551 brand=vcs,driver\u003e=550,driver\u003c551 brand=vws,driver\u003e=550,driver\u003c551 brand=cloudgaming,driver\u003e=550,driver\u003c551 brand=unknown,driver\u003e=560,driver\u003c561 brand=grid,driver\u003e=560,driver\u003c561 brand=tesla,driver\u003e=560,driver\u003c561 brand=nvidia,driver\u003e=560,driver\u003c561 brand=quadro,driver\u003e=560,driver\u003c561 brand=quadrortx,driver\u003e=560,driver\u003c561 brand=nvidiartx,driver\u003e=560,driver\u003c561 brand=vapps,driver\u003e=560,driver\u003c561 brand=vpc,driver\u003e=560,driver\u003c561 brand=vcs,driver\u003e=560,driver\u003c561 brand=vws,driver\u003e=560,driver\u003c561 brand=cloudgaming,driver\u003e=560,driver\u003c561 brand=unknown,driver\u003e=565,driver\u003c566 brand=grid,driver\u003e=565,driver\u003c566 brand=tesla,driver\u003e=565,driver\u003c566 brand=nvidia,driver\u003e=565,driver\u003c566 brand=quadro,driver\u003e=565,driver\u003c566 brand=quadrortx,driver\u003e=565,driver\u003c566 brand=nvidiartx,driver\u003e=565,driver\u003c566 brand=vapps,driver\u003e=565,driver\u003c566 brand=vpc,driver\u003e=565,driver\u003c566 brand=vcs,driver\u003e=565,driver\u003c566 brand=vws,driver\u003e=565,driver\u003c566 brand=cloudgaming,driver\u003e=565,driver\u003c566",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_CUDA_MAJOR_VERSION=12",
            "NVIDIA_CUDA_MINOR_VERSION=8",
            "NVIDIA_CUDA_BUILD_VERSION=1",
            "CUDA_VERSION=12.8.1",
            "NV_CUDA_CUDART_VERSION=12.8.90-1",
            "NV_CUDA_LIB_VERSION=12.8.1-1",
            "NV_NVTX_VERSION=12.8.90-1",
            "NV_LIBCUSPARSE_VERSION=12.5.8.93-1",
            "NV_LIBCUBLAS_VERSION=12.8.4.1-1",
            "NV_LIBNPP_VERSION=12.3.3.100-1"
        ],
        "Cmd": [
            "/app/llama-server",
            "--host",
            "0.0.0.0",
            "--port",
            "8080",
            "--log-colors",
            "off",
            "--keep",
            "0",
            "--predict",
            "-1",
            "--prio",
            "3",
            "--prio-batch",
            "3",
            "--cont-batching",
            "--context-shift",
            "--escape",
            "--no-webui",
            "--no-slots",
            "--no-perf"
        ],
        "Image": "sha256:78201cfc85fd5b5b5b97cc3deb139aac7bbb58a81de58d37eab7a4389a5d1add",
        "Volumes": {
            "/app/models": {}
        },
        "WorkingDir": "/app",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": {
            "maintainer": "Dimas Restu Hidayanto \u003cdimas.restu@student.upi.edu\u003e"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 3646577013,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/6d4ae29d3926a31e7643e6d58b769985423eab235a93f1fdb11a0bacf65cefde/diff:/var/lib/docker/overlay2/d3f2f9a2a811f353be4d15d46f8690f1d3304bc8a06b46c26680824111853df2/diff:/var/lib/docker/overlay2/cdc8e26b30208c680840fffb0b8d7156242cce3a26bf46b0618cbdd152806acb/diff:/var/lib/docker/overlay2/8f531fccc4befa77794f2e5956447532fa3da682d8af1be67205b39f9aa87a39/diff:/var/lib/docker/overlay2/2b8875ac1c01c71a951d7462d63853465b83c64aa45a7c33b242a0cae92b3fc7/diff:/var/lib/docker/overlay2/890f46ae0b0affabd1efaf0840b34ca857ced71d64b95311439497df351271a8/diff:/var/lib/docker/overlay2/2bb525e3048e4477af58fbfe0ab0ab1faddc9156008b3d5a2ad209893739470d/diff:/var/lib/docker/overlay2/1ae4ae74e12f7fcad89bed8b539a04ec0ca3221e85151598fae5e4b77c4e68b1/diff:/var/lib/docker/overlay2/cd9cb36f82b4a6a570304a082a3d97b369643777f7f7b25df6d47ffb3b3d36ab/diff",
            "MergedDir": "/var/lib/docker/overlay2/e29efe534943dbc5aa711d5a439917d8dba442ad93b70e9efe30cd832f8d27f6/merged",
            "UpperDir": "/var/lib/docker/overlay2/e29efe534943dbc5aa711d5a439917d8dba442ad93b70e9efe30cd832f8d27f6/diff",
            "WorkDir": "/var/lib/docker/overlay2/e29efe534943dbc5aa711d5a439917d8dba442ad93b70e9efe30cd832f8d27f6/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:6c4c763d22d0c5f9b2c5901dfa667fbbc4713cee6869336b8fd5022185071f1c",
            "sha256:bf6cb6da3062d9c3bbbecfb0b1fa3eb30f569d1d3212c1dcc6a8df0d5c673a6e",
            "sha256:d528ce5bcca381799e25c5be0faa3fbe21b1acea5474fa76e69e6038fd8574c4",
            "sha256:ec516a95f7ce5ec29beb2a4d172a601720912970783574938795d628cd4124b9",
            "sha256:ac7f994e1514dd845db84487e2f4bee16187f7df0c5694e05db46dbd6b1ddc64",
            "sha256:b2f6f3e6e813419398b055ce6bf89a529010452f88e74427a664e617542d2053",
            "sha256:9b8a2470dfc79c59f1646059aea81228ef6b5fa648360ca077019eaf9a2f0395",
            "sha256:9f8e7f31847e9cc358e0283e4d1e6c774fbde4701fbf1ecb2fe821b6c69b917f",
            "sha256:b72a8930d7dd3d08f0498dd2c54850a7858d677e984e06bfe6dcd658dc2600f8",
            "sha256:233dc4a47667a27f5faeddc2b104732197583fdedbebab64dfea0a4a2f9056c4"
        ]
    },
    "Metadata": {
        "LastTagTime": "2026-04-28T00:08:25.826968443+08:00"
    }
}

更多版本

docker.io/dimaskiddo/llama.cpp:server

linux/amd64 docker.io3.65GB2026-04-28 00:14
37