docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12 linux/amd64

docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12 - 国内下载镜像源 浏览次数:89

LocalAI Docker 镜像

这是一个包含 LocalAI 软件的 Docker 镜像, LocalAI 是一款用于构建、训练和部署机器学习模型的开源平台。

镜像用途

* 在 Docker 容器中快速部署和运行 LocalAI * 方便地进行机器学习项目开发和实验 * 轻松共享和部署机器学习模型

镜像内容

* LocalAI 软件及所有依赖项 * 必要的配置文件和工具 * 示例数据集和模型

使用说明

请参考 LocalAI 官方文档获取详细的使用说明和安装步骤。
源镜像 docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12
镜像ID sha256:241043c029ae4630e486caff8bbaf4f639885e6aa7269cba7415e26afda3367c
镜像TAG master-aio-gpu-nvidia-cuda-12
大小 42.47GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 /aio/entrypoint.sh
工作目录 /build
OS/平台 linux/amd64
浏览量 89 次
贡献者
镜像创建 2025-02-27T12:41:55.390293998Z
同步时间 2025-02-28 01:41
更新时间 2025-03-31 07:44
开放端口
8080/tcp
环境变量
PATH=/root/.cargo/bin:/opt/rocm/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/go/bin:/usr/local/go/bin DEBIAN_FRONTEND=noninteractive EXTERNAL_GRPC_BACKENDS=coqui:/build/backend/python/coqui/run.sh,transformers:/build/backend/python/transformers/run.sh,rerankers:/build/backend/python/rerankers/run.sh,autogptq:/build/backend/python/autogptq/run.sh,bark:/build/backend/python/bark/run.sh,diffusers:/build/backend/python/diffusers/run.sh,faster-whisper:/build/backend/python/faster-whisper/run.sh,kokoro:/build/backend/python/kokoro/run.sh,vllm:/build/backend/python/vllm/run.sh,exllama2:/build/backend/python/exllama2/run.sh BUILD_TYPE=cublas REBUILD=false HEALTHCHECK_ENDPOINT=http://localhost:8080/readyz MAKEFLAGS=--jobs=3 --output-sync=target NVIDIA_DRIVER_CAPABILITIES=compute,utility NVIDIA_REQUIRE_CUDA=cuda>=12.0 NVIDIA_VISIBLE_DEVICES=all
镜像标签
2025-02-27T10:33:39.257Z: org.opencontainers.image.created :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference: org.opencontainers.image.description MIT: org.opencontainers.image.licenses ubuntu: org.opencontainers.image.ref.name 3bf2e9d065d5b155b0255453935ebafbc6cbf2e9: org.opencontainers.image.revision https://github.com/mudler/LocalAI: org.opencontainers.image.source LocalAI: org.opencontainers.image.title https://github.com/mudler/LocalAI: org.opencontainers.image.url master-aio-gpu-nvidia-cuda-12: org.opencontainers.image.version

Docker拉取命令 无权限下载?点我修复

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12  docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12  docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12

Shell快速替换命令

sed -i 's#localai/localai:master-aio-gpu-nvidia-cuda-12#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12  docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12  docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12'

镜像构建历史


# 2025-02-27 20:41:55  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/aio/entrypoint.sh"]
                        
# 2025-02-27 20:41:55  27.38KB 复制新文件或目录到容器中
COPY aio/ /aio # buildkit
                        
# 2025-02-27 20:41:55  61.51MB 执行命令并创建新的镜像层
RUN /bin/bash -c apt-get update && apt-get install -y pciutils && apt-get clean # buildkit
                        
# 2025-02-27 20:18:59  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/build/entrypoint.sh"]
                        
# 2025-02-27 20:18:59  0.00B 声明容器运行时监听的端口
EXPOSE map[8080/tcp:{}]
                        
# 2025-02-27 20:18:59  0.00B 创建挂载点用于持久化数据或共享数据
VOLUME [/build/models]
                        
# 2025-02-27 20:18:59  0.00B 指定检查容器健康状态的命令
HEALTHCHECK &{["CMD-SHELL" "curl -f ${HEALTHCHECK_ENDPOINT} || exit 1"] "1m0s" "10m0s" "0s" "0s" '\n'}
                        
# 2025-02-27 20:18:59  0.00B 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/bash -c mkdir -p /build/models # buildkit
                        
# 2025-02-27 20:18:58  15.29GB 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/bash -c if [[ ( "${EXTRA_BACKENDS}" =~ "vllm" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/vllm     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "autogptq" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/autogptq     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "bark" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/bark     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "rerankers" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/rerankers     ; fi # buildkit
                        
# 2025-02-27 20:16:59  7.34GB 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/bash -c if [[ ( "${EXTRA_BACKENDS}" =~ "kokoro" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/kokoro     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "exllama2" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/exllama2     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "transformers" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/transformers     ; fi # buildkit
                        
# 2025-02-27 20:15:49  7.62GB 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/bash -c if [[ ( "${EXTRA_BACKENDS}" =~ "coqui" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/coqui     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "faster-whisper" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/faster-whisper     ; fi &&     if [[ ( "${EXTRA_BACKENDS}" =~ "diffusers" || -z "${EXTRA_BACKENDS}" ) && "$IMAGE_TYPE" == "extras" ]]; then         make -C backend/python/diffusers     ; fi # buildkit
                        
# 2025-02-27 20:15:03  0.00B 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/bash -c if [[ ( "${IMAGE_TYPE}" == "extras ")]]; then         apt-get -qq -y install espeak-ng     ; fi # buildkit
                        
# 2025-02-27 20:15:02  0.00B 
SHELL [/bin/bash -c]
                        
# 2025-02-27 20:15:02  34.64MB 复制新文件或目录到容器中
COPY /build/sources/go-piper/piper-phonemize/pi/lib/* /usr/lib/ # buildkit
                        
# 2025-02-27 20:15:02  1.78GB 复制新文件或目录到容器中
COPY /build/local-ai ./ # buildkit
                        
# 2025-02-27 20:14:55  1.51GB 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/sh -c make prepare-sources # buildkit
                        
# 2025-02-27 20:14:32  1.21GB 复制新文件或目录到容器中
COPY /opt/grpc /usr/local # buildkit
                        
# 2025-02-27 20:14:26  910.24MB 复制新文件或目录到容器中
COPY /build/sources ./sources/ # buildkit
                        
# 2025-02-27 18:37:59  16.09MB 复制新文件或目录到容器中
COPY . . # buildkit
                        
# 2025-02-27 18:37:59  0.00B 设置工作目录为/build
WORKDIR /build
                        
# 2025-02-27 18:37:57  329.45MB 执行命令并创建新的镜像层
RUN |13 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false FFMPEG=true IMAGE_TYPE=extras EXTRA_BACKENDS= MAKEFLAGS=--jobs=3 --output-sync=target /bin/sh -c if [ "${FFMPEG}" = "true" ]; then         apt-get update &&         apt-get install -y --no-install-recommends             ffmpeg &&         apt-get clean &&         rm -rf /var/lib/apt/lists/*     ; fi # buildkit
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA
ENV NVIDIA_REQUIRE_CUDA=cuda>=12.0
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG CUDA_MAJOR_VERSION=12
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 MAKEFLAGS --output-sync
ENV MAKEFLAGS=--jobs=3 --output-sync=target
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 HEALTHCHECK_ENDPOINT
ENV HEALTHCHECK_ENDPOINT=http://localhost:8080/readyz
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 REBUILD
ENV REBUILD=false
                        
# 2025-02-27 18:37:32  0.00B 设置环境变量 BUILD_TYPE
ENV BUILD_TYPE=cublas
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG MAKEFLAGS=--jobs=3 --output-sync=target
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG EXTRA_BACKENDS
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG IMAGE_TYPE=extras
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG BUILD_TYPE=cublas
                        
# 2025-02-27 18:37:32  0.00B 定义构建参数
ARG FFMPEG=true
                        
# 2025-02-27 18:37:32  0.00B 执行命令并创建新的镜像层
RUN |9 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false /bin/sh -c if [ "${BUILD_TYPE}" = "hipblas" ] && [ "${SKIP_DRIVERS}" = "false" ]; then         apt-get update &&         apt-get install -y --no-install-recommends             hipblas-dev             rocblas-dev &&         apt-get clean &&         rm -rf /var/lib/apt/lists/* &&         ldconfig     ; fi # buildkit
                        
# 2025-02-27 18:37:32  0.00B 执行命令并创建新的镜像层
RUN |9 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false /bin/sh -c if [ "${BUILD_TYPE}" = "clblas" ] && [ "${SKIP_DRIVERS}" = "false" ]; then         apt-get update &&         apt-get install -y --no-install-recommends             libclblast-dev &&         apt-get clean &&         rm -rf /var/lib/apt/lists/*     ; fi # buildkit
                        
# 2025-02-27 18:37:32  3.94GB 执行命令并创建新的镜像层
RUN |9 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false /bin/sh -c <<EOT bash
    if [ "${BUILD_TYPE}" = "cublas" ] && [ "${SKIP_DRIVERS}" = "false" ]; then
        apt-get update && \
        apt-get install -y  --no-install-recommends \
            software-properties-common pciutils
        if [ "amd64" = "$TARGETARCH" ]; then
            curl -O https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb
        fi
        if [ "arm64" = "$TARGETARCH" ]; then
            curl -O https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/arm64/cuda-keyring_1.1-1_all.deb
        fi
        dpkg -i cuda-keyring_1.1-1_all.deb && \
        rm -f cuda-keyring_1.1-1_all.deb && \
        apt-get update && \
        apt-get install -y --no-install-recommends \
            cuda-nvcc-${CUDA_MAJOR_VERSION}-${CUDA_MINOR_VERSION} \
            libcufft-dev-${CUDA_MAJOR_VERSION}-${CUDA_MINOR_VERSION} \
            libcurand-dev-${CUDA_MAJOR_VERSION}-${CUDA_MINOR_VERSION} \
            libcublas-dev-${CUDA_MAJOR_VERSION}-${CUDA_MINOR_VERSION} \
            libcusparse-dev-${CUDA_MAJOR_VERSION}-${CUDA_MINOR_VERSION} \
            libcusolver-dev-${CUDA_MAJOR_VERSION}-${CUDA_MINOR_VERSION} && \
        apt-get clean && \
        rm -rf /var/lib/apt/lists/*
    fi
EOT # buildkit
                        
# 2025-02-27 18:35:31  0.00B 执行命令并创建新的镜像层
RUN |9 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= BUILD_TYPE=cublas CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=0 SKIP_DRIVERS=false /bin/sh -c <<EOT bash
    if [ "${BUILD_TYPE}" = "vulkan" ] && [ "${SKIP_DRIVERS}" = "false" ]; then
        apt-get update && \
        apt-get install -y  --no-install-recommends \
            software-properties-common pciutils wget gpg-agent && \
        wget -qO - https://packages.lunarg.com/lunarg-signing-key-pub.asc | apt-key add - && \
        wget -qO /etc/apt/sources.list.d/lunarg-vulkan-jammy.list https://packages.lunarg.com/vulkan/lunarg-vulkan-jammy.list && \
        apt-get update && \
        apt-get install -y \
            vulkan-sdk && \
        apt-get clean && \
        rm -rf /var/lib/apt/lists/*
    fi
EOT # buildkit
                        
# 2025-02-27 18:35:30  0.00B 设置环境变量 BUILD_TYPE
ENV BUILD_TYPE=cublas
                        
# 2025-02-27 18:35:30  0.00B 定义构建参数
ARG SKIP_DRIVERS=false
                        
# 2025-02-27 18:35:30  0.00B 定义构建参数
ARG CUDA_MINOR_VERSION=0
                        
# 2025-02-27 18:35:30  0.00B 定义构建参数
ARG CUDA_MAJOR_VERSION=12
                        
# 2025-02-27 18:35:30  0.00B 定义构建参数
ARG BUILD_TYPE=cublas
                        
# 2025-02-27 18:35:30  35.31MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c pip install --user grpcio-tools # buildkit
                        
# 2025-02-27 18:35:28  281.45MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c apt-get update &&     apt-get install -y --no-install-recommends         espeak-ng         espeak         python3-pip         python-is-python3         python3-dev llvm         python3-venv &&     apt-get clean &&     rm -rf /var/lib/apt/lists/* &&     pip install --upgrade pip # buildkit
                        
# 2025-02-27 18:35:11  1.14GB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y # buildkit
                        
# 2025-02-27 18:34:49  0.00B 设置环境变量 PATH
ENV PATH=/root/.cargo/bin:/opt/rocm/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/go/bin:/usr/local/go/bin
                        
# 2025-02-27 18:34:49  39.64MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c curl -LsSf https://astral.sh/uv/install.sh | UV_INSTALL_DIR=/usr/bin sh # buildkit
                        
# 2025-02-27 18:34:47  0.00B 设置工作目录为/build
WORKDIR /build
                        
# 2025-02-27 18:34:47  110.52MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c apt-get update &&     apt-get install -y --no-install-recommends         libopenblas-dev &&     apt-get clean &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-02-27 18:34:41  0.00B 设置环境变量 PATH
ENV PATH=/opt/rocm/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/go/bin:/usr/local/go/bin
                        
# 2025-02-27 18:34:41  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/go/bin:/usr/local/go/bin
                        
# 2025-02-27 18:34:41  0.00B 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c echo "Target Variant: $TARGETVARIANT" # buildkit
                        
# 2025-02-27 18:34:41  0.00B 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c echo "Target Architecture: $TARGETARCH" # buildkit
                        
# 2025-02-27 18:34:41  0.00B 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c test -n "$TARGETARCH"     || (echo 'warn: missing $TARGETARCH, either set this `ARG` manually, or run using `docker buildkit`') # buildkit
                        
# 2025-02-27 18:34:41  219.34KB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c update-ca-certificates # buildkit
                        
# 2025-02-27 18:34:40  0.00B 复制新文件或目录到容器中
COPY --chmod=644 custom-ca-certs/* /usr/local/share/ca-certificates/ # buildkit
                        
# 2025-02-27 18:34:40  136.47MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.34.2 &&     go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@1958fcbe2ca8bd93af633f11e97d44e567e945af # buildkit
                        
# 2025-02-27 18:34:26  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/go/bin:/usr/local/go/bin
                        
# 2025-02-27 18:34:26  222.31MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c curl -L -s https://go.dev/dl/go${GO_VERSION}.linux-${TARGETARCH}.tar.gz | tar -C /usr/local -xz # buildkit
                        
# 2025-02-27 18:34:23  68.61MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c <<EOT bash
    if [ "${CMAKE_FROM_SOURCE}}" = "true" ]; then
        curl -L -s https://github.com/Kitware/CMake/releases/download/v${CMAKE_VERSION}/cmake-${CMAKE_VERSION}.tar.gz -o cmake.tar.gz && tar xvf cmake.tar.gz && cd cmake-${CMAKE_VERSION} && ./configure && make && make install
    else
        apt-get update && \
        apt-get install -y \
            cmake && \
        apt-get clean && \
        rm -rf /var/lib/apt/lists/*
    fi
EOT # buildkit
                        
# 2025-02-27 18:34:16  308.87MB 执行命令并创建新的镜像层
RUN |5 GO_VERSION=1.22.6 CMAKE_VERSION=3.26.4 CMAKE_FROM_SOURCE=false TARGETARCH=amd64 TARGETVARIANT= /bin/sh -c apt-get update &&     apt-get install -y --no-install-recommends         build-essential         ccache         ca-certificates         curl libssl-dev         git         unzip upx-ucl &&     apt-get clean &&     rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2025-02-27 18:34:16  0.00B 设置环境变量 EXTERNAL_GRPC_BACKENDS
ENV EXTERNAL_GRPC_BACKENDS=coqui:/build/backend/python/coqui/run.sh,transformers:/build/backend/python/transformers/run.sh,rerankers:/build/backend/python/rerankers/run.sh,autogptq:/build/backend/python/autogptq/run.sh,bark:/build/backend/python/bark/run.sh,diffusers:/build/backend/python/diffusers/run.sh,faster-whisper:/build/backend/python/faster-whisper/run.sh,kokoro:/build/backend/python/kokoro/run.sh,vllm:/build/backend/python/vllm/run.sh,exllama2:/build/backend/python/exllama2/run.sh
                        
# 2025-02-27 18:34:16  0.00B 设置环境变量 DEBIAN_FRONTEND
ENV DEBIAN_FRONTEND=noninteractive
                        
# 2025-02-27 18:34:16  0.00B 定义构建参数
ARG TARGETVARIANT=
                        
# 2025-02-27 18:34:16  0.00B 定义构建参数
ARG TARGETARCH=amd64
                        
# 2025-02-27 18:34:16  0.00B 定义构建参数
ARG CMAKE_FROM_SOURCE=false
                        
# 2025-02-27 18:34:16  0.00B 定义构建参数
ARG CMAKE_VERSION=3.26.4
                        
# 2025-02-27 18:34:16  0.00B 定义构建参数
ARG GO_VERSION=1.22.6
                        
# 2025-02-27 18:34:16  0.00B 指定运行容器时使用的用户
USER root
                        
# 2025-01-26 13:31:11  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2025-01-26 13:31:10  77.86MB 
/bin/sh -c #(nop) ADD file:1b6c8c9518be42fa2afe5e241ca31677fce58d27cdfa88baa91a65a259be3637 in / 
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2025-01-26 13:31:07  0.00B 
/bin/sh -c #(nop)  ARG RELEASE
                        
                    

镜像信息

{
    "Id": "sha256:241043c029ae4630e486caff8bbaf4f639885e6aa7269cba7415e26afda3367c",
    "RepoTags": [
        "localai/localai:master-aio-gpu-nvidia-cuda-12",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12"
    ],
    "RepoDigests": [
        "localai/localai@sha256:c6c4cf8894484c9c8ad2050e65ee099a82ee90e2630e1c2c05b1cc21b90be34d",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/localai/localai@sha256:9f1e29a11a13e28cb117104835a372d3f1600cd46e8781bf94877a49ce5f9d97"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-02-27T12:41:55.390293998Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "root",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "ExposedPorts": {
            "8080/tcp": {}
        },
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/root/.cargo/bin:/opt/rocm/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/go/bin:/usr/local/go/bin",
            "DEBIAN_FRONTEND=noninteractive",
            "EXTERNAL_GRPC_BACKENDS=coqui:/build/backend/python/coqui/run.sh,transformers:/build/backend/python/transformers/run.sh,rerankers:/build/backend/python/rerankers/run.sh,autogptq:/build/backend/python/autogptq/run.sh,bark:/build/backend/python/bark/run.sh,diffusers:/build/backend/python/diffusers/run.sh,faster-whisper:/build/backend/python/faster-whisper/run.sh,kokoro:/build/backend/python/kokoro/run.sh,vllm:/build/backend/python/vllm/run.sh,exllama2:/build/backend/python/exllama2/run.sh",
            "BUILD_TYPE=cublas",
            "REBUILD=false",
            "HEALTHCHECK_ENDPOINT=http://localhost:8080/readyz",
            "MAKEFLAGS=--jobs=3 --output-sync=target",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.0",
            "NVIDIA_VISIBLE_DEVICES=all"
        ],
        "Cmd": null,
        "Healthcheck": {
            "Test": [
                "CMD-SHELL",
                "curl -f ${HEALTHCHECK_ENDPOINT} || exit 1"
            ],
            "Interval": 60000000000,
            "Timeout": 600000000000,
            "Retries": 10
        },
        "Image": "",
        "Volumes": {
            "/build/models": {}
        },
        "WorkingDir": "/build",
        "Entrypoint": [
            "/aio/entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2025-02-27T10:33:39.257Z",
            "org.opencontainers.image.description": ":robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI,  running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference",
            "org.opencontainers.image.licenses": "MIT",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "3bf2e9d065d5b155b0255453935ebafbc6cbf2e9",
            "org.opencontainers.image.source": "https://github.com/mudler/LocalAI",
            "org.opencontainers.image.title": "LocalAI",
            "org.opencontainers.image.url": "https://github.com/mudler/LocalAI",
            "org.opencontainers.image.version": "master-aio-gpu-nvidia-cuda-12"
        },
        "Shell": [
            "/bin/bash",
            "-c"
        ]
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 42465085253,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/640d1f78ecedb50961f8e579ca1e08765c37c1f9e58864ef2287659dbf733425/diff:/var/lib/docker/overlay2/86f10ad01c304260bdf0b1b91e6b006c33345537df3a1f541065818bb6c1bde1/diff:/var/lib/docker/overlay2/a517e8f9f8ca16a96d2e7e0f78289a76b4e4496bd64cad1e6f03e1ba67c2f08e/diff:/var/lib/docker/overlay2/5a5cf0cd2bb79eb40a7e5760f220e42b8995716b90de76ff09ad1b9082fe9c84/diff:/var/lib/docker/overlay2/c96095d172fca3540ed2882c567ff31787ae164150d00571fe8416502624998b/diff:/var/lib/docker/overlay2/b0dc07acbc79ba6daf67421178bad1396a4cb8bdb84c076404eb9cc184687c79/diff:/var/lib/docker/overlay2/0430a8cbad1f746b0f7d782aa26bd6b196247ea4af0e5a3aa97f0f89ad4d418e/diff:/var/lib/docker/overlay2/309a79fb5c078e089cc9a1888aed282051d4c59e78917d956b6478e0eed28cbd/diff:/var/lib/docker/overlay2/7c5acc816104ee6d764f0439eebac40fd93af6075aab17ec91cec576f6f24ed5/diff:/var/lib/docker/overlay2/760cace05fda352e1e339645bf8fb125216e44a08fb76173892c40c2354be698/diff:/var/lib/docker/overlay2/17e1e8852ade64fb69a017552b5f526c9c29577fdc9e9d6087066ee09150dc92/diff:/var/lib/docker/overlay2/b2d09031bb434ec0a5259a0921a78519f434ee05d69f978d0520af9672802915/diff:/var/lib/docker/overlay2/ffe3b79c00c798534ac1b1ce1c45c60f9da3ee3ea1363b3d79f85e9e5eab5e06/diff:/var/lib/docker/overlay2/c9b9f65d10c09c42d0b0bf6a8b0684d0246440a3a492c09f08fd3e55c849c14b/diff:/var/lib/docker/overlay2/206c0ea1eeeac4d4746c33623568d3b508378adaba7faa40672368fed76d8119/diff:/var/lib/docker/overlay2/d7682101418f8e0e121768cd04ae778bcc1dc45661a1761273d02c6f12c3053c/diff:/var/lib/docker/overlay2/f25636f5057994218e881edb45378915d0afb21bf1d1d7ebfc518726fe82fb92/diff:/var/lib/docker/overlay2/029502acff6e3b5280b089624409436a2ae4c0a51c96ef5676606399f1d0b89e/diff:/var/lib/docker/overlay2/cdc3db14368f582885766836a0b38f77f8578f942ea375f0407a704cfc610e27/diff:/var/lib/docker/overlay2/77199cbfd702b8688b551973f8bdb45616d2ef3f50a2f37c58482815e05c1025/diff:/var/lib/docker/overlay2/3a710abfbddf0f9cf006f5939d186b02cefab5b244d6b67df0b1cfd0b9c82248/diff:/var/lib/docker/overlay2/a6d3262a5607c8efd425f369f8bcc49bd9b69531a3c6b9ebf1de22ff055dc54c/diff:/var/lib/docker/overlay2/1e13f97b7a9f3646e828ea2f904cac12ab094ae3b3a44946b070e2f34d895c3c/diff:/var/lib/docker/overlay2/950aa83f8ff65dd7b46a98b663cfcb0957d18bb3d4778d0cd687759492bdc330/diff:/var/lib/docker/overlay2/7b6afd552a979e61b22356e20f22852c09f792b3dbbf2e61fc5fd8c79d54727f/diff:/var/lib/docker/overlay2/7e93da0f5722a5dccfdd27af44ec6ce2985c41ec608fc71b3d8063fd6c8899da/diff:/var/lib/docker/overlay2/89be80ec2f43af96b3f192483f068b0b72d1fea35741f5072d0796d6f19d147c/diff:/var/lib/docker/overlay2/fb2d414646c9970f01b37f024555833fdeae9b46b06460da72318107abc9f697/diff:/var/lib/docker/overlay2/c8a541f02bd61f09c4304b4201c036d4b070b89fa7a24d67b27b2b3a005eda99/diff:/var/lib/docker/overlay2/09553f58b9147778aa71631c9299d3ab4affbc1144c4dcd6cec861752fe2055f/diff:/var/lib/docker/overlay2/faef5e0c99adb337a14a97bc7175ca2df28b270874f36b7f06686685fb1aa145/diff:/var/lib/docker/overlay2/09218ea14043eea051ed5f675ed2ac438287daaab192c067630907608b9cb331/diff:/var/lib/docker/overlay2/ab22ba2d55bf9ec6c0025413d58ca48a6e68fd3cd92305f7d5bcd812945df612/diff:/var/lib/docker/overlay2/ace3f972cf88bd330727fa9a25fd0df2c3fec1df161ac9102bf9f5739b40b82c/diff",
            "MergedDir": "/var/lib/docker/overlay2/a63657a33b5f57784d89232a4f6795d1c4e72909cb33fc3b7abade11fe8c43a2/merged",
            "UpperDir": "/var/lib/docker/overlay2/a63657a33b5f57784d89232a4f6795d1c4e72909cb33fc3b7abade11fe8c43a2/diff",
            "WorkDir": "/var/lib/docker/overlay2/a63657a33b5f57784d89232a4f6795d1c4e72909cb33fc3b7abade11fe8c43a2/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:270a1170e7e398434ff1b31e17e233f7d7b71aa99a40473615860068e86720af",
            "sha256:81f2beb21fd2b57f4e13e4111b326b36f6cccaadef51adb5c726c0e78ea49b4d",
            "sha256:96906a241dbe7c69ca44105b7c19a8fb3623e875d22c2ba7c6f0650a970ec2a9",
            "sha256:44aad9301cd0516189f40c4c91217d0893a9f7f5428287f8aed346a969963eeb",
            "sha256:155ebcd32a1300e19d9a1a231971e30f6e807a9e7b36fbb1a72177a2e9cece39",
            "sha256:5095f7965b9be4a20c0c24804048d3d10fefc9738d11c4e9eb8abc2b6d8152ad",
            "sha256:5acc5065bb29b2e1d0da4b9c80ebc99c3a5aa71b191f6dedb4085068fb0bc7b7",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:b63619945061abada8903c8170a5d07d5b55cf2dbe4f0ff22875ad7be88fc172",
            "sha256:d20426592dc48339b8afc9f953b2523b497f9667feb3c5264fc1e50f5907f262",
            "sha256:d8177bbb6c147eff1c6ead1aa1714c34ced588ad21ff1406e81a05ae05db66a9",
            "sha256:2110c1a59af2f4ad879d1223fbb02786c80c86d8356fad46689449ca95709139",
            "sha256:a48b8417712d35c3164125892ae00cd83514f52115540aff39179573b16c1f06",
            "sha256:d2a754b5944a89b4a53f1a54c52e490dfd87695bbe05ad300e9ea856146f38ca",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:e9edcf931c208441fb2dd0cfb48a96c077f7866622f4bb5354bf8e02d86c9468",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:919949f1adb023ad53e3880f9d2db395616b8f5f23a40da9f639b2544c5dc780",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:35b8a42da9a5c7e697220983446b67d7ca518935575c2463e29e01fd6211037c",
            "sha256:a0e98fd1f2130d452b586d65d19f089e78c1f5f5a65b0442f5aa316f73d31724",
            "sha256:07cb08656714804b7e047977e313280462ea36d19d72b64eb650ac41dadf1452",
            "sha256:23af64947a94b3dd9c33de94c4657beba2d8fc223064622fc9ce54839819e05d",
            "sha256:7ce799d5cc1620120ad1d008ce01e0f01fef678d8e84020a598026a5ee38fd83",
            "sha256:7433191dfd3cf53156c7b8efcf992a367ceb34b9a4ab8acead77a328c517a72f",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:f90196d4d29755cdb899095f927f3b2d9a31cfc07262d5ad3605187470be1083",
            "sha256:8760845f8d2aba563ff8a418035f71de8aedcd8283f197aebb558fc123230d82",
            "sha256:7ab9013a68086da435a9f327327cb6897682a6f3f44eae017c5bcb40732097e7",
            "sha256:3294e9f3a00bcbb0daa9de615dbad168ca495631595dfbfacb2e10ddff0290a5",
            "sha256:d2c236513c6d662943d1e5bd910d3e480368aa30937c586e2767e35ba24e9979",
            "sha256:5491a1089890b8f61b4763149fda90cfe543e961be5985835cfea72765eb18b2"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-02-28T00:58:32.739699598+08:00"
    }
}

更多版本

docker.io/localai/localai:latest-aio-cpu

linux/amd64 docker.io6.42GB2024-11-08 14:23
228

docker.io/localai/localai:latest-aio-gpu-nvidia-cuda-12

linux/amd64 docker.io45.94GB2024-11-21 01:51
133

docker.io/localai/localai:master-aio-gpu-nvidia-cuda-12

linux/amd64 docker.io42.47GB2025-02-28 01:41
88

docker.io/localai/localai:master-vulkan-ffmpeg-core

linux/amd64 docker.io5.91GB2025-03-03 18:48
64

docker.io/localai/localai:latest-aio-gpu-hipblas

linux/amd64 docker.io88.18GB2025-03-10 02:52
83

docker.io/localai/localai:latest-gpu-nvidia-cuda-12

linux/amd64 docker.io41.80GB2025-03-11 02:52
79