ghcr.io/berriai/litellm:main-stable linux/amd64

ghcr.io/berriai/litellm:main-stable - 国内下载镜像源 浏览次数:24

litellm 镜像

这是一个用于运行 litellm 的 Docker 容器镜像，litellm 是一个用于构建和部署轻量级语言模型的框架。

该镜像包含 litellm 的所有必要依赖项，方便用户快速部署和使用。

使用该镜像可以轻松构建和运行各种语言模型，例如：

  • 文本分类
  • 机器翻译
  • 问答
  • 代码生成

该镜像由 Berriai 开发维护。

源镜像 ghcr.io/berriai/litellm:main-stable
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable
镜像ID sha256:c753a1c5ed64fdd8205641e0f98e85fb72ea02dcc0f67a92ddd6270008dfeaa5
镜像TAG main-stable
大小 1.35GB
镜像源 ghcr.io
CMD --port 4000
启动入口 litellm
工作目录 /app
OS/平台 linux/amd64
浏览量 24 次
贡献者 tz*******l@gmail.com
镜像创建 2024-11-09T01:55:37.376331887Z
同步时间 2024-11-12 11:57
更新时间 2024-11-20 06:38
开放端口
4000/tcp
环境变量
PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LANG=C.UTF-8 GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D PYTHON_VERSION=3.11.8 PYTHON_PIP_VERSION=24.0 PYTHON_SETUPTOOLS_VERSION=65.5.1 PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/dbf0c85f76fb6e1ab42aa672ffca6f0a675d9ee4/public/get-pip.py PYTHON_GET_PIP_SHA256=dfe9fd5c28dc98b5ac17979a953ea550cec37ae1b47a5116007395bfacff2ab9
镜像标签
2024-11-09T01:53:43.836Z: org.opencontainers.image.created Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]: org.opencontainers.image.description NOASSERTION: org.opencontainers.image.licenses 3d1c3054019c7e524f658af76f5f1c453c2c3dca: org.opencontainers.image.revision https://github.com/BerriAI/litellm: org.opencontainers.image.source litellm: org.opencontainers.image.title https://github.com/BerriAI/litellm: org.opencontainers.image.url main: org.opencontainers.image.version
镜像安全扫描 查看Trivy扫描报告

系统OS: debian 12.7 扫描引擎: Trivy 扫描时间: 2024-11-12 11:57

低危漏洞:77 中危漏洞:20 高危漏洞:13 严重漏洞:1
ghcr.io/berriai/litellm:main-stable (debian 12.7) (debian) Node.js (node-pkg) Python (python-pkg) /app/litellm/llms/huggingface_llms_metadata/hf_text_generation_models.txt () /app/litellm/proxy/_types.py ()

Docker拉取命令 无权限下载?点我修复 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable  ghcr.io/berriai/litellm:main-stable

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable  ghcr.io/berriai/litellm:main-stable

Shell快速替换命令 

sed -i 's#ghcr.io/berriai/litellm:main-stable#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable  ghcr.io/berriai/litellm:main-stable'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable  ghcr.io/berriai/litellm:main-stable'

镜像历史

大小 创建时间 层信息
0.00B 2024-11-09 09:55:37 CMD ["--port" "4000"]
0.00B 2024-11-09 09:55:37 ENTRYPOINT ["litellm"]
0.00B 2024-11-09 09:55:37 EXPOSE map[4000/tcp:{}]
0.00B 2024-11-09 09:55:37 RUN /bin/sh -c chmod +x docker/entrypoint.sh # buildkit
573.19MB 2024-11-09 09:55:37 RUN /bin/sh -c prisma generate # buildkit
488.39MB 2024-11-09 09:55:26 RUN /bin/sh -c pip install *.whl /wheels/* --no-index --find-links=/wheels/ && rm -f *.whl && rm -rf /wheels # buildkit
94.29MB 2024-11-09 09:55:00 COPY /wheels/ /wheels/ # buildkit
6.34MB 2024-11-09 09:55:00 COPY /app/dist/*.whl . # buildkit
0.00B 2024-11-09 09:54:06 RUN /bin/sh -c ls -la /app # buildkit
24.14MB 2024-11-09 09:54:06 COPY . . # buildkit
0.00B 2024-11-09 09:54:05 WORKDIR /app
37.39MB 2024-11-09 09:54:05 RUN /bin/sh -c apt-get update && apt-get upgrade -y && rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2024-03-22 07:32:08 CMD ["python3"]
12.40MB 2024-03-22 07:32:08 RUN /bin/sh -c set -eux; savedAptMark="$(apt-mark showmanual)"; apt-get update; apt-get install -y --no-install-recommends wget; wget -O get-pip.py "$PYTHON_GET_PIP_URL"; echo "$PYTHON_GET_PIP_SHA256 *get-pip.py" | sha256sum -c -; apt-mark auto '.*' > /dev/null; [ -z "$savedAptMark" ] || apt-mark manual $savedAptMark > /dev/null; apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false; rm -rf /var/lib/apt/lists/*; export PYTHONDONTWRITEBYTECODE=1; python get-pip.py --disable-pip-version-check --no-cache-dir --no-compile "pip==$PYTHON_PIP_VERSION" "setuptools==$PYTHON_SETUPTOOLS_VERSION" ; rm -f get-pip.py; pip --version # buildkit
0.00B 2024-03-22 07:32:08 ENV PYTHON_GET_PIP_SHA256=dfe9fd5c28dc98b5ac17979a953ea550cec37ae1b47a5116007395bfacff2ab9
0.00B 2024-03-22 07:32:08 ENV PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/dbf0c85f76fb6e1ab42aa672ffca6f0a675d9ee4/public/get-pip.py
0.00B 2024-03-22 07:32:08 ENV PYTHON_SETUPTOOLS_VERSION=65.5.1
0.00B 2024-03-22 07:32:08 ENV PYTHON_PIP_VERSION=24.0
32.00B 2024-03-22 07:32:08 RUN /bin/sh -c set -eux; for src in idle3 pydoc3 python3 python3-config; do dst="$(echo "$src" | tr -d 3)"; [ -s "/usr/local/bin/$src" ]; [ ! -e "/usr/local/bin/$dst" ]; ln -svT "$src" "/usr/local/bin/$dst"; done # buildkit
34.30MB 2024-03-22 07:32:08 RUN /bin/sh -c set -eux; savedAptMark="$(apt-mark showmanual)"; apt-get update; apt-get install -y --no-install-recommends dpkg-dev gcc gnupg libbluetooth-dev libbz2-dev libc6-dev libdb-dev libexpat1-dev libffi-dev libgdbm-dev liblzma-dev libncursesw5-dev libreadline-dev libsqlite3-dev libssl-dev make tk-dev uuid-dev wget xz-utils zlib1g-dev ; wget -O python.tar.xz "https://www.python.org/ftp/python/${PYTHON_VERSION%%[a-z]*}/Python-$PYTHON_VERSION.tar.xz"; wget -O python.tar.xz.asc "https://www.python.org/ftp/python/${PYTHON_VERSION%%[a-z]*}/Python-$PYTHON_VERSION.tar.xz.asc"; GNUPGHOME="$(mktemp -d)"; export GNUPGHOME; gpg --batch --keyserver hkps://keys.openpgp.org --recv-keys "$GPG_KEY"; gpg --batch --verify python.tar.xz.asc python.tar.xz; gpgconf --kill all; rm -rf "$GNUPGHOME" python.tar.xz.asc; mkdir -p /usr/src/python; tar --extract --directory /usr/src/python --strip-components=1 --file python.tar.xz; rm python.tar.xz; cd /usr/src/python; gnuArch="$(dpkg-architecture --query DEB_BUILD_GNU_TYPE)"; ./configure --build="$gnuArch" --enable-loadable-sqlite-extensions --enable-optimizations --enable-option-checking=fatal --enable-shared --with-lto --with-system-expat --without-ensurepip ; nproc="$(nproc)"; EXTRA_CFLAGS="$(dpkg-buildflags --get CFLAGS)"; LDFLAGS="$(dpkg-buildflags --get LDFLAGS)"; LDFLAGS="${LDFLAGS:--Wl},--strip-all"; make -j "$nproc" "EXTRA_CFLAGS=${EXTRA_CFLAGS:-}" "LDFLAGS=${LDFLAGS:-}" "PROFILE_TASK=${PROFILE_TASK:-}" ; rm python; make -j "$nproc" "EXTRA_CFLAGS=${EXTRA_CFLAGS:-}" "LDFLAGS=${LDFLAGS:--Wl},-rpath='\$\$ORIGIN/../lib'" "PROFILE_TASK=${PROFILE_TASK:-}" python ; make install; cd /; rm -rf /usr/src/python; find /usr/local -depth \( \( -type d -a \( -name test -o -name tests -o -name idle_test \) \) -o \( -type f -a \( -name '*.pyc' -o -name '*.pyo' -o -name 'libpython*.a' \) \) \) -exec rm -rf '{}' + ; ldconfig; apt-mark auto '.*' > /dev/null; apt-mark manual $savedAptMark; find /usr/local -type f -executable -not \( -name '*tkinter*' \) -exec ldd '{}' ';' | awk '/=>/ { so = $(NF-1); if (index(so, "/usr/local/") == 1) { next }; gsub("^/(usr/)?", "", so); printf "*%s\n", so }' | sort -u | xargs -r dpkg-query --search | cut -d: -f1 | sort -u | xargs -r apt-mark manual ; apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false; rm -rf /var/lib/apt/lists/*; python3 --version # buildkit
0.00B 2024-03-22 07:32:08 ENV PYTHON_VERSION=3.11.8
0.00B 2024-03-22 07:32:08 ENV GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D
9.23MB 2024-03-22 07:32:08 RUN /bin/sh -c set -eux; apt-get update; apt-get install -y --no-install-recommends ca-certificates netbase tzdata ; rm -rf /var/lib/apt/lists/* # buildkit
0.00B 2024-03-22 07:32:08 ENV LANG=C.UTF-8
0.00B 2024-03-22 07:32:08 ENV PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
0.00B 2024-03-12 09:21:01 /bin/sh -c #(nop) CMD ["bash"]
74.77MB 2024-03-12 09:21:01 /bin/sh -c #(nop) ADD file:b86ae1c7ca3586d8feedcd9ff1b2b1e8ab872caf6587618f1da689045a5d7ae4 in /

镜像信息 

{
    "Id": "sha256:c753a1c5ed64fdd8205641e0f98e85fb72ea02dcc0f67a92ddd6270008dfeaa5",
    "RepoTags": [
        "ghcr.io/berriai/litellm:main-stable",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm:main-stable"
    ],
    "RepoDigests": [
        "ghcr.io/berriai/litellm@sha256:3a0689b5bb4a5ac67ba116e686093fbaab730d77c4790f317fac466e113a87f3",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/berriai/litellm@sha256:c1b27b13ddc3c0c35e6fd145800d93eb8f1b2152c2afc0e2e26274cf1da535a8"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2024-11-09T01:55:37.376331887Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "ExposedPorts": {
            "4000/tcp": {}
        },
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LANG=C.UTF-8",
            "GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D",
            "PYTHON_VERSION=3.11.8",
            "PYTHON_PIP_VERSION=24.0",
            "PYTHON_SETUPTOOLS_VERSION=65.5.1",
            "PYTHON_GET_PIP_URL=https://github.com/pypa/get-pip/raw/dbf0c85f76fb6e1ab42aa672ffca6f0a675d9ee4/public/get-pip.py",
            "PYTHON_GET_PIP_SHA256=dfe9fd5c28dc98b5ac17979a953ea550cec37ae1b47a5116007395bfacff2ab9"
        ],
        "Cmd": [
            "--port",
            "4000"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/app",
        "Entrypoint": [
            "litellm"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.created": "2024-11-09T01:53:43.836Z",
            "org.opencontainers.image.description": "Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]",
            "org.opencontainers.image.licenses": "NOASSERTION",
            "org.opencontainers.image.revision": "3d1c3054019c7e524f658af76f5f1c453c2c3dca",
            "org.opencontainers.image.source": "https://github.com/BerriAI/litellm",
            "org.opencontainers.image.title": "litellm",
            "org.opencontainers.image.url": "https://github.com/BerriAI/litellm",
            "org.opencontainers.image.version": "main"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 1354437054,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/db4b0df6e6135adfc31dd6c10ef47817eec5f44599795a3d3dfd435501a41d6d/diff:/var/lib/docker/overlay2/a75937d1354ef1c7eaa00951babe3a17beb1ac6e28001a2bf279e42a28cd8a81/diff:/var/lib/docker/overlay2/2426b0d8f8237ca24b6d56981b0a5adc123226614fad8a9e3504a8e6988bbdce/diff:/var/lib/docker/overlay2/b54b08a448a8b3fd5ff3e5126dc26dfd0439b8eaf3cb7d907b29df13f023e4e1/diff:/var/lib/docker/overlay2/98b40e07d39c38b09846f035771f99dc4ac39cb4889d8b001766f8792ea6e0d0/diff:/var/lib/docker/overlay2/20ae51127d1f946b20e17eb01a07003615e050f61a9f49750fc3cf99fb77c268/diff:/var/lib/docker/overlay2/cf631e0bcfe5c8458026473f6883c1829128e9d62ecdf0c2670cd01e7068c961/diff:/var/lib/docker/overlay2/c1abd971fa014371d7305f35d3f31fe56396e9951c000e06c14970f7dff6390c/diff:/var/lib/docker/overlay2/a413e2162d54e9b91d143c964b815c210e7e0272df3d8f1405d5c3f4102598f0/diff:/var/lib/docker/overlay2/e3f44ae6de66880c3e0577e3923841fc6d47d92b07c30f76c67518e3c1233e69/diff:/var/lib/docker/overlay2/b4572851e9bb50ae7900e9e9de3269a19f533dcedd028b64cc2f90a5eadd74ea/diff:/var/lib/docker/overlay2/023cb13fb33a7a744e3d6f39463289357a4ba22424fbe8d2eecb63c39b0f7ded/diff:/var/lib/docker/overlay2/b5d3e7ac2c1324d839e40a64a285a62d7eaa59a83d0be96d675166da9710bc03/diff",
            "MergedDir": "/var/lib/docker/overlay2/9d99a8d6d09e6fd4a881d911ef5f3b505618934730bf2d83f31158fafe652b4b/merged",
            "UpperDir": "/var/lib/docker/overlay2/9d99a8d6d09e6fd4a881d911ef5f3b505618934730bf2d83f31158fafe652b4b/diff",
            "WorkDir": "/var/lib/docker/overlay2/9d99a8d6d09e6fd4a881d911ef5f3b505618934730bf2d83f31158fafe652b4b/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:a483da8ab3e941547542718cacd3258c6c705a63e94183c837c9bc44eb608999",
            "sha256:c8f253aef5606f6716778771171c3fdf6aa135b76a5fa8bf66ba45c12c15b540",
            "sha256:9559125c0303b960274ed767b40a1a1950c500dd9e3f5ffea9418d156b787299",
            "sha256:010a290fc3d5487d6431681165ae41aca6278b077be77a285db6888154903022",
            "sha256:067693c93cf96e1757b12c3b57a46f0ef79e2499b4729c35a608bb2e915e64ee",
            "sha256:df836bbc5b0b5b8b831682c05fc6425a85e138244b046beea903b423f0037322",
            "sha256:11fdcac02ba155945f5285a6ae93450f05e60cf5dcfa204d7a9b3753c81b1ba1",
            "sha256:ecc417d4e2fc04a70f402343c3a89db7b68639f0009aa82dcca3ee8eabe2c7a0",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:0f28dd4490e9d892edd23c0a9a4262e65ef8edb0bfc9dec719de83862bc6d78a",
            "sha256:6a22020ba0b1c1765bb538957fb24b2fae8e21b15a130b6fb3f4027b51312c74",
            "sha256:a3ac46db19e2b6d0cc7a76badbdb23190e9d82500d96741779c3c771219acb6a",
            "sha256:528ff3a19e90fb64ef126ccae954bd32d3261f7b76097bb61a530b09af1c81f2",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-11-12T11:55:59.668900152+08:00"
    }
}

更多版本

ghcr.io/berriai/litellm-non_root:main-v1.48.6

linux/amd64 ghcr.io1.18GB2024-09-29 18:13
60

ghcr.io/berriai/litellm:main-stable

linux/amd64 ghcr.io1.35GB2024-11-12 11:57
23