logo
ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1
linux/amd64 ghcr.io wangxingrui 贡献

该Docker镜像为llm-d项目下的UDS分词器组件,用于大语言模型相关的文本分词预处理,支持大语言模型应用中的数据处理需求。

10
浏览次数
2.94GB
镜像大小
国内镜像
swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1
源镜像
ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1
镜像ID
sha256:26d0cf7e38552aa3cc97172fb9891ef12ad7e1dd37dd5a1791e9a18962725f1c
镜像 TAG
vllm-v0.19.1
镜像大小
2.94GB
平台架构
linux/amd64
镜像源
ghcr.io
CMD
python /app/run_grpc_server.py
启动入口
工作目录
/app
OS/平台
linux/amd64
镜像创建
2026-06-18T23:02:38.237602901Z
同步时间
2026-08-22 17:06
浏览量
10 次
贡献者
avatar wangxingrui
🔌 开放端口 1
8082/tcp
⚙️ 环境变量 6
KeyValue
PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 0
LANG=C.UTF-8 1
GPG_KEY=7169605F62C751356D054A26A821E680E5FA6305 2
PYTHON_VERSION=3.12.13 3
PYTHON_SHA256=c08bc65a81971c1dd5783182826503369466c7e67374d1646519adf05207b684 4
TOKENIZERS_DIR=/app/tokenizers 5
🛡️ 镜像安全扫描
debian 13.5 Trivy 2026-08-22 17:06 查看完整报告
68
低危 LOW
87
中危 MEDIUM
71
高危 HIGH
5
严重 CRITICAL
受影响目标 (2)
ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1 (debian 13.5) debian Python python-pkg

Docker拉取命令

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1  ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1  ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1

Shell快速替换命令

sed -i 's#ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1  ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1  ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1'

镜像构建历史


# 2026-06-19 07:02:38  0.00B 设置默认要执行的命令
CMD ["python" "/app/run_grpc_server.py"]
                        
# 2026-06-19 07:02:38  0.00B 声明容器运行时监听的端口
EXPOSE [8082/tcp]
                        
# 2026-06-19 07:02:38  0.00B 指定运行容器时使用的用户
USER 65532:65532
                        
# 2026-06-19 07:02:38  8.88KB 执行命令并创建新的镜像层
RUN |1 HEALTH_PORT=8082 /bin/sh -c useradd -u 65532 -m nonroot # buildkit
                        
# 2026-06-19 07:02:38  0.00B 执行命令并创建新的镜像层
RUN |1 HEALTH_PORT=8082 /bin/sh -c mkdir -p /.cache && chown -R 65532:65532 /.cache # buildkit
                        
# 2026-06-19 07:02:38  0.00B 执行命令并创建新的镜像层
RUN |1 HEALTH_PORT=8082 /bin/sh -c mkdir -p /.modelscope && chown -R 65532:65532 /.modelscope # buildkit
                        
# 2026-06-19 07:02:38  3.14KB 执行命令并创建新的镜像层
RUN |1 HEALTH_PORT=8082 /bin/sh -c mkdir -p /app/tokenizers && chown -R 65532:65532 /app/tokenizers # buildkit
                        
# 2026-06-19 07:02:37  0.00B 设置环境变量 TOKENIZERS_DIR
ENV TOKENIZERS_DIR=/app/tokenizers
                        
# 2026-06-19 07:02:37  0.00B 执行命令并创建新的镜像层
RUN |1 HEALTH_PORT=8082 /bin/sh -c mkdir -p /tmp/tokenizer && chown 65532:65532 /tmp/tokenizer # buildkit
                        
# 2026-06-19 07:02:37  24.32KB 复制新文件或目录到容器中
COPY tokenizerpb/ /app/tokenizerpb/ # buildkit
                        
# 2026-06-19 07:02:37  18.41KB 复制新文件或目录到容器中
COPY tokenizer_service/ /app/tokenizer_service/ # buildkit
                        
# 2026-06-19 07:02:37  7.32KB 复制新文件或目录到容器中
COPY utils/ /app/utils/ # buildkit
                        
# 2026-06-19 07:02:37  3.14KB 复制新文件或目录到容器中
COPY tokenizers/ /app/tokenizers/ # buildkit
                        
# 2026-06-19 07:02:37  12.25KB 复制新文件或目录到容器中
COPY tokenizer_grpc_service.py /app/tokenizer_grpc_service.py # buildkit
                        
# 2026-06-19 07:02:37  3.57KB 复制新文件或目录到容器中
COPY run_grpc_server.py /app/ # buildkit
                        
# 2026-06-19 07:02:37  394.18KB 复制新文件或目录到容器中
COPY /usr/local/bin/ /usr/local/bin/ # buildkit
                        
# 2026-06-19 07:02:37  2.82GB 复制新文件或目录到容器中
COPY /usr/local/lib/python3.12/site-packages /usr/local/lib/python3.12/site-packages # buildkit
                        
# 2026-06-19 07:00:33  0.00B 执行命令并创建新的镜像层
RUN |1 HEALTH_PORT=8082 /bin/sh -c apt-get update && apt-get upgrade -y && apt-get clean && rm -rf /var/lib/apt/lists/* /var/cache/apt/* # buildkit
                        
# 2026-06-19 07:00:30  0.00B 设置工作目录为/app
WORKDIR /app
                        
# 2026-06-19 07:00:30  0.00B 定义构建参数
ARG HEALTH_PORT=8082
                        
# 2026-06-11 09:11:27  0.00B 设置默认要执行的命令
CMD ["python3"]
                        
# 2026-06-11 09:11:27  36.00B 执行命令并创建新的镜像层
RUN /bin/sh -c set -eux; 	for src in idle3 pip3 pydoc3 python3 python3-config; do 		dst="$(echo "$src" | tr -d 3)"; 		[ -s "/usr/local/bin/$src" ]; 		[ ! -e "/usr/local/bin/$dst" ]; 		ln -svT "$src" "/usr/local/bin/$dst"; 	done # buildkit
                        
# 2026-06-11 09:11:27  36.77MB 执行命令并创建新的镜像层
RUN /bin/sh -c set -eux; 		savedAptMark="$(apt-mark showmanual)"; 	apt-get update; 	apt-get install -y --no-install-recommends 		dpkg-dev 		gcc 		gnupg 		libbluetooth-dev 		libbz2-dev 		libc6-dev 		libdb-dev 		libffi-dev 		libgdbm-dev 		liblzma-dev 		libncursesw5-dev 		libreadline-dev 		libsqlite3-dev 		libssl-dev 		make 		tk-dev 		uuid-dev 		wget 		xz-utils 		zlib1g-dev 	; 		wget -O python.tar.xz "https://www.python.org/ftp/python/${PYTHON_VERSION%%[a-z]*}/Python-$PYTHON_VERSION.tar.xz"; 	echo "$PYTHON_SHA256 *python.tar.xz" | sha256sum -c -; 	wget -O python.tar.xz.asc "https://www.python.org/ftp/python/${PYTHON_VERSION%%[a-z]*}/Python-$PYTHON_VERSION.tar.xz.asc"; 	GNUPGHOME="$(mktemp -d)"; export GNUPGHOME; 	gpg --batch --keyserver hkps://keys.openpgp.org --recv-keys "$GPG_KEY"; 	gpg --batch --verify python.tar.xz.asc python.tar.xz; 	gpgconf --kill all; 	rm -rf "$GNUPGHOME" python.tar.xz.asc; 	mkdir -p /usr/src/python; 	tar --extract --directory /usr/src/python --strip-components=1 --file python.tar.xz; 	rm python.tar.xz; 		cd /usr/src/python; 	gnuArch="$(dpkg-architecture --query DEB_BUILD_GNU_TYPE)"; 	./configure 		--build="$gnuArch" 		--enable-loadable-sqlite-extensions 		--enable-optimizations 		--enable-option-checking=fatal 		--enable-shared 		$(test "${gnuArch%%-*}" != 'riscv64' && echo '--with-lto') 		--with-ensurepip 	; 	nproc="$(nproc)"; 	EXTRA_CFLAGS="$(dpkg-buildflags --get CFLAGS)"; 	LDFLAGS="$(dpkg-buildflags --get LDFLAGS)"; 	LDFLAGS="${LDFLAGS:-} -Wl,--strip-all"; 	arch="$(dpkg --print-architecture)"; arch="${arch##*-}"; 	case "$arch" in 		amd64|arm64) 			EXTRA_CFLAGS="${EXTRA_CFLAGS:-} -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer"; 			;; 		i386) 			;; 		*) 			EXTRA_CFLAGS="${EXTRA_CFLAGS:-} -fno-omit-frame-pointer"; 			;; 	esac; 	make -j "$nproc" 		"EXTRA_CFLAGS=${EXTRA_CFLAGS:-}" 		"LDFLAGS=${LDFLAGS:-}" 	; 	rm python; 	make -j "$nproc" 		"EXTRA_CFLAGS=${EXTRA_CFLAGS:-}" 		"LDFLAGS=${LDFLAGS:-} -Wl,-rpath='\$\$ORIGIN/../lib'" 		python 	; 	make install; 		cd /; 	rm -rf /usr/src/python; 		find /usr/local -depth 		\( 			\( -type d -a \( -name test -o -name tests -o -name idle_test \) \) 			-o \( -type f -a \( -name '*.pyc' -o -name '*.pyo' -o -name 'libpython*.a' \) \) 		\) -exec rm -rf '{}' + 	; 		ldconfig; 		apt-mark auto '.*' > /dev/null; 	apt-mark manual $savedAptMark; 	find /usr/local -type f -executable -not \( -name '*tkinter*' \) -exec ldd '{}' ';' 		| awk '/=>/ { so = $(NF-1); if (index(so, "/usr/local/") == 1) { next }; gsub("^/(usr/)?", "", so); printf "*%s\n", so }' 		| sort -u 		| xargs -rt dpkg-query --search 		| awk 'sub(":$", "", $1) { print $1 }' 		| sort -u 		| xargs -r apt-mark manual 	; 	apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false; 	apt-get dist-clean; 		export PYTHONDONTWRITEBYTECODE=1; 	python3 --version; 	pip3 --version # buildkit
                        
# 2026-06-11 09:02:10  0.00B 设置环境变量 PYTHON_SHA256
ENV PYTHON_SHA256=c08bc65a81971c1dd5783182826503369466c7e67374d1646519adf05207b684
                        
# 2026-06-11 09:02:10  0.00B 设置环境变量 PYTHON_VERSION
ENV PYTHON_VERSION=3.12.13
                        
# 2026-06-11 09:02:10  0.00B 设置环境变量 GPG_KEY
ENV GPG_KEY=7169605F62C751356D054A26A821E680E5FA6305
                        
# 2026-06-11 09:02:10  3.81MB 执行命令并创建新的镜像层
RUN /bin/sh -c set -eux; 	apt-get update; 	apt-get install -y --no-install-recommends 		ca-certificates 		netbase 		tzdata 	; 	apt-get dist-clean # buildkit
                        
# 2026-06-11 09:02:10  0.00B 设置环境变量 LANG
ENV LANG=C.UTF-8
                        
# 2026-06-11 09:02:10  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2026-06-10 08:00:00  78.63MB 
# debian.sh --arch 'amd64' out/ 'trixie' '@1781049600'
                        
                    

镜像信息

{
    "Id": "sha256:26d0cf7e38552aa3cc97172fb9891ef12ad7e1dd37dd5a1791e9a18962725f1c",
    "RepoTags": [
        "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1"
    ],
    "RepoDigests": [
        "ghcr.io/llm-d/llm-d-uds-tokenizer@sha256:cd5a89348f787bf39b3c87b781b8de7444552f465f5cb3aac8ec3b1c701245df",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/ghcr.io/llm-d/llm-d-uds-tokenizer@sha256:c53d77942790eb2779f17f046581a970257517c4f069a9ce94ac7854bef9d89d"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2026-06-18T23:02:38.237602901Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "65532:65532",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "ExposedPorts": {
            "8082/tcp": {}
        },
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "LANG=C.UTF-8",
            "GPG_KEY=7169605F62C751356D054A26A821E680E5FA6305",
            "PYTHON_VERSION=3.12.13",
            "PYTHON_SHA256=c08bc65a81971c1dd5783182826503369466c7e67374d1646519adf05207b684",
            "TOKENIZERS_DIR=/app/tokenizers"
        ],
        "Cmd": [
            "python",
            "/app/run_grpc_server.py"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/app",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": null
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 2942469033,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/52e7fbb739b67f48725000b2442f7100561ea1f73428dc27a229d2e02fc62f8a/diff:/var/lib/docker/overlay2/ec3a5b000e74402736bb70bc8ae8e1621b63e2fbba9e72747912a6100792f588/diff:/var/lib/docker/overlay2/80abe6637f3227742803a627625c533464ced17d8587a29840d66d8d0689e5fe/diff:/var/lib/docker/overlay2/ad0d9438669509ee69632be5ecca455ecc94dc10dfa026d012fd5aa085baf9c1/diff:/var/lib/docker/overlay2/576d4705bc3539b02da8ba5a4a903e276ea2a65f92ff7cfbae0ba41277cb5710/diff:/var/lib/docker/overlay2/9c65ed9a70bb35072933bdac0065934addbda3e13a069bb4e05fc83da2d1c7d4/diff:/var/lib/docker/overlay2/10075a1cdc5e5cc304112092d49ebc8f8f9b9b87a1e17dc21b3fd5243d5431ea/diff:/var/lib/docker/overlay2/4df3d4536fa6454387fc99b56575ed0a32c2053155097b292d8aee910da23ae0/diff:/var/lib/docker/overlay2/4c52304fe593ba75dff79efdb3f7c9bde8ec392894cb54b06d6b438fe6640931/diff:/var/lib/docker/overlay2/1ae760e7d51a031e0cf74c5cc52eece8b46b9379a470a864ec292b9dce8d7e2f/diff:/var/lib/docker/overlay2/ae2dd83b787efabde6b76d2cc682d093aad85607edfbbcf381d847c3355f93f0/diff:/var/lib/docker/overlay2/1ab24120b9fbdda1e20e293be4052ab3198cb51ce97d7131551620c90dd10e5e/diff:/var/lib/docker/overlay2/107bf3f07c307014ac332468fcfb04af61ea2d21356f8224a9e9e04c912c7e90/diff:/var/lib/docker/overlay2/5f315dd94655b7b654e6aec610592ba99db2946a9136ddd8c261d88bbd3addf0/diff:/var/lib/docker/overlay2/e74a6d599772f5f96c6a75d34fbf3040e41b04c92c240977102cb618af740514/diff:/var/lib/docker/overlay2/6a097264cf06482723638d7a65693f1c37d8b61915b0af22672035ebf8900aeb/diff:/var/lib/docker/overlay2/d650bc913ce88924d5de6c2f7451defd99eea813eb95f68720ef2faf798c4e43/diff:/var/lib/docker/overlay2/5a9166c60bc8288b4cfb7796a25c5e82cf4efdbc784773beaab2c74a5042b48b/diff",
            "MergedDir": "/var/lib/docker/overlay2/c5690e7b093b6eae06fb4c4ed86dfb170b1698622002c49ad53d4a07371dbf92/merged",
            "UpperDir": "/var/lib/docker/overlay2/c5690e7b093b6eae06fb4c4ed86dfb170b1698622002c49ad53d4a07371dbf92/diff",
            "WorkDir": "/var/lib/docker/overlay2/c5690e7b093b6eae06fb4c4ed86dfb170b1698622002c49ad53d4a07371dbf92/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:f4f8b983b714f130e2cff99176baa26352db6a55d3622e10ada40f2b4720a4eb",
            "sha256:6745e6c94581b7c6ac6ee921e610e7899c25ef178ea8be0c538d267485e94257",
            "sha256:4a4c29065f7ee7ad8981719b93c5d8605a69ecb8a9cbb19588ec3112791f71be",
            "sha256:74975aa7a061dc4da7ff605715d3d64989873032b406fe7ba080fe25f90db307",
            "sha256:b76675b107c1f0ec5835c4b1f62938091b3d2857b9ab1e4224ae4783bec853a8",
            "sha256:976ef96d6dd36f83086964cabaa4a7615b02196405b46aa0c60db01d13938390",
            "sha256:b81eb89d2b67b2f2e9511d3f33a39af818b3891b449f3d29e48c57d22a3385c5",
            "sha256:5046190f278615959de8666c36d61dd3525301bbd78075d150e1db60b9f9865b",
            "sha256:2050ec596e5c4fc936bf99d146e62b7a1e1f1d45deac36129ee1c9594626b56a",
            "sha256:c9c855fc0cc9eb5dcc38cc93b5422e24347a020d37cffdca28fa1d28ccfebf9f",
            "sha256:6c7327db58e24fb8db7754eb4b443b210a48b2ae29f155e861ba05c603f9d69c",
            "sha256:e8266a36d2425c17f8bd3d32203b3cfe6c6b584ab48c3a1b386b5bd8850e9482",
            "sha256:44df77a5e77c61ebbfed7304e8b5bf27ccb03ad6eb101633bff7b9fafa0063b4",
            "sha256:315679750fe7bc2542b1749f854f5efcac0c1e833fab35112d2da233f91241e9",
            "sha256:8837cab683dbe84812089c857655d6fb5aed8a5f7e038d4444558fd6304821e7",
            "sha256:1e1fc5fde56233b710d575e5db944acdc5f825c56cf8f9770c4c03bcd6512e30",
            "sha256:fa8dbb949d45c5387c04eb7d723576b204bc2fac3556b28b21b2828b1e486678",
            "sha256:c9636845db0084c29bf8bf97d55e8949693f13e656a8524d1c91582c076e65fa",
            "sha256:145d96eb2ecb00449bee4f25fb716ae264b97dd2c2b1950ee9909bae59602ebf"
        ]
    },
    "Metadata": {
        "LastTagTime": "2026-08-22T17:04:40.538470577+08:00"
    }
}

更多版本

ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1

linux/amd64 ghcr.io2.94GB2026-08-22 17:06
9
检测到您正在使用广告拦截插件,本站为公益站点,依赖广告维持运转 🙏 查看如何关闭 ×