docker.io/datajuicer/data-juicer:v1.4.2 linux/amd64

docker.io/datajuicer/data-juicer:v1.4.2 - 国内下载镜像源 浏览次数:27
<>

Data Juicer 镜像描述

Data Juicer是一个用于数据处理和分析的Docker镜像。它提供了一个预配置的环境，包含了常用的数据处理工具和库，方便用户快速构建和部署数据处理应用。

源镜像 docker.io/datajuicer/data-juicer:v1.4.2
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2
镜像ID sha256:a7ab9899f846a7de3e6346b00520a36bdc5892a0225db958186430d265969d36
镜像TAG v1.4.2
大小 23.22GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 /opt/nvidia/nvidia_entrypoint.sh
工作目录 /data-juicer
OS/平台 linux/amd64
浏览量 27 次
贡献者
镜像创建 2025-08-18T03:45:40.933721435Z
同步时间 2025-08-20 05:28
更新时间 2025-08-26 22:40
环境变量
PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NVARCH=x86_64 NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536 NV_CUDA_CUDART_VERSION=12.4.127-1 NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4 CUDA_VERSION=12.4.1 LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_VISIBLE_DEVICES=all NVIDIA_DRIVER_CAPABILITIES=compute,utility NV_CUDA_LIB_VERSION=12.4.1-1 NV_NVTX_VERSION=12.4.127-1 NV_LIBNPP_VERSION=12.2.5.30-1 NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1 NV_LIBCUSPARSE_VERSION=12.3.1.170-1 NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4 NV_LIBCUBLAS_VERSION=12.4.5.8-1 NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1 NV_LIBNCCL_PACKAGE_NAME=libnccl2 NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1 NCCL_VERSION=2.21.5-1 NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4 NVIDIA_PRODUCT_NAME=CUDA NV_CUDA_CUDART_DEV_VERSION=12.4.127-1 NV_NVML_DEV_VERSION=12.4.127-1 NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1 NV_LIBNPP_DEV_VERSION=12.2.5.30-1 NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1 NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1 NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4 NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1 NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1 NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1 NV_NVPROF_VERSION=12.4.127-1 NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1 NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1 NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4 LIBRARY_PATH=/usr/local/cuda/lib64/stubs NV_CUDNN_VERSION=9.1.0.70-1 NV_CUDNN_PACKAGE_NAME=libcudnn9-cuda-12 NV_CUDNN_PACKAGE=libcudnn9-cuda-12=9.1.0.70-1 NV_CUDNN_PACKAGE_DEV=libcudnn9-dev-cuda-12=9.1.0.70-1 JAVA_HOME=/opt/jdk
镜像标签
9.1.0.70-1: com.nvidia.cudnn.version NVIDIA CORPORATION <cudatools@nvidia.com>: maintainer 2025-08-18T03:23:22.199Z: org.opencontainers.image.created Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷: org.opencontainers.image.description Apache-2.0: org.opencontainers.image.licenses ubuntu: org.opencontainers.image.ref.name 14f659412482454ecc4cda3a4a8dc7a4d25791cb: org.opencontainers.image.revision https://github.com/modelscope/data-juicer: org.opencontainers.image.source data-juicer: org.opencontainers.image.title https://github.com/modelscope/data-juicer: org.opencontainers.image.url v1.4.2: org.opencontainers.image.version
无权限下载?点我修复 生成Docker Run命令 生成Kubernetes YAML资源

Docker拉取命令 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2  docker.io/datajuicer/data-juicer:v1.4.2

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2  docker.io/datajuicer/data-juicer:v1.4.2

Shell快速替换命令 

sed -i 's#datajuicer/data-juicer:v1.4.2#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2  docker.io/datajuicer/data-juicer:v1.4.2'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2  docker.io/datajuicer/data-juicer:v1.4.2'

镜像构建历史 


# 2025-08-18 11:45:40  13.24GB 执行命令并创建新的镜像层
RUN /bin/sh -c uv pip install -v -e .[all] -i https://pypi.tuna.tsinghua.edu.cn/simple --system     && python -c "import nltk; nltk.download('punkt_tab'); nltk.download('punkt'); nltk.download('averaged_perceptron_tagger');  nltk.download('averaged_perceptron_tagger_eng')" # buildkit
                        
# 2025-08-18 11:32:55  68.48MB 复制新文件或目录到容器中
COPY . . # buildkit
                        
# 2025-08-18 11:32:55  43.86MB 执行命令并创建新的镜像层
RUN /bin/sh -c uv pip install --upgrade setuptools==69.5.1 setuptools_scm -i https://pypi.tuna.tsinghua.edu.cn/simple --system     && uv pip install http://dail-wlcb.oss-cn-wulanchabu.aliyuncs.com/data_juicer/recognize-anything-main.zip -i https://pypi.tuna.tsinghua.edu.cn/simple --system # buildkit
                        
# 2025-08-18 11:32:49  68.71MB 执行命令并创建新的镜像层
RUN /bin/sh -c pip install uv -i https://pypi.tuna.tsinghua.edu.cn/simple # buildkit
                        
# 2025-08-18 11:32:45  0.00B 设置工作目录为/data-juicer
WORKDIR /data-juicer
                        
# 2025-08-18 11:32:45  0.00B 设置环境变量 JAVA_HOME
ENV JAVA_HOME=/opt/jdk
                        
# 2025-08-18 11:32:45  331.67MB 执行命令并创建新的镜像层
RUN /bin/sh -c wget https://aka.ms/download-jdk/microsoft-jdk-17.0.9-linux-x64.tar.gz -O jdk.tar.gz     && tar -xzf jdk.tar.gz     && rm -rf jdk.tar.gz     && mv jdk-17.0.9+8 jdk # buildkit
                        
# 2025-08-18 11:32:09  0.00B 设置工作目录为/opt
WORKDIR /opt
                        
# 2025-08-18 11:32:09  815.09MB 执行命令并创建新的镜像层
RUN /bin/sh -c DEBIAN_FRONTEND=noninteractive apt-get update     && DEBIAN_FRONTEND=noninteractive apt-get install -y ffmpeg libsm6 libxext6 software-properties-common build-essential cmake gfortran libopenblas-dev liblapack-dev postgresql postgresql-contrib libpq-dev # buildkit
                        
# 2025-08-18 11:31:02  362.99MB 执行命令并创建新的镜像层
RUN /bin/sh -c DEBIAN_FRONTEND=noninteractive apt-get update     && DEBIAN_FRONTEND=noninteractive apt-get install -y git curl vim wget python3.10 libpython3.10-dev python3-pip libgl1-mesa-glx libglib2.0-0     && ln -sf /usr/bin/python3.10  /usr/bin/python3     && ln -sf /usr/bin/python3.10  /usr/bin/python     && apt-get autoclean && rm -rf /var/lib/apt/lists/*     && pip install --upgrade pip -i https://pypi.tuna.tsinghua.edu.cn/simple # buildkit
                        
# 2025-08-18 11:30:34  2.40KB 执行命令并创建新的镜像层
RUN /bin/sh -c sed -i 's/archive.ubuntu.com/mirrors.aliyun.com/g' /etc/apt/sources.list     && sed -i 's/security.ubuntu.com/mirrors.aliyun.com/g' /etc/apt/sources.list # buildkit
                        
# 2024-04-23 08:11:02  1.02GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     ${NV_CUDNN_PACKAGE}     ${NV_CUDNN_PACKAGE_DEV}     && apt-mark hold ${NV_CUDNN_PACKAGE_NAME}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-04-23 08:11:02  0.00B 添加元数据标签
LABEL com.nvidia.cudnn.version=9.1.0.70-1
                        
# 2024-04-23 08:11:02  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2024-04-23 08:11:02  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2024-04-23 08:11:02  0.00B 设置环境变量 NV_CUDNN_PACKAGE_DEV
ENV NV_CUDNN_PACKAGE_DEV=libcudnn9-dev-cuda-12=9.1.0.70-1
                        
# 2024-04-23 08:11:02  0.00B 设置环境变量 NV_CUDNN_PACKAGE
ENV NV_CUDNN_PACKAGE=libcudnn9-cuda-12=9.1.0.70-1
                        
# 2024-04-23 08:11:02  0.00B 设置环境变量 NV_CUDNN_PACKAGE_NAME
ENV NV_CUDNN_PACKAGE_NAME=libcudnn9-cuda-12
                        
# 2024-04-23 08:11:02  0.00B 设置环境变量 NV_CUDNN_VERSION
ENV NV_CUDNN_VERSION=9.1.0.70-1
                        
# 2024-04-23 07:54:42  0.00B 设置环境变量 LIBRARY_PATH
ENV LIBRARY_PATH=/usr/local/cuda/lib64/stubs
                        
# 2024-04-23 07:54:42  389.87KB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_DEV_PACKAGE_NAME} ${NV_LIBNCCL_DEV_PACKAGE_NAME} # buildkit
                        
# 2024-04-23 07:54:41  4.98GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-dev-12-4=${NV_CUDA_CUDART_DEV_VERSION}     cuda-command-line-tools-12-4=${NV_CUDA_LIB_VERSION}     cuda-minimal-build-12-4=${NV_CUDA_LIB_VERSION}     cuda-libraries-dev-12-4=${NV_CUDA_LIB_VERSION}     cuda-nvml-dev-12-4=${NV_NVML_DEV_VERSION}     ${NV_NVPROF_DEV_PACKAGE}     ${NV_LIBNPP_DEV_PACKAGE}     libcusparse-dev-12-4=${NV_LIBCUSPARSE_DEV_VERSION}     ${NV_LIBCUBLAS_DEV_PACKAGE}     ${NV_LIBNCCL_DEV_PACKAGE}     ${NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-04-23 07:54:41  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2024-04-23 07:54:41  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBNCCL_DEV_PACKAGE
ENV NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NCCL_VERSION
ENV NCCL_VERSION=2.21.5-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBNCCL_DEV_PACKAGE_VERSION
ENV NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBNCCL_DEV_PACKAGE_NAME
ENV NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_NVPROF_DEV_PACKAGE
ENV NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_NVPROF_VERSION
ENV NV_NVPROF_VERSION=12.4.127-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE
ENV NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_CUDA_NSIGHT_COMPUTE_VERSION
ENV NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBCUBLAS_DEV_PACKAGE
ENV NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBCUBLAS_DEV_PACKAGE_NAME
ENV NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBCUBLAS_DEV_VERSION
ENV NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBNPP_DEV_PACKAGE
ENV NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBNPP_DEV_VERSION
ENV NV_LIBNPP_DEV_VERSION=12.2.5.30-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_LIBCUSPARSE_DEV_VERSION
ENV NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_NVML_DEV_VERSION
ENV NV_NVML_DEV_VERSION=12.4.127-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_CUDA_CUDART_DEV_VERSION
ENV NV_CUDA_CUDART_DEV_VERSION=12.4.127-1
                        
# 2024-04-23 07:54:41  0.00B 设置环境变量 NV_CUDA_LIB_VERSION
ENV NV_CUDA_LIB_VERSION=12.4.1-1
                        
# 2024-04-23 07:46:26  0.00B 配置容器启动时运行的命令
ENTRYPOINT ["/opt/nvidia/nvidia_entrypoint.sh"]
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NVIDIA_PRODUCT_NAME
ENV NVIDIA_PRODUCT_NAME=CUDA
                        
# 2024-04-23 07:46:26  2.53KB 复制新文件或目录到容器中
COPY nvidia_entrypoint.sh /opt/nvidia/ # buildkit
                        
# 2024-04-23 07:46:26  3.06KB 复制新文件或目录到容器中
COPY entrypoint.d/ /opt/nvidia/entrypoint.d/ # buildkit
                        
# 2024-04-23 07:46:26  263.02KB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-mark hold ${NV_LIBCUBLAS_PACKAGE_NAME} ${NV_LIBNCCL_PACKAGE_NAME} # buildkit
                        
# 2024-04-23 07:46:26  2.05GB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-libraries-12-4=${NV_CUDA_LIB_VERSION}     ${NV_LIBNPP_PACKAGE}     cuda-nvtx-12-4=${NV_NVTX_VERSION}     libcusparse-12-4=${NV_LIBCUSPARSE_VERSION}     ${NV_LIBCUBLAS_PACKAGE}     ${NV_LIBNCCL_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-04-23 07:46:26  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2024-04-23 07:46:26  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE
ENV NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NCCL_VERSION
ENV NCCL_VERSION=2.21.5-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE_VERSION
ENV NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBNCCL_PACKAGE_NAME
ENV NV_LIBNCCL_PACKAGE_NAME=libnccl2
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBCUBLAS_PACKAGE
ENV NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBCUBLAS_VERSION
ENV NV_LIBCUBLAS_VERSION=12.4.5.8-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBCUBLAS_PACKAGE_NAME
ENV NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBCUSPARSE_VERSION
ENV NV_LIBCUSPARSE_VERSION=12.3.1.170-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBNPP_PACKAGE
ENV NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_LIBNPP_VERSION
ENV NV_LIBNPP_VERSION=12.2.5.30-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_NVTX_VERSION
ENV NV_NVTX_VERSION=12.4.127-1
                        
# 2024-04-23 07:46:26  0.00B 设置环境变量 NV_CUDA_LIB_VERSION
ENV NV_CUDA_LIB_VERSION=12.4.1-1
                        
# 2024-04-23 07:42:28  0.00B 设置环境变量 NVIDIA_DRIVER_CAPABILITIES
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
                        
# 2024-04-23 07:42:28  0.00B 设置环境变量 NVIDIA_VISIBLE_DEVICES
ENV NVIDIA_VISIBLE_DEVICES=all
                        
# 2024-04-23 07:42:28  17.29KB 复制新文件或目录到容器中
COPY NGC-DL-CONTAINER-LICENSE / # buildkit
                        
# 2024-04-23 07:42:28  0.00B 设置环境变量 LD_LIBRARY_PATH
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
                        
# 2024-04-23 07:42:28  0.00B 设置环境变量 PATH
ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
                        
# 2024-04-23 07:42:28  46.00B 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c echo "/usr/local/nvidia/lib" >> /etc/ld.so.conf.d/nvidia.conf     && echo "/usr/local/nvidia/lib64" >> /etc/ld.so.conf.d/nvidia.conf # buildkit
                        
# 2024-04-23 07:42:28  155.93MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     cuda-cudart-12-4=${NV_CUDA_CUDART_VERSION}     ${NV_CUDA_COMPAT_PACKAGE}     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-04-23 07:42:16  0.00B 设置环境变量 CUDA_VERSION
ENV CUDA_VERSION=12.4.1
                        
# 2024-04-23 07:42:16  10.57MB 执行命令并创建新的镜像层
RUN |1 TARGETARCH=amd64 /bin/sh -c apt-get update && apt-get install -y --no-install-recommends     gnupg2 curl ca-certificates &&     curl -fsSLO https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/${NVARCH}/cuda-keyring_1.1-1_all.deb &&     dpkg -i cuda-keyring_1.1-1_all.deb &&     apt-get purge --autoremove -y curl     && rm -rf /var/lib/apt/lists/* # buildkit
                        
# 2024-04-23 07:42:16  0.00B 添加元数据标签
LABEL maintainer=NVIDIA CORPORATION <cudatools@nvidia.com>
                        
# 2024-04-23 07:42:16  0.00B 定义构建参数
ARG TARGETARCH
                        
# 2024-04-23 07:42:16  0.00B 设置环境变量 NV_CUDA_COMPAT_PACKAGE
ENV NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4
                        
# 2024-04-23 07:42:16  0.00B 设置环境变量 NV_CUDA_CUDART_VERSION
ENV NV_CUDA_CUDART_VERSION=12.4.127-1
                        
# 2024-04-23 07:42:16  0.00B 设置环境变量 NVIDIA_REQUIRE_CUDA brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand brand
ENV NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536
                        
# 2024-04-23 07:42:16  0.00B 设置环境变量 NVARCH
ENV NVARCH=x86_64
                        
# 2024-04-11 02:52:04  0.00B 
/bin/sh -c #(nop)  CMD ["/bin/bash"]
                        
# 2024-04-11 02:52:04  77.86MB 
/bin/sh -c #(nop) ADD file:3bd10da0673e2e72cb06a1f64a9df49a36341df39b0f762e3d1b38ee4de296fa in / 
                        
# 2024-04-11 02:52:02  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.version=22.04
                        
# 2024-04-11 02:52:02  0.00B 
/bin/sh -c #(nop)  LABEL org.opencontainers.image.ref.name=ubuntu
                        
# 2024-04-11 02:52:02  0.00B 
/bin/sh -c #(nop)  ARG LAUNCHPAD_BUILD_ARCH
                        
# 2024-04-11 02:52:02  0.00B 
/bin/sh -c #(nop)  ARG RELEASE

镜像信息 

{
    "Id": "sha256:a7ab9899f846a7de3e6346b00520a36bdc5892a0225db958186430d265969d36",
    "RepoTags": [
        "datajuicer/data-juicer:v1.4.2",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer:v1.4.2"
    ],
    "RepoDigests": [
        "datajuicer/data-juicer@sha256:989833e42c7be85f6da1feb9282328ff187f37fb38f72e4d00952955157fb6cb",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/datajuicer/data-juicer@sha256:86a041153489bab2373d4ccaf3fdf6c4c1cf829f689e385fb17860937215ef2d"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2025-08-18T03:45:40.933721435Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "NVARCH=x86_64",
            "NVIDIA_REQUIRE_CUDA=cuda\u003e=12.4 brand=tesla,driver\u003e=470,driver\u003c471 brand=unknown,driver\u003e=470,driver\u003c471 brand=nvidia,driver\u003e=470,driver\u003c471 brand=nvidiartx,driver\u003e=470,driver\u003c471 brand=geforce,driver\u003e=470,driver\u003c471 brand=geforcertx,driver\u003e=470,driver\u003c471 brand=quadro,driver\u003e=470,driver\u003c471 brand=quadrortx,driver\u003e=470,driver\u003c471 brand=titan,driver\u003e=470,driver\u003c471 brand=titanrtx,driver\u003e=470,driver\u003c471 brand=tesla,driver\u003e=525,driver\u003c526 brand=unknown,driver\u003e=525,driver\u003c526 brand=nvidia,driver\u003e=525,driver\u003c526 brand=nvidiartx,driver\u003e=525,driver\u003c526 brand=geforce,driver\u003e=525,driver\u003c526 brand=geforcertx,driver\u003e=525,driver\u003c526 brand=quadro,driver\u003e=525,driver\u003c526 brand=quadrortx,driver\u003e=525,driver\u003c526 brand=titan,driver\u003e=525,driver\u003c526 brand=titanrtx,driver\u003e=525,driver\u003c526 brand=tesla,driver\u003e=535,driver\u003c536 brand=unknown,driver\u003e=535,driver\u003c536 brand=nvidia,driver\u003e=535,driver\u003c536 brand=nvidiartx,driver\u003e=535,driver\u003c536 brand=geforce,driver\u003e=535,driver\u003c536 brand=geforcertx,driver\u003e=535,driver\u003c536 brand=quadro,driver\u003e=535,driver\u003c536 brand=quadrortx,driver\u003e=535,driver\u003c536 brand=titan,driver\u003e=535,driver\u003c536 brand=titanrtx,driver\u003e=535,driver\u003c536",
            "NV_CUDA_CUDART_VERSION=12.4.127-1",
            "NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-4",
            "CUDA_VERSION=12.4.1",
            "LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64",
            "NVIDIA_VISIBLE_DEVICES=all",
            "NVIDIA_DRIVER_CAPABILITIES=compute,utility",
            "NV_CUDA_LIB_VERSION=12.4.1-1",
            "NV_NVTX_VERSION=12.4.127-1",
            "NV_LIBNPP_VERSION=12.2.5.30-1",
            "NV_LIBNPP_PACKAGE=libnpp-12-4=12.2.5.30-1",
            "NV_LIBCUSPARSE_VERSION=12.3.1.170-1",
            "NV_LIBCUBLAS_PACKAGE_NAME=libcublas-12-4",
            "NV_LIBCUBLAS_VERSION=12.4.5.8-1",
            "NV_LIBCUBLAS_PACKAGE=libcublas-12-4=12.4.5.8-1",
            "NV_LIBNCCL_PACKAGE_NAME=libnccl2",
            "NV_LIBNCCL_PACKAGE_VERSION=2.21.5-1",
            "NCCL_VERSION=2.21.5-1",
            "NV_LIBNCCL_PACKAGE=libnccl2=2.21.5-1+cuda12.4",
            "NVIDIA_PRODUCT_NAME=CUDA",
            "NV_CUDA_CUDART_DEV_VERSION=12.4.127-1",
            "NV_NVML_DEV_VERSION=12.4.127-1",
            "NV_LIBCUSPARSE_DEV_VERSION=12.3.1.170-1",
            "NV_LIBNPP_DEV_VERSION=12.2.5.30-1",
            "NV_LIBNPP_DEV_PACKAGE=libnpp-dev-12-4=12.2.5.30-1",
            "NV_LIBCUBLAS_DEV_VERSION=12.4.5.8-1",
            "NV_LIBCUBLAS_DEV_PACKAGE_NAME=libcublas-dev-12-4",
            "NV_LIBCUBLAS_DEV_PACKAGE=libcublas-dev-12-4=12.4.5.8-1",
            "NV_CUDA_NSIGHT_COMPUTE_VERSION=12.4.1-1",
            "NV_CUDA_NSIGHT_COMPUTE_DEV_PACKAGE=cuda-nsight-compute-12-4=12.4.1-1",
            "NV_NVPROF_VERSION=12.4.127-1",
            "NV_NVPROF_DEV_PACKAGE=cuda-nvprof-12-4=12.4.127-1",
            "NV_LIBNCCL_DEV_PACKAGE_NAME=libnccl-dev",
            "NV_LIBNCCL_DEV_PACKAGE_VERSION=2.21.5-1",
            "NV_LIBNCCL_DEV_PACKAGE=libnccl-dev=2.21.5-1+cuda12.4",
            "LIBRARY_PATH=/usr/local/cuda/lib64/stubs",
            "NV_CUDNN_VERSION=9.1.0.70-1",
            "NV_CUDNN_PACKAGE_NAME=libcudnn9-cuda-12",
            "NV_CUDNN_PACKAGE=libcudnn9-cuda-12=9.1.0.70-1",
            "NV_CUDNN_PACKAGE_DEV=libcudnn9-dev-cuda-12=9.1.0.70-1",
            "JAVA_HOME=/opt/jdk"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/data-juicer",
        "Entrypoint": [
            "/opt/nvidia/nvidia_entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.nvidia.cudnn.version": "9.1.0.70-1",
            "maintainer": "NVIDIA CORPORATION \u003ccudatools@nvidia.com\u003e",
            "org.opencontainers.image.created": "2025-08-18T03:23:22.199Z",
            "org.opencontainers.image.description": "Data processing for and with foundation models!  🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "ubuntu",
            "org.opencontainers.image.revision": "14f659412482454ecc4cda3a4a8dc7a4d25791cb",
            "org.opencontainers.image.source": "https://github.com/modelscope/data-juicer",
            "org.opencontainers.image.title": "data-juicer",
            "org.opencontainers.image.url": "https://github.com/modelscope/data-juicer",
            "org.opencontainers.image.version": "v1.4.2"
        }
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 23221131170,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/955ccd145fd5e51f622ed8adf3aa1fffc02e74b57db96cf5298ac2203559b7fb/diff:/var/lib/docker/overlay2/5c14c35ff2fdd766d952d79788118a592ef6f2763555905ea1f68722c3bc1784/diff:/var/lib/docker/overlay2/7a55e22a9efcbfc33d54fa7bd6f1e21b7e29cb17f321ae76a8a5975e3f85027a/diff:/var/lib/docker/overlay2/499d114f60fe2fad18c42a9b3b0f18b7983cecd14840f22f7baff43f76d918f8/diff:/var/lib/docker/overlay2/0bc344f123ceaad69178bc4b5c7dfa8712a42ddc98831725ed6fc86ae0b65ac9/diff:/var/lib/docker/overlay2/f6dc5b33bf5d1da0de494c23cdaedf7fb2c8cdfd30d5422a7cc3bbb901f4b244/diff:/var/lib/docker/overlay2/167bc3dec01d4b381a3a101e4754dac94ba48b86b6c6f4ba1cdd57f616240c0f/diff:/var/lib/docker/overlay2/53e3f9f11f1debfe4d18b6ad24a8c251522aaba573bd4e47f0b118bd155da952/diff:/var/lib/docker/overlay2/c52ac13fdc25dcd174a42b75f803ad1172134d32a7b775184e5543da3dd5a652/diff:/var/lib/docker/overlay2/dc3779d0c707b83cb8d033b9aeafc0ac8087f467a172c1799f6c7e28d5139304/diff:/var/lib/docker/overlay2/3bb0d1a2eb9b7cdea4fcd6c4a53517227f8540942e16b35bdd2846aefbcdf431/diff:/var/lib/docker/overlay2/23c4e21ec768114874d20d8d9b6e884a26f5a03aed1ed975ef4382148b5b27db/diff:/var/lib/docker/overlay2/460d19cb532102cd0bcfd95be3986260bfdbca1aaec97b047cb5b22f3756b6f4/diff:/var/lib/docker/overlay2/49ac5f82fcc45f913e82a65186a144d339c8fe016b90bd7d7d5f2a71ea88141d/diff:/var/lib/docker/overlay2/7742c8ba0d503f17964d213d74102bd64eecf78683b48d60f1b2c52384771f90/diff:/var/lib/docker/overlay2/55acbb143b09ee31ec439c6ed577ccf679c200bd7ebe50ccdc0d420e45099b0c/diff:/var/lib/docker/overlay2/36b29ff462a1bb78633c8378b9075b81a4023d428952436976cb1abc6841c785/diff:/var/lib/docker/overlay2/a39d472ae2bcfb44fb1af13e47341422d160322800aebcc1d627f6f99cc8d61b/diff:/var/lib/docker/overlay2/68ac74c277a4815fe2fe2714e8cdfc8312a40a3814fd641919dd73f9591f3973/diff:/var/lib/docker/overlay2/d5ba49172fffa9da4656e826b86e17d83be3837cfa108a60df4403ee1f4be6c8/diff:/var/lib/docker/overlay2/518175769d21bd73a7a0eefee7bafc6624b91f0161dddcc4a0fc9a991535701e/diff",
            "MergedDir": "/var/lib/docker/overlay2/18abd12551b4eb04b998a45e316263d644f8a67f8c6af37cf7a52db739cfb00a/merged",
            "UpperDir": "/var/lib/docker/overlay2/18abd12551b4eb04b998a45e316263d644f8a67f8c6af37cf7a52db739cfb00a/diff",
            "WorkDir": "/var/lib/docker/overlay2/18abd12551b4eb04b998a45e316263d644f8a67f8c6af37cf7a52db739cfb00a/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:e0a9f5911802534ba097660206feabeb0247a81e409029167b30e2e1f2803b57",
            "sha256:47654eeadbc543f1dd44ebb41c6ca0954b9f1813efabdcd46b0e7f17ac4e9fd1",
            "sha256:efe2b79b53de08e199a2ce107d83adc0cbdff94f605e03f5ef51f3df3ae31cfd",
            "sha256:46d54736d31f4bfeb749544e22e8611dba11128bdb2cebb820a3b452b50e7d52",
            "sha256:809d3bb9c80fb3d31d4c061ba0b38ba4e83b6329e33c2cb2bbf27251a8e527c6",
            "sha256:1ffbbe19418f9726ebb365371ef96637c68f9d25af3f76a4f01f760e87fb31be",
            "sha256:1b30dd39de2709bc00beebf392ea1f931d5f037d08e0f675a50855385cddad93",
            "sha256:89fd878224a017aead1d4c83d5c62749307aa6f1a9e22087144ef339c3df8c1e",
            "sha256:2b4acda8678c6f7ae0075eabb2c0c21078b80671800996ad2cf730f15fa0ef26",
            "sha256:5fb5b17c5835e3e44f7c48dfc15f29504febad945f26dcfa11470d0070b166e4",
            "sha256:b7fa3c6c5beea49f65d51f65f06a4a8af32b48f128c02bea3822e5afaf4ebf23",
            "sha256:9b39c4e5264e7c4b3762a1f1d06bb00db03e2e21893ea703e8ad6e8f2e0f5fba",
            "sha256:a8892cf1debee23fe713078ee919331f9d45eb9c315172151c8e546459a7fed7",
            "sha256:15f21996a24b90396dc48380c5374ec6d54638c45257842319899f62b0590ce0",
            "sha256:ea13e024e4ec8ea61991fd11695dafb5bcb13a9f9599bf18e22996e765603990",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:fdec49008bac0b6e989d5ebe579a19555db93a3c311c644a7c1992b7379e7a09",
            "sha256:41c2335faf8103e2219c8b38bbc802d70c0ef6f56064191583a3eb8f0edc491b",
            "sha256:5f8e1ec8df3498d86214fede938861fd6e32553975ca288f3f65b4853b4eb154",
            "sha256:225c35ebfa95650d2ca81d386ecf7c72fade8e52f5be428275b89f625a2e1bcc",
            "sha256:28ec5f78403acc5f0dc469a654b89e70d1d5e443fda71108e7a8902050b572bf",
            "sha256:3b95322f1f1d60bb9a3d60f5a5f44f09140385ef4ea2ff9f8a95834b20f784be"
        ]
    },
    "Metadata": {
        "LastTagTime": "2025-08-20T05:11:40.797535236+08:00"
    }
}

更多版本

docker.io/datajuicer/data-juicer:v1.4.2

linux/amd64 docker.io23.22GB2025-08-20 05:28
26