docker.io/bitnami/spark:3.3.2-debian-11-r10 linux/amd64

docker.io/bitnami/spark:3.3.2-debian-11-r10 - 国内下载镜像源 浏览次数:14 安全受验证的发布者-VMware

Bitnami Apache Spark

这是一个预先配置好的 Apache Spark 容器镜像,由 Bitnami 提供。它包含了 Apache Spark 的所有必要组件,可以轻松部署和使用。

特点:

  • 基于最新的 Apache Spark 版本
  • 预先配置好了所有的依赖项
  • 提供安全的环境
  • 易于部署和管理

用途:

  • 运行 Apache Spark 作业
  • 开发和测试 Apache Spark 应用程序
  • 快速部署 Apache Spark 集群
源镜像 docker.io/bitnami/spark:3.3.2-debian-11-r10
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10
镜像ID sha256:016e1a3e260d43bb261b3e9a3d52b8d95cb018e32844f16db6b123a4de52e536
镜像TAG 3.3.2-debian-11-r10
大小 1.24GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /opt/bitnami/scripts/spark/run.sh
启动入口 /opt/bitnami/scripts/spark/entrypoint.sh
工作目录 /opt/bitnami/spark
OS/平台 linux/amd64
浏览量 14 次
贡献者
镜像创建 2023-03-22T04:59:03.706104026Z
同步时间 2024-11-21 17:27
更新时间 2024-11-22 11:20
环境变量
PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/opt/bitnami/common/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin HOME=/ OS_ARCH=amd64 OS_FLAVOUR=debian-11 OS_NAME=linux APP_VERSION=3.3.2 BITNAMI_APP_NAME=spark JAVA_HOME=/opt/bitnami/java LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.8/site-packages/numpy.libs: LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd PYTHONPATH=/opt/bitnami/spark/python/: SPARK_HOME=/opt/bitnami/spark
镜像标签
docker.io/bitnami/minideb:bullseye: org.opencontainers.image.base.name 2023-03-22T04:41:44Z: org.opencontainers.image.created Application packaged by VMware, Inc: org.opencontainers.image.description Apache-2.0: org.opencontainers.image.licenses 3.3.2-debian-11-r10: org.opencontainers.image.ref.name spark: org.opencontainers.image.title VMware, Inc.: org.opencontainers.image.vendor 3.3.2: org.opencontainers.image.version

Docker拉取命令 无权限下载?点我修复

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10  docker.io/bitnami/spark:3.3.2-debian-11-r10

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10  docker.io/bitnami/spark:3.3.2-debian-11-r10

Shell快速替换命令

sed -i 's#bitnami/spark:3.3.2-debian-11-r10#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10  docker.io/bitnami/spark:3.3.2-debian-11-r10'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10  docker.io/bitnami/spark:3.3.2-debian-11-r10'

镜像历史

大小 创建时间 层信息
1.24GB 0001-01-01 08:00:00 crane flatten sha256:43ac0feeedd6266f97bf654daff7d2bd490a607b7c9f2d51c51d318e82acefc0

镜像信息

{
    "Id": "sha256:016e1a3e260d43bb261b3e9a3d52b8d95cb018e32844f16db6b123a4de52e536",
    "RepoTags": [
        "bitnami/spark:3.3.2-debian-11-r10",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.3.2-debian-11-r10"
    ],
    "RepoDigests": [
        "bitnami/spark@sha256:460fffa5336ef8f2f84b03e46086c944fe7b54d561ee3d0dfb278f07976a8d56",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark@sha256:0786708f4d5fd16789e7fbd9367f44b6f1178e91b88e8a0d2660f487ecd24ef4"
    ],
    "Parent": "",
    "Comment": "[{\"created\":\"2023-03-17T00:11:34.313535807Z\",\"comment\":\"from Bitnami with love\"},{\"created\":\"2023-03-22T04:43:15.320106861Z\",\"created_by\":\"ARG JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:43:15.320106861Z\",\"created_by\":\"ARG TARGETARCH\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:43:15.320106861Z\",\"created_by\":\"LABEL org.opencontainers.image.base.name=docker.io/bitnami/minideb:bullseye org.opencontainers.image.created=2023-03-22T04:41:44Z org.opencontainers.image.description=Application packaged by VMware, Inc org.opencontainers.image.licenses=Apache-2.0 org.opencontainers.image.ref.name=3.3.2-debian-11-r10 org.opencontainers.image.title=spark org.opencontainers.image.vendor=VMware, Inc. org.opencontainers.image.version=3.3.2\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:43:15.320106861Z\",\"created_by\":\"ENV HOME=/ OS_ARCH=amd64 OS_FLAVOUR=debian-11 OS_NAME=linux PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/opt/bitnami/common/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:43:15.320106861Z\",\"created_by\":\"COPY prebuildfs / # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:43:15.320106861Z\",\"created_by\":\"SHELL [/bin/bash -o pipefail -c]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:43:29.328804509Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c install_packages ca-certificates curl libbz2-1.0 libcom-err2 libcrypt1 libffi7 libgcc-s1 libgssapi-krb5-2 libk5crypto3 libkeyutils1 libkrb5-3 libkrb5support0 liblzma5 libncursesw6 libnsl2 libreadline8 libsqlite3-0 libssl1.1 libstdc++6 libtinfo6 libtirpc3 procps zlib1g # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:44:07.295556919Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c mkdir -p /tmp/bitnami/pkg/cache/ \\u0026\\u0026 cd /tmp/bitnami/pkg/cache/ \\u0026\\u0026     COMPONENTS=(       \\\"python-3.8.16-8-linux-${OS_ARCH}-debian-11\\\"       \\\"java-1.8.362-3-linux-${OS_ARCH}-debian-11\\\"       \\\"spark-3.3.2-2-linux-${OS_ARCH}-debian-11\\\"       \\\"gosu-1.16.0-3-linux-${OS_ARCH}-debian-11\\\"     ) \\u0026\\u0026     for COMPONENT in \\\"${COMPONENTS[@]}\\\"; do       if [ ! -f \\\"${COMPONENT}.tar.gz\\\" ]; then         curl -SsLf \\\"https://downloads.bitnami.com/files/stacksmith/${COMPONENT}.tar.gz\\\" -O ;         curl -SsLf \\\"https://downloads.bitnami.com/files/stacksmith/${COMPONENT}.tar.gz.sha256\\\" -O ;       fi \\u0026\\u0026       sha256sum -c \\\"${COMPONENT}.tar.gz.sha256\\\" \\u0026\\u0026       tar -zxf \\\"${COMPONENT}.tar.gz\\\" -C /opt/bitnami --strip-components=2 --no-same-owner --wildcards '*/files' \\u0026\\u0026       rm -rf \\\"${COMPONENT}\\\".tar.gz{,.sha256} ;     done # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:44:34.897011587Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c apt-get autoremove --purge -y curl \\u0026\\u0026     apt-get update \\u0026\\u0026 apt-get upgrade -y \\u0026\\u0026     apt-get clean \\u0026\\u0026 rm -rf /var/lib/apt/lists /var/cache/apt/archives # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:44:45.862886534Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c chmod g+rwX /opt/bitnami # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:45:33.640751145Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c mkdir /.local \\u0026\\u0026 chmod g+rwX /.local # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:47:30.521497131Z\",\"created_by\":\"COPY rootfs / # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:48:36.665019592Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c /opt/bitnami/scripts/spark/postunpack.sh # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:56:00.541085935Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o pipefail -c /opt/bitnami/scripts/java/postunpack.sh # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:56:00.541085935Z\",\"created_by\":\"ENV APP_VERSION=3.3.2 BITNAMI_APP_NAME=spark JAVA_HOME=/opt/bitnami/java LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.8/site-packages/numpy.libs: LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd PYTHONPATH=/opt/bitnami/spark/python/: SPARK_HOME=/opt/bitnami/spark\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:59:03.706104026Z\",\"created_by\":\"WORKDIR /opt/bitnami/spark\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2023-03-22T04:59:03.706104026Z\",\"created_by\":\"USER 1001\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:59:03.706104026Z\",\"created_by\":\"ENTRYPOINT [\\\"/opt/bitnami/scripts/spark/entrypoint.sh\\\"]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2023-03-22T04:59:03.706104026Z\",\"created_by\":\"CMD [\\\"/opt/bitnami/scripts/spark/run.sh\\\"]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true}]",
    "Created": "2023-03-22T04:59:03.706104026Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "1001",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/opt/bitnami/common/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "HOME=/",
            "OS_ARCH=amd64",
            "OS_FLAVOUR=debian-11",
            "OS_NAME=linux",
            "APP_VERSION=3.3.2",
            "BITNAMI_APP_NAME=spark",
            "JAVA_HOME=/opt/bitnami/java",
            "LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.8/site-packages/numpy.libs:",
            "LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so",
            "NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group",
            "NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd",
            "PYTHONPATH=/opt/bitnami/spark/python/:",
            "SPARK_HOME=/opt/bitnami/spark"
        ],
        "Cmd": [
            "/opt/bitnami/scripts/spark/run.sh"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/bitnami/spark",
        "Entrypoint": [
            "/opt/bitnami/scripts/spark/entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "org.opencontainers.image.base.name": "docker.io/bitnami/minideb:bullseye",
            "org.opencontainers.image.created": "2023-03-22T04:41:44Z",
            "org.opencontainers.image.description": "Application packaged by VMware, Inc",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "3.3.2-debian-11-r10",
            "org.opencontainers.image.title": "spark",
            "org.opencontainers.image.vendor": "VMware, Inc.",
            "org.opencontainers.image.version": "3.3.2"
        },
        "Shell": [
            "/bin/bash",
            "-o",
            "pipefail",
            "-c"
        ]
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 1238365779,
    "GraphDriver": {
        "Data": {
            "MergedDir": "/var/lib/docker/overlay2/07cad58109bd818031b089edb09c74c7be2ea40b76a4e8d5ee5c112c09f521b0/merged",
            "UpperDir": "/var/lib/docker/overlay2/07cad58109bd818031b089edb09c74c7be2ea40b76a4e8d5ee5c112c09f521b0/diff",
            "WorkDir": "/var/lib/docker/overlay2/07cad58109bd818031b089edb09c74c7be2ea40b76a4e8d5ee5c112c09f521b0/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:8cb26f5b4cd240a514f243c07e12c2c0e36682452729bf71aec3870b7aded8cd"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-11-21T17:25:43.786740689+08:00"
    }
}

更多版本

docker.io/bitnami/spark:latest

linux/amd64 docker.io1.67GB2024-09-25 17:23
87

docker.io/bitnami/spark:3.5.3

linux/amd64 docker.io1.66GB2024-10-29 01:31
38

docker.io/bitnami/spark:3.3.2-debian-11-r10

linux/amd64 docker.io1.24GB2024-11-21 17:27
13