docker.io/bitnami/spark:3.5.3 linux/amd64

docker.io/bitnami/spark:3.5.3 - 国内下载镜像源 浏览次数:38 安全受验证的发布者-VMware

Bitnami Apache Spark

这是一个预先配置好的 Apache Spark 容器镜像,由 Bitnami 提供。它包含了 Apache Spark 的所有必要组件,可以轻松部署和使用。

特点:

  • 基于最新的 Apache Spark 版本
  • 预先配置好了所有的依赖项
  • 提供安全的环境
  • 易于部署和管理

用途:

  • 运行 Apache Spark 作业
  • 开发和测试 Apache Spark 应用程序
  • 快速部署 Apache Spark 集群
源镜像 docker.io/bitnami/spark:3.5.3
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3
镜像ID sha256:7a8b6af7686bafe14c6ba50af5c81834e9fc121941d61d96edaacad991fd5fbb
镜像TAG 3.5.3
大小 1.66GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /opt/bitnami/scripts/spark/run.sh
启动入口 /opt/bitnami/scripts/spark/entrypoint.sh
工作目录 /opt/bitnami/spark
OS/平台 linux/amd64
浏览量 38 次
贡献者
镜像创建 2024-10-24T18:26:02.991666808Z
同步时间 2024-10-29 01:31
更新时间 2024-11-22 09:18
环境变量
PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin HOME=/ OS_ARCH=amd64 OS_FLAVOUR=debian-12 OS_NAME=linux APP_VERSION=3.5.3 BITNAMI_APP_NAME=spark JAVA_HOME=/opt/bitnami/java LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.12/site-packages/numpy.libs: LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd PYTHONPATH=/opt/bitnami/spark/python/: SPARK_HOME=/opt/bitnami/spark SPARK_USER=spark
镜像标签
sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83: com.vmware.cp.artifact.flavor docker.io/bitnami/minideb:bookworm: org.opencontainers.image.base.name 2024-10-24T18:07:53Z: org.opencontainers.image.created Application packaged by Broadcom, Inc.: org.opencontainers.image.description https://github.com/bitnami/containers/tree/main/bitnami/spark/README.md: org.opencontainers.image.documentation Apache-2.0: org.opencontainers.image.licenses 3.5.3-debian-12-r1: org.opencontainers.image.ref.name https://github.com/bitnami/containers/tree/main/bitnami/spark: org.opencontainers.image.source spark: org.opencontainers.image.title Broadcom, Inc.: org.opencontainers.image.vendor 3.5.3: org.opencontainers.image.version

Docker拉取命令 无权限下载?点我修复

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3  docker.io/bitnami/spark:3.5.3

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3  docker.io/bitnami/spark:3.5.3

Shell快速替换命令

sed -i 's#bitnami/spark:3.5.3#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3  docker.io/bitnami/spark:3.5.3'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3  docker.io/bitnami/spark:3.5.3'

镜像历史

大小 创建时间 层信息
1.66GB 0001-01-01 08:00:00 crane flatten sha256:636a675eac6abeefbfe509076113bc576fc8760c1886b3d29a777d282d6b54ad

镜像信息

{
    "Id": "sha256:7a8b6af7686bafe14c6ba50af5c81834e9fc121941d61d96edaacad991fd5fbb",
    "RepoTags": [
        "bitnami/spark:3.5.3",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:3.5.3"
    ],
    "RepoDigests": [
        "bitnami/spark@sha256:df7d0952f6912734c104cd1e7adedaa91fe9c273634f54244895fcc6658c55e0",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark@sha256:8c9f0cd1801fb9fc000b7ad8213407414b215df0d51a0258f5e78344c2bd66dd"
    ],
    "Parent": "",
    "Comment": "[{\"created\":\"2024-10-23T08:46:16.542116502Z\",\"comment\":\"from Bitnami with love\"},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"ARG DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"ARG JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"ARG TARGETARCH\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"LABEL com.vmware.cp.artifact.flavor=sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83 org.opencontainers.image.base.name=docker.io/bitnami/minideb:bookworm org.opencontainers.image.created=2024-10-24T18:07:53Z org.opencontainers.image.description=Application packaged by Broadcom, Inc. org.opencontainers.image.documentation=https://github.com/bitnami/containers/tree/main/bitnami/spark/README.md org.opencontainers.image.licenses=Apache-2.0 org.opencontainers.image.ref.name=3.5.3-debian-12-r1 org.opencontainers.image.source=https://github.com/bitnami/containers/tree/main/bitnami/spark org.opencontainers.image.title=spark org.opencontainers.image.vendor=Broadcom, Inc. org.opencontainers.image.version=3.5.3\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"ENV HOME=/ OS_ARCH=amd64 OS_FLAVOUR=debian-12 OS_NAME=linux PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"COPY prebuildfs / # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:09:13.972567139Z\",\"created_by\":\"SHELL [/bin/bash -o errexit -o nounset -o pipefail -c]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:09:19.17199244Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c install_packages ca-certificates curl libbz2-1.0 libcom-err2 libcrypt1 libffi8 libgcc-s1 libgssapi-krb5-2 libk5crypto3 libkeyutils1 libkrb5-3 libkrb5support0 liblzma5 libncursesw6 libnsl2 libreadline8 libsqlite3-0 libssl3 libstdc++6 libtinfo6 libtirpc3 procps zlib1g # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:10:13.115961708Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c mkdir -p /tmp/bitnami/pkg/cache/ ; cd /tmp/bitnami/pkg/cache/ ;     COMPONENTS=(       \\\"python-3.12.7-3-linux-${OS_ARCH}-debian-12\\\"       \\\"java-17.0.13-12-1-linux-${OS_ARCH}-debian-12\\\"       \\\"spark-3.5.3-1-linux-${OS_ARCH}-debian-12\\\"     ) ;     for COMPONENT in \\\"${COMPONENTS[@]}\\\"; do       if [ ! -f \\\"${COMPONENT}.tar.gz\\\" ]; then         curl -SsLf \\\"https://${DOWNLOADS_URL}/${COMPONENT}.tar.gz\\\" -O ;         curl -SsLf \\\"https://${DOWNLOADS_URL}/${COMPONENT}.tar.gz.sha256\\\" -O ;       fi ;       sha256sum -c \\\"${COMPONENT}.tar.gz.sha256\\\" ;       tar -zxf \\\"${COMPONENT}.tar.gz\\\" -C /opt/bitnami --strip-components=2 --no-same-owner --wildcards '*/files' ;       rm -rf \\\"${COMPONENT}\\\".tar.gz{,.sha256} ;     done # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:10:22.182302269Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c apt-get autoremove --purge -y curl \\u0026\\u0026     apt-get update \\u0026\\u0026 apt-get upgrade -y \\u0026\\u0026     apt-get clean \\u0026\\u0026 rm -rf /var/lib/apt/lists /var/cache/apt/archives # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:10:32.013745946Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c chmod g+rwX /opt/bitnami # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:10:53.876415635Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c find / -perm /6000 -type f -exec chmod a-s {} \\\\; || true # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:16:59.824276143Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c mkdir /.local \\u0026\\u0026 chmod g+rwX /.local # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:18:18.702436598Z\",\"created_by\":\"COPY rootfs / # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:23:04.081658854Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c /opt/bitnami/scripts/spark/postunpack.sh # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:24:54.74498109Z\",\"created_by\":\"RUN |3 DOWNLOADS_URL=downloads.bitnami.com/files/stacksmith JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c /opt/bitnami/scripts/java/postunpack.sh # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:24:54.74498109Z\",\"created_by\":\"ENV APP_VERSION=3.5.3 BITNAMI_APP_NAME=spark JAVA_HOME=/opt/bitnami/java LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.12/site-packages/numpy.libs: LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd PYTHONPATH=/opt/bitnami/spark/python/: SPARK_HOME=/opt/bitnami/spark SPARK_USER=spark\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:26:02.991666808Z\",\"created_by\":\"WORKDIR /opt/bitnami/spark\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-10-24T18:26:02.991666808Z\",\"created_by\":\"USER 1001\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:26:02.991666808Z\",\"created_by\":\"ENTRYPOINT [\\\"/opt/bitnami/scripts/spark/entrypoint.sh\\\"]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-10-24T18:26:02.991666808Z\",\"created_by\":\"CMD [\\\"/opt/bitnami/scripts/spark/run.sh\\\"]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true}]",
    "Created": "2024-10-24T18:26:02.991666808Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "1001",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "HOME=/",
            "OS_ARCH=amd64",
            "OS_FLAVOUR=debian-12",
            "OS_NAME=linux",
            "APP_VERSION=3.5.3",
            "BITNAMI_APP_NAME=spark",
            "JAVA_HOME=/opt/bitnami/java",
            "LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.12/site-packages/numpy.libs:",
            "LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so",
            "NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group",
            "NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd",
            "PYTHONPATH=/opt/bitnami/spark/python/:",
            "SPARK_HOME=/opt/bitnami/spark",
            "SPARK_USER=spark"
        ],
        "Cmd": [
            "/opt/bitnami/scripts/spark/run.sh"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/bitnami/spark",
        "Entrypoint": [
            "/opt/bitnami/scripts/spark/entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.vmware.cp.artifact.flavor": "sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83",
            "org.opencontainers.image.base.name": "docker.io/bitnami/minideb:bookworm",
            "org.opencontainers.image.created": "2024-10-24T18:07:53Z",
            "org.opencontainers.image.description": "Application packaged by Broadcom, Inc.",
            "org.opencontainers.image.documentation": "https://github.com/bitnami/containers/tree/main/bitnami/spark/README.md",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "3.5.3-debian-12-r1",
            "org.opencontainers.image.source": "https://github.com/bitnami/containers/tree/main/bitnami/spark",
            "org.opencontainers.image.title": "spark",
            "org.opencontainers.image.vendor": "Broadcom, Inc.",
            "org.opencontainers.image.version": "3.5.3"
        },
        "Shell": [
            "/bin/bash",
            "-o",
            "errexit",
            "-o",
            "nounset",
            "-o",
            "pipefail",
            "-c"
        ]
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 1664553003,
    "GraphDriver": {
        "Data": {
            "MergedDir": "/var/lib/docker/overlay2/90d7afefe7bd3d475759e1fc110cf005dfaf3870b6f8aa406379a1bdebaba5ab/merged",
            "UpperDir": "/var/lib/docker/overlay2/90d7afefe7bd3d475759e1fc110cf005dfaf3870b6f8aa406379a1bdebaba5ab/diff",
            "WorkDir": "/var/lib/docker/overlay2/90d7afefe7bd3d475759e1fc110cf005dfaf3870b6f8aa406379a1bdebaba5ab/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:229ba53d74c1952eb5682865838e2e62ac76dee268415736612ba43e041b1e62"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-10-29T01:28:35.121762879+08:00"
    }
}

更多版本

docker.io/bitnami/spark:latest

linux/amd64 docker.io1.67GB2024-09-25 17:23
87

docker.io/bitnami/spark:3.5.3

linux/amd64 docker.io1.66GB2024-10-29 01:31
37

docker.io/bitnami/spark:3.3.2-debian-11-r10

linux/amd64 docker.io1.24GB2024-11-21 17:27
13