docker.io/bitnami/spark:latest linux/amd64

docker.io/bitnami/spark:latest - 国内下载镜像源 浏览次数:88 安全受验证的发布者-VMware

温馨提示:此镜像为latest tag镜像,本站无法保证此版本为最新镜像

Bitnami Apache Spark

这是一个预先配置好的 Apache Spark 容器镜像,由 Bitnami 提供。它包含了 Apache Spark 的所有必要组件,可以轻松部署和使用。

特点:

  • 基于最新的 Apache Spark 版本
  • 预先配置好了所有的依赖项
  • 提供安全的环境
  • 易于部署和管理

用途:

  • 运行 Apache Spark 作业
  • 开发和测试 Apache Spark 应用程序
  • 快速部署 Apache Spark 集群
源镜像 docker.io/bitnami/spark:latest
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest
镜像ID sha256:5497232715644d0c99a008e4e2af705502ae585a934158d9d333e83341034d6a
镜像TAG latest
大小 1.67GB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /opt/bitnami/scripts/spark/run.sh
启动入口 /opt/bitnami/scripts/spark/entrypoint.sh
工作目录 /opt/bitnami/spark
OS/平台 linux/amd64
浏览量 88 次
贡献者
镜像创建 2024-09-16T11:01:56.873113778Z
同步时间 2024-09-25 17:23
更新时间 2024-11-22 07:48
环境变量
PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin HOME=/ OS_ARCH=amd64 OS_FLAVOUR=debian-12 OS_NAME=linux APP_VERSION=3.5.2 BITNAMI_APP_NAME=spark JAVA_HOME=/opt/bitnami/java LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.12/site-packages/numpy.libs: LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd PYTHONPATH=/opt/bitnami/spark/python/: SPARK_HOME=/opt/bitnami/spark SPARK_USER=spark
镜像标签
sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83: com.vmware.cp.artifact.flavor docker.io/bitnami/minideb:bookworm: org.opencontainers.image.base.name 2024-09-16T10:41:21Z: org.opencontainers.image.created Application packaged by Broadcom, Inc.: org.opencontainers.image.description https://github.com/bitnami/containers/tree/main/bitnami/spark/README.md: org.opencontainers.image.documentation Apache-2.0: org.opencontainers.image.licenses 3.5.2-debian-12-r3: org.opencontainers.image.ref.name https://github.com/bitnami/containers/tree/main/bitnami/spark: org.opencontainers.image.source spark: org.opencontainers.image.title Broadcom, Inc.: org.opencontainers.image.vendor 3.5.2: org.opencontainers.image.version

Docker拉取命令 无权限下载?点我修复

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest  docker.io/bitnami/spark:latest

Containerd拉取命令

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest  docker.io/bitnami/spark:latest

Shell快速替换命令

sed -i 's#bitnami/spark:latest#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest#' deployment.yaml

Ansible快速分发-Docker

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest  docker.io/bitnami/spark:latest'

Ansible快速分发-Containerd

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest  docker.io/bitnami/spark:latest'

镜像历史

大小 创建时间 层信息
1.67GB 0001-01-01 08:00:00 crane flatten sha256:7b9e8e97229e080a6180ac74c33e9351f112a6d5a046578f42a290581e5b5566

镜像信息

{
    "Id": "sha256:5497232715644d0c99a008e4e2af705502ae585a934158d9d333e83341034d6a",
    "RepoTags": [
        "bitnami/spark:latest",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark:latest"
    ],
    "RepoDigests": [
        "bitnami/spark@sha256:28e33c84dad08e620888055279083cb565e698c20156e309a7e0c6ebe0e1d317",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/bitnami/spark@sha256:972b971c98eda7fd29cd4dc04884b14a928c696732ffe3dcae306857d98d5952"
    ],
    "Parent": "",
    "Comment": "[{\"created\":\"2024-09-05T00:12:56.503576797Z\",\"comment\":\"from Bitnami with love\"},{\"created\":\"2024-09-16T10:43:10.812607219Z\",\"created_by\":\"ARG JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T10:43:10.812607219Z\",\"created_by\":\"ARG TARGETARCH\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T10:43:10.812607219Z\",\"created_by\":\"LABEL com.vmware.cp.artifact.flavor=sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83 org.opencontainers.image.base.name=docker.io/bitnami/minideb:bookworm org.opencontainers.image.created=2024-09-16T10:41:21Z org.opencontainers.image.description=Application packaged by Broadcom, Inc. org.opencontainers.image.documentation=https://github.com/bitnami/containers/tree/main/bitnami/spark/README.md org.opencontainers.image.licenses=Apache-2.0 org.opencontainers.image.ref.name=3.5.2-debian-12-r3 org.opencontainers.image.source=https://github.com/bitnami/containers/tree/main/bitnami/spark org.opencontainers.image.title=spark org.opencontainers.image.vendor=Broadcom, Inc. org.opencontainers.image.version=3.5.2\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T10:43:10.812607219Z\",\"created_by\":\"ENV HOME=/ OS_ARCH=amd64 OS_FLAVOUR=debian-12 OS_NAME=linux PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T10:43:10.812607219Z\",\"created_by\":\"COPY prebuildfs / # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:43:10.812607219Z\",\"created_by\":\"SHELL [/bin/bash -o errexit -o nounset -o pipefail -c]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T10:43:16.119766212Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c install_packages ca-certificates curl libbz2-1.0 libcom-err2 libcrypt1 libffi8 libgcc-s1 libgssapi-krb5-2 libk5crypto3 libkeyutils1 libkrb5-3 libkrb5support0 liblzma5 libncursesw6 libnsl2 libreadline8 libsqlite3-0 libssl3 libstdc++6 libtinfo6 libtirpc3 procps zlib1g # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:44:10.660363767Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c mkdir -p /tmp/bitnami/pkg/cache/ ; cd /tmp/bitnami/pkg/cache/ ;     COMPONENTS=(       \\\"python-3.12.6-2-linux-${OS_ARCH}-debian-12\\\"       \\\"java-17.0.12-10-1-linux-${OS_ARCH}-debian-12\\\"       \\\"spark-3.5.2-1-linux-${OS_ARCH}-debian-12\\\"     ) ;     for COMPONENT in \\\"${COMPONENTS[@]}\\\"; do       if [ ! -f \\\"${COMPONENT}.tar.gz\\\" ]; then         curl -SsLf \\\"https://downloads.bitnami.com/files/stacksmith/${COMPONENT}.tar.gz\\\" -O ;         curl -SsLf \\\"https://downloads.bitnami.com/files/stacksmith/${COMPONENT}.tar.gz.sha256\\\" -O ;       fi ;       sha256sum -c \\\"${COMPONENT}.tar.gz.sha256\\\" ;       tar -zxf \\\"${COMPONENT}.tar.gz\\\" -C /opt/bitnami --strip-components=2 --no-same-owner --wildcards '*/files' ;       rm -rf \\\"${COMPONENT}\\\".tar.gz{,.sha256} ;     done # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:45:01.127964105Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c apt-get autoremove --purge -y curl \\u0026\\u0026     apt-get update \\u0026\\u0026 apt-get upgrade -y \\u0026\\u0026     apt-get clean \\u0026\\u0026 rm -rf /var/lib/apt/lists /var/cache/apt/archives # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:45:51.24247202Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c chmod g+rwX /opt/bitnami # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:48:19.689754708Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c find / -perm /6000 -type f -exec chmod a-s {} \\\\; || true # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:54:25.577407824Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c mkdir /.local \\u0026\\u0026 chmod g+rwX /.local # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:57:53.934746816Z\",\"created_by\":\"COPY rootfs / # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T10:59:09.993319968Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c /opt/bitnami/scripts/spark/postunpack.sh # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T11:00:24.05844122Z\",\"created_by\":\"RUN |2 JAVA_EXTRA_SECURITY_DIR=/bitnami/java/extra-security TARGETARCH=amd64 /bin/bash -o errexit -o nounset -o pipefail -c /opt/bitnami/scripts/java/postunpack.sh # buildkit\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T11:00:24.05844122Z\",\"created_by\":\"ENV APP_VERSION=3.5.2 BITNAMI_APP_NAME=spark JAVA_HOME=/opt/bitnami/java LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.12/site-packages/numpy.libs: LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd PYTHONPATH=/opt/bitnami/spark/python/: SPARK_HOME=/opt/bitnami/spark SPARK_USER=spark\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T11:01:56.873113778Z\",\"created_by\":\"WORKDIR /opt/bitnami/spark\",\"comment\":\"buildkit.dockerfile.v0\"},{\"created\":\"2024-09-16T11:01:56.873113778Z\",\"created_by\":\"USER 1001\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T11:01:56.873113778Z\",\"created_by\":\"ENTRYPOINT [\\\"/opt/bitnami/scripts/spark/entrypoint.sh\\\"]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true},{\"created\":\"2024-09-16T11:01:56.873113778Z\",\"created_by\":\"CMD [\\\"/opt/bitnami/scripts/spark/run.sh\\\"]\",\"comment\":\"buildkit.dockerfile.v0\",\"empty_layer\":true}]",
    "Created": "2024-09-16T11:01:56.873113778Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "1001",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/opt/bitnami/python/bin:/opt/bitnami/java/bin:/opt/bitnami/spark/bin:/opt/bitnami/spark/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "HOME=/",
            "OS_ARCH=amd64",
            "OS_FLAVOUR=debian-12",
            "OS_NAME=linux",
            "APP_VERSION=3.5.2",
            "BITNAMI_APP_NAME=spark",
            "JAVA_HOME=/opt/bitnami/java",
            "LD_LIBRARY_PATH=/opt/bitnami/python/lib:/opt/bitnami/spark/venv/lib/python3.12/site-packages/numpy.libs:",
            "LIBNSS_WRAPPER_PATH=/opt/bitnami/common/lib/libnss_wrapper.so",
            "NSS_WRAPPER_GROUP=/opt/bitnami/spark/tmp/nss_group",
            "NSS_WRAPPER_PASSWD=/opt/bitnami/spark/tmp/nss_passwd",
            "PYTHONPATH=/opt/bitnami/spark/python/:",
            "SPARK_HOME=/opt/bitnami/spark",
            "SPARK_USER=spark"
        ],
        "Cmd": [
            "/opt/bitnami/scripts/spark/run.sh"
        ],
        "ArgsEscaped": true,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/bitnami/spark",
        "Entrypoint": [
            "/opt/bitnami/scripts/spark/entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": {
            "com.vmware.cp.artifact.flavor": "sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83",
            "org.opencontainers.image.base.name": "docker.io/bitnami/minideb:bookworm",
            "org.opencontainers.image.created": "2024-09-16T10:41:21Z",
            "org.opencontainers.image.description": "Application packaged by Broadcom, Inc.",
            "org.opencontainers.image.documentation": "https://github.com/bitnami/containers/tree/main/bitnami/spark/README.md",
            "org.opencontainers.image.licenses": "Apache-2.0",
            "org.opencontainers.image.ref.name": "3.5.2-debian-12-r3",
            "org.opencontainers.image.source": "https://github.com/bitnami/containers/tree/main/bitnami/spark",
            "org.opencontainers.image.title": "spark",
            "org.opencontainers.image.vendor": "Broadcom, Inc.",
            "org.opencontainers.image.version": "3.5.2"
        },
        "Shell": [
            "/bin/bash",
            "-o",
            "errexit",
            "-o",
            "nounset",
            "-o",
            "pipefail",
            "-c"
        ]
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 1667804187,
    "GraphDriver": {
        "Data": {
            "MergedDir": "/var/lib/docker/overlay2/722dde40a6c4ff30385ef6a8acd9311a3d5347d6ce176b369f6c61092bcb7ac8/merged",
            "UpperDir": "/var/lib/docker/overlay2/722dde40a6c4ff30385ef6a8acd9311a3d5347d6ce176b369f6c61092bcb7ac8/diff",
            "WorkDir": "/var/lib/docker/overlay2/722dde40a6c4ff30385ef6a8acd9311a3d5347d6ce176b369f6c61092bcb7ac8/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:f9c1e93067c9385891cef6038dc4314c83cf8bb7a085f0b6ffee2a38d8dcce6f"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-09-25T17:21:05.116235774+08:00"
    }
}

更多版本

docker.io/bitnami/spark:latest

linux/amd64 docker.io1.67GB2024-09-25 17:23
87

docker.io/bitnami/spark:3.5.3

linux/amd64 docker.io1.66GB2024-10-29 01:31
38

docker.io/bitnami/spark:3.3.2-debian-11-r10

linux/amd64 docker.io1.24GB2024-11-21 17:27
14