docker.io/apache/spark:v3.2.3 linux/amd64

docker.io/apache/spark:v3.2.3 - 国内下载镜像源 浏览次数:23 安全受验证的发布者-apache

Apache Spark 镜像

该镜像包含 Apache Spark 的预构建环境，可用于运行 Spark 作业和应用程序。它提供了 Spark 的核心组件，包括:

  • Spark Core
  • Spark SQL
  • Spark Streaming
  • Spark MLlib
  • Spark GraphX

使用该镜像可以快速开始使用 Spark，无需手动安装和配置。它是一个易于使用且可靠的解决方案，适用于各种 Spark 应用场景。

源镜像 docker.io/apache/spark:v3.2.3
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3
镜像ID sha256:b614acd71f4da1ba60d459530fd30bbd36d11d33f1724ad59be8682abdfb68eb
镜像TAG v3.2.3
大小 612.37MB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD
启动入口 /opt/entrypoint.sh
工作目录 /opt/spark/work-dir
OS/平台 linux/amd64
浏览量 23 次
贡献者
镜像创建 2023-01-04T18:45:07.198129429Z
同步时间 2024-11-11 16:11
更新时间 2024-11-22 09:42
环境变量
PATH=/usr/local/openjdk-11/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin JAVA_HOME=/usr/local/openjdk-11 LANG=C.UTF-8 JAVA_VERSION=11.0.16 SPARK_HOME=/opt/spark
镜像安全扫描 查看Trivy扫描报告

系统OS: debian 11.4 扫描引擎: Trivy 扫描时间: 2024-11-11 16:12

低危漏洞:123 中危漏洞:112 高危漏洞:192 严重漏洞:47
docker.io/apache/spark:v3.2.3 (debian 11.4) (debian) Java (jar)

Docker拉取命令 无权限下载?点我修复 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3  docker.io/apache/spark:v3.2.3

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3  docker.io/apache/spark:v3.2.3

Shell快速替换命令 

sed -i 's#apache/spark:v3.2.3#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3 && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3  docker.io/apache/spark:v3.2.3'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3 && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3  docker.io/apache/spark:v3.2.3'

镜像历史

大小 创建时间 层信息
0.00B 2023-01-05 02:45:07 USER 185
0.00B 2023-01-05 02:45:07 ENTRYPOINT ["/opt/entrypoint.sh"]
0.00B 2023-01-05 02:45:07 RUN |1 spark_uid=185 /bin/sh -c chmod a+x /opt/decom.sh # buildkit
0.00B 2023-01-05 02:45:07 RUN |1 spark_uid=185 /bin/sh -c chmod g+w /opt/spark/work-dir # buildkit
0.00B 2023-01-05 02:45:06 WORKDIR /opt/spark/work-dir
0.00B 2023-01-05 02:45:06 ENV SPARK_HOME=/opt/spark
968.74KB 2023-01-05 02:45:06 COPY data /opt/spark/data # buildkit
11.27KB 2023-01-05 02:45:06 COPY kubernetes/tests /opt/spark/tests # buildkit
3.12MB 2023-01-05 02:45:06 COPY examples /opt/spark/examples # buildkit
1.28KB 2023-01-05 02:45:06 COPY kubernetes/dockerfiles/spark/decom.sh /opt/ # buildkit
3.49KB 2023-01-05 02:45:06 COPY kubernetes/dockerfiles/spark/entrypoint.sh /opt/ # buildkit
45.08KB 2023-01-05 02:45:06 COPY sbin /opt/spark/sbin # buildkit
54.04KB 2023-01-05 02:45:06 COPY bin /opt/spark/bin # buildkit
301.50MB 2023-01-05 02:45:06 COPY jars /opt/spark/jars # buildkit
83.40MB 2023-01-05 02:45:05 RUN |1 spark_uid=185 /bin/sh -c set -ex && sed -i 's/http:\/\/deb.\(.*\)/https:\/\/deb.\1/g' /etc/apt/sources.list && apt-get update && ln -s /lib /lib64 && apt install -y bash tini libc6 libpam-modules krb5-user libnss3 procps && mkdir -p /opt/spark && mkdir -p /opt/spark/examples && mkdir -p /opt/spark/work-dir && touch /opt/spark/RELEASE && rm /bin/sh && ln -sv /bin/bash /bin/sh && echo "auth required pam_wheel.so use_uid" >> /etc/pam.d/su && chgrp root /etc/passwd && chmod ug+rw /etc/passwd && rm -rf /var/cache/apt/* # buildkit
0.00B 2023-01-05 02:45:05 ARG spark_uid=185
138.00MB 2022-08-02 13:53:58 /bin/sh -c set -eux; arch="$(dpkg --print-architecture)"; case "$arch" in 'amd64') downloadUrl='https://github.com/AdoptOpenJDK/openjdk11-upstream-binaries/releases/download/jdk-11.0.16%2B8/OpenJDK11U-jre_x64_linux_11.0.16_8.tar.gz'; ;; 'arm64') downloadUrl='https://github.com/AdoptOpenJDK/openjdk11-upstream-binaries/releases/download/jdk-11.0.16%2B8/OpenJDK11U-jre_aarch64_linux_11.0.16_8.tar.gz'; ;; *) echo >&2 "error: unsupported architecture: '$arch'"; exit 1 ;; esac; savedAptMark="$(apt-mark showmanual)"; apt-get update; apt-get install -y --no-install-recommends dirmngr gnupg wget ; rm -rf /var/lib/apt/lists/*; wget --progress=dot:giga -O openjdk.tgz "$downloadUrl"; wget --progress=dot:giga -O openjdk.tgz.asc "$downloadUrl.sign"; export GNUPGHOME="$(mktemp -d)"; gpg --batch --keyserver keyserver.ubuntu.com --recv-keys EAC843EBD3EFDB98CC772FADA5CD6035332FA671; gpg --batch --keyserver keyserver.ubuntu.com --keyserver-options no-self-sigs-only --recv-keys CA5F11C6CE22644D42C6AC4492EF8D39DC13168F; gpg --batch --list-sigs --keyid-format 0xLONG CA5F11C6CE22644D42C6AC4492EF8D39DC13168F | tee /dev/stderr | grep '0xA5CD6035332FA671' | grep 'Andrew Haley'; gpg --batch --verify openjdk.tgz.asc openjdk.tgz; gpgconf --kill all; rm -rf "$GNUPGHOME"; mkdir -p "$JAVA_HOME"; tar --extract --file openjdk.tgz --directory "$JAVA_HOME" --strip-components 1 --no-same-owner ; rm openjdk.tgz*; apt-mark auto '.*' > /dev/null; [ -z "$savedAptMark" ] || apt-mark manual $savedAptMark > /dev/null; apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false; { echo '#!/usr/bin/env bash'; echo 'set -Eeuo pipefail'; echo 'trust extract --overwrite --format=java-cacerts --filter=ca-anchors --purpose=server-auth "$JAVA_HOME/lib/security/cacerts"'; } > /etc/ca-certificates/update.d/docker-openjdk; chmod +x /etc/ca-certificates/update.d/docker-openjdk; /etc/ca-certificates/update.d/docker-openjdk; find "$JAVA_HOME/lib" -name '*.so' -exec dirname '{}' ';' | sort -u > /etc/ld.so.conf.d/docker-openjdk.conf; ldconfig; java -Xshare:dump; java --version
0.00B 2022-08-02 13:52:17 /bin/sh -c #(nop) ENV JAVA_VERSION=11.0.16
0.00B 2022-08-02 13:52:17 /bin/sh -c #(nop) ENV LANG=C.UTF-8
0.00B 2022-08-02 13:52:17 /bin/sh -c #(nop) ENV PATH=/usr/local/openjdk-11/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
27.00B 2022-08-02 13:52:17 /bin/sh -c { echo '#/bin/sh'; echo 'echo "$JAVA_HOME"'; } > /usr/local/bin/docker-java-home && chmod +x /usr/local/bin/docker-java-home && [ "$JAVA_HOME" = "$(docker-java-home)" ] # backwards compatibility
0.00B 2022-08-02 13:52:16 /bin/sh -c #(nop) ENV JAVA_HOME=/usr/local/openjdk-11
4.88MB 2022-08-02 13:48:05 /bin/sh -c set -eux; apt-get update; apt-get install -y --no-install-recommends ca-certificates p11-kit ; rm -rf /var/lib/apt/lists/*
0.00B 2022-08-02 09:20:05 /bin/sh -c #(nop) CMD ["bash"]
80.39MB 2022-08-02 09:20:04 /bin/sh -c #(nop) ADD file:0eae0dca665c7044bf242cb1fc92cb8ea744f5af2dd376a558c90bc47349aefe in /

镜像信息 

{
    "Id": "sha256:b614acd71f4da1ba60d459530fd30bbd36d11d33f1724ad59be8682abdfb68eb",
    "RepoTags": [
        "apache/spark:v3.2.3",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark:v3.2.3"
    ],
    "RepoDigests": [
        "apache/spark@sha256:5d111be3e4b73479da8488fd1a1e0db2b4aa75190828e0f0356e644f7ab065a8",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/apache/spark@sha256:d7b237fc2682b4a2c20065ca470a18ef3f98c1988147b3863600bd5600b77653"
    ],
    "Parent": "",
    "Comment": "buildkit.dockerfile.v0",
    "Created": "2023-01-04T18:45:07.198129429Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "185",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/openjdk-11/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
            "JAVA_HOME=/usr/local/openjdk-11",
            "LANG=C.UTF-8",
            "JAVA_VERSION=11.0.16",
            "SPARK_HOME=/opt/spark"
        ],
        "Cmd": null,
        "Image": "",
        "Volumes": null,
        "WorkingDir": "/opt/spark/work-dir",
        "Entrypoint": [
            "/opt/entrypoint.sh"
        ],
        "OnBuild": null,
        "Labels": null
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 612374040,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/649685bb57c7eb3869e77bae2aed7f4330cd980d41039904dbb5a2f4145e67a3/diff:/var/lib/docker/overlay2/5f667dad05ad22ea6aa0f781aba57d775ffb85ad8a93d2b60c767ad2b86423de/diff:/var/lib/docker/overlay2/7b339ea06f28285a56d711ca32646faba9b383a43fe6f18ffc197c0106638853/diff:/var/lib/docker/overlay2/a2ac6dfffdccdcbe37d4447afb7aa7d938192009a35bc89ba652843abf867483/diff:/var/lib/docker/overlay2/fd8f9d7b4cc57559fe38fafdf703559ba65e49d4ce7ceff4bc643910fc810b62/diff:/var/lib/docker/overlay2/4672b522cd5b9aa64327fcea2fdd656f3163ba85c4cf2d79e7125c1e126845fa/diff:/var/lib/docker/overlay2/4e1669e23d1e0674fc1105cdaeaaafe6309d66069d53808d20e6b584c9412134/diff:/var/lib/docker/overlay2/9a4b3b777febd3aba02d1e6c4f5c685175692b25959ff59afda09bc2b52d5eea/diff:/var/lib/docker/overlay2/404434b6f3953c871e0d1ebda74bab43beff96d6a971151e9d4fd185773611d2/diff:/var/lib/docker/overlay2/9ac6a723280ff9a09e087e014bd3483613d988aa28c47f8df1eb41beb759e840/diff:/var/lib/docker/overlay2/b10bb2c3bddc550fd6a46dd65c4c461c2b15c1e617cf92274993bb653c05636d/diff:/var/lib/docker/overlay2/fbc43f3c241be5b4daefd9ff551eb633473a57e0ad6934e1ccec42cddaf689e0/diff:/var/lib/docker/overlay2/3f6ad1b70e989e0d0ee48b4fb9e801ec62625807e5c5d19a0dbcde9c77a714f3/diff:/var/lib/docker/overlay2/9c71e9255f93b8db166af620ce1c6555d75ed5cbe12cfe711321c244665ba88a/diff:/var/lib/docker/overlay2/7ea06a880f35006476b5fe87975006641ae6094e7a3dae782a694ea632aba0f0/diff",
            "MergedDir": "/var/lib/docker/overlay2/9326bbffb125c0a097ed6860084639e638a66fc794a7367084f2a9bdc35a64bb/merged",
            "UpperDir": "/var/lib/docker/overlay2/9326bbffb125c0a097ed6860084639e638a66fc794a7367084f2a9bdc35a64bb/diff",
            "WorkDir": "/var/lib/docker/overlay2/9326bbffb125c0a097ed6860084639e638a66fc794a7367084f2a9bdc35a64bb/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:92a4e8a3140f7a04a0e5a15793adef2d0e8889ed306a8f95a6cfb67cecb5f212",
            "sha256:eafe6e032dbd1979848a323c4c84071be765d175661d6ea2ac148dbd673c6713",
            "sha256:e3abdc2e92525469b91b8616216f3ab94b40c98f99e9690fd8505725fd7e1bfe",
            "sha256:d7802b8508afcba9f87b128ab24e5e2706476a94b1d9610602fda64bf273a845",
            "sha256:9ab655a721766bded3cc651f38258e6b368322e328e4ae7387729e91364c0d80",
            "sha256:1581591738f2bd0b91eb6892f94dcf86009ea281c1094b0700acdf192b773240",
            "sha256:8017bfdbd5b6c9c4b0269612408ae81fb86381fe9810c5a19e5d36da17119c09",
            "sha256:513389261b0cf21abae6a5c8bae3d2dc0598e145d92a9af66b0cf0d36d03e90d",
            "sha256:994729a09f0220bfcd05caaf69c6d560b8f682edb72d1705098425eab0cba2cb",
            "sha256:29007d86311e0aead94c229c9dd762dea220246c218b63a2220887ec98faa198",
            "sha256:4de3977c341569e3bf7cf1776d9a6d64c2618f928b6d84d2f786b99496f56472",
            "sha256:3ff6b1877adea9e91240ef823bfc3823ae8983023dbaceca6f8897629683bfce",
            "sha256:60a5a5a605f45c45674c868bce1e2823c8f38956a201a2862e3b2c6860f72705",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef",
            "sha256:8fc23fa9f797e5e2d515bdfaa616b3eb59a78194c5531dfc340b4e9794163e92",
            "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-11-11T16:10:08.506447994+08:00"
    }
}

更多版本

docker.io/apache/spark:3.4.4

linux/amd64 docker.io974.48MB2024-10-29 01:26
59

docker.io/apache/spark:v3.2.3

linux/amd64 docker.io612.37MB2024-11-11 16:11
22