docker.io/pingcap/tispark:latest linux/amd64

docker.io/pingcap/tispark:latest - 国内下载镜像源 浏览次数:23

温馨提示:此镜像为latest tag镜像，本站无法保证此版本为最新镜像

这是一个包含 TiSpark 的 Docker 镜像，由 PingCAP 维护。TiSpark 是 Apache Spark 在 TiDB 上的集成，它允许您使用 Spark SQL 查询 TiDB 数据，并利用 Spark 的分布式处理能力来加速分析任务。

源镜像 docker.io/pingcap/tispark:latest
国内镜像 swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest
镜像ID sha256:8856e8cfadeb56ee97d0303640b043f706e2cf0a8d14f5727e126cc0f2910eaa
镜像TAG latest
大小 635.64MB
镜像源 docker.io
项目信息 Docker-Hub主页 🚀项目TAG 🚀
CMD /bin/sh
启动入口
工作目录 /opt/spark
OS/平台 linux/amd64
浏览量 23 次
贡献者
镜像创建 2022-02-10T02:33:01.969105487Z
同步时间 2024-11-07 14:22
更新时间 2024-11-19 16:55
环境变量
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/jdk/bin JAVA_VERSION_MAJOR=8 JAVA_VERSION_MINOR=202 JAVA_VERSION_BUILD=08 JAVA_PACKAGE=server-jre JAVA_JCE=standard JAVA_HOME=/opt/jdk GLIBC_REPO=https://github.com/sgerrand/alpine-pkg-glibc GLIBC_VERSION=2.29-r0 LANG=C.UTF-8 SPARK_VERSION=2.4.3 HADOOP_VERSION=2.7 TISPARK_PYTHON_VERSION=2.0 SPARK_HOME=/opt/spark SPARK_NO_DAEMONIZE=true SPARK_MASTER_PORT=7077 SPARK_MASTER_HOST=0.0.0.0 SPARK_MASTER_WEBUI_PORT=8080 PYTHONPATH=/opt/spark/python/lib/py4j-0.10.4-src.zip:/opt/spark/python:
镜像安全扫描 查看Trivy扫描报告

系统OS: alpine 3.8.2 扫描引擎: Trivy 扫描时间: 2024-11-07 14:22

低危漏洞:11 中危漏洞:66 高危漏洞:161 严重漏洞:74
docker.io/pingcap/tispark:latest (alpine 3.8.2) (alpine) Java (jar) Python (python-pkg)

Docker拉取命令 无权限下载?点我修复 

docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest
docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest  docker.io/pingcap/tispark:latest

Containerd拉取命令 

ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest
ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest  docker.io/pingcap/tispark:latest

Shell快速替换命令 

sed -i 's#pingcap/tispark:latest#swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest#' deployment.yaml

Ansible快速分发-Docker 

#ansible k8s -m shell -a 'docker pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest && docker tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest  docker.io/pingcap/tispark:latest'

Ansible快速分发-Containerd 

#ansible k8s -m shell -a 'ctr images pull swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest && ctr images tag  swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest  docker.io/pingcap/tispark:latest'

镜像历史

大小 创建时间 层信息
0.00B 2022-02-10 10:33:01 /bin/sh -c #(nop) WORKDIR /opt/spark
0.00B 2022-02-10 10:33:01 /bin/sh -c #(nop) ENV PYTHONPATH=/opt/spark/python/lib/py4j-0.10.4-src.zip:/opt/spark/python:
2.16KB 2022-02-10 10:33:01 /bin/sh -c #(nop) ADD file:cf5039dc17bdc121f608b9ac858fc066ab2fe6cd5a8d2eb1e6907f92a32b2780 in /opt/spark/conf/log4j.properties
36.29KB 2022-02-10 10:33:01 /bin/sh -c #(nop) ADD file:1144d7b4baa88b4da321ef551bf7836676424eea1a85dcd6cd46539383d76c0b in /opt/spark/python/pyspark/sql/
312.97MB 2022-02-10 10:33:00 /bin/sh -c wget -q https://download.pingcap.org/spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz && tar zxf spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz -C /opt/ && ln -s /opt/spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION} ${SPARK_HOME} && wget -q http://download.pingcap.org/tispark-assembly-latest-linux-amd64.tar.gz && tar zxf ./tispark-assembly-latest-linux-amd64.tar.gz -C /opt/ && cp /opt/assembly/target/tispark-assembly-*.jar ${SPARK_HOME}/jars && wget -q http://download.pingcap.org/tispark-sample-data.tar.gz && tar zxf tispark-sample-data.tar.gz -C ${SPARK_HOME}/data/ && rm -rf /opt/assembly/ spark-${SPARK_VERSION}-bin-hadoop${HADOOP_VERSION}.tgz tispark-latest-linux-amd64.tar.gz tispark-sample-data.tar.gz
196.67MB 2022-02-10 10:32:34 /bin/sh -c apk --no-cache add coreutils mysql-client procps python py-pip R
366.00B 2022-02-10 10:32:05 /bin/sh -c #(nop) ADD dir:4765f06925579f236a83cf01eabcb4e1662fe3d9d17e8fc0b98ce10b9642ad1c in /opt/tispark-tests
0.00B 2022-02-10 10:32:04 /bin/sh -c #(nop) ENV SPARK_VERSION=2.4.3 HADOOP_VERSION=2.7 TISPARK_PYTHON_VERSION=2.0 SPARK_HOME=/opt/spark SPARK_NO_DAEMONIZE=true SPARK_MASTER_PORT=7077 SPARK_MASTER_HOST=0.0.0.0 SPARK_MASTER_WEBUI_PORT=8080
121.55MB 2019-02-13 21:18:10 /bin/sh -c set -ex && [[ ${JAVA_VERSION_MAJOR} != 7 ]] || ( echo >&2 'Oracle no longer publishes JAVA7 packages' && exit 1 ) && apk -U upgrade && apk add libstdc++ curl ca-certificates bash java-cacerts && wget -q -O /etc/apk/keys/sgerrand.rsa.pub https://alpine-pkgs.sgerrand.com/sgerrand.rsa.pub && for pkg in glibc-${GLIBC_VERSION} glibc-bin-${GLIBC_VERSION} glibc-i18n-${GLIBC_VERSION}; do curl -sSL ${GLIBC_REPO}/releases/download/${GLIBC_VERSION}/${pkg}.apk -o /tmp/${pkg}.apk; done && apk add /tmp/*.apk && rm -v /tmp/*.apk && ( /usr/glibc-compat/bin/localedef --force --inputfile POSIX --charmap UTF-8 C.UTF-8 || true ) && echo "export LANG=C.UTF-8" > /etc/profile.d/locale.sh && /usr/glibc-compat/sbin/ldconfig /lib /usr/glibc-compat/lib && mkdir /opt && curl -jksSLH "Cookie: oraclelicense=accept-securebackup-cookie" -o /tmp/java.tar.gz http://download.oracle.com/otn-pub/java/jdk/${JAVA_VERSION_MAJOR}u${JAVA_VERSION_MINOR}-b${JAVA_VERSION_BUILD}/1961070e4c9b4e26a04e7f5a083f551e/${JAVA_PACKAGE}-${JAVA_VERSION_MAJOR}u${JAVA_VERSION_MINOR}-linux-x64.tar.gz && JAVA_PACKAGE_SHA256=$(curl -sSL https://www.oracle.com/webfolder/s/digest/${JAVA_VERSION_MAJOR}u${JAVA_VERSION_MINOR}checksum.html | grep -E "${JAVA_PACKAGE}-${JAVA_VERSION_MAJOR}u${JAVA_VERSION_MINOR}-linux-x64\.tar\.gz" | grep -Eo '(sha256: )[^<]+' | cut -d: -f2 | xargs) && echo "${JAVA_PACKAGE_SHA256} /tmp/java.tar.gz" > /tmp/java.tar.gz.sha256 && sha256sum -c /tmp/java.tar.gz.sha256 && gunzip /tmp/java.tar.gz && tar -C /opt -xf /tmp/java.tar && ln -s /opt/jdk1.${JAVA_VERSION_MAJOR}.0_${JAVA_VERSION_MINOR} /opt/jdk && find /opt/jdk/ -maxdepth 1 -mindepth 1 | grep -v jre | xargs rm -rf && cd /opt/jdk/ && ln -s ./jre/bin ./bin && if [ "${JAVA_JCE}" == "unlimited" ]; then echo "Installing Unlimited JCE policy" && curl -jksSLH "Cookie: oraclelicense=accept-securebackup-cookie" -o /tmp/jce_policy-${JAVA_VERSION_MAJOR}.zip http://download.oracle.com/otn-pub/java/jce/${JAVA_VERSION_MAJOR}/jce_policy-${JAVA_VERSION_MAJOR}.zip && cd /tmp && unzip /tmp/jce_policy-${JAVA_VERSION_MAJOR}.zip && cp -v /tmp/UnlimitedJCEPolicyJDK8/*.jar /opt/jdk/jre/lib/security/; fi && sed -i s/#networkaddress.cache.ttl=-1/networkaddress.cache.ttl=10/ $JAVA_HOME/jre/lib/security/java.security && apk del curl glibc-i18n && rm -rf /opt/jdk/jre/plugin /opt/jdk/jre/bin/javaws /opt/jdk/jre/bin/jjs /opt/jdk/jre/bin/orbd /opt/jdk/jre/bin/pack200 /opt/jdk/jre/bin/policytool /opt/jdk/jre/bin/rmid /opt/jdk/jre/bin/rmiregistry /opt/jdk/jre/bin/servertool /opt/jdk/jre/bin/tnameserv /opt/jdk/jre/bin/unpack200 /opt/jdk/jre/lib/javaws.jar /opt/jdk/jre/lib/deploy* /opt/jdk/jre/lib/desktop /opt/jdk/jre/lib/*javafx* /opt/jdk/jre/lib/*jfx* /opt/jdk/jre/lib/amd64/libdecora_sse.so /opt/jdk/jre/lib/amd64/libprism_*.so /opt/jdk/jre/lib/amd64/libfxplugins.so /opt/jdk/jre/lib/amd64/libglass.so /opt/jdk/jre/lib/amd64/libgstreamer-lite.so /opt/jdk/jre/lib/amd64/libjavafx*.so /opt/jdk/jre/lib/amd64/libjfx*.so /opt/jdk/jre/lib/ext/jfxrt.jar /opt/jdk/jre/lib/ext/nashorn.jar /opt/jdk/jre/lib/oblique-fonts /opt/jdk/jre/lib/plugin.jar /tmp/* /var/cache/apk/* && ln -sf /etc/ssl/certs/java/cacerts $JAVA_HOME/jre/lib/security/cacerts && echo 'hosts: files mdns4_minimal [NOTFOUND=return] dns mdns4' >> /etc/nsswitch.conf
0.00B 2019-02-13 21:17:33 /bin/sh -c #(nop) ENV JAVA_VERSION_MAJOR=8 JAVA_VERSION_MINOR=202 JAVA_VERSION_BUILD=08 JAVA_PACKAGE=server-jre JAVA_JCE=standard JAVA_HOME=/opt/jdk PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/jdk/bin GLIBC_REPO=https://github.com/sgerrand/alpine-pkg-glibc GLIBC_VERSION=2.29-r0 LANG=C.UTF-8
0.00B 2019-02-13 21:17:33 /bin/sh -c #(nop) MAINTAINER Anastas Dancha <anapsix@random.io>
0.00B 2019-01-31 06:19:47 /bin/sh -c #(nop) CMD ["/bin/sh"]
4.41MB 2019-01-31 06:19:46 /bin/sh -c #(nop) ADD file:91fb97ea3549e52e7b6e22b93a6736cf915c756f3d13348406d8ad5f1a872680 in /

镜像信息 

{
    "Id": "sha256:8856e8cfadeb56ee97d0303640b043f706e2cf0a8d14f5727e126cc0f2910eaa",
    "RepoTags": [
        "pingcap/tispark:latest",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark:latest"
    ],
    "RepoDigests": [
        "pingcap/tispark@sha256:58c7c1984a08ed1c1584a64b8ddecd9c922b800c01f919a76d1025a3b184d473",
        "swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/pingcap/tispark@sha256:58c7c1984a08ed1c1584a64b8ddecd9c922b800c01f919a76d1025a3b184d473"
    ],
    "Parent": "",
    "Comment": "",
    "Created": "2022-02-10T02:33:01.969105487Z",
    "Container": "",
    "ContainerConfig": null,
    "DockerVersion": "18.09.9",
    "Author": "",
    "Config": {
        "Hostname": "",
        "Domainname": "",
        "User": "",
        "AttachStdin": false,
        "AttachStdout": false,
        "AttachStderr": false,
        "Tty": false,
        "OpenStdin": false,
        "StdinOnce": false,
        "Env": [
            "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/jdk/bin",
            "JAVA_VERSION_MAJOR=8",
            "JAVA_VERSION_MINOR=202",
            "JAVA_VERSION_BUILD=08",
            "JAVA_PACKAGE=server-jre",
            "JAVA_JCE=standard",
            "JAVA_HOME=/opt/jdk",
            "GLIBC_REPO=https://github.com/sgerrand/alpine-pkg-glibc",
            "GLIBC_VERSION=2.29-r0",
            "LANG=C.UTF-8",
            "SPARK_VERSION=2.4.3",
            "HADOOP_VERSION=2.7",
            "TISPARK_PYTHON_VERSION=2.0",
            "SPARK_HOME=/opt/spark",
            "SPARK_NO_DAEMONIZE=true",
            "SPARK_MASTER_PORT=7077",
            "SPARK_MASTER_HOST=0.0.0.0",
            "SPARK_MASTER_WEBUI_PORT=8080",
            "PYTHONPATH=/opt/spark/python/lib/py4j-0.10.4-src.zip:/opt/spark/python:"
        ],
        "Cmd": [
            "/bin/sh"
        ],
        "ArgsEscaped": true,
        "Image": "sha256:3a416789cbd5d3e2d72528939e41aee9cf56a6d86a8aa6d7b3b04c2960bd40e5",
        "Volumes": null,
        "WorkingDir": "/opt/spark",
        "Entrypoint": null,
        "OnBuild": null,
        "Labels": null
    },
    "Architecture": "amd64",
    "Os": "linux",
    "Size": 635636243,
    "GraphDriver": {
        "Data": {
            "LowerDir": "/var/lib/docker/overlay2/0bf24993cad12b8a02b4c9690e297f6015901f6917650db06227a5d8f3f9a8b1/diff:/var/lib/docker/overlay2/6fc43eddd7755976c68d161d18bfce2b66752704e491dfb7ca9d4c9b19361b60/diff:/var/lib/docker/overlay2/8a5b74a5b328cbff1ead63d5d3e6853d53759907f44dc4c452fb648f369adcb4/diff:/var/lib/docker/overlay2/dd7a75d78cb6ffeb9e531baf5f8509daf14b9c4e8630b7b4b5ed75e555731219/diff:/var/lib/docker/overlay2/d8bab43374437f5bf37b11fe40997f69fb2c2ae7cd7ffa2687f2372100d7fb12/diff:/var/lib/docker/overlay2/139703b259239d5419230677ab008c055b45c8a21f7bd66503a2ae9e662d74aa/diff",
            "MergedDir": "/var/lib/docker/overlay2/b5dd27204bb023847a615bd38863a132161cd444d22bca922ea5939d30a098a7/merged",
            "UpperDir": "/var/lib/docker/overlay2/b5dd27204bb023847a615bd38863a132161cd444d22bca922ea5939d30a098a7/diff",
            "WorkDir": "/var/lib/docker/overlay2/b5dd27204bb023847a615bd38863a132161cd444d22bca922ea5939d30a098a7/work"
        },
        "Name": "overlay2"
    },
    "RootFS": {
        "Type": "layers",
        "Layers": [
            "sha256:767f936afb51c8a3ad9a96592a4be092048bb70f2ca410028a0b3f64b826acbb",
            "sha256:7c9f15a80d25afe2eeb05a8ad343e442fe8f9f5cc2e51dd538f1af41c83ef74a",
            "sha256:a5b61d252a6c6701eb0416c6ff5ce1b016fa01d4ed9a940b8780b927f1d63006",
            "sha256:82f64d2ff965a18023ba6a82a6fcb761798ba4015c42913ef90dcd6d2a059d14",
            "sha256:3bc93f2f34422c422549bb63698809f2cf12e94a0c989d8ac319bcfba2009654",
            "sha256:23766f7b35d4a97750312a087329b4bcf6454cc113dd3e3be09cf8a252bc16e0",
            "sha256:bcf2a3d7193ab72f08ea62d6b33cfb19b33960b4998331919fb6fdd89214b7f7"
        ]
    },
    "Metadata": {
        "LastTagTime": "2024-11-07T14:21:33.069178465+08:00"
    }
}

更多版本

docker.io/pingcap/tispark:latest

linux/amd64 docker.io635.64MB2024-11-07 14:22
22