xy720 commented on issue #4101:
URL:
https://github.com/apache/incubator-doris/issues/4101#issuecomment-661636359
**The repository structure** will be like this:
__spark_repository__/
|-__archive_1_0_0/
| |-__lib_990325d2c0d1d5e45bf675e54e44fb16_spark-dpp.zip
| |-__lib_7670c29daf535efe3c9b923f778f61fc_spark-2x.zip
|-__archive_2_2_0/
| |-__lib_64d5696f99c379af2bee28c1c84271d5_spark-dpp.zip
| |-__lib_1bbb74bb6b264a270bc7fca3e964160f_spark-2x.zip
|-__archive_3_2_0/
| |-...
1、The archive represents a remote directory contains the libraries which are
in the same dppVersion.
2、The library(lib) represents a remote library for Spark-2x/Spark-dpp.
Every time when fe upload its zip, it creates a subfolder like
"__archive_1_2_0" in repository, and put the zip file into it.
The zip file is named like "__lib_md5sum_spark-dpp.zip", generated by the
jar packages. For example, spark-dpp.zip is generated by spark-dpp.jar, and
spark-2x.zip is generated by jars under $SPARK_HOME/jars.
If upload is needed, by default fe will find the local zip file with the
following config:
spark_dpp_resource_local_path = $DORIS_HOME + /lib/spark-dpp.zip
spark_resource_local_path = "{user_setting}"
if spark_resource_local_path is empty, fe will try find zip file at
$SPARK_HOME/jars/spark-2x.zip
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
