This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new eb42bb49 [SPARK-26529] Add debug logs for confArchive when preparing
local resource
eb42bb49 is described below
commit eb42bb493b1d7c79e9516660b71aec66bdde5d51
Author: Liupengcheng <liupengch...@xiaomi.com>
AuthorDate: Wed Jan 9 10:39:25 2019 +0800
[SPARK-26529] Add debug logs for confArchive when preparing local resource
## What changes were proposed in this pull request?
Currently, `Client#createConfArchive` do not handle IOException, and some
detail info is not provided in logs. Sometimes, this may delay the time of
locating the root cause of io error.
This PR will add debug logs for confArchive when preparing local resource.
## How was this patch tested?
unittest
Closes #23444 from
liupc/Add-logs-for-IOException-when-preparing-local-resource.
Authored-by: Liupengcheng <liupengch...@xiaomi.com>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
.../yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala | 1 +
1 file changed, 1 insertion(+)
diff --git
a/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
index 9f09dc0..8492180 100644
---
a/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
+++
b/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
@@ -713,6 +713,7 @@ private[spark] class Client(
new File(Utils.getLocalDir(sparkConf)))
val confStream = new ZipOutputStream(new FileOutputStream(confArchive))
+ logDebug(s"Creating an archive with the config files for distribution at
$confArchive.")
try {
confStream.setLevel(0)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
