This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new b0255cf [SPARK-52661] Suppress pending pod log messages
b0255cf is described below
commit b0255cfa9bc0c725b3ea2d126f99a696f4d7d23b
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Jul 2 18:43:14 2025 -0700
[SPARK-52661] Suppress pending pod log messages
### What changes were proposed in this pull request?
This PR aims to suppress pending pod log messages from WARN to DEBUG.
### Why are the changes needed?
Since the pending status is a legit status, we don't need to WARN.
Frequently, it can happen during the K8s cluster autoscaling-up.
```
25/07/02 22:58:44 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:44 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:44 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:44 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:44 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:44 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:46 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:46 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:46 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:46 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:46 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:46 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:50 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:55 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:55 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:55 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:55 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:55 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:55 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:58 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:58 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:58 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:58 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:58 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:58:58 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:03 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:05 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:05 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:05 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:05 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:05 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:05 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:09 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:09 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:09 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:09 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:09 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:09 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:13 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:13 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:13 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:13 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
25/07/02 22:59:13 WARN BaseAppDriverObserver: Cannot determine driver pod
status, the pod may in pending state.
```
### Does this PR introduce _any_ user-facing change?
No behavior change because this changes only log levels.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #272 from dongjoon-hyun/SPARK-52661.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../spark/k8s/operator/reconciler/observers/BaseAppDriverObserver.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/spark-operator/src/main/java/org/apache/spark/k8s/operator/reconciler/observers/BaseAppDriverObserver.java
b/spark-operator/src/main/java/org/apache/spark/k8s/operator/reconciler/observers/BaseAppDriverObserver.java
index dd8ba64..f8cc25c 100644
---
a/spark-operator/src/main/java/org/apache/spark/k8s/operator/reconciler/observers/BaseAppDriverObserver.java
+++
b/spark-operator/src/main/java/org/apache/spark/k8s/operator/reconciler/observers/BaseAppDriverObserver.java
@@ -82,7 +82,7 @@ public abstract class BaseAppDriverObserver
if (status == null
|| status.getContainerStatuses() == null
|| status.getContainerStatuses().isEmpty()) {
- log.warn("Cannot determine driver pod status, the pod may in pending
state.");
+ log.debug("Cannot determine driver pod status, the pod may in pending
state.");
return Optional.empty();
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
