This is an automated email from the ASF dual-hosted git repository.

kirs pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
     new 29dbce7456d [fix](docker hive3) hive server oom and not auto-restart 
(#50456)
29dbce7456d is described below

commit 29dbce7456d2b37428f73219f03854a199014a9d
Author: Thearas <gaozif...@selectdb.com>
AuthorDate: Mon Apr 28 16:21:41 2025 +0800

    [fix](docker hive3) hive server oom and not auto-restart (#50456)
    
    ### What problem does this PR solve?
    
    Docker hive3 server OOM and not auto-restart when testing:
    
    ```sh
    Exception: java.lang.OutOfMemoryError thrown from the 
UncaughtExceptionHandler in thread 
"org.apache.hadoop.hive.common.JvmPauseMonitor$Monitor@6690b9fa"
    2025-04-27 04:59:07,640 Log4j2-TF-2-AsyncLogger[AsyncContext@3930015a]-1 
ERROR Unable to invoke factory method in class 
org.apache.hadoop.hive.ql.log.HushableRandomAccessFileAppender for element 
HushableMutableRandomAccess: java.lang.OutOfMemoryError: Java heap space 
java.lang.reflect.InvocationTargetException
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
            at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:498)
            at 
org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:136)
            at 
org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:958)
            at 
org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:898)
            at 
org.apache.logging.log4j.core.appender.routing.RoutingAppender.createAppender(RoutingAppender.java:271)
            at 
org.apache.logging.log4j.core.appender.routing.RoutingAppender.getControl(RoutingAppender.java:255)
            at 
org.apache.logging.log4j.core.appender.routing.RoutingAppender.append(RoutingAppender.java:225)
            at 
org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:156)
            at 
org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:129)
            at 
org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:120)
            at 
org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:84)
            at 
org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:448)
            at 
org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:433)
            at 
org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)
            at 
org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:79)
            at 
org.apache.logging.log4j.core.async.AsyncLogger.actualAsyncLog(AsyncLogger.java:380)
            at 
org.apache.logging.log4j.core.async.RingBufferLogEvent.execute(RingBufferLogEvent.java:152)
            at 
org.apache.logging.log4j.core.async.RingBufferLogEventHandler.onEvent(RingBufferLogEventHandler.java:45)
            at 
org.apache.logging.log4j.core.async.RingBufferLogEventHandler.onEvent(RingBufferLogEventHandler.java:29)
            at 
com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:129)
            at java.lang.Thread.run(Thread.java:748)
    Caused by: java.lang.OutOfMemoryError: Java heap space
    ```
---
 docker/thirdparties/docker-compose/hive/hive-3x.yaml.tpl | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/docker/thirdparties/docker-compose/hive/hive-3x.yaml.tpl 
b/docker/thirdparties/docker-compose/hive/hive-3x.yaml.tpl
index 84d4a653554..5118b6bd65d 100644
--- a/docker/thirdparties/docker-compose/hive/hive-3x.yaml.tpl
+++ b/docker/thirdparties/docker-compose/hive/hive-3x.yaml.tpl
@@ -56,11 +56,13 @@ services:
 
   hive-server:
     image: doristhirdpartydocker/hive:3.1.2-postgresql-metastore
+    restart: always
     env_file:
       - ./hadoop-hive-3x.env
     environment:
       HIVE_CORE_CONF_javax_jdo_option_ConnectionURL: 
"jdbc:postgresql://${IP_HOST}:${PG_PORT}/metastore"
       SERVICE_PRECONDITION: "${IP_HOST}:${HMS_PORT}"
+      JVM_OPTS: -Xmx2g
     container_name: ${CONTAINER_UID}hive3-server
     expose:
       - "${HS_PORT}"


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to