[GitHub] [incubator-doris] fanlongmengjd opened a new issue #3455: Be memory increase

[GitBox]

fanlongmengjd opened a new issue #3455:
URL: https://github.com/apache/incubator-doris/issues/3455


   **Describe the bug**
   A clear and concise description of what the bug is.
   1. Be restart 
   2. There were a routine loads which topic had 2-5 billion data 
   3. Be memory increased from 2-3G to 70G
   
   **To Reproduce**
   1. Be restart
   2. Start routine load with 20 concurrent tasks and  topic had 2-5 billion 
data 
   
   **Expected behavior**
   Be memory were steady in some level.
   
   **Screenshots**
   1. from Prometheus
   
![image](https://user-images.githubusercontent.com/63618584/80872261-b6855b80-8c65-11ea-8d12-8bcfcd0989ff.png)
   
   2. from pprof growth
   
   
    Time1  5/1. 16:50
   
[10.196.41.69-be-growth-afterrestart-0501-1650.svg.zip](https://github.com/apache/incubator-doris/files/4568522/10.196.41.69-be-growth-afterrestart-0501-1650.svg.zip)
   
   Time2   5/2. 00:30
   
[10.196.41.69-be-growth-afterrestart-0502-0030.svg.zip](https://github.com/apache/incubator-doris/files/4568529/10.196.41.69-be-growth-afterrestart-0502-0030.svg.zip)
   
   Time3.  5/2. 23:15
   
[10.196.41.69-be-growth-afterrestart-0502-1030.svg.zip](https://github.com/apache/incubator-doris/files/4568525/10.196.41.69-be-growth-afterrestart-0502-1030.svg.zip)
   
   3 from heap
   Time1 5/2  00:30
   
[10.196.41.69-be-heap-afterrestart-0502-0030.heap.zip](https://github.com/apache/incubator-doris/files/4568533/10.196.41.69-be-heap-afterrestart-0502-0030.heap.zip)
   
   Time2 5/2/ 10:30
   
[10.196.41.69-be-heap-afterrestart-0502-1030.heap.zip](https://github.com/apache/incubator-doris/files/4568534/10.196.41.69-be-heap-afterrestart-0502-1030.heap.zip)
   
   
   **Desktop (please complete the following information):**
   OS: CentOS
   Browser chrome
   Version 0.11.33.1
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org