Thanks Hoss and Shawn for helping. there are not many OOM stack details printed in the solr log file, it's just saying No enough memory, and it's killed by ****oom.sh(solr's script).
My question(issue) is not it's OOM or not, the issue is why JVM memory usage keeps growing up but never going down, it's not how java programs work. the normal java process can use a lot of memory, but it will throw away after using it instead of keep it in the memory with reference. After trying solr 8.7.0 in one week, I go back to solr 8.6.2(config, plugin and 3th party libraries are all the same, Xmx=6G), now I can see JVM memory usage up and down. I can see it goes up when I am creating collections, but it will go down once the collection is created completely. I think I should stick with 8.6.2 until I can find a proper config or stable version. thanks again Derrick On Thu, Jan 28, 2021 at 11:43 PM Chris Hostetter <hossman_luc...@fucit.org> wrote: > > : Is the matter to use the config file ? I am using custom config instead > : of _default, my config is from solr 8.6.2 with custom solrconfig.xml > > Well, it depends on what's *IN* the custom config ... maybe you are using > some built in functionality that has a bug but didn't get triggered by my > simple test case -- or maybe you have custom components that have memory > leaks. > > The point of the question was to try and understand where/how you are > running into an OOM i can't reproduce. > > Knowing exactly what your config looks like would help, knowing exactly > what you do before you see the OOM would help (are you realy just creating > the collections, or is it actauly neccessary to index some docs into those > collections before you see this problem start to happen? what do the logs > say during the time when the heap usage is just growing w/o explanation? > what is the stack trace of the OOM? what does a heap abalysis show in > terms of large/leaked objects? etc. > > You have to help us understand the minimally viable steps we need > to execute to see the behavior you see.... > > https://cwiki.apache.org/confluence/display/SOLR/UsingMailingLists > > -Hoss > http://www.lucidworks.com/ > >