Re: collection reload leads to OutOfMemoryError

2018-03-18 Thread Erick Erickson
Hendrik: There are a limited number of threads that load in parallel when starting up, depends on the configuration. The defaults are 3 threads in stand-alone and 8 in Cloud (see: NodeConfig.java) public static final int DEFAULT_CORE_LOAD_THREADS = 3; public static final int DEFAULT_CORE_LOAD_THR

Re: collection reload leads to OutOfMemoryError

2018-03-18 Thread Hendrik Haddorp
I increased the metaspace size to 2GB. This way I could do multiple rounds of reloading all collections already. The GC logs do show now an almost stable metaspace size. So maybe I did just set the limits too low. Still a bit odd that reloading the collections results in a higher memory usage.

collection reload leads to OutOfMemoryError

2018-03-18 Thread Hendrik Haddorp
Hi, I did a simple test on a three node cluster using Solr 7.2.1. The JVMs (Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_162 25.162-b12) have about 6.5GB heap and 1.5GB metaspace. In my test I have 1000 collections with only 1000 simple documents each. I'm then triggering collec