@rick I see many indexing config, but i don't see any config related to query (i.e., number of threads etc.) in solrconfig. What will be the relevant part for this area? In jetty threadpool is set to 10000.
@Toke: I have a webserver which uses solr for querying, this i guess is pretty typical. At times, there are 50 users sending queries at a given second. Sometimes, the queries take a few second to finish (i.e., if the max across all shards is 5 second due to any local reason, even if the median is sub-second, the aggregator query will take 5 seconds). This can cause some query load to build up on the aggregator node. This is all fine and understandable. Now, the load and testclient is identical for both solr4.5 and solr7, what can be causing solr7 aggregator to spin more threads? I also agree that 4000 threads is not useful, so the solution is not to increase the threadlimit for the process, rather it is somewhere else. Thanks Nawab On Sat, Nov 18, 2017 at 10:22 AM, Rick Leir <rl...@leirtech.com> wrote: > Nawab > You probably need to share the relevant config to get an answer to this. > Cheers -- Rick > > On November 17, 2017 2:19:03 PM EST, Nawab Zada Asad Iqbal < > khi...@gmail.com> wrote: > >Hi, > > > >I have a sharded solr7 cluster and I am using an aggregator node (which > >has > >no data/index of its own) to distribute queries and aggregate results > >from > >the shards. I am puzzled that when I use solr7 on the aggregator node, > >then > >number of threads shoots up to 32000 on that host and then the process > >reaches its memory limits. However, when i use solr4 on the aggregator, > >then it all seems to work fine. The peak number of threads during my > >testing were around 4000 or so. The test load is same in both cases, > >except > >that it doesn't finish in case of solr7 (due to the memory / thread > >issue). > >The memory settings and Jetty threadpool setting (max=10000) are also > >consistent in both servers (solr 4 and solr 7). > > > > > >Has anyone else been in similar circumstances? > > > > > >Thanks > >Nawab > > -- > Sorry for being brief. Alternate email is rickleir at yahoo dot com
