Re: Maximum number of SolrCloud collections in limited hardware resource

2018-07-12 Thread Sharif Shahriar
Thanks a lot Shawn for your details reply. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-07-06 Thread Sharif Shahriar
Hi Erick, Setting the size parameter to 0 in solrconfig.xml can stop document caching, but it cannot control how much memory it will take initially when creating a collection, right? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-07-05 Thread Alexandre Rafalovitch
Does it need to be a SolrCloud? If it is just replication, maybe it can just be double indexed from the client. Or old style replication. And then use LotsOfCores autoloading. Regards, Alex On Wed, Jun 27, 2018, 8:46 AM Shawn Heisey, wrote: > On 6/27/2018 5:10 AM, Sharif Shahrair wrote: > >

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-07-05 Thread Erick Erickson
Just set the size parameter in solrconfig.xml to 0. Best, Erick On Wed, Jul 4, 2018 at 10:37 PM, Sharif Shahriar wrote: > Hi Emir, > Thanks a lot for your reply. In your reply you've mentioned- > If you stick with multiple collections, you can turn off caches completely, > monitor latency and tu

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-07-05 Thread Sharif Shahriar
Hi Emir, Thanks a lot for your reply. In your reply you've mentioned- If you stick with multiple collections, you can turn off caches completely, monitor latency and turn on caches for collections when it is reaching some threshold. -How this can be done? Is there any configuration to turn off ca

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-06-29 Thread Emir Arnautović
Hi, It is probably the best if you merge some of your collections (or all) and have discriminator field that will be used to filter out tenant’s documents only. In case you go with multiple collections serving multiple tenants, you would have to have logic on top of it to resolve tenant to colle

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-06-27 Thread Shawn Heisey
On 6/27/2018 5:10 AM, Sharif Shahrair wrote: Now the problem is, when we create about 1400 collection(all of them are empty i.e. no document is added yet) the solr service goes down showing out of memory exception. We have few questions here- 1. When we are creating collections, each collection

Maximum number of SolrCloud collections in limited hardware resource

2018-06-27 Thread Sharif Shahrair
Hi Guys, We are in a use-case where we need to create a large number of collections(1000 to 1500) in a SolrCloud. Here most of collections will have a very limited number of documents(100 to 1000), even some collections are empty. We are using single shard and 2 replicas.For each replica we using a