Re: Multiple collections vs multiple shards for multitenancy

2017-05-06 Thread Erick Erickson
Well, you've been doing your homework ;). bq: I am a little confused on this statement you made: > Plus you can't commit > individually, a commit on one will _still_ commit on all so you're > right back where you started. Never mind. autocommit kicks off on a per replica basis. IOW, when a new d

Re: Automatic conversion to Range Query

2017-05-06 Thread Aman Deep Singh
Hi Erik, We can't use dismax as we are using the other functionality of edismax parser On 07-May-2017 12:13 AM, "Erik Hatcher" wrote: What about dismax instead of edismax?It might do the righter thing here without escaping. > On May 6, 2017, at 12:57, Shawn Heisey wrote: > >> On 5/6/2017 7

Re: Slow indexing speed when collection size is large

2017-05-06 Thread Zheng Lin Edwin Yeo
Hi Shawn, For my rich documentation handling, I'm using Extracting Request Handler, and it requires OCR. However, currently, for the slow indexing speed which I'm experiencing, the indexing is done directly from the Sybase database. I will fetch about 1000 records at a time from Sybase, and store

Re: Multiple collections vs multiple shards for multitenancy

2017-05-06 Thread Chris Troullis
Hi Erick, Thanks for the reply, I really appreciate it. To answer your questions, we have a little over 300 tenants, and a couple of different collections, the largest of which has ~11 million documents (so not terribly large). We are currently running standard Solr with simple master/slave repli

Re: Automatic conversion to Range Query

2017-05-06 Thread Erik Hatcher
What about dismax instead of edismax?It might do the righter thing here without escaping. > On May 6, 2017, at 12:57, Shawn Heisey wrote: > >> On 5/6/2017 7:09 AM, Aman Deep Singh wrote: >> After escaping the square bracket the query is working fine, Is their >> any way in the parser to av

Re: Automatic conversion to Range Query

2017-05-06 Thread Shawn Heisey
On 5/6/2017 7:09 AM, Aman Deep Singh wrote: > After escaping the square bracket the query is working fine, Is their > any way in the parser to avoid the automatic conversion if not proper > query will be passed like in my case even though I haven't passed > proper range query (with keyword TO). If

Re: SessionExpiredException

2017-05-06 Thread Piyush Kunal
We already faced this issue and found out the issue to be long GC pauses itself on either client side or server side. Regards, Piyush On Sat, May 6, 2017 at 6:10 PM, Shawn Heisey wrote: > On 5/3/2017 7:32 AM, Satya Marivada wrote: > > I see below exceptions in my logs sometimes. What could be ca

Re: Multiple collections vs multiple shards for multitenancy

2017-05-06 Thread Erick Erickson
Well, it's not either/or. And you haven't said how many tenants we're talking about here. Solr startup times for a single _instance_ of Solr when there are thousands of collections can be slow. But note what I am talking about here: A single Solr on a single node where there are hundreds and hundr

Re: Automatic conversion to Range Query

2017-05-06 Thread Aman Deep Singh
Thanks Shawn, After escaping the square bracket the query is working fine, Is their any way in the parser to avoid the automatic conversion if not proper query will be passed like in my case even though I haven't passed proper range query (with keyword TO). On 06-May-2017 6:08 PM, "Shawn Heisey"

Re: Slow indexing speed when collection size is large

2017-05-06 Thread Shawn Heisey
On 5/1/2017 10:17 AM, Zheng Lin Edwin Yeo wrote: > I'm using Solrj for the indexing, not using curl. Normally I bundle > about 1000 documents for each POST. There's more than 300GB of RAM for > that server, and I do not use any sharing at the moment. Looking over your email history on the list, I

Re: SessionExpiredException

2017-05-06 Thread Shawn Heisey
On 5/3/2017 7:32 AM, Satya Marivada wrote: > I see below exceptions in my logs sometimes. What could be causing it? > > org.apache.zookeeper.KeeperException$SessionExpiredException: Based on my limited research, this would tend to indicate that the heartbeats ZK uses to detect when sessions have g

Re: Automatic conversion to Range Query

2017-05-06 Thread Shawn Heisey
On 5/5/2017 12:42 PM, Aman Deep Singh wrote: > Hi Erick, I don't want to do the range query , That is why I'm using > the pattern replace filter to remove all the non alphanumeric to space > so that this type of situation don't arrive,Since end user can query > anything, also in the query I haven't

Multiple collections vs multiple shards for multitenancy

2017-05-06 Thread Chris Troullis
Hi, I use Solr to serve multiple tenants and currently all tenant's data resides in one large collection, and queries have a tenant identifier. This works fine with aggressive autowarming, but I have a need to reduce my NRT search capabilities to seconds as opposed to the minutes it is at now, whi

RE: Overseer session expires on multiple collection creation

2017-05-06 Thread apoorvqwerty
So i figured out the issue i was facing https://issues.apache.org/jira/browse/SOLR-9803 ${solr.ulog.dir:} ${solr.ulog.numVersionBuckets:8388608} i had a huge value set fir numVersioinBuckets which was causing memory leak as stated in issue 9803 Changing to default value s