>> Since you've already reproduced it on a small scale, we'll need your entire 
>> Solr logfile.  The mailing list eats attachments, so you'll need to place it 
>> somewhere and provide a URL.  Sites like gist and dropbox are excellent for 
>> sharing large text content.

Sure. I will try and sent it across. However I don’t see anything in them. I 
have FINE level logs.

>> Do you literally mean 10 records (a number I can count on my fingers)? 
How much data is in each of those DB records?  Which configset did you use when 
creating the index?

Yes. Crazy right. Actually the select query I gave will yield 10 records only. 
Total records in the table is 200,000. I restricted the query to reproduce the 
issue in small scale. This issue started appearing in my QA, where, one time we 
happen to have an accidently frequent hard commit by two batch jobs. There is 
no autocommit set in solrconfig. Only the batch jobs send a commit. I was never 
able to recover the collection so I had to delete the data and reindex to fix 
it. Hence decided to reproduce the issue in very small scale and trying to fix 
it because deleting data and reindex cannot be a fix. DB records are just 
normal varchars. Some 7 columns. I don’t think data is the problem.

I cloned the 'solr-5.3.2\example\example-DIH\solr\db' and added some addition 
fields and removed unused default fields.

>> You mentioned a 10GB heap and then said the machine has 8GB of RAM.  Is this 
>> correct?  If so, this would be a source of serious performance issues.

OOPPSS. Its 1 GB heap. That was a typo. The consumed heap is around 300-400 MB.

Thank you,
Aswath NS


-----Original Message-----
From: Shawn Heisey [mailto:apa...@elyograg.org] 
Sent: Tuesday, March 22, 2016 10:41 AM
To: solr-user@lucene.apache.org
Subject: Re: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

On 3/22/2016 11:32 AM, Aswath Srinivasan (TMS) wrote:
> Thank you Shawn for taking time and responding.
>
> Unfortunately, this is not the case. My heap is not even going past 
> 50% and I have a heap of 10 GB on a instance that I just installed as 
> a standalone version and was only trying out these,
>
> •       Install a standalone solr 5.3.2 in my PC
> •       Indexed some 10 db records
> •       Hit core reload/call commit frequently in quick internals
> •       Seeing the  o.a.s.c.SolrCore [db] PERFORMANCE WARNING: Overlapping 
> onDeckSearchers=2
> •       Collection crashes
> •       Only way to recover is to stop solr – delete the data folder – start 
> solr – reindex
>
> In any case, if this heap related issue, a solr restart should help, is what 
> I think.

That shouldn't happen.

Since you've already reproduced it on a small scale, we'll need your entire 
Solr logfile.  The mailing list eats attachments, so you'll need to place it 
somewhere and provide a URL.  Sites like gist and dropbox are excellent for 
sharing large text content.

More questions:

Do you literally mean 10 records (a number I can count on my fingers)? 
How much data is in each of those DB records?  Which configset did you use when 
creating the index?

You mentioned a 10GB heap and then said the machine has 8GB of RAM.  Is this 
correct?  If so, this would be a source of serious performance issues.

Thanks,
Shawn

Reply via email to