Re: Recovery Thread Blocked

2015-10-06 Thread Rallavagu
It is java thread though. Does it need increasing OS level threads? On 10/6/15 6:21 PM, Mark Miller wrote: If it's a thread and you have plenty of RAM and the heap is fine, have you checked raising OS thread limits? - Mark On Tue, Oct 6, 2015 at 4:54 PM Rallavagu wrote: GC logging shows nor

Re: Recovery Thread Blocked

2015-10-06 Thread Mark Miller
If it's a thread and you have plenty of RAM and the heap is fine, have you checked raising OS thread limits? - Mark On Tue, Oct 6, 2015 at 4:54 PM Rallavagu wrote: > GC logging shows normal. The "OutOfMemoryError" appears to be pertaining > to a thread but not to JVM. > > On 10/6/15 1:07 PM, Ma

Re: Recovery Thread Blocked

2015-10-06 Thread Rallavagu
GC logging shows normal. The "OutOfMemoryError" appears to be pertaining to a thread but not to JVM. On 10/6/15 1:07 PM, Mark Miller wrote: That amount of RAM can easily be eaten up depending on your sorting, faceting, data. Do you have gc logging enabled? That should describe what is happenin

Re: Recovery Thread Blocked

2015-10-06 Thread Mark Miller
That amount of RAM can easily be eaten up depending on your sorting, faceting, data. Do you have gc logging enabled? That should describe what is happening with the heap. - Mark On Tue, Oct 6, 2015 at 4:04 PM Rallavagu wrote: > Mark - currently 5.3 is being evaluated for upgrade purposes and >

Re: Recovery Thread Blocked

2015-10-06 Thread Rallavagu
Mark - currently 5.3 is being evaluated for upgrade purposes and hopefully get there sooner. Meanwhile, following exception is noted from logs during updates ERROR org.apache.solr.update.CommitTracker – auto commit error...:java.lang.IllegalStateException: this writer hit an OutOfMemoryError

Re: Recovery Thread Blocked

2015-10-05 Thread Mark Miller
I'd make two guess: Looks like you are using Jrocket? I don't think that is common or well tested at this point. There are a billion or so bug fixes from 4.6.1 to 5.3.2. Given the pace of SolrCloud, you are dealing with something fairly ancient and so it will be harder to find help with older iss

Re: Recovery Thread Blocked

2015-10-05 Thread Rallavagu
Any takers on this? Any kinda clue would help. Thanks. On 10/4/15 10:14 AM, Rallavagu wrote: As there were no responses so far, I assume that this is not a very common issue that folks come across. So, I went into source (4.6.1) to see if I can figure out what could be the cause. The thread th

Re: Recovery Thread Blocked

2015-10-04 Thread Rallavagu
As there were no responses so far, I assume that this is not a very common issue that folks come across. So, I went into source (4.6.1) to see if I can figure out what could be the cause. The thread that is locking is in this block of code synchronized (recoveryLock) { // to be air tigh

Re: Recovery Thread Blocked

2015-10-02 Thread Rallavagu
Here is the stack trace of the thread that is holding the lock. "Thread-55266" id=77142 idx=0xc18 tid=992 prio=5 alive, waiting, native_blocked, daemon -- Waiting for notification on: org/apache/solr/cloud/RecoveryStrategy@0x3f34e8480[fat lock] at pthread_cond_wait@@GLIBC_2.3.2+202(:0