Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-19 Thread Steve Rowe
I’m glad it’s working for you now, thanks for reporting back. - Steve On Mar 19, 2014, at 5:32 AM, Martin de Vries wrote: > We are running stable now for a full day, so the bug has been fixed. > > Many thanks! > > Martin

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-19 Thread Martin de Vries
We are running stable now for a full day, so the bug has been fixed. Many thanks! Martin

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-18 Thread Till Kinstler
Am 18.03.2014 15:26, schrieb Martin de Vries: Martin, I’ve committed the SOLR-5875 fix, including to the lucene_solr_4_7 branch. Any chance you could test the fix? Hi Steve, I'm very happy you found the bug. We are running the version from SVN on one server and it's already running fine for 5

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-18 Thread Martin de Vries
Martin, I’ve committed the SOLR-5875 fix, including to the lucene_solr_4_7 branch. Any chance you could test the fix? Hi Steve, I'm very happy you found the bug. We are running the version from SVN on one server and it's already running fine for 5 hours. If it's still stable tomorrow than w

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-17 Thread Walter Underwood
Thanks. That is probably worth a mention in the bug and release notes. --wunder On Mar 17, 2014, at 9:33 AM, Steve Rowe wrote: > No, only QueryComponent.mergeIds() is only called for distributed queries. > > Steve > > On Mar 17, 2014, at 12:18 PM, Walter Underwood wrote: > >> Does this bug

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-17 Thread Steve Rowe
No, only QueryComponent.mergeIds() is only called for distributed queries. Steve On Mar 17, 2014, at 12:18 PM, Walter Underwood wrote: > Does this bug happen in the non-sharded case? --wunder > > On Mar 17, 2014, at 9:15 AM, Steve Rowe wrote: > >> Martin, I’ve committed the SOLR-5875 fix, in

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-17 Thread Walter Underwood
Does this bug happen in the non-sharded case? --wunder On Mar 17, 2014, at 9:15 AM, Steve Rowe wrote: > Martin, I’ve committed the SOLR-5875 fix, including to the lucene_solr_4_7 > branch. > > Any chance you could test the fix? > > Thanks, > Steve > > On Mar 17, 2014, at 11:16 AM, Steve Rowe

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-17 Thread Steve Rowe
Martin, I’ve committed the SOLR-5875 fix, including to the lucene_solr_4_7 branch. Any chance you could test the fix? Thanks, Steve On Mar 17, 2014, at 11:16 AM, Steve Rowe wrote: > Martin, > > You’re right, a bug was introduced by SOLOR-5354. I’ve opened an issue >

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-17 Thread Steve Rowe
Martin, You’re right, a bug was introduced by SOLOR-5354. I’ve opened an issue and will commit the fix shortly. I hope to include this fix in a 4.7.1 release. Steve On Mar 8, 2014, at 1:32 AM, Martin de Vries wrote: >> The memory leak seems

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-10 Thread Martin de Vries
Hi, When our server crashes the memory fills up fast. So I think it might be a specific query that causes our servers to crash. I think the query won't be logged because it doesn't finish. Is there anything we can do to see the currently running queries in de Solr server (so when can see them

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-07 Thread Martin de Vries
The memory leak seems to be in: org.apache.solr.handler.component.ShardFieldSortedHitQueue I think our issue might be related to this one, because this change has been introduced in 4.7 and has changes to ShardFieldSortedHitQueue: https://issues.apache.org/jira/browse/SOLR-5354 Is the memor

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-07 Thread Martin de Vries
> IndexSchema is using 62% of the memory That seems odd. Can you see what objects are taking all the RAM in the IndexSchema? We investigated this and found out that a dictionary was loaded for each core, taking loads of memory. We the the config to shareSchema=true. The memory usage decreas

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-07 Thread Martin de Vries
We parsed the "Unreachable Objects" of the memory dump. The memory leak seems to be in: org.apache.solr.handler.component.ShardFieldSortedHitQueue https://www.dropbox.com/s/hdv49xlb4g4wi03/Screenshot%202014-03-07%2016.51.56.png Martin

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-06 Thread Shawn Heisey
On 3/6/2014 3:37 PM, Martin de Vries wrote: > We have 5 Solr servers in a Cloud with about 70 cores and 12GB > indexes in total (every core has 2 shards, so it's 6 GB per server). > > After upgrade to Solr 4.7 the Solr servers are crashing constantly > (each server about one time per hour). We cur

Re: SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-06 Thread Mark Miller
On Mar 6, 2014, at 5:37 PM, Martin de Vries wrote: > IndexSchema is using 62% of the memory but we don't know if that's a > problem: That seems odd. Can you see what objects are taking all the RAM in the IndexSchema? - Mark http://about.me/markrmiller

SolrCloud constantly crashes after upgrading to Solr 4.7

2014-03-06 Thread Martin de Vries
Hi, We have 5 Solr servers in a Cloud with about 70 cores and 12GB indexes in total (every core has 2 shards, so it's 6 GB per server). After upgrade to Solr 4.7 the Solr servers are crashing constantly (each server about one time per hour). We currently don't have any clue about the reason.