Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-22 Thread Shawn Heisey
On 3/22/2013 8:54 AM, Per Steffensen wrote: > Me too. I will find out soon - I hope! But re-indexing is kinda a > problem for us, but we will figure out. > Any "guide to re-index all you stuff" anywhere, so I do it the easiest > way? Guess maybe there are some nice tricks about steaming data direct

Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-22 Thread Per Steffensen
On 3/21/13 10:50 PM, Shawn Heisey wrote: On 3/21/2013 4:05 AM, Per Steffensen wrote: Can anyone else elaborate? How to "activate" it? How to make sure, for sorting, that sort-field-value for all docs are not read into memory for sorting - leading to OOM when you have a lot of docs? Can this feat

Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-21 Thread Shawn Heisey
On 3/21/2013 4:05 AM, Per Steffensen wrote: Can anyone else elaborate? How to "activate" it? How to make sure, for sorting, that sort-field-value for all docs are not read into memory for sorting - leading to OOM when you have a lot of docs? Can this feature be activated on top of an existing 4.0

Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-21 Thread Per Steffensen
On 3/21/13 10:52 AM, Toke Eskildsen wrote: On Thu, 2013-03-21 at 09:57 +0100, Per Steffensen wrote: Thanks Toke! Can you please elaborate a little bit? How to use it? What it is supposed to do for you? Sorry, no, I only know about it on the abstract level. The release notes for Solr 4.2 says *

Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-21 Thread Toke Eskildsen
On Thu, 2013-03-21 at 09:57 +0100, Per Steffensen wrote: > Thanks Toke! Can you please elaborate a little bit? How to use it? What > it is supposed to do for you? Sorry, no, I only know about it on the abstract level. The release notes for Solr 4.2 says * DocValues have been integrated into Solr

Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-21 Thread Per Steffensen
On 3/21/13 9:48 AM, Toke Eskildsen wrote: On Thu, 2013-03-21 at 09:13 +0100, Per Steffensen wrote: We have a lot of docs in Solr. Each particular Solr-node handles a lot of docs distributed among several replica. When you issue a sort query, it seems to me that, the value of the sort-field of AL

Re: Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-21 Thread Toke Eskildsen
On Thu, 2013-03-21 at 09:13 +0100, Per Steffensen wrote: > We have a lot of docs in Solr. Each particular Solr-node handles a lot > of docs distributed among several replica. When you issue a sort query, > it seems to me that, the value of the sort-field of ALL docs under the > Solr-node is adde

Sort-field for ALL docs in FieldCache for sort queries -> OOM on lots of docs

2013-03-21 Thread Per Steffensen
Hi We have a lot of docs in Solr. Each particular Solr-node handles a lot of docs distributed among several replica. When you issue a sort query, it seems to me that, the value of the sort-field of ALL docs under the Solr-node is added to the FieldCache. This leads to OOM-exceptions at some p