Re: Sorting and JVM heap size ....

2008-11-28 Thread Chris Hostetter
: Subject: Sorting and JVM heap size : In-Reply-To: <[EMAIL PROTECTED]> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not reply to an existing message, instead start a fresh email. Even

Re: Sorting and JVM heap size ....

2008-11-25 Thread Shalin Shekhar Mangar
On Tue, Nov 25, 2008 at 9:37 PM, souravm <[EMAIL PROTECTED]> wrote: > > Could you please explain a bit more on how the new searcher can double the > memory ? > Take a look at slide 13 of Yonik's presentation available at http://people.apache.org/~yonik/ApacheConEU2006/Solr.ppt Each searcher in S

RE: Sorting and JVM heap size ....

2008-11-25 Thread souravm
:40 AM To: solr-user@lucene.apache.org Cc: souravm Subject: Re: Sorting and JVM heap size On Tue, Nov 25, 2008 at 7:49 AM, souravm <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote: 3. Another case is - if there are 2 search requests concurrently hitting the server, each wit

Re: Sorting and JVM heap size ....

2008-11-25 Thread Shalin Shekhar Mangar
On Tue, Nov 25, 2008 at 7:49 AM, souravm <[EMAIL PROTECTED]> wrote: > > 3. Another case is - if there are 2 search requests concurrently hitting > the server, each with sorting on the same 20 character date field, then also > it would need 2x2GB memory. So if I know that I need to support at least

RE: Sorting and JVM heap size ....

2008-11-24 Thread souravm
Thanks Yonik. It explains. Regards, Sourav -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent: Monday, November 24, 2008 7:07 PM To: solr-user@lucene.apache.org Subject: Re: Sorting and JVM heap size On Mon, Nov 24, 2008 at 9:19 PM

Re: Sorting and JVM heap size ....

2008-11-24 Thread Yonik Seeley
ed to start the JVM at least with 8 GB heap > size. > > Please let me know if my understanding is correct. > > Regards, > Sourav > > -Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley > Sent: Monday, November 24, 200

RE: Sorting and JVM heap size ....

2008-11-24 Thread souravm
correct. Regards, Sourav -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent: Monday, November 24, 2008 6:03 PM To: solr-user@lucene.apache.org Subject: Re: Sorting and JVM heap size On Mon, Nov 24, 2008 at 8:48 PM, souravm <[EM

Re: Sorting and JVM heap size ....

2008-11-24 Thread Yonik Seeley
On Mon, Nov 24, 2008 at 8:48 PM, souravm <[EMAIL PROTECTED]> wrote: > I have around 200M documents in index. The field I'm sorting on is a date > string (containing date and time in dd-mmm- hh:mm:yy format) and the > field is part of the search criteria. > > Also please note that the number

RE: Sorting and JVM heap size ....

2008-11-24 Thread souravm
t: Re: Sorting and JVM heap size On Mon, Nov 24, 2008 at 6:26 PM, souravm <[EMAIL PROTECTED]> wrote: > I have indexed data of size around 20GB. My JVM memory is 1.5GB. > > For this data if I do a query with sort flag on (for a single field) I always > get java out of memor

Re: Sorting and JVM heap size ....

2008-11-24 Thread Yonik Seeley
On Mon, Nov 24, 2008 at 6:26 PM, souravm <[EMAIL PROTECTED]> wrote: > I have indexed data of size around 20GB. My JVM memory is 1.5GB. > > For this data if I do a query with sort flag on (for a single field) I always > get java out of memory exception even if the number of hit is 0. With no > sor

Sorting and JVM heap size ....

2008-11-24 Thread souravm
Hi, I have indexed data of size around 20GB. My JVM memory is 1.5GB. For this data if I do a query with sort flag on (for a single field) I always get java out of memory exception even if the number of hit is 0. With no sorting (or default sorting with score) the query works perfectly fine.` I