Distributed Search - only get ids

2009-04-29 Thread Joe Pollard
Solr 1.3: If I am only getting back the document ids from a distributed search (e.g., uniqueid is 'id' and the fl parameter only contains 'id'), there seems to be some room for optimization in the current code path: 1) On each shard, grab top N sorted document ids & sort fields) 2) M

_val:ord(field) (from wiki LargeIndexes)

2009-04-07 Thread Joe Pollard
I see this interesting line in the wiki page LargeIndexes http://wiki.apache.org/solr/LargeIndexes (sorting section towards the bottom) Using _val:ord(field) as a search term will sort the results without incurring the memory cost. I'd like to know what this means, but I'm having a bit of trou

RE: Coming up with a model of memory usage

2009-04-07 Thread Joe Pollard
up > to you to decide whether or not it's worth the effort > > Best > Erick > > On Tue, Apr 7, 2009 at 10:55 AM, Joe Pollard > wrote: > >> It doesn't seem to matter whether fields are stored or not, but I've >> found a rather striking diff

RE: Coming up with a model of memory usage

2009-04-07 Thread Joe Pollard
ecide whether or not it's worth the effort Best Erick On Tue, Apr 7, 2009 at 10:55 AM, Joe Pollard wrote: > It doesn't seem to matter whether fields are stored or not, but I've > found a rather striking difference in the memory requirements during > sorting. Sorting o

RE: Coming up with a model of memory usage

2009-04-07 Thread Joe Pollard
Cool, great resource, thanks. -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Tuesday, April 07, 2009 10:13 AM To: solr-user@lucene.apache.org Subject: Re: Coming up with a model of memory usage On Tue, Apr 7, 2009 at 8:25 PM, Joe Pollard wrote: >

Re: Coming up with a model of memory usage

2009-04-07 Thread Joe Pollard
by '2008-08-12' and then by '121826'. Any other tips/guidance like this would be great! Thanks, -Joe On Mon, 2009-04-06 at 15:43 -0500, Joe Pollard wrote: > To combat our frequent OutOfMemory Exceptions, I'm attempting to come up > with a model so that we can determi

Coming up with a model of memory usage

2009-04-06 Thread Joe Pollard
To combat our frequent OutOfMemory Exceptions, I'm attempting to come up with a model so that we can determine how much memory to give Solr based on how much data we have (as we expand to more data types eligible to be supported this becomes more important). Are there any published guidelines on h

RE: Best way to unit test solr integration

2009-03-27 Thread Joe Pollard
t; solr works the same as your integration/test environment Solr. Eric On Mar 27, 2009, at 11:59 AM, Joe Pollard wrote: > Hello, > > On our project, we have quite a bit of code used to generate Solr > queries, and I need to create some unit tests to ensure that these > cont

Best way to unit test solr integration

2009-03-27 Thread Joe Pollard
Hello, On our project, we have quite a bit of code used to generate Solr queries, and I need to create some unit tests to ensure that these continue to work. In addition, I need to generate some unit tests that will test indexing and retrieval of certain documents, based on our current schema

combining negative queries and OR

2008-11-03 Thread Joe Pollard
I am trying to decide if this is a solr or a lucene problem, using solr 1.3: take this example -- (-productName:"whatever") OR (anotherField:"Johnny") I would expect to get back records that have anotherField=Johnny, but also, any records that don't have 'whatever' as the productName. However