Re: OutOfMemory error while sorting

2006-06-14 Thread Yonik Seeley
On 6/14/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: Off the top of my head, i don't remember if omiting norms for fields reduces the amount of resident memory needed by the index It does indeed. 1 byte per document for the indexed field. -Yonik

Re: OutOfMemory error while sorting

2006-06-14 Thread Chris Hostetter
This is a fairly typical Lucene issue (ie: not specific to Solr)... Sorting on a field requires building a FieldCache for every document -- regardless of how many documents match your query. This cache is reused for all searches thta sort on that field. For things like Integers and Floats, the

custom query response writer

2006-06-14 Thread Erik Hatcher
I'm now implementing a custom QueryResponseWriter in order to inject some additional information into the output. I still am generating XML output, for the time being, but just with more information per document (it will read field information from other documents that are linked to the on

OutOfMemory error while sorting

2006-06-14 Thread Marcus Stratmann
Hello, I have a new problem with OutOfMemory errors. As I reported before, we have an index with more than 10 million documents and 23 fields. Recently I added a new field which we will only use for sorting purposes (by "adding" I mean building a new index). But it turned out that every query