RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
Thanks, Chris. I will test with vanilla Solr to clarify whether the problem occurs with it, or only in the version where we have made changes. -Graham > : To tweak our scoring, a custom hit collector in > SolrIndexSearcher creates 1 > : fieldCache and 3 ValueSources from 3 fields: > : - an inte

RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Chris Hostetter
: To tweak our scoring, a custom hit collector in SolrIndexSearcher creates 1 : fieldCache and 3 ValueSources from 3 fields: : - an integer field with many unique values (order 10^4) : - another integer field with many unique values (order 10^4) : - an integer field with hundreds of unique values

RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
> > Our queries do not sort by any field. However, we do make use of > > FunctionQueries and a typical query is something like: > > > > users_query AND (+linear_function_query > +recip_function_query > > +language:english^0 -flags:spam^0) > > Function queries often build fieldCaches--on

Re: Debugging Solr memory usage/heap problems

2007-02-06 Thread Mike Klaas
On 2/6/07, Graham Stead <[EMAIL PROTECTED]> wrote: Our queries do not sort by any field. However, we do make use of FunctionQueries and a typical query is something like: users_query AND (+linear_function_query +recip_function_query +language:english^0 -flags:spam^0) Function queries

RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
Mike, Yonik, thanks for the quick reply. > I think it is in your queries. Are you sorting on many > fields? What is a typical query? I'm not a lucene expert, > but there are lucene experts on this list. Our queries do not sort by any field. However, we do make use of FunctionQueries and a

Re: Debugging Solr memory usage/heap problems

2007-02-06 Thread Yonik Seeley
On 2/6/07, Graham Stead <[EMAIL PROTECTED]> wrote: Hi everyone, My Solr JVM runs out of heap space quite frequently. I'm trying to understand Solr/Lucene's memory usage so I can address the problem correctly. Otherwise, I feel I'm taking random shots in the dark. I've tried previous troubleshoo

Re: Debugging Solr memory usage/heap problems

2007-02-06 Thread Mike Klaas
On 2/6/07, Graham Stead <[EMAIL PROTECTED]> wrote: Hi everyone, My Solr JVM runs out of heap space quite frequently. I'm trying to understand Solr/Lucene's memory usage so I can address the problem correctly. Otherwise, I feel I'm taking random shots in the dark. <> 4) In solrconfig.xml, I s

Re: Analyzers and Tokenizers?

2007-02-06 Thread rubdabadub
Thanks Thorsten! On 2/6/07, Thorsten Scherler <[EMAIL PROTECTED]> wrote: On Tue, 2007-02-06 at 17:27 +0100, rubdabadub wrote: > Hi: > > Are there more filters/tokenizers then the ones mentioned here..? > > http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters > > I have found in the exampl

Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
Hi everyone, My Solr JVM runs out of heap space quite frequently. I'm trying to understand Solr/Lucene's memory usage so I can address the problem correctly. Otherwise, I feel I'm taking random shots in the dark. I've tried previous troubleshooting suggestions. Here's what I've done: 1) Incre

Re: Spelling

2007-02-06 Thread Mike Klaas
On 2/6/07, Michael Kimsal <[EMAIL PROTECTED]> wrote: When you say rewrite the query, what specifically do you mean? I'm googling (direct and on the solr site) for query.rewrite, but nothing is jumping out at me as anything that's useful/pertinent. It sounds like you're telling me to do some ma

Re: Analyzers and Tokenizers?

2007-02-06 Thread Thorsten Scherler
On Tue, 2007-02-06 at 17:27 +0100, rubdabadub wrote: > Hi: > > Are there more filters/tokenizers then the ones mentioned here..? > > http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters > > I have found in the example/schema.xml, which are new ... > > sortMissingLast="true" omitNorms="t

Analyzers and Tokenizers?

2007-02-06 Thread rubdabadub
Hi: Are there more filters/tokenizers then the ones mentioned here..? http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters I have found in the example/schema.xml, which are new ... more Is there any complete list somewhere ..or how can I find more info abou

Re: [solrb] Win32 Functional Tests and patches...

2007-02-06 Thread Sergey Polzunov
Windows users? :) I apologize for interrupting, I'm windows Solr user too. At least I'm playing with Solr on work-machine with Windows On 2/6/07, Mel Riffe <[EMAIL PROTECTED]> wrote: On 2/6/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: > > > On Feb 5, 2007, at 11:50 PM, Mel Riffe wrote: > > I hav

Re: [solrb] Win32 Functional Tests and patches...

2007-02-06 Thread Mel Riffe
On 2/6/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: On Feb 5, 2007, at 11:50 PM, Mel Riffe wrote: > I have a first pass at getting the test server to come up in a win32 > environment. Fantastic! Now both of you will soon be able to test solrb on Windows ;) > So I would like to know how to

Re: few questions

2007-02-06 Thread Sergey Polzunov
Thank you for your answers. -- Best regards, Polzunov Sergei e-mail: [EMAIL PROTECTED] ICQ: #204206246

Re: few questions

2007-02-06 Thread Yonik Seeley
On 2/6/07, Sergey Polzunov <[EMAIL PROTECTED]> wrote: Hello all! I have few questions. I'm digging into Solr server only 3 days and maybe didn't get something, so I would appreciate for any useful links with info about Solr configuring Questions are: 1. What about cache persistent? I've noticed

few questions

2007-02-06 Thread Sergey Polzunov
Hello all! I have few questions. I'm digging into Solr server only 3 days and maybe didn't get something, so I would appreciate for any useful links with info about Solr configuring Questions are: 1. What about cache persistent? I've noticed that there are 3 cache types. If there will be interru

Re: Spelling

2007-02-06 Thread Michael Kimsal
This isn't something I use that approach on. Let me explain. I work in a call center, and I'm doing a search for specific key word in customer notes every night. For example, we might need a report of which customers called up about "apple", "banana" or "pear". I have a script which generates a

Re: Spelling

2007-02-06 Thread Erik Hatcher
Doesn't the built-in Solr Highlighting feature do the rewrite? If not, it should. I looked into this once and I believe it does have this particular bug, but I also vaguely recall it not being straightforward to rewrite the query at that point in the code. Erik On Feb 6, 2007, a

Re: Spelling

2007-02-06 Thread karl wettin
6 feb 2007 kl. 04.19 skrev Michael Kimsal: Thanks Erik. That worked, then threw me for another loop, which I sort of have fixed I think. I'm using the highligher functionality, but it doesn't seem to highlight the 'matched' word if it's a partial match, although it does in fact return t

Re: [solrb] Win32 Functional Tests and patches...

2007-02-06 Thread Erik Hatcher
On Feb 5, 2007, at 11:50 PM, Mel Riffe wrote: I have a first pass at getting the test server to come up in a win32 environment. Fantastic! Now both of you will soon be able to test solrb on Windows ;) So I would like to know how to submit a patch. Pleasantly enough, we have this:

Re: convert custom facets to Solr facets...

2007-02-06 Thread Erik Hatcher
Yonik - this is great! Thanks for codifying the use cases and providing a possible implementation. I'll tinker with this more when I can. Erik On Feb 4, 2007, at 2:13 PM, Yonik Seeley wrote: I was confusing myself too much without nailing down more concrete examples, so I too

Re: Questions about facets?

2007-02-06 Thread Erik Hatcher
Just to clarify something that you mentioned for others... a facet field name can be anything of your choosing. Solr itself does not have any special naming conventions on any field. But, I am establishing some field naming conventions for the Ruby work in solrb/Flare with a customized sch