RE: Error with bin/optimize and multiple solr webapps

2007-03-06 Thread Graham Stead
Apologies in advance if SOLR-187 and SOLR-188 look the same -- they are the same issue. I have been using adjusted scripts locally but hadn't used Jira before and wasn't sure of the process. I decided to figure it out after answering Gola's question this morning...then saw that Jeff had mentioned a

RE: Time after snapshot is "visible" on the slave

2007-03-06 Thread Graham Stead
I forgot to mention that the admin page (solr/admin/stats.jsp) is an excellent way to see when the last searcher was opened. After running commit, you should see update to the openedAt and registeredAt timestamps, e.g.,: openedAt : Tue Mar 06 08:14:19 PST 2007 registeredAt : Tue Mar 06 08:15:55 PS

RE: Time after snapshot is "visible" on the slave

2007-03-06 Thread Graham Stead
Hi Galo, The snapinstaller actually performs a commit as its last step, so if that didn't work, it's not surprising that running commit separately didn't work, either. I would suggest running the snapinstaller and/or commit scripts with the -V option. This will produce verbose debugging informati

RE: 'accumulate' copyField for faceting

2007-03-01 Thread Graham Stead
Sorry for interloping, but I have been wondering the same thing as Ryan. On my current index with ~6.1M docs, I restarted Solr and ran a query that included faceting on 4 fields: QTime: 5712 numFound: 25908 filterCache stats: lookups : 0 hits : 0 hitratio : 0.00 ins

RE: Incremental replication...

2007-02-13 Thread Graham Stead
We have used replication for a few weeks now and it generally works well. I believe you'll find that commit operations cause only new segments to be transferred, whereas optimize operations cause the entire index to be transferred. Therefore, the amount of data transferred really depends on how fr

RE: Gentoo: problem with xml-apis.jar/Apache Tomcat Native Library

2007-02-12 Thread Graham Stead
I'm afraid I don't have the answer, I can only add that we also had this problem. We later installed the official Tomcat binary, but still get the "optimal performance in production environments" error notification. -Graham

RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
Thanks, Chris. I will test with vanilla Solr to clarify whether the problem occurs with it, or only in the version where we have made changes. -Graham > : To tweak our scoring, a custom hit collector in > SolrIndexSearcher creates 1 > : fieldCache and 3 ValueSources from 3 fields: > : - an inte

RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
> > Our queries do not sort by any field. However, we do make use of > > FunctionQueries and a typical query is something like: > > > > users_query AND (+linear_function_query > +recip_function_query > > +language:english^0 -flags:spam^0) > > Function queries often build fieldCaches--on

RE: Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
Mike, Yonik, thanks for the quick reply. > I think it is in your queries. Are you sorting on many > fields? What is a typical query? I'm not a lucene expert, > but there are lucene experts on this list. Our queries do not sort by any field. However, we do make use of FunctionQueries and a

Debugging Solr memory usage/heap problems

2007-02-06 Thread Graham Stead
Hi everyone, My Solr JVM runs out of heap space quite frequently. I'm trying to understand Solr/Lucene's memory usage so I can address the problem correctly. Otherwise, I feel I'm taking random shots in the dark. I've tried previous troubleshooting suggestions. Here's what I've done: 1) Incre

RE: Function boosts...

2006-12-29 Thread Graham Stead
I believe two concepts are getting slightly mixed here: the LinearFloatFunction, which is a Solr FunctionQuery, and the original Lucene scoring methodology. FunctionQueries are not part of vanilla Lucene, so you will not explicitly see them mentioned in the Lucene similarity documents. The best wa