Re: Performance when indexing or cold cache

2009-04-10 Thread sunnyfr
Hi Walter, Did you find a way to sort out your issue, I would be very interested. Thanks a lot, Walter Underwood wrote: > > We've had some performance problems while Solr is indexing and also when > it > starts with a cold cache. I'm still digging through our own logs, but I'd > like to get mo

Re: Any tips for indexing large amounts of data?

2009-04-10 Thread sunnyfr
ok but how people do for a frequent update for a large dabase and lot of query on it ? do they turn off the slave during the warmup ?? Noble Paul നോബിള്‍ नोब्ळ् wrote: > > On Thu, Apr 9, 2009 at 8:51 PM, sunnyfr wrote: >> >> Hi Otis, >> How did you manage that? I've 8 core machine with 8GB o

Re: multiple tokenizers needed

2009-04-10 Thread Grant Ingersoll
The only thing that comes to mind in a short term way is writing two TokenFilter implementations that wrap the second and third tokenizers On Apr 9, 2009, at 11:00 PM, Ashish P wrote: I want to analyze a text based on pattern ";" and separate on whitespace and it is a Japanese text so use

Re: Question on Solr Distributed Search

2009-04-10 Thread Shalin Shekhar Mangar
On Fri, Apr 10, 2009 at 7:50 AM, vivek sar wrote: > Just an update. I changed the schema to store the unique id field, but > I still get the connection reset exception. I did notice that if there > is no data in the core then it returns the 0 result (no exception), > but if there is data and you

QueryElevationComponent : hot update of elevate.xml

2009-04-10 Thread Nicolas Pastorino
Hello ! Browsing the mailing-list's archives did not help me find the answer, hence the question asked directly here. Some context first : Integrating Solr with a CMS ( eZ Publish ), we chose to support Elevation. The idea is to be able to 'elevate' any object from the CMS. This can be a

Re: Any tips for indexing large amounts of data?

2009-04-10 Thread Noble Paul നോബിള്‍ नोब्ळ्
they don't usually turn off the slave , but it is not a bad idea if you can take it offline. It is a logistical headache. BTW do you have very good cache hit ratio? then it makes sense to autowarm . --Noble On Fri, Apr 10, 2009 at 4:07 PM, sunnyfr wrote: > > ok but how people do for a frequent u

Re: multiple tokenizers needed

2009-04-10 Thread Erik Hatcher
Or have the indexing client split the data at these delimiters and just use the CJKAnalyzer. Erik On Apr 10, 2009, at 7:30 AM, Grant Ingersoll wrote: The only thing that comes to mind in a short term way is writing two TokenFilter implementations that wrap the second and third token

Re: QueryElevationComponent : hot update of elevate.xml

2009-04-10 Thread Ryan McKinley
On Apr 10, 2009, at 7:48 AM, Nicolas Pastorino wrote: Hello ! Browsing the mailing-list's archives did not help me find the answer, hence the question asked directly here. Some context first : Integrating Solr with a CMS ( eZ Publish ), we chose to support Elevation. The idea is to be a

Re: Additive filter queries

2009-04-10 Thread Matthew Runo
That would work, but the other part of our problem comes in when we then try to facet on the resulting set.. If we filter by size 1, for example, and then facet Width again - we get facet results that have no size 1's, because we have no taught solr what 1_W means, etc etc.. I think field c

Index Version Number

2009-04-10 Thread Richard Wiseman
Is it possible for a Solr client to determine if the index has changed since the last time it performed a query? For example, is it possible to query the current Lucene indexVersion? Thanks in advance for your help, Richard

Re: Question on Solr Distributed Search

2009-04-10 Thread vivek sar
yes - it's all new indexes. I can search them individually, but adding "shards" throws "Connection Reset" error. Is there any way I can debug this or any other pointers? -vivek On Fri, Apr 10, 2009 at 4:49 AM, Shalin Shekhar Mangar wrote: > On Fri, Apr 10, 2009 at 7:50 AM, vivek sar wrote: > >>

Re: Help with relevance failure in Solr 1.3

2009-04-10 Thread Walter Underwood
If you don't see the attachments, you can get them here: http://wunderwood.org/solr/ wunder On 4/10/09 10:56 AM, "Walter Underwood" wrote: > We have a rare, hard-to-reproduce problem with our Solr 1.3 servers, and > I would appreciate any ideas. > > Ocassionally, a server will start returning

Help with relevance failure in Solr 1.3

2009-04-10 Thread Walter Underwood
We have a rare, hard-to-reproduce problem with our Solr 1.3 servers, and I would appreciate any ideas. Ocassionally, a server will start returning results with really poor relevance. Single term queries work fine, but multi-term queries are scored based on the most common term (lowest IDF). I don

Re: Help with relevance failure in Solr 1.3

2009-04-10 Thread Grant Ingersoll
On Apr 10, 2009, at 1:56 PM, Walter Underwood wrote: We have a rare, hard-to-reproduce problem with our Solr 1.3 servers, and I would appreciate any ideas. Ocassionally, a server will start returning results with really poor relevance. Single term queries work fine, but multi-term queries ar

Re: Index Version Number

2009-04-10 Thread Grant Ingersoll
This info is available via the Luke Handler, I believe: http://localhost:8983/solr/admin/luke/ : In there, I see: version, current, optimized and true information. See also http://wiki.apache.org/solr/LukeRequestHandler HTH, Grant On Apr 10, 2009, at 11:58 AM, Richard Wiseman wrote: Is it po

Question on StreamingUpdateSolrServer

2009-04-10 Thread vivek sar
Hi, I was using CommonsHttpSolrServer for indexing, but having two threads writing (10K batches) at the same time was throwing, "ProtocolException: Unbuffered entity enclosing request can not be repeated. " I switched to StreamingUpdateSolrServer (using addBeans) and I don't see the problem a

Re: Help with relevance failure in Solr 1.3

2009-04-10 Thread Walter Underwood
Normally, both "changeling" and "the changeling" work fine. This one server is misbehaving like this for all multi-term queries. Yes, it is VERY weird that the term "changeling" does not show up in the explain. A server will occasionally "go bad" and stay in that state. In one case, two servers w

Re: Question on StreamingUpdateSolrServer

2009-04-10 Thread vivek sar
I also noticed that the Solr app has over 6000 file handles open - "lsof | grep solr | wc -l" - shows 6455 I've 10 cores (using multi-core) managed by the same Solr instance. As soon as start up the Tomcat the open file count goes up to 6400. Few questions, 1) Why is Solr holding on to al

Re: logging

2009-04-10 Thread Ryan McKinley
If you use the off the shelf .war, it *should* be the same. (if not, we need to fix it) If you are building your own .war, how SLF4 behaves depends on what implementation is in the runtime path. If you want to use log4j logging, put in the slf4j-log4j.jar in your classpath and you should

Re: logging

2009-04-10 Thread Kevin Osborn
Or for my quick and dirty methods (this was just a test), I just removed the jcl-over-slrj JAR, and it worked like normal. From: Ryan McKinley To: solr-user@lucene.apache.org Sent: Friday, April 10, 2009 3:16:30 PM Subject: Re: logging If you use the off the

maxCodeLength in PhoneticFilterFactory

2009-04-10 Thread Brian Whitman
i have this version of solr running: Solr Implementation Version: 1.4-dev 747554M - bwhitman - 2009-02-24 16:37:49 and am trying to update a schema to support 8 code length metaphone instead of 4 via this (committed) issue: https://issues.apache.org/jira/browse/SOLR-813 So I change the schema t

PHP Remove From Index/Search By Fields

2009-04-10 Thread Johnny X
Hey, How could I write some code in PHP to place in a button to remove a returned item from the index? In turn, is it possible to copy all of the XML elements from said item and place them in a document somewhere locally once it's been removed? Finally, there is one default search field. How d

special characters in Solr search query.

2009-04-10 Thread Sagar Khetkade
Hi, There is a strange issue while querying on the Solr indexes. If my query contains the special characters like [ ] !<> etc. It is throwing the query parse exception. From my application interface I am able to handle the special characters but the issue is while the document which I am goin

Re: special characters in Solr search query.

2009-04-10 Thread Shalin Shekhar Mangar
On Sat, Apr 11, 2009 at 10:13 AM, Sagar Khetkade wrote: > > There is a strange issue while querying on the Solr indexes. If my query > contains the special characters like [ ] !<> etc. It is throwing the query > parse exception. From my application interface I am able to handle the > special char

Re: Question on StreamingUpdateSolrServer

2009-04-10 Thread Shalin Shekhar Mangar
On Sat, Apr 11, 2009 at 3:29 AM, vivek sar wrote: > I also noticed that the Solr app has over 6000 file handles open - > >"lsof | grep solr | wc -l" - shows 6455 > > I've 10 cores (using multi-core) managed by the same Solr instance. As > soon as start up the Tomcat the open file count goes

Re: sorlj search

2009-04-10 Thread Shalin Shekhar Mangar
On Wed, Feb 6, 2008 at 10:51 AM, Tevfik Kiziloren wrote: > > Caused by: org.apache.solr.common.SolrException: parsing error >at > > org.apache.solr.client.solrj.impl.XMLResponseParser.processResponse(XMLResponseParser.java:138) >at > > org.apache.solr.client.solrj.impl.XMLResponse