Re: Decrease warmupTime

2009-02-06 Thread Cheng Zhang
I did restart the solr server. Here is the config. Thx. - Original Message From: Otis Gospodnetic To: solr-user@lucene.apache.org Sent: Friday, February 6, 2009 10:40:45 PM Subject: Re: Decrease warmupTime Have you restarted Solr after you made the change? Ca

Re: Decrease warmupTime

2009-02-06 Thread Otis Gospodnetic
Have you restarted Solr after you made the change? Can you paste your query result cache config? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch From: Cheng Zhang To: solr-user@lucene.apache.org Sent: Friday, February 6, 2009 11:04:07 PM Subj

Re: Decrease warmupTime

2009-02-06 Thread Cheng Zhang
Hi Yonik, I just changed the autowarmCount for queryResultCache but it did not work. In the log, it still shows warmupTime for autowarmCount is about 45 seconds. queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=6,evictions=0,size=6,warmupTime=44055,cumulative_lookups=1,cumulative_h

Re: Decrease warmupTime

2009-02-06 Thread Yonik Seeley
On Fri, Feb 6, 2009 at 5:12 PM, Cheng Zhang wrote: > Is there any way to decrease this warmupTime? Go into solrconfig.xml and reduce (or eliminate) the autowarm counts for the caches. -Yonik

Re: Searchers in single/multi-core environments

2009-02-06 Thread Shalin Shekhar Mangar
On Sat, Feb 7, 2009 at 3:44 AM, Mark Ferguson wrote: > > For example then, if I have 10 cores, and maxWarmSearchers is 2 for each > core, if I send a commit to all of them at once this will not cause any > exceptions, because each core handles its searchers separately? Correct. Though it is a go

Re: Searchers in single/multi-core environments

2009-02-06 Thread Mark Ferguson
> > > What I'm also curious about is how searchers are handled in a multi-core > > environment. Does the maxWarmSearchers argument apply to the entire set > of > > cores, or to each individual core? > > > It applied to one core unless ofcourse, you are sharing the solrconfig.xml > with multiple cor

Decrease warmupTime

2009-02-06 Thread Cheng Zhang
First, I'm new Solr. I have setup a Solr server and added some documents into it. I noticed that as I added more and more docs, the warmupTime became longer and longer. After added 400K docs, I can see the warmupTime is now about 1 minutes. Here is one log entry: queryResultCache{lookups=0,hi

Re: Searchers in single/multi-core environments

2009-02-06 Thread Shalin Shekhar Mangar
On Sat, Feb 7, 2009 at 3:28 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > If waitSearcher=false then the commit thread blocks until these operations > finish. > I meant if waitSearcher=true then the commit thread blocks until these operations finish. -- Regards, Shalin Shekhar Man

Re: Searchers in single/multi-core environments

2009-02-06 Thread Shalin Shekhar Mangar
On Sat, Feb 7, 2009 at 2:51 AM, Mark Ferguson wrote: > > I am looking for more information about how searchers work in different > environments. Correct me if I'm mistaken, but my understanding is that in a > single core environment, there is one searcher for the one index which > handles all quer

Searchers in single/multi-core environments

2009-02-06 Thread Mark Ferguson
Hello, My apologies if this topic has already been discussed but I haven't been able to find a lot of information in the wiki or mailing lists. I am looking for more information about how searchers work in different environments. Correct me if I'm mistaken, but my understanding is that in a singl

Re: Realtime Searching..

2009-02-06 Thread Otis Gospodnetic
Michael, There is no single system that will provide Twitter like functionality. You'd have to look into Lucene/Solr for searching, memcached (for example) for caching, maybe caching layer in front of Solr (e.g. varnish, squid, apache), something to store the data in (e.g. RDBMS, HBase, HDFS,

Re: Searching on field A gives spurious highlights in field B

2009-02-06 Thread Jeffrey Baker
On Fri, Feb 6, 2009 at 3:36 PM, Mike Klaas wrote: > > On 6-Feb-09, at 12:34 PM, Jeffrey Baker wrote: > >> Hello all. First post to the list. > > Welcome aboard. > >> I noticed that if I search for foo:blah&hl.fl=bar, I get highlight >> output for instances of "blah" in field "bar". Is there any

Re: Searching on field A gives spurious highlights in field B

2009-02-06 Thread Mike Klaas
On 6-Feb-09, at 12:34 PM, Jeffrey Baker wrote: Hello all. First post to the list. Welcome aboard. I noticed that if I search for foo:blah&hl.fl=bar, I get highlight output for instances of "blah" in field "bar". Is there any way to avoid that? I'm using solr 1.3. Try hl.requireFieldMat

Searching on field A gives spurious highlights in field B

2009-02-06 Thread Jeffrey Baker
Hello all. First post to the list. I noticed that if I search for foo:blah&hl.fl=bar, I get highlight output for instances of "blah" in field "bar". Is there any way to avoid that? I'm using solr 1.3. -jwb

Re: Realtime Searching..

2009-02-06 Thread Michael Austin
Just to back up and think about if solr/lucene realtime updating is what I want to begin with.. Would this be something that a twitter type system might use to be more scalable and fast? Let's just say that I have a site with as much message traffic as twitter and I want to be able to update and s

Re: Issuing just a spell check query

2009-02-06 Thread Shalin Shekhar Mangar
On Sat, Feb 7, 2009 at 1:17 AM, Rupert Fiasco wrote: > > I would like to issue just a spell check query, I dont care about it > being inline and piggy-backing off a normal search query. > > How would I achieve this? > > Now, I can sort of achieve what I want by in fact a normal search but > then

Re: Realtime Searching..

2009-02-06 Thread Michael Austin
Thanks Otis, Is it possible to get my hands on the ability in lucene utilizing patches before it is released to the public? (sorry to ask) - How close is it in the source code if I didn't care about the documentation/packaging/etc..? So from what it sounds like, this would be a realtime store(wit

Re: Issuing just a spell check query

2009-02-06 Thread Rupert Fiasco
But its deprecated (??) -Rupert On Fri, Feb 6, 2009 at 11:51 AM, Otis Gospodnetic wrote: > Rupert, > > You could use the SpellCheck*Handler* to achieve this. > > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > > > From: Rupert Fias

Re: how to exactly query in the multitype

2009-02-06 Thread Otis Gospodnetic
Hi, I don't fully understand the question, but I'll try... One option is to simply not remove stop words. The second option is to use a trick like the one Nutch uses: http://lucene.apache.org/nutch/apidocs/org/apache/nutch/analysis/CommonGrams.html Are there more options? Otis -- Sematext -- h

Re: exceeded limit of maxWarmingSearchers

2009-02-06 Thread Otis Gospodnetic
I'd say: "Make sure you don't commit more frequently than the time it takes for your searcher to warm up", or else you risk searcher overlap and pile-up. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch From: Jon Drukman To: solr-user@lucene

Re: Issuing just a spell check query

2009-02-06 Thread Otis Gospodnetic
Rupert, You could use the SpellCheck*Handler* to achieve this. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch From: Rupert Fiasco To: solr-user@lucene.apache.org Sent: Friday, February 6, 2009 2:47:19 PM Subject: Issuing just a spell check

Re: Realtime Searching..

2009-02-06 Thread Otis Gospodnetic
Michael, The short answer is that Solr is not there yet, but will be. Expect to see real-time search in Lucene first, then in Solr. We have a case study about real-time search with Lucene in the upcoming Lucene in Action 2, but a more tightly integrated real-time search will be added to Lucene

Issuing just a spell check query

2009-02-06 Thread Rupert Fiasco
The docs for the SpellCheckComponent say "The SpellCheckComponent is designed to provide inline spell checking of queries without having to issue separate requests." I would like to issue just a spell check query, I dont care about it being inline and piggy-backing off a normal search query. How

Realtime Searching..

2009-02-06 Thread Michael Austin
I need to find a solution for our current social application. It's low traffic now because we are early on.. However I'm expecting and want to be prepaired to grow. We have messages of different "types" that are aggregated into one stream. Each of these message types have much different data so th

Re: Fwd: Separate error logs

2009-02-06 Thread Marc Sturlese
Hey James, Your log use case remains me to mine... I wanted to use different log files fore different cores... for the moment there's no way to separate logs in different files (as far as I know). I sorted it using log4j. What I do is send the log data to the linux syslog (using syslog appender).

Re: [ANN] Lucid Imagination

2009-02-06 Thread Renaud Delbru
Hi, I don't find any documentation about Solr Gaze. How can I use it ? Thanks, Regards -- Renaud Delbru Grant Ingersoll wrote: Hi Lucene and Solr users, As some of you may know, Yonik, Erik, Sami, Mark and I teamed up with Marc Krellenstein to create a company to provide commercial support (w

Fwd: Separate error logs

2009-02-06 Thread James Brady
OK, so java.util.logging has no way of sending error messages to a separate log without writing your own Handler/Filter code. If we just skip over the absurdity of that, and the rage it makes me feel, what are my options here? What I'm looking for is for all records to go to one file, and records o

Need help with DictionaryCompoundWordTokenFilterFactory

2009-02-06 Thread Kraus, Ralf | pixelhouse GmbH
Hi, Now I ran into another problem by using the solr.DictionaryCompoundWordTokenFilterFactory :-( If I search for the german word "Spargelcremesuppe" which contains "Spargel", "Creme" and "Suppe" SOLR will find way to many result. Its because SOLR finds EVERY entry with either one of the three

how to exactly query in the multitype

2009-02-06 Thread fei dong
I am using the "text" field type in the schema.xml provides basic text search for English text. But, it has a surprise: the actual text given to this field is not indexed as-is, and therefore searching for the raw text may not work. If you search "To Be Or Not To Be" or "s.h.e." in a "text" field