Re: recent query execution cache in Solr

2010-01-16 Thread Chris Hostetter
: Yes, it's the cache. But not document/query/filter cache, but http : cache. Yes, you can disable it in solrconfig.xml Specificly: it is (probably) your browser cache, as Solr doesn't cache anything between restarts. Info about disabling (or changing the rules for) HTTP caching can be found

Re: Encountering a roadblock with my Solr schema design...use dedupe?

2010-01-16 Thread David MARTIN
I'm really interested in reading the answer to this thread as my problem is rather the same. Maybe my main difference is the huge SKU number per product I may have. David On Thu, Jan 14, 2010 at 2:35 AM, Kelly Taylor wrote: > > Hoss, > > Would you suggest using dedup for my use case; and if so

Re: Fundamental questions of how to build up solr for huge portals

2010-01-16 Thread Sven Maurmann
Hi! Your question is quite general in nature, therefore here are only a few initial remarks on how to get started: If you want to have a global search over all of your portals it might be best to start with one Solr instance and access it from all the portals. If you plan to build collections th

Re: How to start using Solr

2010-01-16 Thread Lance Norskog
Java 1.6. Also decide if you need 32-bit java (limited to 2G of jvm) or 64-bit. Some kind of log file rolling or size control. On Sat, Jan 16, 2010 at 4:56 AM, nfire wrote: > > > Glad that I found this thread, I was searching for this issue throughout the > forum. > > Does this mean that if I hos

Re: java heap space error when faceting

2010-01-16 Thread Matt Mitchell
I'm embarrassed (but hugely relieved) to say that, the script I had for starting Jetty had a bug in the way it set java options! So, my heap start/max was always set at the default. I did end up using jconsole and learned quite a bit from that too. Thanks for your help Yonik :) Matt On Sat, Jan

Re: only use sorting when there's no "q" is "*:*"?

2010-01-16 Thread Chris Hostetter
: It uses the doc insertion order by default. Strictly speaking: it sorts by score, and when multiple docs have identical scores, the secondary sorting is undefined (as an implementation detail it is _usually_ doc insertion order, but that's not really garunteed. As for your original question

Re: Errors when registering MBeans

2010-01-16 Thread Chris Hostetter
: MBeans. I have tried to deploy it without generating MBeans but with : no luck. First off, a quick solution: if you don't care about using JMX to monitor Solr, just completley remove the "" config option from solrconfig.xml. that should eliminate all attempts by Solr to register MBeans at a

Re: Index Courruption after replication by new Solr 1.4 Replication

2010-01-16 Thread Chris Hostetter
: Subject: Index Courruption after replication by new Solr 1.4 Replication : References: <3ca90cc651ae3f4baedf8a5b78639c8c038a1...@mail02.tveyes.com> : <667725.5147...@web52905.mail.re2.yahoo.com> : <3ca90cc651ae3f4baedf8a5b78639c8c038a1...@mail02.tveyes.com> : <359a92831001151042n73a47daby46ee

Re: Stripping Punctuation in a fieldType

2010-01-16 Thread Chris Hostetter
: Subject: Stripping Punctuation in a fieldType : In-Reply-To: <27179780.p...@talk.nabble.com> : References: : : <27178423.p...@talk.nabble.com> <27179780.p...@talk.nabble.com> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussi

Re: java heap space error when faceting

2010-01-16 Thread Yonik Seeley
On Sat, Jan 16, 2010 at 11:04 AM, Matt Mitchell wrote: > These are single valued fields. Strings and integers. Is there more specific > info I could post to help diagnose what might be happening? Faceting on either should currently take ~24MB (6M docs @ 4 bytes per doc + size_of_unique_values) Wi

Re: java heap space error when faceting

2010-01-16 Thread Matt Mitchell
These are single valued fields. Strings and integers. Is there more specific info I could post to help diagnose what might be happening? Thanks! Matt On Sat, Jan 16, 2010 at 10:42 AM, Yonik Seeley wrote: > On Sat, Jan 16, 2010 at 10:01 AM, Matt Mitchell > wrote: > > I have an index with more tha

Re: java heap space error when faceting

2010-01-16 Thread Yonik Seeley
On Sat, Jan 16, 2010 at 10:01 AM, Matt Mitchell wrote: > I have an index with more than 6 million docs. All is well, until I turn on > faceting and specify a facet.field. There is only about unique 20 values for > this particular facet throughout the entire index. Hmmm, that doesn't sound right..

Re: OverlappingFileLockException when using startup

2010-01-16 Thread Yonik Seeley
On Sat, Jan 16, 2010 at 7:38 AM, Joe Kessel wrote: > There is no issue here, we had patched our solr to include SOLR-1595 and our > webapps directory contained two wars.  With only a single war file there is > no issue with this replication handler. Thanks Joe, for now I've added a note to the

java heap space error when faceting

2010-01-16 Thread Matt Mitchell
I have an index with more than 6 million docs. All is well, until I turn on faceting and specify a facet.field. There is only about unique 20 values for this particular facet throughout the entire index. I was able to make things a little better by using facet.method=enum. That seems to work, until

Re: Fundamental questions of how to build up solr for huge portals

2010-01-16 Thread MitchK
Hello Peter, well, I am no expert on Solr, but what you want to do sounds like a case for several SolrCores [1]. I am thinking of one core per portal and one super-core to search over all portals. This would be redundant and several information will be stored twice or more times. Another way woul

Fundamental questions of how to build up solr for huge portals

2010-01-16 Thread Peter
Hello! Our team wants to use solr for an community portal built up out of 3 and more sub portals. We are unsure in which way we sould build up the whole architecture, because we have more than one portal and we want to make them all connected and searchable by solr. Could some experts help us

Re: How to start using Solr

2010-01-16 Thread nfire
Glad that I found this thread, I was searching for this issue throughout the forum. Does this mean that if I host my website on a Virtual Private Server, will it be okay if I ask my hosting provider for Windows Server (since the website was developed using asp.net) and Apache Tomcat installed?

RE: OverlappingFileLockException when using startup

2010-01-16 Thread Joe Kessel
There is no issue here, we had patched our solr to include SOLR-1595 and our webapps directory contained two wars. With only a single war file there is no issue with this replication handler. thanks for the quick response. Joe > From: isjust...@hotmail.com > To: solr-user@lucene.apach

Re: Term Dictionary + scoring

2010-01-16 Thread MitchK
Grant, thank you for the link to the wiki. TermsComponent was unknown to me until now. It sounds good! > Generally, this clickthrough tracking is tied to the query, so you need a > layer above just popularity. You >need popularity per query (or in all > likelihood a subset of the queries, since