multicores issue..

2008-07-17 Thread dudes dudes
thanks Erik, I'm experiencing some problems here.. solr version: solr-2008-07-07 Out of the box multicores directory: apache-solr-nightly/example/multicore multcore.xml: shown bellow: I can easily see the admin page http://localhost:8983/solr/core0/admin/ and http://localhost:8983/

Re: Using custom Similarity class

2008-07-17 Thread Sébastien Rainville
I'm using solr-1.2.0. I didn't have a no-arg constructor. I just tried with one and it doesn't fix it. My servlet container is Jetty. Sebastien On Wed, Jul 16, 2008 at 10:22 PM, Erik Hatcher <[EMAIL PROTECTED]> wrote: > What version of Solr are you using? Seems to be not quite trunk at least

RE: multicores issue..

2008-07-17 Thread dudes dudes
it's ok guys,,, fixed the problem :) I have 2 different schemas up and running thanks anyway ak > From: [EMAIL PROTECTED] > To: solr-user@lucene.apache.org > Subject: multicores issue.. > Date: Thu, 17 Jul 2008 09:55:04 +0100 > > > thanks Erik, > I'm e

Re: Multiple query fields in DisMax handler

2008-07-17 Thread chris sleeman
Thanks a lot..this is, more or less, what i was looking for. However, is there a way to pre-configure the dismax query parser, with parameters like qf, pf, boost etc., in solr-config.xml, rather than doing so at query time. So my actual query would look like - < http://localhost:8983/solr/select?q

Re: Multiple query fields in DisMax handler

2008-07-17 Thread Preetam Rao
If I understand the question correctly, you can provide init params, default params and invariant params in the appropriate request handler section in solrconfig.xml. So you can create a standard request handler with name dismaxL, whose defType is dismax and set all parameters in defaults section.

Re: Multiple query fields in DisMax handler

2008-07-17 Thread chris sleeman
What I actually meant was whether or not I could create a configuration for a dismax query parser and then refer to it in my filter query. I already have a standard request handler with a "dismax" deftype for my query field. I wanted to use another dismax parser for the fq param, on the lines of wh

Re: Multiple query fields in DisMax handler

2008-07-17 Thread Erik Hatcher
A custom QParserPlugin could be created and implement an #init(NamedList) which you could parameterize via it's solrconfig.xml configuration. That would be one way. Another trick, I think, would be to use request parameter substitution. The javadocs here might lead you to what you're a

Re: Solr stops responding

2008-07-17 Thread Doug Steigerwald
It happened again last night. I cronned a script that ran jstack on the process every 5 minutes just to see what was going on. Here's a snippet: "btpool0-2668" prio=10 tid=0x2aac3a905800 nid=0x76ed waiting for monitor entry [0x5e584000..0x5e585a10] java.lang.Thread

Re: Multiple query fields in DisMax handler

2008-07-17 Thread Preetam Rao
I see that a QParser takes local params (those given via {!...} )as well as request params. It sets the lookup chain as local followed be request params. AFAIK, the request param lookup chain is set up as - those given in the url explicitly, then invariants, then defaults gievn in solrconfig for t

Re: Multiple query fields in DisMax handler

2008-07-17 Thread Preetam Rao
Oops.. this will only help you configure only the defaults common to the main dismax query as well as the fq dismax query. For creating two sets of dismax parsers which are named and want to read params from solrconfig, I think one can extend the dismaxQParser's currently empty init() method to se

Re: Multiple query fields in DisMax handler

2008-07-17 Thread Yonik Seeley
On Thu, Jul 17, 2008 at 8:11 AM, chris sleeman <[EMAIL PROTECTED]> wrote: > What I actually meant was whether or not I could create a configuration for > a dismax query parser and then refer to it in my filter query. I already > have a standard request handler with a "dismax" deftype for my query f

Specifying explicit FacetQuery w/ a normal query?

2008-07-17 Thread Jon Baer
Ive gone from a complex multicore setup back to a single solrconfig setup and using a doctype field (since the index is pretty small), however there are a few spots where items are laid out in tabs and each tab has a count of docs associated, ie: News (123) | Images (345) | Video (678) | Bl

Re: Using custom Similarity class

2008-07-17 Thread Koji Sekiguchi
> com.example.CustomSimilarity cannot be cast to > org.apache.lucene.search.Similarity > at org.apache.solr.schema.IndexSchema.readConfig(IndexSchema.java:449) > ... 28 more I think you've got a class loader problem. If you have solr-1.2.0 source code, see the line 499 of IndexSchema.java:

Re: Multiple query fields in DisMax handler

2008-07-17 Thread chris sleeman
Thanks a ton...this is quite useful. Regards, Chris On Thu, Jul 17, 2008 at 6:42 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Thu, Jul 17, 2008 at 8:11 AM, chris sleeman <[EMAIL PROTECTED]> > wrote: > > What I actually meant was whether or not I could create a configuration > for > > a disma

Re: Solr stops responding

2008-07-17 Thread Fuad Efendi
Thanks Doug, Would be nice to have stacktrace for btpool0-2051... I analyzed LUCache several times, of course it has strange synchronization statements like public void warm(SolrIndexSearcher searcher, SolrCache old) throws IOException { ... LRUCache other = (LRUCache)old; ...

Re: Using custom Similarity class

2008-07-17 Thread Sébastien Rainville
Thanks for the tip but I solved it but using the old way of loading custom libs into solr: unpack the war file, add the custom library to WEB-INF/lib and repack it. It definetly is a class loader problem, as the wiki specifies that the new way of loading custom jars is using a custom class loader t

Re: Solr stops responding

2008-07-17 Thread Doug Steigerwald
I included part of it in my last email, but here's the full one: "btpool0-2051": at java.util.Vector.size(Unknown Source) - waiting to lock <0x2aaac0af0ea0> (a java.util.Vector) at java.util.AbstractList.listIterator(Unknown Source) at java.util.AbstractList.li

spellchecker problems (bugs)

2008-07-17 Thread r.nieto
Hi users and developers, I'm having some problems with the spellchecker component (I think there are bugs). A few weeks ago Geoff spoke about some of them. If I restart tomcat without re-issuing spellcheck.build=true then the spellcheck starts to fail. Another thing is that if I have 3 c

Re: Solr stops responding

2008-07-17 Thread Fuad Efendi
Try to use Tomcat... I never had SOLR-deadlocks (I believe) on 4-CPU SLES 10 server; only OutOfMemoryExceptions (possibly due to faceting, and significant memory fragmentation) Recent OOM happened because I run MySQL on same server, and I overloaded it... OpenBitSet & Faceting is main memory

OutOfMemoryError - Quick Fix: Increase HashDocSet

2008-07-17 Thread Fuad Efendi
Change it to higher value, for instance, 3. OpenBitSet is created for larger values and requires a lot of memory... Jul 17, 2008 11:09:02 AM org.apache.solr.common.SolrException log SEVERE: java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 3149016, Num elem

Re: spellchecker problems (bugs)

2008-07-17 Thread Shalin Shekhar Mangar
The problems you described in the spellchecker are noted in https://issues.apache.org/jira/browse/SOLR-622 -- I shall create an issue to synchronize spellcheck.build so that the index is not corrupted. As for multiple cores, yes, they should work independently of each other. On Thu, Jul 17, 2008

OutOfMemoryError - Lucene

2008-07-17 Thread Fuad Efendi
How much memory Lucene needs? 100Mb for each such query... Jul 16, 2008 8:38:43 PM org.apache.solr.common.SolrException log SEVERE: java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 100767936, Num elements: 25191979 at org.apache.lucene.search.FieldCacheImpl$10.createValue(

Re: OutOfMemoryError - Quick Fix: Increase HashDocSet

2008-07-17 Thread Mike Klaas
On 17-Jul-08, at 10:28 AM, Fuad Efendi wrote: Change it to higher value, for instance, 3. OpenBitSet is created for larger values and requires a lot of memory... Careful--hash sets of that size can be quite slow. It does make sense to bump up the value to 6000 or so for large

Re: OutOfMemoryError - Quick Fix: Increase HashDocSet

2008-07-17 Thread Fuad Efendi
Thanks Mike, I have 25 millions docs indexed, faceted on simple fields (cardinality: 5 for country field and 1 for host field) 8192Mb, JRockit R27 (Java 6) Unpredictable OOMs... I set HashDocSet/max to 30,000, don't see any performance degradation yet (the same response times for faceted

Re: Using custom Similarity class

2008-07-17 Thread Chris Hostetter
: Thanks for the tip but I solved it but using the old way of loading custom : libs into solr: unpack the war file, add the custom library to WEB-INF/lib : and repack it. It definetly is a class loader problem, as the wiki specifies : that the new way of loading custom jars is using a custom class

what do you do to track clickthroughs?

2008-07-17 Thread pdovyda2
Hey Guys, I've been putting together a search engine using Solr/Lucene on the backend and GWT for the UI. I am looking to track clickthroughs on my results to construct relevance judgements for the dataset I'm using - but I'm not sure of a good way to go about this. Obviously how you do this de

Re: what do you do to track clickthroughs?

2008-07-17 Thread Jacob Singh
Hi Paul, I actually use google analytics for this, since it is setup to do it. In fact, you can configure your GA profile to treat your search page as a search page and track the effectiveness of searches and even some support for filters! Check it out. -J pdovyda2 wrote: > Hey Guys, > > I've b

Updated version of SOLR?

2008-07-17 Thread Sunny Bassan
I have noticed that SOLR is stuck on Version 1.2, although this is quite fine because it works well, I see that Lucene is now up at Version 2.3.2 well beyond the version that is supporting SOLR 1.2. Does anybody know if there is an updated SOLR version working with the new Lucene foundation, or is

Re: Updated version of SOLR?

2008-07-17 Thread Otis Gospodnetic
Hi, 1.3-dev (nightly) uses the latest Lucene. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Sunny Bassan <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Friday, July 18, 2008 1:20:36 AM > Subject: Updated version of SOLR? >

Re: Updated version of SOLR?

2008-07-17 Thread Sunny Bassan
Thank you

Re: Filter by Type increases search results.

2008-07-17 Thread chris sleeman
> btw, this *seems* to only work for me with standard search handler. dismax and fq: dont' seem to get along nicely... Wouldnt the dismax parser consider the filter query parameter as "type idea" and not value "idea" for solr field - "type"? I guess thats the reason this query doesnt work with dis