Re: Solr and Multiple Index Partitions

2007-03-08 Thread Venkatesh Seetharam
Thanks Chris for a wonderful explanation. I completely get it now. Thanks for the handy URL too. Venkatesh On 3/8/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : I use a custom Analyzer which extends Lucene's StandardAnalyzer. When I : configured Solr to use this one, It throws an exception

Re: Solr and Multiple Index Partitions

2007-03-08 Thread Chris Hostetter
whoops .. forgot the documentaiton link... http://wiki.apache.org/solr/SolrPlugins#head-9939da9abe85a79eb30a026e85cc4aec0beac10c : you can use any Analyzer you want, but you can't configure a : positionIncrementGap in the schema.xml unless your Analyzer extends : SolrAnalyzer (the concept of a p

Re: Solr and Multiple Index Partitions

2007-03-08 Thread Chris Hostetter
: I use a custom Analyzer which extends Lucene's StandardAnalyzer. When I : configured Solr to use this one, It throws an exception : RuntimeException("Can't set positionIncrementGap on custom analyzer " + : analyzer.getClass()). : : Do I need to extend a specific Analyzer for it to work with Solr

Re: Re[2]: Solr and Multiple Index Partitions

2007-03-08 Thread Erik Hatcher
On Mar 7, 2007, at 9:20 PM, Jack L wrote: Selecting by type will do the job. But I suppose it sacrifice performance because having multiple document types in the same index will render a larger index. Is it bad? A many documents we talking here? My hunch is you'll be fine :) Erik

Re[2]: Solr and Multiple Index Partitions

2007-03-07 Thread Jack L
Selecting by type will do the job. But I suppose it sacrifice performance because having multiple document types in the same index will render a larger index. Is it bad? -- Best regards, Jack Wednesday, March 7, 2007, 2:15:14 PM, you wrote: > As it is now... I don't think so. SolrCore is a sta

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
Thanks Ryan for your insight. I do not wish to change Solr. Although it seems weird, just adding a "type" field makes it possible I'm not working with a DB but since we are indexing a huge vault of XML documents, I use Hadoop + Lucene for indexing which finally generates N number of partitions,

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
Yes, I'm implementing federated search. I do have N partitions of indexes built and I'd like to have mutiple Solr instances in a cluster each serving atleast 2 partitions. I was wondering if I could somehow find a way to make Solr work with atleast 2 partitions. It looks like I need to have smalle

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Ryan McKinley
As it is now... I don't think so. SolrCore is a static singleton class -- without some serious reworking, i think there is only one instance per jvm. I think getting rid of the static singleton should go on the long term TODO list, but that doesn't help you now. Although it seems weird, just ad

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Bradley Burke
Venkatesh, Are you perhapes talking about Federated Searching ( http://wiki.apache.org/solr/FederatedSearch). I am new to Solr but this was a feature I was looking far as well. I do not think its built into Solr at the momment. Regards, Brad On 3/7/07, Venkatesh Seetharam <[EMAIL PROTECTED]>

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
Thanks Ryan for your inputs. If I'm not using Solr webapp but wrapping Solr in plain Java, is there any way that I could get Solr to work with multiple index partitions? Venkatesh On 3/7/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: Solr looks at one index - If you want to look at multiple inde

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Ryan McKinley
Solr looks at one index - If you want to look at multiple indexes, you need multiple solr instances running. Check the wiki for how to set that up: http://wiki.apache.org/solr/SolrJetty (the resin and tomcat pages have something similar) On 3/7/07, Venkatesh Seetharam <[EMAIL PROTECTED]> wr

Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
Hello there, Howdy. I was wondering if there is a way to configure one Solr instance to search multiple Index partitions? I read the wiki and found the entry in SolrConfig.xml: /var/data/solr Can I have mutiple directories? Comma separated? Any help is greatly appreciated. -- Thanks, Venkates