Re: Solr Scripts.conf Parsing Error

2007-04-14 Thread Venkatesh Seetharam
you could use dos2unix command on linux or cygwin to remove these. On 4/13/07, realw5 <[EMAIL PROTECTED]> wrote: I think you're on to something, here was the output: # Licensed to the Apache Software Foundation (ASF) under one or more^M$ # contributor license agreements. See the NOTICE file

Re: Solr logo poll

2007-04-06 Thread Venkatesh Seetharam
I like B. Young! On 4/6/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: Quick poll... Solr 2.1 release planning is underway, and a new logo may be a part of that. What "form" of logo do you prefer, A or B? There may be further tweaks to these pictures, but I'd like to get a sense of what the user

Re: maximum index size

2007-03-29 Thread Venkatesh Seetharam
Hi Mike, I'd be interested to know what is the ideal size for an index to achieve 1 sec response time for queries. I'd appreciate if you can share any numbers. Thanks, Venkatesh On 3/27/07, Mike Klaas <[EMAIL PROTECTED]> wrote: On 3/27/07, Kevin Osborn <[EMAIL PROTECTED]> wrote: > I know ther

Re: maximum index size

2007-03-27 Thread Venkatesh Seetharam
Hi Andre, Comments are inline. What hardware are you running? 4 Dual-proc 64 GB blades for each searcher and a broker that merges results on 64 bit SUSE linux running JDK 1.6 with 8GB Heap. Do you use collection distribution? Nope. I use hadoop to index the documents. Thanks, Venkatesh On

Re: maximum index size

2007-03-27 Thread Venkatesh Seetharam
I've 50 million documents each about 10K in size and I've 4 index partitions each consisting of 12.5 million documents. Each index partition is about 80GB. A search typically takes about 3-5 seconds. Single word searches are faster than multi-word searches. I'm still working on finding the ideal i

Re: Federated Search

2007-03-14 Thread Venkatesh Seetharam
Hi Jed, Thanks for sharing your thoughts and the link. Venkatesh On 3/11/07, Jed Reynolds <[EMAIL PROTECTED]> wrote: Venkatesh Seetharam wrote: > >> The hash idea sounds really interesting and if I had a fixed number of > indexes it would be perfect. > I'm i

Re: HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
Thanks Hoss for the clarification. I think I can make a copy of the index for searching and rename 'em. I think I can work around this one but good to know the bigger picture. Venkatesh On 3/8/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : I'm struck with Solr requiring an index directory u

Re: HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
Thanks Yonik and Chris for your confirmation. Chris, these are read-only index partitions. I perform updates/deletions on a master index which will be snapshotted at some fixed intervals. I'll look into the Collection Distribution of Solr. Sounds very powerful. I'm struck with Solr requiring an i

Re: HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
same index partition and point the Solr instances to these copies? Since my index partition lives on a shared NetApp mount, I'd like to use the same index partition for multiple Solr instances. Thanks for any help, Venkatesh On 3/8/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 3/8/07

HA and load balancing Qauestion

2007-03-08 Thread Venkatesh Seetharam
Hello there, Howdy. I'd like to know if I can configure Multiple Solr instances working with a single read-only index partition for failover/HA and load balancing purposes. Or is there any other way that Solr has built-in features to handle the same. Any ideas/thoughts are greatly appreciated.

Re: Solr and Multiple Index Partitions

2007-03-08 Thread Venkatesh Seetharam
Thanks Chris for a wonderful explanation. I completely get it now. Thanks for the handy URL too. Venkatesh On 3/8/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : I use a custom Analyzer which extends Lucene's StandardAnalyzer. When I : configured Solr to use this one, It throws an exception

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
ding a "type" field makes it possible to put things that seem like they need their own database into the same index - you select the 'type' you want by adding "+type:mytype" to your query On 3/7/07, Venkatesh Seetharam <[EMAIL PROTECTED]> wrote: > Thanks Ryan

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
do not think its built into Solr at the momment. Regards, Brad On 3/7/07, Venkatesh Seetharam <[EMAIL PROTECTED]> wrote: > > Thanks Ryan for your inputs. If I'm not using Solr webapp but wrapping > Solr > in plain Java, is there any way that I could get Solr to work with >

Re: Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
at multiple indexes, you need multiple solr instances running. Check the wiki for how to set that up: http://wiki.apache.org/solr/SolrJetty (the resin and tomcat pages have something similar) On 3/7/07, Venkatesh Seetharam <[EMAIL PROTECTED]> wrote: > Hello there, > > Howdy. I w

Solr and Multiple Index Partitions

2007-03-07 Thread Venkatesh Seetharam
Hello there, Howdy. I was wondering if there is a way to configure one Solr instance to search multiple Index partitions? I read the wiki and found the entry in SolrConfig.xml: /var/data/solr Can I have mutiple directories? Comma separated? Any help is greatly appreciated. -- Thanks, Venkates

Re: Re[2]: Federated Search

2007-03-05 Thread Venkatesh Seetharam
, a database seems to be required to track the documents. -- Best regards, Jack Monday, March 5, 2007, 7:47:36 AM, you wrote: > Venkatesh Seetharam wrote: >> Hi Tim, >> >> Howdy. I saw your post on Solr newsgroup and caught my attention. I'm >> working on a similar pr

Re: Federated Search

2007-03-05 Thread Venkatesh Seetharam
<[EMAIL PROTECTED]> wrote: Venkatesh Seetharam wrote: > Hi Tim, > > Howdy. I saw your post on Solr newsgroup and caught my attention. I'm > working on a similar problem for searching a vault of over 100 million > XML documents. I already have the encoding part done u