Re: Index structuring

2008-06-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
Fot 16 mil docs it may not be necessary. Add the shards when you see that perf is degrading. --Noble On Wed, Jun 4, 2008 at 4:17 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote: > > The number of docs I have indexed till now is : 1,633,570 > I am bit afraid as the number of indexed docs will grow a

Re: Index structuring

2008-06-04 Thread Ritesh Ambastha
The number of docs I have indexed till now is : 1,633,570 I am bit afraid as the number of indexed docs will grow atleast 5-10 times in very near future. Regards, Ritesh Ambastha Shalin Shekhar Mangar wrote: > > A lot of this also depends on the number of documents. But we have > successful

Re: Index structuring

2008-06-04 Thread Shalin Shekhar Mangar
A lot of this also depends on the number of documents. But we have successfully used Solr with upto 10-12 million documents. On Wed, Jun 4, 2008 at 4:10 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote: > > Thanks Noble, > > That means, I can go ahead with single Index for long. > :) > > Regards, >

Re: Index structuring

2008-06-04 Thread Ritesh Ambastha
Thanks Noble, That means, I can go ahead with single Index for long. :) Regards, Ritesh Ambastha Noble Paul നോബിള്‍ नोब्ळ् wrote: > > For the datasize you are proposing , single index should be fine .Just > give the m/c enough RAM > > Distributed search involves multiple requests made betwe

Re: Index structuring

2008-06-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
For the datasize you are proposing , single index should be fine .Just give the m/c enough RAM Distributed search involves multiple requests made between shards which may be an unncessary overhead. --Noble On Wed, Jun 4, 2008 at 4:02 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote: > > Thanks Noble

Re: Index structuring

2008-06-04 Thread Ritesh Ambastha
Thanks Noble, I maintain two separate indexes on my disk for two different search services. The index size of two are: 91MB and 615MB. I am pretty sure that these index size will grow in future, and may reach 10GB. My doubts : 1. When should I start partitioning my index? 2. Is there any perf

Re: Index structuring

2008-05-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
You could have been more specific on the dataset size. If your data volumes are growing you can partition your index into multiple shards. http://wiki.apache.org/solr/DistributedSearch --Noble On Sat, May 31, 2008 at 9:02 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote: > > Dear Readers, > > I am a