Fot 16 mil docs it may not be necessary. Add the shards when you see
that perf is degrading.
--Noble
On Wed, Jun 4, 2008 at 4:17 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote:
>
> The number of docs I have indexed till now is : 1,633,570
> I am bit afraid as the number of indexed docs will grow a
The number of docs I have indexed till now is : 1,633,570
I am bit afraid as the number of indexed docs will grow atleast 5-10 times
in very near future.
Regards,
Ritesh Ambastha
Shalin Shekhar Mangar wrote:
>
> A lot of this also depends on the number of documents. But we have
> successful
A lot of this also depends on the number of documents. But we have
successfully used Solr with upto 10-12 million documents.
On Wed, Jun 4, 2008 at 4:10 PM, Ritesh Ambastha <[EMAIL PROTECTED]>
wrote:
>
> Thanks Noble,
>
> That means, I can go ahead with single Index for long.
> :)
>
> Regards,
>
Thanks Noble,
That means, I can go ahead with single Index for long.
:)
Regards,
Ritesh Ambastha
Noble Paul നോബിള് नोब्ळ् wrote:
>
> For the datasize you are proposing , single index should be fine .Just
> give the m/c enough RAM
>
> Distributed search involves multiple requests made betwe
For the datasize you are proposing , single index should be fine .Just
give the m/c enough RAM
Distributed search involves multiple requests made between shards
which may be an unncessary overhead.
--Noble
On Wed, Jun 4, 2008 at 4:02 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote:
>
> Thanks Noble
Thanks Noble,
I maintain two separate indexes on my disk for two different search
services.
The index size of two are: 91MB and 615MB. I am pretty sure that these index
size will grow in future, and may reach 10GB.
My doubts :
1. When should I start partitioning my index?
2. Is there any perf
You could have been more specific on the dataset size.
If your data volumes are growing you can partition your index into
multiple shards.
http://wiki.apache.org/solr/DistributedSearch
--Noble
On Sat, May 31, 2008 at 9:02 PM, Ritesh Ambastha <[EMAIL PROTECTED]> wrote:
>
> Dear Readers,
>
> I am a